Foot input system, foot position indicator, foot position detection device, indicator position input method using foot input system, and image processing system using foot input system

Abstract

The present invention makes it possible for a user to use his / her foot to input various kinds of information into an image processing device such that there is no discrepancy between a changing image and the user's perception of his / her bodily movement. Position designation units 303L, 303R and 303C are provided in the rear of the sole part of a position designation tool 300 for the foot. A position detection device 400 for the foot receives position designation signals from the position designation units 303L, 303R and 303C so as to detect whether the position designation tool 300 for the foot has made a forward movement, which is in the direction of extension of a line extending from the heel-side portion to the toe-side portion, or made a backward movement, which is in the direction of extension of a line extending from the toe-side portion to the heel-side portion, and instructs the image processing device 700 to carry out forward movement or backward movement.

Description

[Technical field]

[0001] The present invention relates to a system, device, and method for enabling a user to input information to, for example, an image processing device using his / her feet. [Background technology]

[0002] In recent years, with the improvement of computer and display performance, fields such as VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality) have been developing rapidly. In the execution environments of these fields, in order to operate a computer with a feeling similar to the real world, special hand devices that detect the movement of the user's hands and fingers may be used instead of conventional input devices such as a mouse, keyboard, and game pad. This makes it possible to reproduce hand gestures, such as grabbing and manipulating an object, in a space created by a computer. In this way, attempts are being made to bring gestures made by the user's hands themselves into digital content created by a computer.

[0003] However, the more closely the user tries to reproduce the hand gestures of a real user in a computer-generated space, the more difficult it becomes to operate a control stick, control buttons, touch panel, etc. that are directly operated by the hand. Also, for example, actions that use the feet (legs), such as walking, are substituted with gestures of the fingertips or the entire arm, which can cause a loss of the sense of immersion that is important in VR, for example.

[0004] For this reason, input devices that allow information to be input using the feet (legs) have been devised. For example, Patent Document 1, which will be described later, discloses an invention relating to a foot-activated input device that allows input to be performed by a simple operation using only one foot. This foot-activated input device can change the indicated position by rotating a ball provided on the bottom of the foot with the foot, and can also be provided with a switch that can be operated with the toes, allowing operations similar to the left and right clicks of a mouse to be performed.

[0005] Furthermore, Patent Document 2, which will be described later, discloses an invention relating to a game controller that can not only measure weight and center of gravity, but also detect various movements such as stepping, walking, jumping, crouching, etc. This game controller detects the pressure distribution of contact areas caused by parts of the player's body as the player (user) moves on a sheet having multiple pressure sensors, and detects the player's movements based on the shape of the distribution and changes in shape. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 9-198188 [Patent Document 2] JP 2016-174699 A Summary of the Invention [Problem to be solved by the invention]

[0007] The invention disclosed in Patent Document 1 is merely a device that allows a mouse operated by hand to be operated by foot, and does not allow for more flexible information input. The invention disclosed in Patent Document 2 is capable of detecting various motion states of the player, and has an effective function as a game controller. However, as a device for inputting information in a space formed by a computer, such as the above-mentioned VR, AR, and MR, the detectable states are limited, and sufficient input cannot be performed.

[0008] In addition, by using a controller called a joystick, which allows directional input using a lever, it is possible to change the 3D spatial image in the virtual 3D space created by VR technology as if the user were moving. However, in this case, since the 3D spatial image changes even though the user's body is not moving, there is a significant difference in the sensation of the changing 3D spatial image and the user's body movement, and some users experience a symptom known as VR sickness.

[0009] For this reason, a head-mounted display, or the like, is used to detect the movement of the user's head using a 6-axis sensor or the like mounted on the head-mounted display, and the displayed image is changed in accordance with the movement of the user's head. In this case, when moving the user's position (viewpoint) in the three-dimensional spatial image, it is considered that there is less difference in the sensation of the changing three-dimensional spatial image and the user's body movement when inputting instructions using the feet, because this is closer to the actual body movement when moving.

[0010] In view of the above, an object of the present invention is to enable a user to input various information into an image processing device using his / her feet, without causing any difference in sensation between the changing image and the user's body movements. [Means for solving the problem]

[0011] In order to solve the above problems, A foot input system comprising a foot position indicating device attached to a user's foot and a foot position detection device that detects a position indicated by the foot position indicating device, and supplies a detection output from the foot position detection device to an image processing device, The foot position indicator comprises: A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; At least one is provided on each of the sole front portion and the sole rear portion, and each of the sole front portion and the sole rear portion has a different frequency. position indication signal A position indication signal transmitting unit that transmits Equipped with The foot position detection device includes: a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; The present invention provides a foot input system comprising:

[0012] According to this foot input system, at least one sensor is provided on each of the sole front and sole front parts of the sole part of the foot position indicator, and each sensor has a different frequency. position indication signal The foot position detection device includes a position indication signal transmitter that transmits a position indication signal to the foot. The position detection sensor of the foot position detection device receives the position indication signal from the position indication signal transmitter and outputs it for each of the multiple electrodes. The detection circuit of the foot position detection device detects, based on the output signal from the position detection sensor, a movement of the sole part in a direction along the longitudinal central axis of the sole part, the extension direction of a line extending from the heel side part to the toe side part, as a forward movement. The detection circuit of the foot position detection device detects, based on the output signal from the position detection sensor, a movement of the sole part in the extension direction of the line extending from the toe side part to the heel side part, as a backward movement. This allows the foot input system to easily instruct the image processing device to perform forward movement and backward movement, and to instruct image processing, such as enlarging an image for forward movement and reducing an image for backward movement. [Brief description of the drawings]

[0013] [Figure 1]FIG. 2 is a diagram for explaining an example of use of the foot input system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram for explaining a configuration example of the foot position indicating device of the first embodiment. [Diagram 3] FIG. 2 is a diagram for explaining a configuration example of the foot position indicating device of the first embodiment. [Figure 4] 1 is a diagram for explaining a configuration example of a foot position detecting device according to a first embodiment; [Diagram 5] 5A to 5C are diagrams for explaining height information and angle information that can be input by the foot position indicating device of the first embodiment. [Figure 6] 5A to 5C are diagrams for explaining angle information that can be input by the foot position indicating device of the first embodiment. [Figure 7] 11A and 11B are diagrams for explaining an example of use of the foot input system according to the second embodiment. [Figure 8] FIG. 11 is a diagram for explaining the overall configuration of an image processing system that is configured using a foot input system according to a second embodiment. [Figure 9] 13A and 13B are diagrams for explaining a configuration example of a foot position indicating device according to a second embodiment. [Figure 10] 10 is a diagram for explaining a configuration example of a foot position detecting device according to a second embodiment; FIG. [Figure 11] 11A and 11B are diagrams for explaining an example of use of the foot input system according to the second embodiment. [Figure 12] 13A to 13C are diagrams for explaining an operating state of the foot input system according to the second embodiment and a display image of the head mounted display. [Figure 13] 13A to 13C are diagrams for explaining an operating state of the foot input system according to the second embodiment and a display image of the head mounted display. [Figure 14] 13A to 13C are diagrams for explaining an operating state of the foot input system according to the second embodiment and a display image of the head mounted display. [Figure 15]13A and 13B are diagrams for explaining instruction input in an image processing system configured using the foot input system of the second embodiment. [Figure 16] 13A and 13B are diagrams for explaining instruction input in an image processing system configured using the foot input system of the second embodiment. [Figure 17] 13A and 13B are diagrams for explaining how a pointing input is detected in the foot input system according to the second embodiment. [Figure 18] 11A and 11B are diagrams for explaining variations in the installation position of a position indication signal transmitter for a foot position indicating device. [Figure 19] FIG. 13 is a diagram for explaining a foot position indicating device configured using a flat coil. [Figure 20] FIG. 13 is a diagram for explaining a foot position indicating device configured using a flat coil. [Figure 21] 11A and 11B are diagrams for explaining an example of use of a foot position indicating device configured using a flat coil. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of the system, device, and method of the present invention will be described with reference to the drawings.

[0015] [First embodiment] <Example of using the foot input system> Fig. 1 is a diagram for explaining an example of use of the foot input system of the first embodiment. As shown in Fig. 1, the computer drawing system is composed of, for example, a pen tablet device TB, an electronic pen PN, a so-called joystick JS, a display DP, and a computer main body. Although the computer main body is not shown in Fig. 1, the pen tablet device TB, the joystick JS, and the display DP are connected to the computer main body.

[0016] When drawing input is performed using a computer drawing system, the user inputs the drawing using the electronic pen PN on a pen tablet device TB placed on a desk. An image (drawn image) corresponding to the drawing input is displayed on the display DP. The user can rotate the drawn image in various directions by operating a so-called joystick JS, and can input detailed drawings of the desired part of the drawn image using the electronic pen PN via the pen tablet device TB.

[0017] In the case of the computer drawing system of this embodiment, a foot input system can also be used. The foot input system is made up of a foot position indicating device 100 and a foot position detection device 200. As shown in Fig. 1, the foot position indicating device 100 is configured in a slipper shape and is worn on the user's feet when in use. The foot position indicating device 100 is a cordless device that is not connected to other devices by a cord.

[0018] The foot position detection device 200 is in the shape of a floor mat, is located under the foot position indication device 100, and realizes the function of detecting the position indicated by the foot position indication device 100. The foot position detection device 200 is connected to a computer main body and is capable of supplying a detection output. Furthermore, operations such as moving, enlarging, and reducing a drawn image, which have conventionally been performed by operating an icon displayed on a display DP, can now be performed using the foot input system.

[0019] Specifically, the drawn image can be moved on the display screen of the display DP by moving the foot position indicating device 100 on the foot position detecting device 200. Also, the drawn image can be enlarged or reduced by raising and lowering the toe side of the foot position indicating device 100 while keeping the heel side attached to the foot position detecting device 200. This is just one example, and various instruction inputs can be made through the foot input system by a program running on the computer drawing system.

[0020] In this way, the foot position input system can function as an input device (input system) for a computer drawing system. In this embodiment, the foot input system can indicate a position through the foot position indicating device 100 by electromagnetic induction, as described later, and can detect and notify the pressure applied to the foot position indicating device 100. A specific configuration example of the foot position indicating device 100 and the foot position detection device 200 that constitute the foot input system will be described below.

[0021] <Configuration Example of Foot Position Indicator 100> 2 and 3 are diagrams for explaining a configuration example of the foot position indicating device 100 of the first embodiment. As shown in Fig. 2(B), the sole of a user's (person's) foot is divided into three parts: the toe side, the arch, and the heel. As shown in Fig. 2(A), the foot position indicating device 100 includes a sole front part 101 located under the toe side, a sole rear part 103 located under the heel, and a sole middle part 102 located under the arch and connecting the sole front part 101 and the sole rear part 103.

[0022] The sole front part 101 is provided with a position indication unit 101U including a coil 101L and a pressure sensor 101P. The sole rear part 103 is provided with a position indication unit 103U including a coil 103L and a pressure sensor 103P. More specifically, as shown in FIG. 3A, the position indication unit 101U is configured by connecting the coil 101L, the capacitor 101C, and the pressure sensor 101P in parallel. Similarly, the position indication unit 103U is configured by connecting the coil 103L, the capacitor 103C, and the pressure sensor 103P in parallel.

[0023] That is, the position indication unit 101U realizes the function of transmitting a position indication signal by forming a resonance circuit by connecting the coil 101L and the capacitor 101C in parallel, and by cooperating with the foot position detection device 200 described later. The pressure sensor 101P is configured as a variable capacitance capacitor, and the capacitance changes according to the applied pressure. The pressure sensor 101P is connected in parallel to the resonance circuit formed by the coil 101L and the capacitor 101C, so that the phase of the resonance frequency changes according to the capacitance, and the pressure information detected can be included in the position indication signal and transmitted. The position indication unit 103U is also configured in the same manner as the position indication unit 101U.

[0024] As shown in Fig. 1 and Fig. 3(B), foot position indicating device 100 is slipper-shaped and includes sole front part 101 and sole rear part 103 as shown in Fig. 3(B) and (C). Position indicating unit 101U is provided on sole front part 101 and position indicating unit 103U is provided on sole rear part 103, so that the respective positions can be indicated and pressure applied to each part can be detected and notified. As will be described later in detail, various information can be input, such as not only position and pressure but also the height and angle at which position indicating units 101U and 103U are positioned, and the angle when foot position indicating device 100 is rotated while the heel part is fixed.

[0025] In this embodiment, the resonant frequency of the position indication unit 101U of the sole front part 101 is different from that of the position indication unit 103U of the sole rear part, for example, at frequency f1 and frequency f2. This allows the foot position detection device 200 to distinguish between the position and pressure corresponding to the position indication signal from the position indication unit 101U and the position and pressure corresponding to the position indication signal from the position indication unit 103U. In other words, the positions of the sole front part 101 and the sole rear part 103 and the pressures applied thereto can be distinguished from each other.

[0026] <Configuration Example of Foot Position Detection Device 200> Fig. 4 is a block diagram for explaining a configuration example of a foot position detection device 200 of this embodiment, which is configured using an electromagnetic induction method. The foot position detection device 200 is roughly divided into a position detection sensor 201 and a position detection circuit 202. The position detection sensor 201 is configured by stacking an X-axis direction loop coil group 201X and a Y-axis direction loop coil group 201Y. As shown in Fig. 1, the position detection sensor 201 is placed at the foot of a user and is used by being positioned below the foot position indicating device 100.

[0027] In addition, the X-axis constituting the electrodes of the position detection sensor 201 direction Each of the loop coils X1 to X40 of the loop coil group 201X and the Y-axis direction Each of the loop coils Y1 to Y30 of the loop coil group 201Y may have one turn or may have two or more turns. In addition, the number of loop coils in each of the loop coil groups 201X and 201Y can be appropriately determined depending on the size of the position detection sensor 201.

[0028] The position detection circuit 202 comprises an oscillator 204, a current driver 205, a selection circuit 206, a switching connection circuit 207, a receiving amplifier 208, a position detection circuit 209, a pressure detection circuit 210, and a control unit 211. The control unit 211 is configured with a microprocessor. The control unit 211 controls the selection of the loop coil in the selection circuit 206 and the switching of the switching connection circuit 207, and also controls the processing timing in the position detection circuit 209 and the pressure detection circuit 210.

[0029] The X-axis direction loop coil group 201X and the Y-axis direction loop coil group 201Y of the position detection sensor 201 are connected to a selection circuit 206. The selection circuit 206 sequentially selects one of the two loop coil groups 201X and 201Y. The oscillator 204 generates an AC signal with a frequency of f0. The oscillator 204 supplies the generated AC signal to a current driver 205 and a pressure detection circuit 210. The current driver 205 converts the AC signal supplied from the oscillator 204 into a current and sends it to a switching connection circuit 207.

[0030] The switching connection circuit 207 switches the connection destination (transmission side terminal T, reception side terminal R) to which the loop coil selected by the selection circuit 206 is connected under the control of the control unit 211. Of these connection destinations, the current driver 205 is connected to the transmission side terminal T, and the reception side terminal R is connected to the reception amplifier 208. When a signal is to be transmitted from the position detection sensor 201, the switching connection circuit 207 is switched to the terminal T side, and conversely, when the position detection sensor 201 receives a signal from the outside, the switching connection circuit 207 is switched to the terminal R side.

[0031] When the switching connection circuit 207 is switched to the terminal T side, a current is supplied from the current driver 205 to the loop coil selected by the selection circuit 206. This generates a magnetic field in the loop coil, which acts on the resonance circuit of the opposing position indication unit 101U, 103U of the foot position indication device 100, thereby transmitting a signal (radio wave).

[0032] On the other hand, when the switching connection circuit 207 is switched to the terminal R side, the induced voltage generated in the loop coil selected by the selection circuit 206 is sent to the receiving amplifier 208 via the selection circuit 206 and the switching connection circuit 207. The receiving amplifier 208 amplifies the induced voltage supplied from the loop coil, and sends it to the position detection circuit 209 and the pressure detection circuit 210.

[0033] That is, an induced voltage is generated in each loop coil of the X-axis direction loop coil group 201X and the Y-axis direction loop coil group 201Y by radio waves (position indication signals) transmitted from the position indication units 101U, 103U of the foot position indication device 100. The position detection circuit 209 detects the induced voltage generated in the loop coils, i.e., the received signal, converts the detection output signal into a digital signal, and outputs it to the control unit 211. The control unit 211 calculates the coordinate values ​​of the indicated positions in the X-axis direction and the Y-axis direction according to the position indication signals from the position indication units 101U, 103U based on the digital signal from the position detection circuit 209, i.e., the level of the voltage value of the induced voltage generated in each loop coil.

[0034] On the other hand, the pressure detection circuit 210 synchronously detects the output signal of the receiving amplifier 208 with the AC signal from the oscillator 204 to obtain a signal with a level corresponding to the phase difference (frequency shift) between them, converts the signal corresponding to the phase difference (frequency shift) into a digital signal, and outputs it to the control unit 211. The control unit 211 detects the pressure applied to the pressure sensors 101P, 103P of the position indication units 101U, 103U based on the digital signal from the pressure detection circuit 210, i.e., the level of the signal corresponding to the phase difference (frequency shift) between the transmitted radio wave and the received radio wave.

[0035] Fig. 5 is a diagram for explaining height information and angle information that can be input by the foot position indicating device 100. As shown in Fig. 5(B), the foot position indicating device 100 can be operated to raise the sole front part 101 away from the position detection sensor 201 while keeping the sole rear part 103 side in contact with the position detection sensor 201. In this case, the control unit 211 can also detect the distance (height) h of the position indicating unit 101U of the foot position indicating device 100 from the position detection sensor 201 based on the voltage value level of the induced voltage generated in each loop coil.

[0036] 5(A), the distance l between the position indication unit 101U attached to the sole front portion 101 and the position indication unit 103U attached to the sole rear portion 103 is determined at the time of attachment. Therefore, the control unit 211 can also calculate the angle θ between the position detection sensor 201 and the bottom surface of the foot position indication device 100 using "tan θ=h / l."

[0037] Also, the foot position indicating device 100 can be operated in the opposite manner to the state shown in FIG. 5(B), in which the sole rear part 103 is raised away from the position detection sensor 201 while the sole front part 101 is kept in contact with the position detection sensor 201. In this case, too, the height angle can be obtained in the same manner as described with reference to FIG. 5. That is, the distance (height) of the position indicating unit 103U from the position detection sensor 201 can be detected. Also, when the sole rear part 103 is It went up The angle between the position detection sensor 201 in this state and the bottom surface of the foot position indicating device 100 can also be found by calculation.

[0038] 6 is a diagram for explaining angle information that can be input by the foot position indicating device 100. As shown in Fig. 6(A), the foot position indicating device 100 can rotate the sole front part 101 leftward or rightward around the sole rear part 103 side on the position detection sensor 201. The control unit 211 can also detect in which direction and how much the sole front part 101 of the foot position indicating device 100 has been rotated from the change in position of the position indicating unit 101U of the foot position indicating device 100.

[0039] For example, as shown in FIG. 6(B), assume that the position of the position indication unit 103U provided on the sole rear part 103 does not change, and the sole front part 101 rotates to the right as indicated by the arrow, changing only the indicated position of the position indication unit 101U. In this case, the length (distance) l between the position indication unit 103U and the position indication unit 101U does not change. Therefore, an isosceles triangle is formed with the position indication unit 103U as the apex, and the indicated position P0 of the position indication unit 101U before rotation and the indicated position P1 of the position indication unit 101U after rotation as the two ends of the base.

[0040] Since the position indicated by position indication unit 103U and positions P0 and P1 indicated by position indication unit 101U can be detected by control unit 211 as described above, the length a of the base having positions P0 and P1 as its two ends can also be found by control unit 211. Similarly, the distance between the midpoint of the base and the vertex indicated by position indication unit 103U, i.e., the height h of the isosceles triangle, can also be found by control unit 211.

[0041] If the length a of the base and the height h of the isosceles triangle are known, the base angle θ can be found using equation (1) in FIG. 6(B). Therefore, as shown in equation (2) in FIG. 6(B), the apex angle φ can be found by subtracting the sum of the two base angles from 180 degrees, which is the sum of the interior angles of the triangle. In this example, this angle φ becomes information (amount of rotation) indicating how much the sole front portion 101 has rotated to the right. When the sole front portion 101 rotates to the left, the amount of rotation can be calculated in the same way, with only the direction of rotation changing.

[0042] The foot position indicating device 100 can also rotate the sole rear part 103 left or right on the position detection sensor 201 around the sole front part 101 side. In this case, it is possible to detect in which direction (left or right) the sole rear part 103 has rotated and how much in the same way as in the case described with reference to Fig. 6. In this way, various information can be input by the foot position indicating device 100, and the display of the drawn image can be controlled using this input information.

[0043] For example, as described with reference to Fig. 5, when the sole front part 101 is raised and lowered without moving the sole rear part 103, the enlarged display of the drawn image can be adjusted, and when the sole rear part 103 is raised and lowered without moving the sole front part 101, the reduced display of the drawn image can be adjusted. Also, as described with reference to Fig. 6, when the sole front part 101 is rotated left and right without moving the sole rear part 103, the drawn image can be rotated left and right. Also, when the sole rear part 103 is rotated left and right without moving the sole front part 101, the drawn image can be rotated up and down.

[0044] In this case, control can be performed based on the detected heights of the position indication units 101U, 103U from the position detection sensor 201 and the angle of the entire sole of the foot position indication device 100 relative to the position detection sensor 201. It is also possible to detect the pressure applied to the pressure sensor 101P mounted on the sole front part 101 and the pressure applied to the pressure sensor 103P mounted on the sole rear part. For this reason, it is also possible to control the enlargement of the drawn image according to the strength of the stepping on the sole front part 101 and the reduction of the drawn image according to the strength of the stepping on the sole rear part 103. This type of control is one example, and various other controls can be performed by the processing program of the computer drawing system according to the information input by the foot input system.

[0045] In the example described with reference to Figs. 5 and 6, either the sole front part 101 or the sole rear part 103 of the foot position indicating device 100 is in contact with the position detection sensor 201. However, this is not limited to this. For example, when both the sole front part 101 and the sole rear part 103 are lifted up and down away from the position detection sensor 201, the foot position detection device 200 can detect this state, and can control the display of a drawn image, for example, according to this state. In addition, both the sole front part 101 and the sole rear part 103 can be lifted up and down away from the position detection sensor 201 and rotated leftward or rightward. The foot position detection device 200 can detect this state, and can control the display of a drawn image, for example, according to this state.

[0046] <Advantages of the First Embodiment> According to the foot input system of the first embodiment described above, various detailed information such as position, pressure, height, and angle can be input using the user's foot. This information is detected by the position detection circuit 202 of the foot position detection device 200, and the detected information is input to a computer main body that processes image data and can be used as a parameter for image processing. As a result, various instructions such as enlarging, reducing, rotating, and adjusting the image quality of a drawn image, which were previously given by inputting instructions using the user's hand, can be given using the foot input unit. In other words, the foot input unit enables new input operations for multiple purposes.

[0047] Furthermore, by adopting an electromagnetic induction system, the foot input unit has a battery-less structure, is highly durable, and allows the foot position indicating device 100 to be moved while still attached to the foot. This makes it easy to handle and provides an input device that is easy to use.

[0048] In addition, a new input unit can be provided in situations where technologies such as VR, AR, and MR are used, enabling more flexible input of instructions. This allows for more flexible information input in fields such as VR, AR, and MR.

[0049] For example, a large room is prepared as a VR space, and the user in that room Below By providing a position detection sensor 201 on the entire surface, a large 3D VR object can be formed in the room, and the 3D VR object can be rendered while moving around the room. In this way, in situations where technologies such as VR, AR, and MR are used, more flexible instruction input is possible, the user's physical fatigue can be reduced without impeding the sense of immersion in the 3D space, and both detailed and rough work can be performed.

[0050] [Second embodiment] <Example of the configuration of the foot input system and image processing system> Fig. 7 is a diagram for explaining an example of use of the foot input system of the second embodiment. The foot input system of the second embodiment, like the foot input system of the first embodiment, comprises a foot position indicating device 300 worn on the user's feet like footwear, and a foot position detection device 400 disposed under the foot position indicating device 300. In the second embodiment, as shown in Fig. 7, the foot position detection device 400, a head mounted display (hereinafter abbreviated as HMD) 500, and a game controller 600 are connected to an image processing device 700, which will be described in detail later.

[0051] The foot input system, consisting of the foot position indicating tool 300 and the foot position detection device 400, and the game controller 600 function as an input device that receives instruction input from the user and supplies the received instruction input to the image processing device 700. The HMD 500 is a head-mounted display (display device), and in this embodiment, as shown in Fig. 7, is mounted on the user's head so as to cover both of the user's eyes.

[0052] The image processing device 700 can form a three-dimensional spatial image (three-dimensional modeling image) covering 360 degrees around the user, as shown as a 360-degree image area GA in Fig. 7, and supply it to the HMD 500. In this embodiment, the image processing device 700 functions as a so-called computer game machine that provides the user with a game using a three-dimensional spatial image.

[0053] Fig. 8 is a diagram for explaining the overall configuration of an image processing system configured using the foot input system of the second embodiment. As shown in Fig. 8, the image processing device 700 includes a three-dimensional image data file 701, a three-dimensional part image file 702, an image processing unit 703, communication units 704 and 705, and an I / F (Interface) 706. The communication unit 704 is for performing wireless communication with the HMD 500. The communication unit 705 is for receiving instruction input from a game controller. The I / F 706 is for receiving detection output from the foot position detection device 400 (instruction input using the foot position indication device 300).

[0054] In this way, the image processing device 700 and the HMD 500 can communicate bidirectionally wirelessly. The image processing device 700 and the game controller 600 are connected wirelessly, and the image processing device 700 can receive at least instruction inputs from the game controller 600. The image processing device 700 and the foot position detection device 400 are connected by wire, and the image processing device 700 can receive detection outputs from the foot position detection device 400.

[0055] The HMD 500 and the game controller 600 can also be connected to the image processing device 700 by wires. However, the HMD 500 and the game controller 600 are worn or carried by a user who may change the orientation of his / her body. For this reason, it is preferable that the HMD 500 and the game controller 600 are connected to the image processing device 700 wirelessly, which eliminates the risk of the connection cord getting tangled around the body. The foot position detection device 400 and the image processing device 700 can also be connected wirelessly. However, the foot position detection device 400 does not move with the movement of the user, so there is no problem with a wired connection.

[0056] The three-dimensional image data file 701 stores and holds three-dimensional image data forming a three-dimensional space image. The three-dimensional part image file 702 stores and holds three-dimensional part image data for forming various three-dimensional part images, such as avatars, to be displayed in the three-dimensional space image. The image processing unit 703 uses the three-dimensional image data of the three-dimensional image data file 701 and the three-dimensional part image data of the three-dimensional part image file 702 to form three-dimensional space image data to be supplied to the HMD 500, and supplies this to the HMD 500.

[0057] The HMD500 includes a display HDP for displaying a three-dimensional spatial image, and a six-axis sensor including, for example, a three-axis gyro sensor and a three-axis angular velocity sensor, and is capable of detecting a rotation direction and a rotation angle. This allows the HMD500 to display a three-dimensional spatial image corresponding to the three-dimensional image data from the image processing device 700 on the display HDP, and also transmits the detected rotation direction and rotation angle to the image processing device 700. Therefore, when a user wearing the HMD500 on his / her head rotates his / her head to the left or right, or looks up or down, the six-axis sensor mounted on the HMD500 detects in which direction and how much the head has rotated, and notifies the image processing device 700 of this.

[0058] The image processing unit 703 of the image processing device 700 identifies the direction in which the user's eyes are facing based on the detection output from the six-axis sensor of the HMD 500, forms three-dimensional spatial image data in that viewing direction, and supplies this to the HMD 500. This allows the user to view a three-dimensional spatial image corresponding to the direction in which his or her eyes are facing through the display HDP of the HMD 500.

[0059] Furthermore, the image processing unit 703 of the image processing device 700 can create three-dimensional space image data by adding changes, such as an avatar throwing a ball or shooting a gun, to the three-dimensional space image displayed on the display of the HMD 500 in response to an instruction input from the game controller 600, and supply this data to the HMD 500. In this way, the three-dimensional space image that changes in response to the instruction input input via the game controller 600 can be viewed through the display HDP of the HMD 500.

[0060] Furthermore, the image processing unit 703 of the image processing device 700 can enlarge or reduce the three-dimensional space image displayed on the display of the HMD 500 according to the detection output from the foot position detection device 400 (instruction input using the foot position indication device 300). As will be described in detail later, by moving the foot position indication device 300 worn on the user's foot on the foot position detection device 400, the three-dimensional space image displayed on the display of the HMD 500 can be enlarged or reduced, and the viewpoint position can be shifted to the left or right in the three-dimensional space image.

[0061] That is, by sliding the foot position indicating device 300 on the foot position detection device 400 in the longitudinal direction of the foot in the direction in which the front of the body faces, the image processing device 700 can be instructed to enlarge the three-dimensional spatial image. Conversely, by sliding the foot position indicating device 300 on the foot position detection device 400 in the longitudinal direction of the foot in the direction in which the back of the body faces, the image processing device 700 can be instructed to reduce the three-dimensional spatial image.

[0062] Also, suppose that the foot position indicating device 300 is slid on the foot position detection device 400 toward the left side of the body in a direction intersecting with the longitudinal direction of the foot. In this case, the viewpoint position in the three-dimensional spatial image is moved to the left, and the three-dimensional spatial image seen from the position after the movement can be displayed. Conversely, suppose that the foot position indicating device 300 is slid on the foot position detection device 400 toward the right side of the body in a direction intersecting with the longitudinal direction of the foot. In this case, the viewpoint position in the three-dimensional spatial image is moved to the right, and the three-dimensional spatial image seen from the position after the movement can be displayed.

[0063] 7, a user wearing the HMD500 on his / her head, holding the game controller 600 in his / her hand, and placing his / her right foot wearing the foot position indicating device 300 on the foot position detection device 400 can enjoy a game using a three-dimensional spatial image. In this case, the user can change the viewing direction by rotating his / her head left or right, looking up or down, and the three-dimensional spatial image displayed on the display of the HMD500 can be changed accordingly.

[0064] Also, the display of three-dimensional image objects such as avatars can be changed in the displayed three-dimensional space image by operating the game controller 600. Furthermore, by moving the foot position indicator on the foot position detection device 400, the three-dimensional space image can be enlarged or reduced, or the viewpoint can be moved to the left or right.

[0065] The head rotation is not limited to the case where only the head is rotated, but also includes the case where the user's entire body is rotated. Therefore, as shown in FIG. 7, the user can freely rotate and move, such as by rotating the entire body and greatly changing the direction of the body, and can enjoy the game using the three-dimensional space image of the entire periphery of the 360-degree image area GA. Moreover, for the three-dimensional space image in any direction, it is possible to enlarge, reduce, and move the viewpoint position in the three-dimensional space image to the left or right through the foot position indicating device 300 and the foot position detecting device 400. In this way, the three-dimensional space image can be dynamically changed by rotating the head and operating the feet, and the game can be enjoyed.

[0066] <Example of the configuration of the foot position indicator> 9A and 9B are diagrams for explaining a configuration example of the foot position indicating device 300 according to the second embodiment, in which FIG. 9A is a diagram of the front side of the foot position indicating device 300 and FIG. 9B is a diagram of the back side of the foot position indicating device 300. As shown in FIG. 9A, the foot position indicating device 300 has a single plate-shaped sole portion 301 that faces the entire sole of the user. The sole portion 301 is composed of a sole front portion 301f located under the toe portion of the user's foot, a sole rear portion 301b located under the heel portion of the user's foot, and a sole middle portion 301c that connects the sole front portion 301f and the sole rear portion 301b. The sole front portion 301f is provided with toe side belt holders 301L and 301R that pass a belt for fixing the foot position indicating device 300 to the user's foot and hold the belt.

[0067] A heel side fixing part 302 is provided on the sole rear part 301b side. In FIG. 9(A), the heel side fixing part 302 is shown in a state separated from the sole part 301 so that the entire configuration of the sole rear part 301b side can be seen. However, the heel side fixing part 302 is actually formed integrally with a bottom surface part 302a that covers the sole rear part 301b and the sole middle part 301c of the sole part 301 from below, as shown in FIG. 9(B). On the upper side of the bottom surface part 302a of the heel side fixing part 302, the sole rear part 301b and the sole middle part 301c of the sole part 301 are placed so as to face each other, as shown in FIG. 9(B), and are fixed by the sole holding part 302SL and the sole holding part 302SR of the bottom surface part 302a. Of course, the bottom surface portion 302a of the heel side fixing portion 302 and the sole rear portion 301b and the sole middle portion 301c of the sole portion 301 may be attached and fixed with an adhesive.

[0068] As shown in FIG. 9(A), the heel-side fixing part 302 is provided with heel-side belt holders 302L and 302R that hold a belt for fixing the foot position indicator 300 to the user's foot by passing the belt through the heel-side belt holders 302L and 302R. The toe part of the user's foot can be fixed to the sole front part 301f by positioning the toe part of the user's foot between the sole front part 301f of the sole part 301 and the belt passed through the toe-side belt holders 301L and 301R. The heel part of the user's foot can be placed on the sole rear part 301b, and the belt passed through the heel-side belt holders 302L and 302R is tightened so as to cover the opposite side of the heel, thereby fixing the heel side of the user's foot to the sole rear part 301b. This allows the entire foot position indicator 300 to be fixed to the user's foot.

[0069] Furthermore, in the foot position indication device 300 of this embodiment, a left position indication unit 303L is provided on the left end side of the sole rear part 301b, and a right position indication unit 303R is provided on the right end side of the sole rear part 301b. A rear position indication unit 303C is provided in the center of the rear end side of the sole rear part 301b. The basic configuration of these three position indication units 303L, 303R, and 303C is similar to that of the position indication units 101U and 103U described using FIG. 3, and is composed of a signal transmission coil, a capacitor, and a pressure sensor. In this embodiment, each of the position indication units 303L, 303R, and 303C is configured to transmit signals of different frequencies.

[0070] These position indication units 303L, 303R, and 303C form an isosceles triangle on the bottom surface of the sole rear part 301b, with the left position indication unit 303L and the right position indication unit 303R as the two ends of the base and the rear position indication unit 303C as the apex. The position indication units 303L, 303R, and 303C arranged in this manner make it possible to detect whether the foot position indication device 300 has moved forward or backward. Note that, for the foot position indication device 300, forward movement means movement in the direction of extension of a line extending from the heel to the toe, and backward movement means movement in the direction of extension of a line extending from the toe to the heel.

[0071] 9(B), a movable range restricting plate 304 is provided on the back surface of the sole rear portion 301b, sandwiching the bottom surface portion 302a of the heel side fixing portion 302. This movable range restricting plate 304 engages with a ring-shaped convex portion surrounding the outer edge of a movable range restricting area provided on the operation surface of the foot position detecting device 400 described later, and acts to restrict the movable range of the foot position indicating device 300 on the foot position detecting device 400. In this manner, the sole portion 301, the heel side fixing portion 302, the position indicating units 303L, 303R, 303C, and the movable range restricting plate 304 constitute the foot position indicating device 300 of this embodiment.

[0072] <Configuration Example of Foot Position Detection Device 400> FIG. 10 is a diagram for explaining a configuration example of a foot position detection device 400 according to a second embodiment. In FIG. 10, FIG. 10(A) is a diagram showing the front side of the foot position detection device 400, and FIG. 10(B) is a diagram showing a schematic configuration inside the foot position detection device 400. The foot position detection device 400 is configured by providing a circular, flat operation surface (top plate) 401 on the upper side of the foot position detection device 200 described using FIG. 4. The above-mentioned foot position indication tool 300 is placed on the operation surface 401, and various operations are performed. A ring-shaped protrusion 403 is provided in a circumferential shape (ring shape) in the center of the operation surface 401, so that the inside thereof becomes a movable range restriction area 402.

[0073] The above-mentioned movable range limiting plate 304 of the foot position indicating device 300 is positioned inside the movable range limiting region 402. As a result, when the foot position indicating device 300 is moved significantly, the side surface of the movable range limiting plate 304 engages with the ring-shaped protrusion 403, and further outward movement is restricted. Note that, if necessary, the movable range limiting plate 304 can move over the ring-shaped protrusion 403 on the operation surface 401.

[0074] In this way, the foot position indicator 300 teeth Although it can move freely on operation surface 401, various operational inputs are usually possible by freely moving movable range restriction plate 304 within movable range restriction area 402 on operation surface 401. Note that linear marks are shown in movable range restriction area 402 in reference direction K and in a direction perpendicular to reference direction K, so that the reference direction and the direction perpendicular to this can be visually recognized. Also, the intersection of the linear marks is the origin O of the reference coordinate system, which will be described in detail later.

[0075] Furthermore, a recognition groove 404 is provided on the outer periphery of the operation surface 401 in the direction indicated by the reference direction K. The sole front part 301f of the foot position indicating device 300 fits into the recognition groove 404, allowing the user to recognize the initial position and initial angle of the foot position indicating device 300 on the operation surface 401. Specifically, the tip of the sole front part 301f abuts against an inner wall part 405 provided in the inner opening part of the recognition groove 404, allowing the user to recognize that the foot position indicating device 300 is located at the inner opening part of the recognition groove 404. In other words, the user can recognize that the foot position indicating device 300 is in the initial position on the operation surface 401.

[0076] If necessary, the sole front part 301f of the foot position indicating device 300 is fitted onto the recognition groove 404 so that the sole front part 301f rides up onto the recognition groove 404. This allows the user to more reliably grasp the position of the foot position indicating device 300 on the operation surface 401 by fitting the foot position indicating device 300 into the recognition groove 404. Thereafter, the foot position indicating device 300 is moved backward and the tip of the sole front part 301f is brought into contact with the inner wall part 405 of the inner opening part of the recognition groove 404, thereby positioning the foot position indicating device 300 at its initial position on the operation surface 401.

[0077] As described above with reference to Fig. 4 and as shown in Fig. 10(B), the foot position detection device 400 is made up of a rectangular position detection sensor 201 and a position detection circuit 202. In Fig. 10(B), the position detection circuit 202 described with reference to Fig. 4 is configured in a housing shown as the position detection circuit 202 in Fig. 10(B). In Fig. 10(B), a cable 221 drawn out from the position detection circuit 202 is connected to the I / F of the image processing device 700. 706 In this embodiment, as shown in FIG. 10B, the foot position detection device 400 The foot position detection device 400 includes a wireless communication unit 222 and a battery 223. The wireless communication unit 222 can be connected to the image processing device 700 wirelessly, and the battery 223 supplies driving power to each unit of the foot position detection device 400.

[0078] 10(B), in this embodiment, the position detection sensor 201 is provided at an angle of 45 degrees to the left with respect to the reference direction K, which is the direction in which the recognition groove 404 of the operation surface 401 is provided. This prevents two position indication units from frequently being placed on the same position detection coil at the initial position and its surrounding angles, making it possible to reduce so-called jitter, which is the fluctuation of the signal waveform in the time axis direction, and improves the accuracy of position detection.

[0079] In addition, in the foot position detection device 400 of this embodiment, the frequencies of the signals transmitted from each of the position indication units 303L, 303R, and 303C provided in the foot position indication tool 300 are grasped, for example, in a memory provided in the control unit 211. This allows the foot position detection device 400 to detect which position indication unit is indicating which position.

[0080] <Example of using the foot input system> FIG. 11 is a diagram for explaining an example of use of the foot input system of the second embodiment. In FIG. 11, FIG. 11(A) is a diagram for explaining the positional relationship of three position indication units 303L, 303R, and 303C provided on the sole rear part 301b of the foot position indication device 300. Also, FIG. 11(B) is a diagram showing a case where the foot position indication device 300 is placed at an initial position on the operation surface 401 of the foot position detection device 400. Also, FIG. 11(C) is a diagram showing the state shown in FIG. 11(B) as viewed from the side (horizontal direction) of the foot position indication device 300. In FIG. 11(C), only the operation surface 401 of the foot position detection device 400 is shown as a cross section, and the foot position indication device 300 is shown as a whole as viewed from its side.

[0081] As shown in FIG. 9A, the sole rear portion 301b of the foot position indicating device 300 of this embodiment has a sole middle portion 301c. Close toA left position indication unit 303L and a right position indication unit 303R are provided at symmetrical positions on the left and right. Furthermore, a rear position indication unit 303C is provided at the center of the rear end side of the sole rear part 301b. These three position indication units 303L, 303R, and 303C form a triangle with each unit as a vertex, as shown in FIG. 11(A).

[0082] In this example, the distance from the left position designation unit 303L to the rear position designation unit 303C is equal to the distance from the right position designation unit 303R to the rear position designation unit 303C. Therefore, an isosceles triangle is formed with the left position designation unit 303L and the right position designation unit 303R as the two ends of the base and the rear position designation unit 303C as the apex. In other words, the line segment connecting the left position designation unit 303L and the right position designation unit 303R is the base, and the line segment connecting the rear position designation unit 303C and the left position designation unit 303L and the line segment connecting the rear position designation unit 303C and the right position designation unit 303R are equilateral.

[0083] As a result, as shown in Fig. 11(A), a position indication coordinate system (transmitting coil coordinate system) is formed, which is defined by the three position indication units 303L, 303R, and 303C. That is, a coordinate system is formed in which a straight line that is parallel to the line segment connecting the left position indication unit 303L and the right position indication unit 303R and passes through the center of gravity G is the x-axis, and a perpendicular line is dropped from the rear position indication unit 303C to the x-axis, and a straight line extending from both ends is the y-axis. This coordinate system is defined as the position indication coordinate system specified by the three position indication units. The origin of this position indication coordinate system is the center of gravity G of the isosceles triangle formed by the three position indication units 303L, 303R, and 303C.

[0084] In this embodiment, a position indication coordinate system defined by the left position indication unit 303L, the right position indication unit 303R, and the rear position indication unit 303C is used as a single reference for determining the direction and amount of movement of the foot position indication device 300. However, since the position indication coordinate system is defined by the three position indication units 303L, 303R, and 303C provided on the foot position indication device 300, when the foot position indication device 300 moves, the coordinate system also moves.

[0085] Therefore, another reference coordinate system is provided. In this case, as shown in Fig. 10(A), the center O of a circular movable range restriction area 402 provided on an operation surface 401 of a foot position detection device 400 is set as the origin O of the reference coordinate system. A straight line passing through the origin O and parallel to the x-axis of the position indication coordinate system is set as the X-axis of the reference coordinate system. Also, a straight line passing through the origin O and parallel to the y-axis of the position indication coordinate system is set as the Y-axis of the reference coordinate system. A change in the position of the origin (center of gravity) G of the position indication coordinate system in the reference coordinate system thus defined becomes an instruction input in the foot input system.

[0086] The reference coordinate system and the position indication coordinate system will be described below. First, in FIG. Three A point inside the isosceles triangle formed by the position indication units 303L, 303R, and 303C indicates the center of gravity G of the isosceles triangle. Suppose that the foot position indication tool 300 is placed on the operation surface 401 of the foot position detection device 400. In this case, the position on the position detection sensor 201 that corresponds to the center of gravity G of the isosceles triangle formed by the position indication units 303L, 303R, and 303C is detected by the foot position detection device 400 as the indicated position of the foot position indication tool 300.

[0087] First, as shown in FIG. 11B, a case will be considered in which the foot position indicating device 300 is placed on the operation surface 401 of the foot position detection device 400. From the side11(B) and (C), in this example, the movable range restricting plate 304 provided on the underside of the sole rear part 301b of the foot position indicating device 300 is located in the movable range restricting area 402 on the operation surface 401 of the foot position detecting device 400. At the same time, the tip of the sole front part 301f of the foot position indicating device 300 faces the inner wall part 405 provided in the inner opening part of the recognition groove part 404 of the foot position detecting device 400, and abuts against it, or is ready to abut against it.

[0088] 11B and 11C are the initial positions of the foot position indicating device 300 placed on the operation surface 401 of the foot position detecting device 400. In this case, the center of gravity G of an isosceles triangle formed by the left position indicating unit 303L, the right position indicating unit 303R, and the rear position indicating unit 303C provided on the sole rear part 301b of the foot position indicating device 300 coincides with the center of the movable range restriction area 402 on the operation surface 401. The center of this movable range restriction area becomes the origin O of the reference coordinate system. In reality, it is rare that the center of gravity (origin) G of an isosceles triangle (position indicating coordinate system) completely coincides with the origin O of the reference coordinate system. Therefore, when the center of gravity G is located within a predetermined range centered on the origin O, the foot position indicating device 300 can be considered to be in the initial position on the foot position detecting device 400.

[0089] In this way, the origin of the reference coordinate system is the center of the movable range restriction area, but the orientation of the X-axis and Y-axis of the reference coordinate system is determined according to the x-axis and y-axis of the position indication coordinate system which is determined according to the orientation of the foot position indication device 300. In other words, the orientation of the position indication coordinate system is determined by the orientation of an isosceles triangle formed by the left position indication unit 303L, the right position indication unit 303R, and the rear position indication unit 303C provided on the foot position indication device 300.

[0090] Therefore, no matter in what orientation the foot position indicating device 300 is placed on the operation surface 401 of the foot position detection device 400, if the foot position indicating device 300 is moved in the longitudinal direction, the movement of the indicated position (center of gravity G) can be detected as a change in the Y-axis direction of the reference coordinate system. Also, no matter in what orientation the foot position indicating device 300 is placed on the operation surface 401 of the foot position detection device 400, if the foot position indicating device 300 is moved in a direction perpendicular to the longitudinal direction, the movement of the indicated position (center of gravity G) can be detected as a change in the X-axis direction of the reference coordinate system.

[0091] A more detailed explanation will be given. Figures 11B and 11C show a case where the foot position indicating device 300 is in an initial position on the operation surface 401 of the foot position detection device 400. In this embodiment, the foot position indicating device 300 can rotate 360 ​​degrees on the operation surface 401, which is a circular plane, around the center of gravity G of an isosceles triangle formed by the three position indicating units 303L, 303R, and 303C of the sole rear part 301b. Also, if the movable range restricting plate 304 of the foot position indicating device 300 is within the movable range restricting area 402 of the operation surface 401, the foot position indicating device 300 can move forward and backward and left and right.

[0092] In this case, the reference coordinate system coincides with the position indicating coordinate system defined by the three position indicating units 303L, 303R, and 303C of the sole rear part 301b, as described above with reference to FIG. 11(A). Therefore, no matter which direction the foot position indicating device 300 faces, if the foot position indicating device 300 is moved forward, the value of the Y axis of the reference coordinate system increases. Also, if the foot position indicating device 300 is moved backward, the value of the Y axis of the reference coordinate system decreases. Similarly, if the foot position indicating device 300 is moved rightward, the value of the X axis of the reference coordinate system increases. Also, if the foot position indicating device 300 is moved leftward, the value of the X axis of the reference coordinate system decreases.

[0093] As shown in Fig. 9, in this embodiment, the left position indication unit 303L and the right position indication unit 303R are provided at symmetrical positions near the sole middle part 301c. The rear position indication unit 303C is provided at the rear end side of the sole rear part 301b. Therefore, the movement direction can be specified depending on whether the rear position indication unit 303C moves following the left position indication unit 303L and the right position indication unit 303R, or whether the left position indication unit 303L and the right position indication unit 303R move following the rear position indication unit 303C.

[0094] That is, it is assumed that the rear position indication unit 303C moves following the left position indication unit 303L and the right position indication unit 303R. Following in this case means that the rear position indication unit 303C moves forward of where the left position indication unit 303L and the right position indication unit 303R were located as the left position indication unit 303L and the right position indication unit 303R move. In this case, as shown by the arrow Fd in FIG. 11(A), it can be detected that the foot position indication device 300 moves in the forward direction, which is the extension direction of a line extending from the heel to the toe. Also, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement in the forward direction, that is, the amount of movement in the direction in which the value increases on the y axis.

[0095] In addition, if the image processing device 700 regards the amount of movement as the amount of movement per unit time, the amount of movement can be regarded as the speed because "speed = distance / time." Therefore, the greater the amount of movement, the faster the speed of advancement. This is also a so-called joystick-like operation. For example, if the unit time is 1 second and the center of gravity G moves 10 cm in 1 second, it can be regarded as moving at a speed of 10 cm per second, that is, the moving speed is 10 cm / second, and this moving speed can be used for processing.

[0096] Conversely, let us assume that the left position designation unit 303L and the right position designation unit 303R move following the rear position designation unit 303C. In this case, the left position designation unit 303L and the right position designation unit 303R move to the same position as the rear position designation unit 303C, as the rear position designation unit 303C moves. Move backwards In this case, as shown by the arrow Bk in FIG. 11(A), it can be detected that the foot position indicating device 300 is moving in the backward direction, which is the extension direction of a line extending from the toe to the heel. Also, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement in the backward direction, that is, the amount of movement in the direction in which the value decreases on the y-axis. Also, as in the case of movement in the forward direction, the distance of the center of gravity G in the backward direction Movement amount It can also be used in the sense that it is the speed of movement in the backward direction (negative direction on the y-axis) per unit time.

[0097] Also, assume that the right position indication unit 303R moves following the left position indication unit 303L. Following in this case means that the right position indication unit 303R moves to the left where the left position indication unit 303L was located, as the left position indication unit 303L moves. In this case, as shown by the arrow Lf in FIG. 11(A), it can be detected that the foot position indication device 300 moves to the left in the direction intersecting the line extending from the heel to the toe. Also, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement to the left, that is, the amount of movement in the direction in which the value decreases on the x-axis. Also, similar to the case of movement in the forward direction, the amount of movement of the center of gravity G to the left can be considered and used as the speed of movement to the left (negative direction on the x-axis) per unit time.

[0098] Conversely, it is assumed that the left position indication unit 303L moves following the right position indication unit 303R. Following in this case means that the left position indication unit 303L moves to the right direction where the right position indication unit 303R was located as the right position indication unit 303R moves. In this case, as shown by the arrow Rt in FIG. 11(A), it can be detected that the foot position indication device 300 moves to the right direction, which is the direction intersecting with the line extending from the heel to the toe. Also, the distance from the position on the position detection sensor 201 where the center of gravity G was located before the movement to the position on the position detection sensor 201 where the center of gravity G is located after the movement corresponds to the amount of movement to the right, that is, the amount of movement in the direction in which the value increases on the x-axis. Also, similar to the case of movement in the forward direction, the amount of movement of the center of gravity G to the right can be used as the speed of movement to the right (positive direction on the x-axis) per unit time.

[0099] In this manner, in the foot position detection device 400 of this embodiment, first, a position indication coordinate system is specified from the positions of the three position indication units 303L, 303R, and 303C. Next, the center of the movable range restriction area 402 of the operation surface 401 is set as the origin O of the reference coordinate system, and the X-axis and Y-axis of the reference coordinate system are specified based on the x-axis and y-axis of the position indication coordinate system. In the reference coordinate system specified in this manner, it is detected how far the foot position indication device 300 has moved in each of the forward direction Fd, backward direction Bk, left direction Lf, and right direction Rt. The amount of movement in this case is determined by how far the center of gravity G provided in the sole rear part 301b is from the origin O of the reference coordinate system. The movement direction and amount of movement of the foot position indication device 300 detected in this manner are sent to the image processing device 700. In another example, the amount of movement per unit time in each movement direction obtained as described above can be interpreted (regarded) as a movement speed per unit time and provided to the image processing device 700 for use.

[0100] <Inputting instructions through a foot input system> 12, 13, and 14 are diagrams for explaining the operation state of the foot input system of the second embodiment and the display image of the head mounted display. As described above, in the foot input system of this embodiment, when the foot position indicator 300 is moved back and forth or left and right on the operation surface 401 of the foot position detection device 400, the direction and amount of movement are supplied to the image processing device 700. Therefore, the image processing device 700 can change the three-dimensional space image displayed on the display of the HMD 500 according to the direction and amount of movement from the foot position detection device 400.

[0101] In the second embodiment, the amount of movement of the center of gravity G from the origin O is the amount of movement per unit time, and the movement speed per unit time specified from this amount of movement per unit time is reflected in the system. Simply put, the amount of movement (distance) displaced from the origin is considered to be the movement speed per unit time. Therefore, when the center of gravity G of the foot position indicating device 300 is displaced forward by r (+r), the image can be changed to move forward at a speed moving a distance r per unit time. Furthermore, when the center of gravity G is displaced forward by 2r (+2r), the image can be changed to move forward at a speed moving a distance 2r per unit time. Furthermore, when the center of gravity G of the foot position indicating device 300 is returned to the origin O, the movement distance becomes 0, and the change in the image stops.

[0102] Similarly, by displacing the center of gravity G of the foot position indicating device 300 backward by r (-r), the image can be changed to move backward at a speed of moving a distance r per unit time. Furthermore, by displacing the center of gravity G of the foot position indicating device 300 to the right by l (+l), the image can be changed at a speed of moving a distance l to the right per unit time. Furthermore, by displacing the center of gravity G of the foot position indicating device 300 to the left by l (-l), the image can be changed at a speed of moving a distance l to the left per unit time. In this way, the direction and speed of image change can be changed according to the displacement of the center of gravity G from the origin O.

[0103] 12, the foot position indicating device 300 is placed on an operation surface 401 of a foot position detection device 400, and the movable range restricting plate 304 on the underside of the sole rear part 301b of the foot position indicating device 300 is located within a movable range restricting area 402 on the operation surface 401. Therefore, in all of FIGS. 12(A), (B), and (C), the left position indicating unit 303L, the right position indicating unit 303R, and the rear position indicating unit 303C provided on the foot position indicating device 300 are located within the movable range restricting area 402.

[0104] Fig. 12(B) shows a case where the foot position indicating device 300 is in the initial position (home position) on the operation surface 401. Accordingly, it shows a case where the center of gravity G of an isosceles triangle formed by three position indicating units 303L, 303R, and 303C provided on the sole rear part 301b of the foot position indicating device 300 and the center (origin) O of the movement range restriction area 402 are approximately aligned. In this state, it is assumed that a three-dimensional space image including trees and clouds as subjects is displayed on the display HDP of the HMD 500 worn on the user's head, as shown in Fig. 12(B).

[0105] 12(B) to 12(C), the foot position indicating device 300 is moved forward while in contact with the operation surface 401. In this case, the position detection circuit 202 of the foot position detection device 400 Movement direction The amount of movement based on the center of gravity G is detected and supplied to the image processing device 700. In this case, the direction of movement is the forward direction (the extension direction of a line extending from the heel to the toe), and the amount of movement is the distance from the origin O to the center of gravity G in the positive direction of the Y axis of the reference coordinate system. Also, as described above, the movement speed per unit time can be grasped from the movement amount per unit time, so that the forward movement is at a movement speed according to the movement amount per unit time.

[0106] In this case, the image processor 703 of the image processor 700 determines that the forward movement of the foot position indicator 300 is an input for instructing the user to enlarge the three-dimensional space image, and performs processing to display the three-dimensional space image on the display HDP so as to continue enlarging it according to the amount or speed of the movement. Enlarging the three-dimensional space image means that as the viewpoint gradually advances, the subject gradually comes closer and appears larger, and the image changes to a more detailed three-dimensional space image. In other words, the image is enlarged so that a forest that was seen far away gradually comes closer as the user moves forward, and the trees appear larger, and if the user continues moving forward, the user enters the forest and the details of the forest become visible.

[0107] 12(B) to the state shown in FIG. 12(A), the foot position indicating device 300 is moved backward while in contact with the operation surface 401. In this case, the position detection circuit 202 of the foot position detection device 400 Movement direction The amount of movement based on the center of gravity G is detected and supplied to the image processing device 700. In this case, the direction of movement is the backward direction (the extension direction of a line extending from the toe to the heel), and the amount of movement is the distance from the origin O to the center of gravity G in the negative direction of the Y axis of the reference coordinate system. Even in this case, the movement speed per unit time can be determined from the movement amount per unit time, so that the backward movement is at a movement speed according to the movement amount per unit time.

[0108] In this case, the image processing unit 703 of the image processing device 700 determines that the backward movement of the foot position indicating device 300 is an input for instructing to reduce the three-dimensional spatial image, and processes the display HDP to display the three-dimensional spatial image so as to continue to reduce it according to the amount or speed of the movement. Reducing a three-dimensional spatial image means that, contrary to enlargement, the viewpoint gradually recedes, causing the subject to gradually move away and appear smaller, and eventually to disappear. In other words, reductionFor example, the display process goes like this: you start out seeing the details of a forest, then you leave the forest and gradually move away from it, so that the trees that appeared large start to look smaller, and eventually the forest and the trees that made up the forest become invisible.

[0109] If the foot position indicating device 300 does not move forward or backward on the operation surface 401, the direction and amount of movement are not detected by the foot position detection device 400 and are not supplied to the image processing device 700. Therefore, as shown in Fig. 13, even if the toe side of the foot position indicating device 300 is rotated, the three-dimensional spatial image displayed on the display HDP does not change. In other words, even if the foot position indicating device 300 is rotated counterclockwise (Fig. 13(A)) or clockwise (Fig. 13(C)) from the state in which it is in the initial position (home position) (Fig. 13(B)), the three-dimensional spatial image displayed on the display HDP does not change.

[0110] However, even if the foot position indicator 300 does not move forward or backward on the operation surface 401, the HMD 500 attached to the user's head can be operated in the same manner. teeth , head rotation Along with If the HMD 500 is rotated, the three-dimensional spatial image on the display HDP changes. That is, as shown in Fig. 14, even if the foot position indicating device 300 does not move at all, if the HMD 500 is rotated, the three-dimensional spatial image displayed on the display HDP changes. In all of Figs. 14(A), (B), and (C), the foot position indicating device 300 is in the initial position (home position).

[0111] In this state, when the user rotates his / her head counterclockwise by φ degrees (-φ), the rotation direction and rotation angle are supplied from the HMD 500 to the image processing device 700. In response, the image processing unit 703 forms a three-dimensional space image rotated counterclockwise by φ degrees, as shown in Fig. 14(A), and displays this on the display HDP. Conversely, when the user rotates his / her head clockwise by φ degrees (+φ), the rotation direction and rotation angle are supplied from the HMD 500 to the image processing device 700. In response, the image processing unit 703 forms a three-dimensional space image rotated clockwise by φ degrees, as shown in Fig. 14(C), and displays this on the display HDP.

[0112] In the case of the foot input system of this embodiment, the foot position indicating device 300 is placed on the operation surface 401 of the foot position detection device 400, and moved left or right while it is placed thereon. In this case, the direction and amount of movement are supplied to the image processing device 700. This makes it possible to shift the viewpoint position left or right in the three-dimensional space image displayed on the display HDP of the HMD 500. In this case, shifting the three-dimensional space image left or right does not mean shifting the viewing direction, as in the case of rotating the HMD 500, but means shifting the user's position in the three-dimensional space image. Viewpoint position means to shift to the left or right.

[0113] For example, suppose that the foot position indicating device 300 is moved leftward on the operation surface 401. In this case, the image processing unit 703 of the image processing device 700 forms a three-dimensional space image that is seen when the user's viewpoint position in the three-dimensional space image is moved leftward, and displays this on the display HDP. Similarly, suppose that the foot position indicating device 300 is moved rightward on the operation surface 401. In this case, the image processing unit 703 of the image processing device 700 forms a three-dimensional space image that is seen when the user's viewpoint position in the three-dimensional space image is moved rightward, and displays this on the display HDP.

[0114] 15 and 16 are diagrams for explaining instruction input in an image processing system configured using the foot input system of the second embodiment. As shown in Fig. 8, as shown in Fig. 15, the image processing device 700 can form a three-dimensional space image in a 360-degree image area GA. That is, the image processing device 700 can form an image (three-dimensional space image) with width, height, and depth over a 360-degree perimeter and display this on the display HDP of the HMD 500.

[0115] In this case, as shown by the arrows R1 and R2 in Fig. 15, the orientation of the 360-degree image area GA can be changed according to the orientation of the HMD 500. Also, as shown by the double-headed arrows around the movable range restriction area 402 shown on the bottom in Fig. 15, the three-dimensional space image displayed on the display HDP of the HMD 500 can be enlarged or reduced by moving the foot position indicating device 300 forward or backward.

[0116] For example, consider a case where the 360-degree image area GA is divided into, for example, six areas GA1, GA2, GA3, GA4, GA5, and GA6 as shown in Fig. 16. In this case, which area of ​​the three-dimensional space image is displayed on the display HDP of the HMD 500 can be switched according to the orientation of the HMD 500, as shown by the arrows on each area. Also, the three-dimensional space image of the displayed area can be enlarged or reduced by moving the foot position indicating tool 300 placed on the operation surface 401 of the foot position detecting device 400 forward or backward, as shown by the double-headed arrows around the movable range restriction area 402 of the foot position detecting device 400.

[0117] 15 and 16, a three-dimensional space image can be formed when the viewpoint position in the three-dimensional space image is moved left or right by moving left or right the foot position indicating tool 300 placed on the operation surface 401 of the foot position detection device 400. The three-dimensional space image is formed by the image processing unit 703 of the image processing device 700 and is supplied to the HMD 500 so as to be displayed on the display HDP.

[0118] Fig. 17 is a diagram for explaining a method of detecting an instruction input in the foot input system of the second embodiment. Fig. 17(A), (C), and (E) show the operation surface 401 of the foot position detection device 400 and the movement states of the position instruction units 303L, 303R, and 303C of the foot position indication device 300 which are moved and operated on the operation surface 401. Fig. 17(B) shows the orientation of the foot position indication device 300 located on the operation surface 401 in Fig. 17(A), and Fig. 17(D) shows the orientation of the foot position indication device 300 located on the operation surface 401 in Fig. 17(C) and (E).

[0119] As described above, in the second embodiment, the reference coordinate system defined on the operation surface 401 of the foot position detection device 400 has the center of the operation surface 401 as the origin O. The directions of the X-axis and Y-axis of the reference coordinate system are determined by the x-axis and y-axis of the position indication coordinate system determined by the three position indication units 303L, 303R, and 303C of the foot position indication device 300. Therefore, when the foot position indication device 300 is placed on the operation surface 401 in the manner shown in Fig. 17(B), the isosceles triangle formed by the position indication units 303L, 303R, and 303C is located at position P0 in Fig. 17(A).

[0120] Therefore, the reference coordinate system (origin O, X-axis, Y-axis) and the position indication coordinate system (origin G, x-axis, y-axis) coincide with each other. In this case, the foot position indication device 300 is moved forward, and the isosceles triangle formed by the position indication units 303L, 303R, and 303C is moved to position P1. Since this is a forward movement, it is interpreted as moving at a speed of moving distance + r per unit time, and the three-dimensional space image is allowed to continue to be enlarged. Also, it is assumed that the foot position indication device 300 is moved backward, and the isosceles triangle formed by the position indication units 303L, 303R, and 303C is moved to position P2. In this case, since this is a backward movement, it is interpreted as moving at a speed of moving distance - r per unit time, and the three-dimensional space image is allowed to continue to be reduced.

[0121] Also, suppose that the foot position indication device 300 is moved to the left, and the isosceles triangle formed by the position indication units 303L, 303R, and 303C is moved to position P3. In this case, since it is a leftward movement, it is interpreted as moving at a speed of moving distance -l per unit time, and the viewpoint continues to move to the left in the three-dimensional space. Also, suppose that the foot position indication device 300 is moved to the right, and the isosceles triangle formed by the position indication units 303L, 303R, and 303C is moved to position P4. In this case, since it is a rightward movement, it is interpreted as moving at a speed of moving distance +l per unit time, and the viewpoint continues to move to the right in the three-dimensional space.

[0122] Also, as shown in Fig. 17(C) and (D), it is assumed that the sole front part 301f of the foot position indicating device 300 is rotated around the sole rear part 301b. In this case, the reference coordinate system (origin O, X-axis, Y-axis) rotates according to the position indicating coordinate system (origin G, x-axis, y-axis). Therefore, as shown in Fig. 17(C), the reference coordinate system (origin O, X-axis, Y-axis) and the position indicating coordinate system (origin G, x-axis, y-axis) coincide with each other. In this state, when the foot position indicating device 300 is moved forward, backward, left, or right, an instruction input similar to that described using Fig. 17(A) and (B) can be performed.

[0123] Also, as described with reference to Figs. 17(A), (B) and Figs. 17(C) and (D), it is assumed that the center of gravity G does not move on the X-axis or Y-axis of the reference coordinate system, but moves to a position away from both the X-axis and the Y-axis as shown in Fig. 17(E). The foot position detection device 400 can grasp the movement distance n from the origin as a movement of +r in the Y-axis direction and -l in the X-axis direction on the reference coordinate system. In this case, the image processing device 700 can perform a process of continuously enlarging the three-dimensional spatial image so as to move toward the left front.

[0124] Therefore, when a so-called joystick, which has been used as an input device in the past, is tilted forward, for example, it is possible to enlarge the displayed image at a speed corresponding to the tilt angle. Specifically, the image can be changed such that when the joystick is tilted slightly, the image changes slowly, and when the joystick is tilted greatly, the image changes quickly. A similar instruction input can be performed using the foot input system. Of course, the foot input system can be used to input instructions similar to those input when tilting the joystick in various directions to change the displayed image, in addition to enlarging the image.

[0125] In the second embodiment, the reference coordinate system defined on the operation surface 401 of the foot position detection device 400 has the center of the operation surface 401 as the origin O. The directions of the X-axis and Y-axis of the reference coordinate system are determined by the x-axis and y-axis of the position indication coordinate system determined by the three position indication units 303L, 303R, and 303C of the foot position indication device 300. In this way, by detecting how the center of gravity G of the foot position indication device 300 moves in the determined reference coordinate system and detecting the speed of the movement, it is possible to flexibly enlarge or reduce the three-dimensional spatial image and move the viewpoint to the left or right.

[0126] [Effects of the embodiment] In the image processing system of the above-described embodiment, the viewing direction can be changed by rotating the HMD 500, and the three-dimensional spatial image can be changed accordingly. In addition, by using the foot input system, the three-dimensional spatial image can be enlarged, reduced, moved left, or moved right by moving the foot position indicating device 300 forward, backward, left, or right on the operation surface 401 of the foot position detection device 400.

[0127] This allows flexible input of instructions using the foot input system. Also, in order to avoid any difference in sensation between the changing three-dimensional space image and the user's body movements, the user can input various information to the image processing device using the user's feet to change the displayed three-dimensional space image. In this way, it is possible to avoid any difference in sensation between the changing three-dimensional space image and the user's body movements, and therefore it is possible to suppress the user from experiencing symptoms such as so-called VR sickness.

[0128] [Variations] <Variations in the placement of position indicator units> In the above-mentioned first embodiment, a case where the position indication unit 101U is provided on the sole front part 101, and the position indication unit 103U is provided on the sole rear part 103 is described. In the second embodiment, a case where the left position indication unit 303L, the right position indication unit 303R, and the rear position indication unit 303C are provided on the sole rear part 301b is described. However, this is not limited to this. There are various variations in the way the position indication units are provided.

[0129] FIG. 18 is a diagram for explaining variations in the installation position of the position indication unit (position indication signal transmitter) of the foot position indication device, with the upper side of the diagram being the toe side (sole front part) and the lower side being the heel side (sole rear part). The foot position indication device 300A in FIG. 18(A) has two position indication units 303F, 303B provided in the longitudinal direction of the sole rear part. By providing two position indication units 303F, 303B in the longitudinal direction of the foot position indication device 300A in this way, a position indication coordinate system is formed in which the straight line connecting these two position indication units 303F, 303B is the y-axis and the straight line perpendicular to the y-axis is the x-axis, and the movement direction can be specified.

[0130] The amount of movement can be calculated as the distance to the origin O using either the position indicating unit 303F or the position indicating unit 303B as a reference, or using the midpoint of the line segment connecting the position indicating unit 303F and the position indicating unit 303B as a reference. In addition, the position on the foot position indicating device 300A specified according to the positions of either or both of the position indicating unit 303F and the position indicating unit 303B can be used as a reference for calculating the amount of movement.

[0131] The foot position indicating device 300B in Fig. 18(B) shows a case where two position indicating units 306F, 306B are provided in the longitudinal direction on the front part of the sole. Therefore, the foot position indicating device 300A in Fig. 18(A) and the foot position indicating device 300B in Fig. 18(B) differ in that the position indicating unit is provided on the heel side or the toe side. However, in the case of the foot position indicating device 300B shown in Fig. 18(B), a position indicating coordinate system can be formed to specify the direction of movement and detect the amount of movement in the same manner as in the case of the foot position indicating device 300A shown in Fig. 18(A).

[0132] The foot position indicator 300C in FIG. 18(C) has an isosceles triangle on the front part of the sole. To form, 18(C) shows a case where three position indicating units 306L, 306R, and 306C are provided. Therefore, the foot position indicating device 300 of the second embodiment described using Figs. 9, 11, etc. and the foot position indicating device 300C of Fig. 18(C) differ in that the position indicating unit is provided on the heel side or the toe side. However, in the case of the foot position indicating device 300C shown in Fig. 18(C), a position indicating coordinate system can be formed to specify the direction of movement and detect the amount of movement in the same manner as in the case of the foot position indicating device 300 of the second embodiment described using Figs. 9, 11, etc.

[0133] FIG. 18(D) shows a foot position indicator 300D in which four position indicator units 303L, 303R, 303F, and 303B are provided to form a quadrangle at the rear of the sole. In this case, a position indicator coordinate system is formed in which the straight line connecting the position indicator units 303F and 303B is the y-axis and the straight line connecting the position indicator units 303L and 303R is the x-axis, and the movement direction can be specified. In this example, the movement amount can be calculated as the distance from the origin O to the center of the quadrangle formed by the position indicator units 303L, 303R, 303F, and 303B as the reference. In addition, the position in the foot position indicator 300D specified according to the positions of one or more of the position indicator units 303L, 303R, 303F, and 303B can be used as the reference for calculating the movement amount.

[0134] Fig. 18(E) shows a foot position indicating device 300E in which three position indicating units 303L, 303R, and 303C are provided at the rear of the sole to form an isosceles triangle, and one position indicating unit 306 is provided at the front of the sole. Fig. 18(F) shows a foot position indicating device 300F in which three position indicating units 303L, 303R, and 303C are provided at the rear of the sole to form an isosceles triangle, and two position indicating units 306L and 306R are provided at the front of the sole.

[0135] In the case of these foot position indicating devices 300E and 300F, a position indicating coordinate system can be formed to specify the direction of movement and detect the amount of movement in the same manner as in the case of the foot position indicating device 300 of the second embodiment described using Figures 9, 11, etc. Furthermore, the foot position indicating devices 300E and 300F are provided with position indicating units at the rear and front parts of the sole.

[0136] 5, it is possible to obtain the height h and angle θ by lifting the front part of the sole (toe side) while keeping the rear part of the sole (heel side) in contact with the operation surface 401. Conversely, it is possible to obtain the height h and angle θ by lifting the rear part of the sole (heel side) while keeping the front part of the sole (toe side) in contact with the operation surface 401. In other words, the height h can be detected according to the voltage level of the signal transmitted from the position indication unit at the position detection sensor 201.

[0137] In the case of the foot position indicating device 300E, the angle θ can be obtained based on the obtained height h and the distance l (L) from the center of gravity G of an isosceles triangle formed by the three position indicating units provided at the rear of the sole to the position indicating unit 306. In the case of the foot position indicating device 300F, the angle θ can be obtained based on the obtained height h and the distance l (L) from the center of gravity G of an isosceles triangle formed by the three position indicating units provided at the rear of the sole to the position indicating unit 306. By unit It can be found based on the distance l from the center of gravity G of the formed isosceles triangle to the midpoint between position indication units 306L and 306R.

[0138] By supplying the height h and angle θ thus obtained to the image processing device 700, various image processing can be performed in the image processing device 700. For example, by lifting the front part of the sole, a three-dimensional spatial image can be enlarged, and by lifting the rear part of the sole, a three-dimensional spatial image can be reduced. In addition, by lifting the front part of the sole, the viewpoint position in the three-dimensional spatial image can be moved upward, and by lifting the rear part of the sole, the viewpoint position in the three-dimensional spatial image can be moved downward, enabling vertical movement processing of the viewpoint position that displays the three-dimensional spatial image that is seen in that case.

[0139] The latter process of moving the viewpoint up and down enables the user to climb or descend within the three-dimensional space image. Therefore, when the user moves the head wearing the HMD 500 so as to look up or down, the viewing direction is changed without changing the viewpoint position. 3D space imageIn this way, by supplying the height h and angle θ that can be detected by raising and lowering the front part of the sole or the rear part of the sole to the image processing device 700, new image processing using this becomes possible.

[0140] It should be noted that variations in the installation position of the position indication unit (position indication signal transmitter) of the foot position indication device are not limited to those shown in Fig. 18. It is possible to provide the position indication unit in various modes that can form a position indication coordinate system consisting of y-axis and x-axis and can detect the amount of movement of the foot position indication device 300. Therefore, the position indication units may be arranged to form a triangle, a square, or a polygon such as a pentagon or hexagon.

[0141] In addition, in each of the foot position indicating devices 300A to 300F shown in Fig. 18, the position indicating units transmit transmission signals of different frequencies. In this case, the foot position detection device 400 knows which position indicating unit is provided where and which frequency of transmission signal it transmits, and is able to distinguish and detect the positions indicated by each position indicating unit.

[0142] Also, two position indication units arranged to form an isosceles triangle may transmit transmission signals of the same frequency. Alternatively, multiple position indication units may be provided and the transmission of the position indication signal may be switched in a time-division manner in a predetermined order to indicate the position. In this case, therefore, there is no need to change the frequency of the transmission signal for each position indication unit. In this case, it can be recognized as being located at both ends of the base, and the direction in which it is provided can also be recognized by the position indication units located at the vertices.

[0143] <Continued expansion and contraction> In the above embodiment, the three-dimensional spatial image is enlarged or reduced depending on the moving direction and the moving amount. However, it is also possible to enlarge or reduce the image more flexibly. For example, suppose that the foot position indicating device 300 is moved forward and the movable range restricting plate 304 of the foot position indicating device 300 engages with the ring-shaped convex portion 403 of the operation surface 401, and the device cannot move. Even in this case, by stepping on the sole rear portion 301b, the pressing force can be detected in the position indicating unit and supplied to the image processing device 700 via the foot position detecting device 400.

[0144] Therefore, the image processing device 700 can continue to enlarge the three-dimensional space image when the pressure from the foot position indicating device 300 is equal to or greater than a certain value, and can stop the enlargement of the three-dimensional space image when the pressure falls below the certain value. Similarly, it is assumed that the foot position indicating device 300 is moved backward and the movable range restricting plate 304 of the foot position indicating device 300 engages with the ring-shaped convex portion 403 of the operation surface 401 and cannot move. In this case, the image processing device 700 can continue to reduce the three-dimensional space image when the pressure from the foot position indicating device 300 is equal to or greater than a certain value, and can stop the reduction of the three-dimensional space image when the pressure falls below the certain value.

[0145] Here, the pressure value from the position indication unit of the foot position indication device 300 is used, but the present invention is not limited to this. For example, the foot position indication device 300 may be moved forward and the three-dimensional spatial image may be continued to be enlarged until it is shifted to a retreating movement. Similarly, the foot position indication device 300 may be moved backward and the three-dimensional spatial image may be continued to be reduced until it is shifted to a forward movement. In this case, the foot position indication device 300 is moved forward and the three-dimensional spatial image is enlarged to a desired state, and then the foot position indication device 300 is moved backward slightly. This makes it possible to stop the enlargement of the three-dimensional spatial image. Similarly, the foot position indication device 300 is moved backward and the three-dimensional spatial image is reduced to a desired state, and then the foot position indication device 300 is moved forward slightly. This makes it possible to stop the reduction of the three-dimensional spatial image.

[0146] <Configuration of foot positioning device> The configuration of the foot position indicating device 300 is not limited to the above configuration. It is sufficient if it can be worn on the user's foot in the same way as so-called footwear such as slippers, sandals, sneakers, etc., and can be equipped with a position indicating unit. In this case, it is preferable that the middle part of the sole connecting the front part of the sole and the rear part of the sole is formed of a flexible material. As described above, this is to facilitate operations such as lifting the toe side while keeping the heel side in contact with the operation surface 401, or lifting the heel side while keeping the toe side in contact with the operation surface 401.

[0147] In the case of the foot position indicating device 300 of the second embodiment described above, the toe side belt holders 301L, 301R and the heel side belt holders 302L, 302R are provided, and the foot position indicating device 300 is attached to the foot of the user by a belt passing through these. However, this is not limited to this. A holder that covers the upper part of the toe part may be provided in advance, as in slippers or sandals, or a holder that covers the side of the foot and the upper part of the toe part may be provided, as in general shoes such as sneakers.

[0148] <Mode setting> In the above-described embodiment, the first mode is a mode that allows the image to be enlarged or reduced and the viewpoint to be moved left or right by moving the foot position indicator 300 forward, backward, left, or right. In this way, the occurrence of symptoms such as so-called VR sickness can be suppressed by changing the three-dimensional spatial image by operating the foot. In addition, the second mode is a mode that allows only the image to be enlarged or reduced by moving the foot position indicator 300 forward or backward. In this case, the occurrence of VR sickness can be further suppressed. Therefore, it is possible to use the modes appropriately, such as a user who is unlikely to suffer from VR sickness using the first mode, and a user who is likely to suffer from VR sickness using the second mode.

[0149] <Using flat coils> Coils for the resonant circuit that can be used in the foot position indicating device 100, 300 include a cylindrical coil formed by winding an insulated conductor in a spiral shape and a flat coil formed into a thin shape by winding an insulated conductor in a spiral shape, for example. Since the cylindrical coil often has a height of, for example, 10 mm or more, it is considered to place it along the outer edge of the sole (bottom of a shoe) of the foot position indicating device 100, 300, such as the part around the heel or the part around the toes of the user of the foot position indicating device 100, 300. This is because if a cylindrical coil is placed on the sole of the foot position indicating device 100, 300, the sole becomes thick.

[0150] In contrast, in the case of a flat coil, the thickness is as thin as, for example, a few millimeters, so that the thickness of the sole part can be suppressed even if the flat coil is placed on the sole part of the foot position indicating device. In addition, in the case of a flat coil, the magnetic flux is less likely to change due to tilt, so it is easier to obtain a signal with less fluctuation in response to physical movements. Therefore, as a more specific modified example of the foot position indicating device, a foot position indicating device 800 configured by placing a flat coil on the sole part of the sole part will be described.

[0151] Fig. 19 is a diagram for explaining a foot position indicating device 800 configured using a flat coil. In Fig. 19, Fig. 19(A) is a diagram of the foot position indicating device 800 when viewed obliquely from above, and Fig. 19(B) is a diagram of the foot position indicating device 800 when viewed obliquely from below. As shown in Fig. 19(A), the foot position indicating device 800 includes a substantially rectangular sole part 801 and belt holding parts 802a, 803a, 802b, and 803b on each of the long sides of the sole part 801. Furthermore, a movable range restricting convex part 804 and a movable range recognition board 805 are provided on the back surface (lower surface) of the sole part 801.

[0152] The portion consisting of the sole part 801, the belt holding parts 802a, 803a, the belt holding parts 802b, 803b is integrally formed from a flexible and crack-resistant material such as polycarbonate ABS resin, which is a thermo-reversible resin that combines the characteristics of polycarbonate resin and ABS resin. In each of the belt holding parts 802a, 803a, and the belt holding parts 802b, 803b, the triangular opening is a hole for passing the heel fixing band, and the elongated opening below it is a hole for passing the instep fixing band. As shown in FIG. 19(A), the belt holding part 802a and the belt holding part 802b are mirror symmetrical. Also, the belt holding part 803a and the belt holding part 803b are mirror symmetrical. As a result, as described later, the foot position indicator 800 can be worn on the user's foot regardless of the front, back, left, or right orientation.

[0153] 19(A) shows the movable range restricting convex portion 804 and the movable range recognition plate 805 in a state before being attached to the sole portion 801. As described later, these are to be attached to the back surface of the sole portion 801. The movable range restricting convex portion 804 and the movable range recognition plate 805 are formed using a material with good abrasion resistance and slipperiness, such as polyacetal (POM) resin. As shown in FIG. 19(A), the movable range recognition plate 805 has a predetermined thickness, and is provided with two fixing recesses for coils or the like, each of which is made up of a circular recess and a rectangular recess.

[0154] A flat coil 806a and a circuit board 807a are fitted into one of the coil fixing recesses of the movable range recognition board 805, and a flat coil 806b and a circuit board 807b are fitted into the other coil fixing recess. Circuit boards 807a, 807b are each mounted with circuit components such as a capacitor, and one resonant circuit is formed by the flat coil 806a and the circuit board 807a, and the other resonant circuit is formed by the flat coil 806a and the circuit board 807a. In this way, two resonant circuits are mounted on the movable range recognition board 805. The resonant circuit formed by the flat coil 806a and the circuit board 807a and the other resonant circuit are formed by the flat coil 806a and the circuit board 807a. 806b and circuit board 807bThe resonant circuit configured with the resonator has a different resonant frequency.

[0155] 19(B), the movable range restricting convex portion 804 is fixed to one end of the rear surface of the sole portion 801, and the movable range recognition board 805 is fixed to the other end of the rear surface of the sole portion 801. The movable range restricting convex portion 804 engages, for example, with the outer edge of the operation surface of the foot position detection device 400, making it possible to recognize the range of the operation surface 401 of the foot position detection device 400. The movable range recognition board 805 has a resonant circuit mounted therein that functions as a position indication unit, and realizes the function of issuing position indications to the foot position detection device 400.

[0156] Fig. 20 is a diagram for explaining a foot position indicating device 800 configured using a flat coil, showing the foot position indicating device 800 as viewed from the top (front surface). For this reason, a movable range restricting convex portion 804, a movable range recognition board 805, etc. attached to the back surface of a sole portion 801 are shown by dotted lines. In the foot position indicating device 800, the flat coils 806a and 806b are arranged so that their centers are located on the center line of the sole portion 801, which is shown by a dotted line with an arrow. This arrangement corresponds to the arrangement shown in Figs. 18(A) and (B).

[0157] As a result, when the foot position indicating device 800 is moved back and forth or left and right on the foot position detection device 400, a position corresponding to the movement can be indicated by transmitting and receiving a magnetic field between the flat coils 806a, 806b and the foot position detection device 400. Therefore, the foot position indicating device 800 can be used on the foot position detection device 400 in the same manner as the foot position indicating device 300 of the second embodiment described above.

[0158] Fig. 21 is a diagram for explaining a manner of attaching foot position indicator 800 to the foot of a user. As shown in Fig. 19(A) and Fig. 20 and described above, belt holding part 802a and belt holding part 803a are mirror symmetrical, and belt holding part 802b and belt holding part 803b are mirror symmetrical. Therefore, foot position indicator 800 can be fixed to the foot of a user regardless of the front-back, left-right orientation of the user's foot.

[0159] That is, as shown in Fig. 21(A), it can be fixed to the user's foot with the movable range restricting convex portion 804 on the toe side and the movable range recognition plate 805 on the heel side. Also, as shown in Fig. 21(B), it can be fixed to the user's foot with the movable range restricting convex portion 804 on the heel side and the movable range recognition plate 805 on the toe side. Also, it can be fixed to either the left or right foot of the user in the same way.

[0160] As described with reference to Figures 21(A) and (B), foot position indicating device 800 can be attached in different orientations relative to the user's foot. In this case, the orientation of foot position indicating device 800, i.e., which of flat coil 806a and flat coil 806b is located on the front side (toe side) and which is located on the rear side (heel side) relative to the user's foot, is set in software. Simply put, when movable range recognition board 805 is located on the toe side, flat coil 806a is positioned on the foot. 806a When the movable range recognition board 805 is located on the heel side, the flat coil 806b can be set to be located on the rear side and the flat coil 806a can be set to be located on the front side with respect to the foot.

[0161] 20, the flat coils 806a and 806b are arranged so that their centers are located on the center line of the sole part 801. That is, the flat coils 806a and 806b are arranged in front and behind the longitudinal direction of the sole part 801. For this reason, for example, as shown in FIG. 21(A), when the foot position indicating device 800 is worn so that the movable range recognition board 805 is located on the heel side of the user's foot, the user lifts the toe without removing the heel side from the operation surface 401 of the foot position detecting device 400.

[0162] In this case, the magnetic field (signal) from the flat coil 806b located further back in the foot remains strong, but the magnetic field (signal) from the flat coil 806a located further forward in the foot becomes weak, or the magnetic field (signal) becomes undetectable. Since the foot position detection device 400 can detect whether the magnetic field is strong, weak, or undetectable, this can be applied to, for example, the input operation of a button switch function. That is, when the foot position indication device 800 is attached to the foot of a user in the manner shown in FIG. 21(A), it becomes possible to perform processing according to the operation of turning the switch on when the toe is lifted and turning the switch off when the toe is lowered. More specifically, it becomes possible to perform processing according to the operation of jumping when the toe is lifted.

[0163] Similarly, as shown in FIG. 21(B), when the foot position indicator 800 is attached so that the movable range recognition board 805 is located on the toe side of the user's foot, the heel is raised without removing the toe from the operation surface 401 of the foot position detection device 400. In this case, the magnetic field (signal) from the flat coil 806b located further forward of the foot remains strong, but the magnetic field (signal) from the flat coil 806a located further back of the foot becomes weaker or cannot be detected. Therefore, when the foot position indicator is attached to the user's foot in the manner shown in FIG. 21(B), it is possible to perform processing according to the action of switching on when the heel is raised and switching off when the heel is lowered. More specifically, it is possible to perform processing according to the action of jumping when the heel is raised (when the toe is stood on).

[0164] Also, it is possible to estimate how much the toes or heels are raised according to the difference in strength of the magnetic field (signal) between the flat coil 806a and the flat coil 806b, determine the depression angle or elevation angle, and change the displayed image. Even when using a flat coil, it is possible to arrange the flat coil in the manner shown in Fig. 18(C) to (F) as well as the manner shown in Fig. 18(A) and (B).

[0165] In the case of the foot position indicating device 800 described with reference to Figures 19 to 21, a resonant circuit is formed by connecting a capacitor to each of the flat coils 806a and 806b. However, this is not limited to this. Furthermore, it is of course possible to form a position indicating unit of the aspect described with reference to Figure 3 by further connecting a pressure sensor in parallel to the resonant circuit formed by the flat coil and the capacitor, and use this.

[0166] In addition, the above-mentioned foot position indication device 800 is configured with two resonant circuits with different resonant frequencies. 、 The number of resonance frequencies scanned on the foot position detection device 400 side can be set to two. In other words, the number of resonance frequencies to be detected can be reduced compared to a foot position indication device equipped with three or more resonance circuits with different resonance frequencies, so the scan rate can be improved and indication position information can be obtained more frequently.

[0167] In addition, by adjusting the length of the belt passed through the belt holders 802a, 802b and the belt holders 803a, 803b, it is also possible to adjust the positions of the movable range regulating convex portion 804 and the movable range recognition plate 805 with respect to the sole of the user's foot. This makes it possible to attach the foot position indicating device 800 to the foot in a manner that each user finds easy to use. In other words, the usability of the foot position indicating device can be improved for each user.

[0168] Alternatively, the toe side including belt holding part 802 of foot position indicating device 800 may be removed, and the heel part composed of belt holding part 803 and movable range recognition board 805 may be placed on the arch of the sole. In other words, the foot position indicating device may be simplified further to be composed of belt holding part 803 and movable range recognition board 805.

[0169] <Other Modifications> In the second embodiment, an instruction is issued to the image processing device 700 to change the three-dimensional space image displayed on the HMD 500, but this is not limiting. As in the first embodiment, when changing the image displayed on the display DP, the foot input system consisting of the foot position indicating tool 300 and the foot position detection device 400 of the second embodiment can also be used.

[0170] Reference coordinate system 10(A), the origin O is described as being fixed at the center of a circular movable range restriction area 402 provided on the operation surface 401 of the foot position detection device 400, but is not limited to this. For example, consider a case where a foot input system consisting of the foot position indicating tool 300 and the foot position detection device 400 of the second embodiment described above is used.

[0171] In this case, the position indication coordinate system is specified according to the positions of the position indication units 303L, 303R, and 303C, as described above. Then, the sole rear part 301b is pressed, and the position of the center of gravity G when a pressure of a predetermined value or more is detected by one or more of the position indication units 303L, 303R, and 303C is set as the origin O. After that, when the pressure related to the position indication units 303L, 303R, and 303C is reduced and the player moves forward, backward, left, or right, it is possible to detect in which direction and how much the center of gravity G has moved from the specified origin O in the specified position indication coordinate system. Therefore, in this example, the sole rear part 301b is pressed, and the position of the center of gravity G can be set as the origin O every time a pressure of a predetermined value or more is detected by one or more of the position indication units 303L, 303R, and 303C.

[0172] In the above-mentioned second embodiment, the HMD500 has been described as being equipped with a display HDP and a six-axis sensor, but the present invention is not limited thereto. The HMD500 may be equipped with a camera function, and may capture an image in the direction in which the user wearing the HMD500 on his / her head is facing, and may supply the image processing device 700 with the image processing device 700. In this case, the image processing device 700 may form three-dimensional space image data by performing image processing such as adding an image of an avatar to the captured image from the HMD500, and may supply the three-dimensional space image data to the HMD500 for display. In this way, the HMD500 may display a three-dimensional space image corresponding to the three-dimensional image data formed by processing an image captured in real time through a camera mounted on the HMD500.

[0173] As can be seen from the above description of the embodiment, the foot position indicator in the claims The features are: The functions of the sole part, the sole front part, and the sole rear part in the claims are realized by the sole part 301, the sole front part 301f, and the sole rear part 301b in the embodiments. The functions of the position indication signal transmission part in the claims are realized by the position indication units 303L, 303R, 303C, etc. in the embodiments.

[0174] The functions of the claimed foot position detection device are realized by foot position detection device 400 and the like in the embodiments. The functions of the claimed position detection sensor are realized by position detection sensor 201 in the embodiments, and the functions of the claimed detection circuit are realized by position detection circuit 202 in the embodiments. The functions of the claimed operation surface are realized by operation surface 401 in the embodiments. The functions of the claimed attachment members are realized by the belts attached to belt holding portions 301L, 301R, 302L, 302R in the embodiments.

[0175] A series of methods for detecting the direction of movement performed by a foot input system consisting of the foot position indicating device 300 and foot position detection device 400 of the second embodiment described above and supplying the detected direction to an image processing device 700 is one embodiment of an instruction input method using a foot input system. [Explanation of symbols]

[0176] 100...foot position indicator, 101...front sole, 101U...position indicator unit, 101L...coil, 101C...capacitor, 101P...pressure sensor, 102...middle sole, 103...rear sole, 103U...position indicator unit, 103L...coil, 103C...capacitor, 103P...pressure sensor, 200...foot position detection device, 201...position detection sensor, 201X...X-axis direction loop coil group, X1 to X40...loop coils, 2 01Y... Y-axis direction loop coil group, Y1 to Y30... loop coils, 202... position detection circuit, 204... oscillator, 205... current driver, 206... selection circuit, 207 switching connection circuit, 208... receiving amplifier, 209... position detection circuit, 210... pressure detection circuit, 211... control unit, 300, 300A to 300F... foot position indicator, 301... sole portion, 301f... sole front portion, 301c... sole middle portion, 301b... sole rear portion, 301 L, 301R... toe side belt holding portion, 302... heel side fixing portion, 302L, 302R... heel side belt holding portion, 302a... bottom surface portion, 302SL, 302SR... sole holding portion, 303L... left position indication unit, 303R... right position indication unit, 303C... rear position indication unit, 303F, 303B... position indication unit, 306F, 306B... position indication unit, 306L, 306R, 306C... position indication unit, 304... movable range rule Control plate, G... center of gravity, 400... foot position detection device, 401... operation surface, 402... movable range restriction area, 403... ring-shaped convex portion, 404... recognition groove portion, 405... inner wall portion, 0... origin, 800... foot position indicator, 801... sole portion, 802a, 802b... belt holder, 803a, 803b... belt holder, 804... movable range restriction convex portion, 805... movable range recognition panel, 806a, 806b... flat coil, 807a, 807b... circuit board

Claims

1. A foot input system comprising a foot position indicating device attached to a user's foot and a foot position detection device that detects a position indicated by the foot position indicating device, and supplies a detection output from the foot position detection device to an image processing device, The foot position indicator comprises: A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; At least one position indication signal transmitting unit is provided on each of the sole front portion and the sole rear portion, each transmitting a position indication signal with a different frequency; Equipped with The foot position detection device includes: a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, the position detection sensor receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; A foot input system comprising:

2. A foot input system comprising a foot position indicating device attached to a user's foot and a foot position detection device that detects a position indicated by the foot position indicating device, and supplies a detection output from the foot position detection device to an image processing device, The foot position indicator comprises: A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; two or more position indication signal transmitters are arranged in a longitudinal direction of the sole portion on at least one of the sole front portion and the sole rear portion, each transmitting a position indication signal with a different frequency; Equipped with The foot position detection device includes: a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, the position detection sensor receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; A foot input system comprising:

3. A foot input system comprising a foot position indicating device attached to a user's foot and a foot position detection device that detects a position indicated by the foot position indicating device, and supplies a detection output from the foot position detection device to an image processing device, The foot position indicator comprises: A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; a position indication signal transmitter provided at each of the vertices of a polygon on at least one of the sole front portion and the sole rear portion, the position indication signal transmitter transmitting a position indication signal having a different frequency; Equipped with The foot position detection device includes: a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, the position detection sensor receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; A foot input system comprising:

4. 4. A foot input system according to claim 1, 2 or 3, A detection circuit of the foot position detection device detects a movement to the left of the extension line before the movement in a direction intersecting with the extension line extending from the heel side portion of the sole portion toward the toe side portion based on an output signal from the position detection sensor, and detects a movement to the right of the extension line before the movement as a leftward movement, and detects a movement to the right of the extension line before the movement as a rightward movement.

1. A foot input system comprising:

5. 5. A foot input system according to claim 1, 2, 3 or 4, comprising: A detection circuit of the foot position detection device detects the amount of movement of the indicated position specified by the position indication signal based on the output signal from the position detection sensor.

1. A foot input system comprising:

6. 4. A foot input system according to claim 1, 2 or 3, The foot position detection device includes: A circular operation surface is disposed on the rectangular position detection sensor.

1. A foot input system comprising:

7. 4. A foot input system according to claim 1, 2 or 3, The detection circuit of the foot position detection device converts the position indicated by the position indication signal into polar coordinates and outputs the polar coordinates.

1. A foot input system comprising:

8. 4. A foot input system according to claim 1, 2 or 3, The front and rear sole portions of the foot position indicator are connected by a connecting member made of a flexible material.

1. A foot input system comprising:

9. 4. A foot input system according to claim 1, 2 or 3, The foot position indicator has attachment members attached to the front and rear sole portions for attachment to the user's foot.

1. A foot input system comprising:

10. A foot position indicating device of a foot input system, comprising: a foot position indicating device to be worn on a user's foot; and a foot position detection device that detects a position indicated by the foot position indicating device, and a detection output from the foot position detection device is supplied to an image processing device, A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; At least one position indication signal transmitting unit is provided on each of the sole front portion and the sole rear portion, each transmitting a position indication signal with a different frequency; Equipped with In the foot position detection device, based on the position indication signal from the position indication signal transmission unit, movement of the sole part in a direction along the longitudinal center axis of the sole part, in the extension direction of a line extending from the heel side part to the toe side part, is detected as forward movement, and movement of the sole part in the extension direction of the line extending from the toe side part to the heel side part is detected as backward movement.

11. A foot position indicating device of a foot input system, comprising: a foot position indicating device to be worn on a user's foot; and a foot position detection device that detects a position indicated by the foot position indicating device, and a detection output from the foot position detection device is supplied to an image processing device, A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; two or more position indication signal transmitters are arranged in a longitudinal direction of the sole portion on at least one of the sole front portion and the sole rear portion, each transmitting a position indication signal with a different frequency; Equipped with In the foot position detection device, based on the position indication signal from the position indication signal transmission unit, movement of the sole part in a direction along the longitudinal center axis of the sole part, in the extension direction of a line extending from the heel side part to the toe side part, is detected as forward movement, and movement of the sole part in the extension direction of the line extending from the toe side part to the heel side part is detected as backward movement.

12. A foot position indicating device of a foot input system, comprising: a foot position indicating device to be worn on a user's foot; and a foot position detection device that detects a position indicated by the foot position indicating device, and a detection output from the foot position detection device is supplied to an image processing device, A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; a position indication signal transmitter provided at each of the vertices of a polygon on at least one of the sole front portion and the sole rear portion, the position indication signal transmitter transmitting a position indication signal having a different frequency; Equipped with In the foot position detection device, based on the position indication signal from the position indication signal transmission unit, movement of the sole part in a direction along the longitudinal center axis of the sole part, in the extension direction of a line extending from the heel side part to the toe side part, is detected as forward movement, and movement of the sole part in the extension direction of the line extending from the toe side part to the heel side part is detected as backward movement.

13. A foot input system including a foot position indicating device attached to a user's foot and a foot position detection device that detects a position indicated by the foot position indicating device, the foot position detection device supplying a detection output from the foot position detection device to an image processing device, The foot position indicating device comprises a sole portion having a sole front portion located on the toe side of the sole and a sole rear portion located on the heel side of the sole, and a position indication signal transmitter that transmits a position indication signal, wherein the position indication signal transmitter is provided at least one on each of the sole front portion and the sole rear portion, and each is configured to transmit the position indication signal of a different frequency, or two or more position indication signal transmitters are provided lined up in the longitudinal direction of the sole portion for at least one of the sole front portion and the sole rear portion, and each is configured to transmit the position indication signal of a different frequency, or are provided at each vertex of a polygon for at least one of the sole front portion and the sole rear portion, and each is configured to transmit the position indication signal of a different frequency, a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, the position detection sensor receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; A foot position detection device comprising:

14. 1. A pointing position input method using a foot input system comprising a foot position indicating device attached to a user's foot, the foot position indicating device comprising a sole portion having a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole, a position indicating signal transmitting portion for transmitting a position indicating signal, and a foot position detecting device for detecting a position indicated by the foot position indicating device, the method supplying a detection output from the foot position detecting device to an image processing device, The position indication signal transmitter of the foot position indication device is provided at least one each on the sole front portion and the sole rear portion, and is configured so that each transmits the position indication signal of a different frequency; alternatively, two or more are provided lined up in the longitudinal direction of the sole portion on at least one of the sole front portion and the sole rear portion, and are configured so that each transmits the position indication signal of a different frequency; or, alternatively, are provided at each vertex of a polygon on at least one of the sole front portion and the sole rear portion, and are configured so that each transmits the position indication signal of a different frequency; In the foot position indicating device, a position indication signal transmitting step of transmitting the position indication signal from the position indication signal transmitting unit Have In the foot position detection device, a position indication signal receiving step of receiving the position indication signal from the position indication signal transmitting unit through a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, and outputting the position indication signal for each of the plurality of electrodes; a detection process in which a detection circuit detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the length of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects a movement of the sole part in the direction of the line extending from the toe side part to the heel side part, as a backward movement, and supplies a detection result to the image processing device as an instruction input; 13. A method for inputting a pointing position using a foot input system comprising:

15. An image processing system comprising: an image processing device; and a foot input system including a foot position indicating device attached to a user's foot and a foot position detection device for detecting a position indicated by the foot position indicating device; The foot position indicating device of the foot input system includes: A sole portion including a front sole portion located on the toe side of the sole and a rear sole portion located on the heel side of the sole; a position indication signal transmitting unit for transmitting a position indication signal; Equipped with the position indication signal transmitters are provided at least one each on the sole front portion and the sole rear portion, and are configured to transmit the position indication signals of different frequencies, or two or more are provided lined up in the longitudinal direction of the sole portion on at least one of the sole front portion and the sole rear portion, and are configured to transmit the position indication signals of different frequencies, or are provided at each vertex of a polygon on at least one of the sole front portion and the sole rear portion, and are configured to transmit the position indication signals of different frequencies, The foot position detection device of the foot input system includes: a position detection sensor configured by arranging a plurality of electrodes at predetermined intervals in each of a first direction and a second direction intersecting the first direction, the position detection sensor receiving the position indication signal from the position indication signal transmitter and outputting the position indication signal for each of the plurality of electrodes; a detection circuit that detects, based on an output signal from the position detection sensor, a movement of the sole part in a direction along a central axis of the longitudinal direction of the sole part, the direction of a line extending from the heel side part to the toe side part, as a forward movement, and detects, based on an output signal from the position detection sensor, a movement of the sole part in the direction of a line extending from the toe side part to the heel side part, as a backward movement; Equipped with The image processing device performs enlargement processing of the display image when the detection output from the foot position detection device indicates a forward movement of the sole part, and performs reduction processing of the display image when the detection output indicates a backward movement of the sole part.

1. An image processing system comprising:

16. 16. The image processing system according to claim 15, The image processing device continues to enlarge or reduce the display image in response to a displacement of the designated position indicated by a detection output from the foot position detection device.

1. An image processing system comprising:

17. 16. The image processing system according to claim 15, a detection circuit of the foot position detection device, based on an output signal from the position detection sensor, detects a leftward movement when the sole part moves to the left of the extension line before the movement in a direction intersecting with the extension line extending from the heel side part of the sole part toward the toe side part, without changing the positional relationship between the sole front part and the sole rear part, and detects a rightward movement when the sole part moves to the right of the extension line before the movement, without changing the positional relationship between the sole front part and the sole rear part; The image processing device shifts the display image to the left when the detection output from the foot position detection device indicates a leftward movement of the sole part, and shifts the display image to the right when the detection output indicates a rightward movement of the sole part.

1. An image processing system comprising:

18. 18. The image processing system according to claim 17, The image processing device continues to shift the display image to the left or to the right in response to a displacement of the designated position indicated by a detection output from the foot position detection device.

1. An image processing system comprising:

19. An image processing system according to any one of claims 15, 16, 17 and 18, The image processing device can form and provide a 360-degree three-dimensional spatial image centered on the user on a head-mounted display that is mounted on the user's head so that the user can view the image, and can change the three-dimensional spatial image according to the orientation of the head-mounted display, and can change the displayed image according to the detection output from the foot position detection device.

1. An image processing system comprising:

Images