Input devices

The input device addresses the challenge of ensuring visibility and accuracy of position and orientation tracking by employing multiple tracking points strategically arranged on its outer surface, enhancing tracking accuracy across various orientations.

JP7657949B2Active Publication Date: 2025-04-07SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023549225
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-22
Publication Date
2025-04-07
Estimated Expiration
2041-09-22

AI Technical Summary

Technical Problem

Existing input devices with a single tracking point on the outer surface face challenges in ensuring visibility and accuracy of position and orientation tracking, especially when the device is oriented in a way that the tracking point is not directly visible to the camera.

Method used

The proposed input device features a plurality of tracking points arranged at intervals on its outer surface, including on an extension portion, upper, and lower portions, ensuring visibility and allowing for accurate calculation of position and orientation. The tracking points are strategically arranged to maintain a sufficient distance between them and to be visible from various orientations.

Benefits of technology

This configuration ensures that a sufficient number of tracking points are visible to the camera, improving the accuracy of position and orientation tracking, even when the device is oriented in a way that would obscure a single tracking point.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007657949000001
    Figure 0007657949000001
  • Figure 0007657949000002
    Figure 0007657949000002
  • Figure 0007657949000003
    Figure 0007657949000003
Patent Text Reader

Abstract

An input device (600) has: an upper part (620) that has a front surface (621a) on which operation members (13), (16), (17) are disposed; and an extension part (640) that extends along a plane including the front surface (621a) and is provided with a plurality of tracking points (H). It is thus easy to ensure that the tracking points (H) are visible to a camera. It is also possible to simplify the structure of a member constituting the outer appearance shape of the input device.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to input devices whose position and orientation are tracked through a camera during use. [Background technology]

[0002] There is a technology for tracking the position and orientation of an input device by providing a light-emitting tracked point on the outer surface of the input device and detecting the tracked point through a camera. Patent Document 1 below discloses an input device for game operation provided with a spherical tracked point. The input device in Patent Document 1 is photographed by a camera attached to a television, for example, and the position and orientation of the input device are calculated from the image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-164932 A Summary of the Invention [Problem to be solved by the invention]

[0004] Unlike Patent Document 1, a system is being considered in which multiple tracked points are arranged at intervals on the outer surface of an input device, and the positions of the multiple tracked points are detected through a camera to calculate the position and orientation of the input device. In such a system, it is important to ensure the visibility of the tracked points by the camera. [Means for solving the problem]

[0005] One example of an input device proposed in the present disclosure has a first portion having a front surface on which a plurality of tracked points, each of which emits light, and an operating member is located, and a second portion extending along a plane including at least a portion of the front surface and on which the plurality of tracked points are located.

[0006] This input device can ensure an area (surface area) for arranging the tracked points. As a result, a sufficient number of tracked points can be provided on the input device while ensuring the distance between two adjacent tracked points, and the visibility of the tracked points can be ensured. In addition, the direction in which the second portion extends is along a plane including the front surface on which the operating member is arranged, so that the structure of the members that make up the external shape of the input device can be simplified. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram for explaining an example of a system in which an input device proposed in the present disclosure is used. [Figure 2A] 1 is a front view showing a first example of an input device proposed in the present disclosure. [Figure 2B] FIG. 2 is a rear view showing a first example of an input device. [Figure 2C] FIG. 2 is a left view showing a first example of an input device. [Figure 2D] FIG. 2 is a right side view showing a first example of an input device. [Figure 2E] FIG. 1 is a plan view showing a first example of an input device. [Figure 2F] FIG. 2 is a bottom view showing a first example of an input device. [Figure 3A] FIG. 2 is a front view showing a second example of an input device proposed in the present disclosure. [Figure 3B] FIG. 11 is a rear view showing a second example of the input device. [Figure 3C] FIG. 13 is a left view showing a second example of the input device. [Figure 3D] FIG. 13 is a right side view showing a second example of the input device. [Figure 3E] FIG. 11 is a plan view showing a second example of the input device. [Figure 3F] FIG. 13 is a bottom view showing a second example of the input device. [Figure 4A] FIG. 11 is a front view showing a third example of an input device proposed in the present disclosure. [Figure 4B] FIG. 11 is a rear view showing a third example of the input device. [Figure 4C] FIG. 13 is a left view showing a third example of the input device. [Figure 4D] FIG. 13 is a right side view showing a third example of the input device. [Figure 4E] FIG. 13 is a plan view showing a third example of the input device. [Figure 4F] FIG. 13 is a bottom view illustrating a third example of the input device. [Figure 5A] FIG. 11 is a front view showing a fourth example of an input device proposed in the present disclosure. [Figure 5B] FIG. 13 is a rear view showing a fourth example of the input device. [Figure 5C] FIG. 13 is a left view showing a fourth example of the input device. [Figure 5D] FIG. 13 is a bottom view showing a fourth example of the input device. [Figure 6A] FIG. 13 is a front view showing a fifth example of an input device proposed in the present disclosure. [Figure 6B] FIG. 13 is a rear view showing a fifth example of the input device. [Figure 6C] FIG. 13 is a left view showing a fifth example of the input device. [Figure 6D] FIG. 13 is a right side view showing a fifth example of an input device. [Figure 6E] FIG. 13 is a plan view showing a fifth example of the input device. [Figure 6F] FIG. 13 is a bottom view showing a fifth example of the input device. [Figure 7A] FIG. 13 is a perspective view showing a sixth example of an input device proposed in the present disclosure. [Figure 7B] FIG. 7B is a front view of the input device shown in FIG. 7A. [Figure 7C]FIG. 7B is a side view of the input device shown in FIG. 7A. [Figure 7D] FIG. 7B is a plan view of the input device shown in FIG. 7A. [Figure 8A] FIG. 13 is a perspective view showing a seventh example of an input device proposed in the present disclosure. [Figure 8B] FIG. 8B is a front view of the input device shown in FIG. 8A. [Figure 8C] FIG. 8B is a diagram showing the front side of the input device shown in FIG. 8A. [Figure 9] 1A and 1B are diagrams illustrating examples of input devices having a loop portion. [Figure 10] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 11A] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 11B] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 12] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 13] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 14] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 15] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 16] 13A and 13B are diagrams illustrating yet another example of an input device having a loop portion. [Figure 17] FIG. 13 is a diagram illustrating yet another example of an input device. [Figure 18] FIG. 13 is a diagram illustrating yet another example of an input device. [Figure 19A] 13 is a side view showing yet another example of an input device having an umbrella portion. FIG. [Figure 19B] FIG. 19B is a perspective view of the input device shown in FIG. 19A. [Figure 20] FIG. 13 is a diagram showing an example of an input device having a sphere portion. [Figure 21]13A and 13B are diagrams illustrating yet another example of an input device having a sphere portion. [Figure 22] FIG. 1 is a front view of an example of an input device having an enlarged top portion. [Diagram 23] FIG. 13 is a side view illustrating yet another example of the input device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] An example of an input device proposed in this disclosure will be described below. In this specification, the directions indicated by Z1 and Z2 in Fig. 2A are referred to as upward and downward, respectively, the directions indicated by X1 and X2 in Fig. 2A are referred to as rightward and leftward, respectively, and the directions indicated by Y1 and Y2 in Fig. 2C are referred to as forward and backward, respectively. These directions are used to describe the relative positions of parts, members, elements, etc. that constitute the input device, and do not specify the attitude or manner of holding the input device when in use.

[0009] [System Overview] As shown in FIG. 1, the input device 100 is used together with, for example, a head mounted display (HMD) 2. A user wears the HMD 2 on his / her head and holds the input device 100 in his / her right and / or left hand. The HMD 2 has a camera 2a facing forward. The input device 100 is provided with a plurality of tracked points H, which will be described later. The positions of the tracked points H are detected through the camera 2a, and the position and orientation of the input device 100 (i.e., the position and orientation of the user's hand) are calculated based on the positions of the tracked points detected. The input device 100 has a plurality of operation members (e.g., operation buttons, operation sticks, touch sensors, etc.) that are operated by the user's fingers, as will be described later. A display unit of the HMD 2 displays the position and orientation of the input device 100, as well as a moving image (e.g., a game image) generated based on the operation performed on the operation members.

[0010] The calculation of the position and orientation of the input device 100 may be performed by an information processing device mounted on the HMD2, or may be performed by an external information processing device (for example, a game device or a personal computer separate from the HMD2). The input device 100 may have a motion sensor (for example, an acceleration sensor or a gyro sensor). The information processing device may calculate the position and orientation of the input device 100 based on not only the position of the tracked point H but also the output of the motion sensor. In addition, the generation of a moving image may be performed by an information processing device mounted on the HMD2, or may be performed by an external information processing device. When the calculation of the position of the input device 100 and the generation of the moving image are performed by an external information processing device, the image information acquired by the camera 2a is transmitted wirelessly or by wire to the external information processing device, and the generated moving image information is transmitted wirelessly or by wire from the external information processing device to the HMD2. Unlike the system illustrated in FIG. 1, the input device 100 may be used separately from the HMD2. In this case, a camera for tracking the position and orientation of the input device 100 may be attached to an external display device (e.g., a television or personal computer monitor) that displays moving images generated based on the position and orientation of the input device 100.

[0011] The outer shapes of the input device for the right hand and the input device for the left hand are symmetrical. The number and types of operation members arranged on the input device may be different between the left and right input devices. In this specification, the explanation will be centered on the input device for the right hand.

[0012] [Input device shape and operation parts] As shown in FIG. 2A, the input device 100 has a grip 11, an upper portion 20 located above the grip 11, and a lower portion 30 located below the grip 11. When a user holds the grip 11, the side of the grip 11 comes into contact with the user's palm, and the grip 11 is held by, for example, the ball of the foot, the middle finger, the ring finger, and the little finger. The upper portion 20 and the lower portion 30 are respectively connected to the ends of the grip 11. A plurality of operating members 13 to 16 are provided on the upper portion 20 and are located above the grip 11. The operating members 13 to 16 can be operated by, for example, the thumb or the index finger.

[0013] As shown in FIG. 2A, for example, an operation stick 13 and operation buttons 14-16 are arranged on the upper part 20 as operation members. The operation stick 13 and the operation buttons 14-15 are arranged on the front surface 21a of the upper part 20, and are operated, for example, by the thumb. The operation stick 13 is an operation member that can be tilted or slid in the radial direction. The operation button 16 is arranged on the rear side of the upper part 20 (see FIG. 2B), and is operated, for example, by the index finger. The operation members provided on the upper part 20 are not limited to the examples described here, and may be, for example, a touch sensor, a trigger button, or a button with a touch sensor. Furthermore, the number of operation members provided on the upper part 20 may be one, two, or four or more.

[0014] The input device 100 has an extension 40 that extends from one of the upper portion 20 and the lower portion 30 to the other and is separated laterally from the grip 11. In other words, the extension 40 is curved so as to bulge outward in the left-right direction, and the middle part of the extension 40 is separated from the grip 11. In the example of the input device 100, the middle part of the extension 40 is separated to the right from the grip 11. A space is provided between the middle part of the extension 40 and the grip 11 in which the user's right hand can be inserted. Both ends of the extension 40 are connected to the upper portion 20 and the lower portion 30, respectively, and the extension 40, the upper portion 20, the lower portion 30, and the grip 11 are generally annular.

[0015] [Tracking point] 2A, a plurality of tracked points H are arranged on the outer surface of the input device 100 (the tracked points are indicated by black circles in the figure). Each tracked point H emits light. As described below, the input device 100 has, for example, a light emitting diode (LED) as a light source for the tracked points H. A light source may be arranged at each position of the tracked points H, or the position of a light guide tube that guides light from the light source to the tracked points H (the position of the light exit surface of the light guide tube) may correspond to the position of the tracked points H.

[0016] In the example of the input device 100, as described below, tracked points H are arranged on each of the extending portion 40, the upper portion 20, the lower portion 30, and the grip 11. In this specification and drawings, the tracked points on the extending portion 40 are given the reference symbol H1, the tracked points on the upper portion 20 are given the reference symbol H2, the tracked points on the lower portion 30 are given the reference symbol H3, and the tracked points on the grip 11 are given the reference symbol H4. In the following description, which does not distinguish between the tracked points H1, H2, H3, and H4, the reference symbol H is used for the tracked points.

[0017] [Stretching part] As shown in FIG. 2D, the extension portion 40 has a plurality of tracked points H1 on its outer surface (here, the "outer surface" refers to the surface opposite to the grip 11 in the left-right direction). The tracked points H1 are distributed over the entire outer surface of the extension portion 40. This improves the accuracy of recognizing the position and orientation of the input device 100 through the camera 2a. The tracked points H1 are arranged in a plurality of rows in the vertical direction. In the example of the input device 100, the tracked points H1 are arranged in two rows. The position (height) of the tracked points H1 in the front row and the position (height) of the tracked points H1 in the rear row are different from each other. Specifically, the height of the tracked points H1 in the front row is approximately halfway between the heights of the two tracked points H1 in the rear row. This makes it difficult for the two tracked points H1 to overlap when viewed through the camera 2a. The arrangement of the tracked points H1 in the extending portion 40 is not limited to the example shown in the figure, and for example, the tracked points H1 may be arranged in a single row or in three or more rows.

[0018] [Top of input device] The upper part 20 has a plurality of tracked points H2 on its outer surface. As shown in FIG. 2A, the width W21 of the upper part 20 in the left-right direction is greater than the width W11 of the grip 11 when the input device 100 is viewed from the front. This ensures the number of tracked points H2 while concealing the distance between two adjacent tracked points H2. As a result, the accuracy of recognizing the position and orientation of the input device 100 through the camera 2a can be improved.

[0019] In the example of the input device 100, the upper part 20 has a left protruding part 20a that protrudes on the opposite side to the extending part 40. The left protruding part 20a protrudes leftward from the left side surface of the grip 11. This shape of the upper part 20 makes it easy to ensure the area of ​​the region where the tracked point H2 is placed. The upper part 20 also has a right protruding part 20b that protrudes rightward from the right side surface of the grip 11. The extending part 40 is connected to the right protruding part 20b. Unlike the example of the input device 100, the upper part 20 may have only one of the left protruding part 20a and the right protruding part 20b.

[0020] The width W21 of the upper portion 20 in the left-right direction (see FIG. 2A) is larger than the width W22 of the upper portion 20 in the front-rear direction (see FIG. 2C). This makes it easy to arrange a plurality of tracked points H2 in the left-right direction on the upper portion 20. In this description, the "width W22 of the upper portion 20 in the front-rear direction" corresponds to the distance from the front surface of the protrusions 20a and 20b to the rear surface of the protrusions 20a and 20b. In the example of the input device 100, the width W22 of the upper portion 20 in the front-rear direction is substantially the same as the width 12 of the grip 11 in the front-rear direction in a side view of the input device 100, or is smaller than the width W12 of the grip 11 in the front-rear direction (see FIG. 2C).

[0021] As shown in FIG. 2E, the upper part 20 has a front surface 21a on which a plurality of operation members 13-15 are arranged. A plurality of tracked points H2 are arranged along the edge of the front surface 21a. In the example of the input device 100, the upper part 20 has a substantially elliptical shape in a front view, and has a curved surface 21c between the edge of the front surface 21a and the edge of the rear surface 21b (the rear surface of the protrusions 20a-20b). The curved surface 21c has portions that constitute the left side surface, the top surface, and the right surface of the upper part 20. A plurality of tracked points H2 are arranged on the curved surface 21c, which are arranged in the left-right direction in a plan view. The tracked points H2 are arranged in a single row, for example, in a plan view of the input device 100.

[0022] The shape of the upper part 20 and the arrangement of the tracked points H2 are not limited to the shapes described here. For example, the upper part 20 may be rectangular or circular in a front view. The tracked points H2 may be arranged not only on the curved surface 21c, but also on the front surface 21a or rear surface 21b. The tracked points H2 may be arranged in two or three rows.

[0023] [Bottom of input device] The lower portion 30 has a plurality of tracked points H3 on its outer surface. Therefore, even if the input device 100 is placed in a position where the lower portion 30 faces the camera 2a, the position and orientation of the input device 100 can be recognized. As shown in FIG. 2C, the width W32 of the lower portion 30 in the front-rear direction is larger than the width W12 of the grip 11 in a side view of the input device 100. This ensures the number of tracked points H3 while concealing the distance between two adjacent tracked points H3. As a result, the accuracy of recognition of the position and orientation of the input device 100 through the camera 2a can be improved.

[0024] In the example of the input device 100, the lower part 30 has a rear protruding part 30a that protrudes rearward from the back surface 12b of the grip 11. This shape of the lower part 30 makes it easy to ensure the area of ​​the region in which the tracked point H3 is arranged. Unlike the input device 100, the lower part 30 may have a front protruding part that protrudes forward from the front surface 12a of the grip 11 instead of the rear protruding part 30a or in addition to the rear protruding part 30a.

[0025] The width W32 of the lower portion 30 in the front-rear direction (see FIG. 2C) is larger than the width W31 of the lower portion 30 in the left-right direction (see FIG. 2A). This makes it easy to align the tracked points H3 in the front-rear direction on the lower portion 30. In the example of the input device 100, the width W31 of the lower portion 30 in the left-right direction is substantially the same as the width W11 of the grip 11 in the left-right direction when viewed from the front of the input device 100, or is smaller than the width W11 of the grip 11 (see FIG. 2A).

[0026] As shown in Fig. 2C, the lower part 30 has a curved surface 31c extending from the front surface 12a of the grip 11 through the lower end of the input device 100 to the back surface 12b of the grip 11. The lower part 30 has a substantially elliptical shape in a side view of the input device 100, and the curved surface 31c has portions constituting the front surface, the lower surface, and the back surface of the lower part 30. The lower part 30 has tracked points H3 arranged on the curved surface 31c in the front-rear direction. The tracked points H3 are arranged so as to be visible in a side view of the input device 100. A tracked point H3 may also be arranged on the left side surface 31b of the lower part 30.

[0027] The shape of the lower portion 30 and the arrangement of the tracked point H3 are not limited to the shapes described here. For example, the lower portion 30 may be rectangular or circular in side view. The tracked point H3 may be arranged on the right side surface 31a of the lower portion 30.

[0028] [Top Orientation and Bottom Orientation] The width W21 of the upper portion 20 in the left-right direction (see FIG. 2A) is larger than the width W22 of the upper portion 20 in the front-rear direction (see FIG. 2C). On the other hand, the width W32 of the lower portion 30 in the front-rear direction (see FIG. 2C) is larger than the width W31 of the lower portion 30 in the left-right direction (see FIG. 2A). In this way, the upper portion 20 and the lower portion 30 have large widths in different directions. According to this input device 100, it is possible to make the direction in which the tracked points H2 are lined up in the upper portion 20 different from the direction in which the tracked points H3 are lined up in the lower portion 30. As a result, even if it is difficult to calculate the position and orientation of the input device 100 using the tracked points H2 in one portion (for example, the upper portion 20), it is possible to calculate the position and orientation of the input device 100 using the tracked points H3 in the other portion (for example, the lower portion 30), and the recognition accuracy of the orientation and position of the input device 100 can be improved.

[0029] The relationship between the width of the upper portion 20 and the width of the lower portion 30 is not limited to the example of the input device 100. The width W22 of the upper portion 20 in the front-rear direction may be larger than the width W21 of the upper portion 20 in the left-right direction, while the width W31 of the lower portion 30 in the left-right direction may be larger than the width W32 of the lower portion 30 in the front-rear direction. In still another example, the longitudinal direction of the lower portion 30 may not be the front-rear direction, but may be, for example, a direction inclined with respect to both the front-rear direction and the left-right direction. Similarly, the longitudinal direction of the upper portion 20 may not be the left-right direction, but may be, for example, a direction inclined with respect to both the front-rear direction and the left-right direction.

[0030] [Grip tracking points] In the example of the input device 100, the tracked point H4 is provided on the grip 11. As a result, even if the input device 100 is placed in a position where the outer surface of the grip 11 faces the camera 2a, the tracked point H4 on the grip 11 can be used to recognize the position and orientation of the input device 100, improving the recognition accuracy. As shown in FIG. 2A, the tracked point H4 is shifted to the left with respect to the center line C1 of the grip 11 that runs along the up-down direction (the center line C1 is a straight line that passes through the center of the grip 11 in the left-right direction and the front-back direction). As described above, the input device 100 shown in FIG. 2A etc. is a device for right-hand use. When the grip 11 is held with the right hand, the right side of the grip 11 is covered by the hand, while the left side of the grip 11 is partially exposed from the hand. Therefore, this arrangement of the tracked point H4 can prevent the tracked point H4 from being covered by the hand. Although the tracked point H4 is shifted to the left with respect to the center line C1, it may intersect with the center line C1. In an input device for a left hand, it is preferable that the tracked point H4 is shifted to the right with respect to the center line C1 passing through the center of the grip 11.

[0031] As shown in FIG. 2C, the tracked point H4 is offset forward from the center line C1 along the up-down direction. That is, the tracked point H4 is offset from the center line C1 in the direction in which the operating member protrudes. This arrangement of the tracked point H4 effectively prevents the tracked point H4 from being covered by the hand. The tracked point H4 is spaced forward from the center line C1 and does not intersect with the center line C1. The tracked point H4 is arranged so that it can be seen both when viewed from the front and from the side (left side) of the input device 100.

[0032] 2A, the tracked point H4 is located below the vertical center C3 of the grip 11. This arrangement of the tracked point H4 can more effectively prevent the tracked point H4 from being covered by the hand.

[0033] A plurality of tracked points H4 may be arranged on the grip 11. In this case, the number of tracked points H4 arranged on the grip 11 is less than the number of tracked points H2 arranged on the upper part 20, and is also less than the number of tracked points H3 arranged on the lower part 30. In the example of the input device 100, the two tracked points H4 are arranged apart in the up-down direction.

[0034] [light source] The light source of the tracked point H is, for example, a Light Emitting Diode (LED). The input device 100 has, for example, a plurality of substrates (not shown) on which LEDs are mounted. The substrate is, for example, a rigid substrate on which one or more LEDs are mounted. The rigid substrate is, for example, a paper phenol substrate, a paper epoxy substrate, a glass epoxy substrate, or the like. The rigid substrate is arranged so that the positions of the plurality of LEDs correspond to the positions of the plurality of tracked points H, respectively. The input device 100 may have a cover that forms its outer surface and covers the LEDs and the rigid substrate. The cover is a member that is entirely light-transmitting, or a member that is light-transmitting only at the position of the tracked point H. The light of the LED passes through the position of the tracked point H on the cover. The input device 100 may have a light-guiding member that guides the light of the LED to the position of the tracked point H on the cover.

[0035] As described later, the substrate on which the LEDs are mounted may be a flexible substrate. In this case, the input device 100 may have a frame, and the flexible substrate may be curved and disposed along the surface of the frame. The flexible substrate and the frame may then be covered by the cover described above.

[0036] [Second example] 3A to 3F are diagrams showing an input device 200 that is a second example of an input device. In the following explanation, the differences between the input device 100 and the input device 200 will be mainly described. For matters not explained regarding the structure of the input device 200, the structure of the input device 100 may be applied.

[0037] Similar to the input device 100, the input device 200 has a grip 211, an upper portion 220, a lower portion 230, and an extending portion 240. A plurality of tracked points H1 are provided on the extending portion 240, a plurality of tracked points H2 are provided on the upper portion 220, and a plurality of tracked points H3 are provided on the lower portion 230.

[0038] As shown in Fig. 3A, the width W21 of the upper part 220 in the left-right direction is greater than the width 11 of the grip 211 when the input device 200 is viewed from the front. Although the upper part 220 has a left protruding part 220a, unlike the example of the input device 100, it does not have a part that protrudes to the right beyond the right side surface of the grip 211. The width W21 of the upper part 220 in the left-right direction (see Fig. 3A) is greater than the width W22 of the upper part 220 in the front-rear direction (see Fig. 3C). In this description, "the width W22 of the upper part 220 in the front-rear direction" corresponds to the distance from the front surface of the protruding part 220a to the back surface of the protruding part 220a.

[0039] The input device 200 differs from the input device 100 in the attitude of the lower part. In detail, as shown in FIG. 3A, the width W31 of the lower part 230 in the left-right direction is larger than the width W11 of the grip 211 in a front view of the input device 200. The lower part 230 has a left protruding part 230a. The lower part 230 does not have a part protruding to the right from the right side surface of the grip 211. The width W31 of the lower part 230 in the left-right direction (see FIG. 3A) is larger than the width W32 of the lower part 230 in the front-rear direction (see FIG. 3C). Therefore, it is easy to align the tracked points H2 in the left-right direction on the lower part 230. Thus, in the example of the input device 200, the upper part 220 and the lower part 230 have a large width in the same direction (i.e., the left-right direction).

[0040] As in the input device 100, a tracked point H4 is disposed on the grip 211. The position of the tracked point H4 is the same as in the input device 100, and as shown in FIG. 3A, the tracked point H4 is shifted to the left with respect to the center line C1 along the up-down direction. Also, as shown in FIG. 3C, the tracked point H4 is shifted forward with respect to the center line C1 along the up-down direction. Furthermore, the tracked point H4 is located below the center of the grip 211 in the up-down direction. In the example of the input device 200, the number of tracked points H4 disposed on the grip 211 is one. The number of tracked points H4 may be two or more.

[0041] [Third example] 4A to 4F are diagrams showing input device 300, which is a third example of an input device. In the following explanation, the differences between input devices 100 and 200 and input device 300 will be mainly described. For matters not explained regarding the structure of input device 300, the structure of input devices 100 and 200 may be applied.

[0042] The input device 300 has a grip 311, an upper portion 320, and a lower portion 330. A plurality of tracked points H2 are provided on the upper portion 320, and a plurality of tracked points H3 are provided on the lower portion 330.

[0043] Unlike the input devices 100 and 200, the input device 300 does not have a portion corresponding to the extension portion 40 / 240 of the input devices 100 / 200. Therefore, the upper portion 320 and the lower portion 330 are connected only via the grip 311. The input device 300 has a plane P (see FIG. 3A ) that is perpendicular to the grip 311 and does not intersect with the input device 300 at any portion other than the grip 311. This shape of the input device 300 makes it possible to reduce the number of parts of the input device 300 (the number of parts that constitute the frame of the input device 300).

[0044] As shown in FIG. 4A, the width W21 of the upper portion 320 in the left-right direction is larger than the width W11 of the grip 311 in a front view of the input device 300. The upper portion 320 has a left protruding portion 320a protruding leftward from the left side surface of the grip 311 and a right protruding portion 320b protruding rightward from the right side surface of the grip 311. More specifically, the right protruding portion 320b protrudes obliquely to the right and upward. The width W21 of the upper portion 320 in the left-right direction (see FIG. 4A) is larger than the width W22 of the upper portion 320 in the front-rear direction (see FIG. 4C). Therefore, it is easy to line up the tracked points H2 in the left-right direction. In this description, the "width W22 of the upper portion 320 in the front-rear direction" corresponds to the distance between the front surface of the protruding portions 320a and 320b and the back surface of the protruding portions 320a and 320b. Also, as shown in FIG. 4C, the width W22 of the upper portion 320 in the front-rear direction is substantially the same as or smaller than the width W12 of the grip 311 in the front-rear direction.

[0045] As shown in Figures 4A and 4B, the upper part 320 has a front surface 321a, a rear surface 321b, and a curved surface 321c. Unlike the example of the input device 100, in the input device 300, a plurality of tracked points H2 are arranged on each of the front surface 321a, the rear surface 321b, and the curved surface 321c. On the front surface 321a, a plurality of tracked points H2 (three tracked points H2) are arranged in the left-right direction. On the curved surface 321c, a plurality of tracked points H2 are also arranged in the left-right direction (see Figure 4). The rear surface 321b has two tracked points H2 arranged on opposite sides of the grip 311.

[0046] The front surface 321a has an area R1 (operation member area) where the multiple operation members 13-15 are arranged, and an area R2 (tracked area) where the multiple tracked points H2 are arranged. The tracked area R2 is an area (an area above the operation member area R1) farther from the grip 311 than the operation member area R1, and surrounds part of the outer edge of the operation member area R1. This makes it easier to ensure the area of ​​the tracked area R2, and therefore makes it easier to ensure the number of tracked points H2 to be arranged in the tracked area R2.

[0047] The front surface 321a has a step 321g formed between the operation member area R1 and the tracked area R2. This makes it possible for the step 321g to prevent the fingers operating the operation members 13 to 15 from overlapping the tracked point H2. The step 321g causes the front surface 321a to protrude forward in the tracked area R2 beyond the operation member area R1. This makes it possible for the step 321g to prevent the fingers operating the operation members 13 to 15 from entering the tracked area R2.

[0048] The tracked points H2 on the front surface 321a are arranged along the edge of the operation member region R1 so as to surround the operation member region R1. In the example shown in the figure, the front surface 321a has the tracked points H2 located on the upper side of the operation member region R1 and the tracked points H2 located on the right side of the operation member region R1. The step 321g is also formed so as to surround the operation member region R1. In detail, the step 321g also includes a portion located on the upper side of the operation member region R1 and a portion located on the right side of the operation member region R1. The arrangement of the tracked points H2 on the front surface 321a and the step 321g may be applied to other input devices disclosed in this specification.

[0049] As shown in FIG. 4A, the width W31 of the lower portion 330 in the left-right direction is larger than the width W11 of the grip 311 in a front view of the input device 300. The lower portion 330 has a left protruding portion 330a protruding leftward from the left side surface of the grip 311 and a right protruding portion 330b protruding rightward from the right side surface of the grip 311. The width W31 of the lower portion 330 in the left-right direction (see FIG. 4A) is larger than the width W32 of the lower portion 330 in the front-rear direction (see FIG. 4C). Therefore, it is easy to align the tracked points H3 in the left-right direction on the lower portion 230. Also, as shown in FIG. 4C, the width W32 of the lower portion 230 in the front-rear direction is larger than the width 12 of the grip 311 in the front-rear direction in a side view of the input device 100.

[0050] 4A to 4E, the lower portion 330 has a front surface 331a, a rear surface 331b, and a curved surface 331c. A plurality of tracked points H3 are arranged on each of the front surface 331a, the rear surface 331b, and the curved surface 331c. A plurality of tracked points H2 are arranged in two rows on the curved surface 331c.

[0051] [Example 4] 5A to 5F are diagrams showing an input device 400 that is a fourth example of an input device. In the following explanation, the differences between the input devices 100 to 300 and the input device 400 will be mainly described. For matters not explained regarding the structure of the input device 400, the structure of the input devices 100 to 300 may be applied.

[0052] 5A, the input device 400 has a grip 411, an upper part 420, and a lower part 430. A plurality of tracked points H are provided on each of the upper part 420 and the lower part 430. In addition, a tracked point H4 is also provided on the lower part of the grip 411.

[0053] As shown in FIG. 5A, the input device 400 has an extension portion 440 extending laterally from the upper portion 420. The extension portion 440 extends laterally from the upper portion 420 and curves downward. Unlike the example of the input device 100, the extension portion 440 does not reach the lower portion 430. Therefore, the input device 400 has a plane P (see FIG. 5A) that is perpendicular to the grip 411 and does not intersect with the input device 400 at any portion other than the grip 411. A plurality of tracked points H1 are disposed on the extension portion 440. The tracked points H1 are lined up in the left-right direction on the extension portion 440. The tracked points H1 may be lined up in a single row or in multiple rows.

[0054] Unlike the example shown in the figure, the input device 400 may have an extension extending laterally from the lower portion 430 instead of the extension portion 440 or together with the extension portion 440. In this case, the extension portion may extend laterally from the lower portion 430 and curve upward. The tracked point H4 may also be disposed on this extension portion.

[0055] [Fifth Example] 6A to 6F are diagrams showing an input device 500 which is a fifth example of an input device. In the following description, differences between the input devices 100 to 400 and the input device 500 will be mainly described. The structures of the input devices 100 to 400 may be applied to matters not described regarding the structure of the input device 500. Note that in FIGS. 6A to 6F, the cover constituting the outer surface of the input device 500 has been removed, and a frame disposed inside the cover and a flexible substrate 550 disposed along the frame are exposed.

[0056] The input device 500 has a grip 511, an upper part 520, and a lower part 530. A plurality of tracked points H are provided on each of the upper part 520 and the lower part 530.

[0057] The input device 500 also has an extension 540 that extends from one of the upper portion 520 and the lower portion 530 to the other and is spaced laterally from the grip 511. The extension 540 is curved so as to bulge outward in the left-right direction, and a middle portion of the extension 540 is spaced apart from the grip 511. Unlike the examples of the input devices 100 and 200, the middle portion of the extension 540 is spaced apart to the left from the grip 511. A plurality of tracked points H1 are arranged on the extension 540.

[0058] The input device 500 has a flexible substrate 550. A plurality of LEDs 551, which are light sources for the tracked point H, are mounted on the flexible substrate 550. The input device 500 has frames Fm2, Fm3, and Fm4. (In the following description, the frame is referred to as Fm in the description without distinguishing between the parts of the frame.) The frame Fm constitutes an upper portion 520, a lower portion 530, and an extension portion 540. The flexible substrate 550 is disposed along the frame Fm. In the example of the input device 500, the flexible substrate 550 extends from the upper portion 520 through the extension portion 540 to the lower portion 530. That is, the flexible substrate 550 has a portion 550a (see FIG. 6E) disposed in the frame Fm2 of the upper portion 520, a portion 550b (see FIG. 6F) disposed in the frame Fm3 of the lower portion 530, and a portion 550c (see FIG. 6C) disposed in the frame Fm4 of the extension portion 540. The plurality of LEDs 551 are disposed at the positions of the plurality of tracked points H, respectively. In this manner, all of the LEDs 551 disposed in the upper portion 520, the lower portion 530, and the extending portion 540 are mounted on one flexible substrate 550. This allows the number of components of the input device 500 to be reduced.

[0059] It should be noted that the number of flexible substrates 550 does not have to be one. For example, one flexible substrate may be disposed between upper portion 520 and extension portion 540, and another flexible substrate may be disposed between lower portion 530 and extension portion 540, and another flexible substrate may be disposed between upper portion 520.

[0060] 6C, the flexible substrate 550 has a plurality of protrusions 550s on which a plurality of LEDs 551 are respectively mounted, and a main extension 550A connecting the plurality of protrusions 550s. In the example of the input device 500, the main extension 550A extends from the upper portion 520 to the lower portion 530.

[0061] The protrusions 550s are formed on two edges of the main extension 550A that are located on opposite sides to each other. The protrusions 550s protrude from the edges of the main extension 550A toward the position of the tracked point H. This allows the flexible substrate 550 (in other words, the main extension 550A) to be thin, making it easy to curve the flexible substrate 550 to match the outer shape of the input device 500. The protrusions 550s are formed, for example, on the front edge and the rear edge of the main extension 550A that is disposed in the extension 540. The protrusions 550a formed on the front edge and the protrusions 550a formed on the rear edge are alternately arranged.

[0062] The main extension 550A and / or the protrusion 550s may be attached to the frames Fm2, Fm3, and Fm4, for example, by screws. A portion of the flexible substrate 550 is connected to a circuit board housed inside the input device 500. The frame of the input device 500 may have an opening through which a portion of the flexible substrate 550 passes toward the inside of the input device 500. In the example of the input device 500, an opening 522 is formed in the frame Fm of the upper portion 520, as shown in FIG. 6D.

[0063] As in the example of the input device 100, the upper portion 520 and the lower portion 530 have large widths in different directions. Specifically, the width W21 of the upper portion 520 in the left-right direction (see FIG. 6A) is larger than the width W22 of the upper portion 520 in the front-rear direction (see FIG. 6D). On the other hand, the width W32 of the lower portion 530 in the front-rear direction (see FIG. 6D) is larger than the width W31 of the lower portion 530 in the left-right direction (see FIG. 6A). Therefore, it is possible to make the direction in which the tracked points H2 are arranged in the upper portion 220 different from the direction in which the tracked points H3 are arranged in the lower portion 530. As shown in FIG. 6E, the portion 550a of the flexible substrate 550 (the portion along the upper portion 520) extends in the left-right direction along the curved surface 521c of the upper portion 520. As shown in FIG. 6F, the portion 550c of the flexible substrate 550 (the portion along the lower portion 530) extends in the front-rear direction along the curved surface 531c of the lower portion 530.

[0064] In the input device 500, the relationship between the width of the upper portion 520 and the width of the lower portion 530 is not limited to that described here. For example, similar to the input device 200, the upper portion 520 and the lower portion 530 may have a larger width in the same direction (for example, the left-right direction). In addition, the flexible substrate 550 may be applied to other examples of the input device (the input devices 100 to 400 described above).

[0065] [Example 6] 7A to 7D are diagrams showing an input device 600 that is a sixth example of an input device. In the following explanation, the differences between the input devices 100 to 500 and the input device 600 will be mainly described. For matters not explained regarding the structure of the input device 600, the structure of the input devices 100 to 500 may be applied.

[0066] As shown in Fig. 7A, the input device 600 has a grip 611 and an upper portion 620 located above the grip 611. When a user holds the grip 611, the side of the grip 611 comes into contact with the user's palm and is held by, for example, the ball of the foot, the middle finger, the ring finger, and the little finger. The upper portion 620 is located at the upper end of the grip 611. A plurality of operating members 13, 16, and 17 are provided on the upper portion 620 and are located above the grip 611. The operating members 13, 16, and 17 can be operated by, for example, the thumb or index finger.

[0067] As shown in FIG. 7B, the upper portion 620 has, for example, an operation stick 13 and operation buttons 16 and 17 as operation members. The operation stick 13 and the operation button 17 are arranged on a front surface 621a of the upper portion 620, and are operated, for example, by a thumb. The operation stick 13 is an operation member that can be tilted in a radial direction or slid. The operation button 17 has, for example, four buttons 17a to 17d located at the ends of a cross. The operation button 16 is arranged on the rear side of the upper portion 620 (see FIG. 7C), and is, for example, a trigger button operated by an index finger. The operation members provided on the upper portion 620 are not limited to the examples described here, and may be, for example, a touch sensor or a button with a touch sensor. The number of operation members provided on the upper portion 620 may be one.

[0068] 7D, one or more operation buttons 18a may also be provided on the grip 611. In the example of the input device 600, three operation buttons 18a aligned in the vertical direction are provided on the left side surface of the grip 611. These three operation buttons 18a can be operated by, for example, the middle finger, the ring finger, and the little finger.

[0069] As shown in FIG. 7A, the input device 600 has an extension portion 640. On the outer surface of the extension portion 640, a plurality of tracked points H, each of which emits light, are arranged (the tracked points are indicated by black circles in the figure). The extension portion 640 has a plurality of tracked points H arranged on a front surface 641a of the extension portion 640, a plurality of tracked points H arranged on a rear surface 641c of the extension portion 640 (see FIG. 7C), and a plurality of tracked points H arranged on a surface 641b (see FIG. 7C) between the front surface 641a and the rear surface 641c. The plurality of tracked points H are distributed and arranged throughout the extension portion 640. By using the extension portion 640, an area (surface area) for arranging the tracked points H can be secured. As a result, a sufficient number of tracked points H can be provided on the input device 600 while securing the distance between two adjacent tracked points H. This can improve the recognition accuracy of the attitude and position of the input device.

[0070] In the example of the input device 600, the tracked points H are provided only on the extension portion 640. Alternatively, the tracked points H may be provided, for example, on the outer surface of the upper portion 620 (including the front surface 621a) and / or the outer surface of the grip 611.

[0071] For example, a Light Emitting Diode (LED) is used as the light source of the tracked point H. The light source may be disposed at each position of the tracked point H. Alternatively, the light from the light source may be guided to the position of the tracked point H by a light guide tube.

[0072] The extension portion 640 extends along a plane P1 (see FIG. 7C) including the front surface 621a of the upper portion 620. More specifically, as shown in FIG. 7C, the front surface 621a of the upper portion 620 extends obliquely downward and backward from the upper end of the front surface 621a in a side view of the input device 600. The extension portion 640 also extends obliquely downward and backward from the upper end of the extension portion 640 in a side view of the input device 600. Therefore, compared to a mode in which the extension portion 640 extends in a direction perpendicular to the front surface 621a of the upper portion 620, for example, the structure of a member (housing) constituting the external appearance of the input device 600 can be simplified. For example, a member constituting the front surface 621a of the upper portion 620 and a member constituting the front surface 641a of the extension portion 640 can be integrated.

[0073] As shown in FIG. 7B, the extension portion 640 includes an arc-shaped portion extending in a direction along a plane P1 including the front surface 621a of the upper portion 620. In the example of the input device 600, the entire extension portion 640 is arc-shaped. This shape of the extension portion 640 makes it easy to ensure the length of the extension portion 640. As a result, it is easy to ensure an area (surface area) for arranging the tracked point H. Note that the front surface 621a of the upper portion 620 may be curved. In this case, the plane P1 may be a plane including only a part of the front surface 621a.

[0074] A protrusion 623 (see FIG. 7A) is formed at the upper end of the upper portion 620 (in other words, at the boundary between the front surface 621a and the extension portion 640). This protrusion 623 can prevent the user's finger from reaching the extension portion 640 and covering any of the tracked points H.

[0075] 7B, extension portion 640 is connected to the upper side of upper portion 620. Extension portion 640 has portion 640R extending to the right from upper portion 620, and portion 640L extending to the left from upper portion 620. (Hereinafter, portion 640R will be referred to as the right extension portion, and portion 640L will be referred to as the left extension portion.) In this way, extension portion 640 extends from upper portion 620 to both the right and left, making it even easier to ensure the length of extension portion 640.

[0076] As shown in FIG. 7B, in the example of the input device 600, each of the right extension portion 640R and the left extension portion 640L is arc-shaped. The right extension portion 640R extends from the upper portion 620 to the right and curves downward. The left extension portion 640L extends from the upper portion 620 to the left and curves downward. According to this shape of the right extension portion 640R and the left extension portion 640L, the length of the right extension portion 640R can be secured while suppressing the size in the left-right direction and the size in the up-down direction of the right extension portion 640R, and similarly, the length of the left extension portion 640L can be secured while suppressing the size in the left-right direction and the size in the up-down direction of the left extension portion 640L. In the example of the input device 600, the right extension portion 640R and the left extension portion 640L have a common center point C1. That is, the right extension portion 640R and the left extension portion 640L extend along an imaginary arc formed around one center point C1. The extension portion 640 is formed along the imaginary arc over 180 degrees or more.

[0077] 7B, in the example of the input device 600, neither the end 640e of the right extension portion 640R nor the end 640f of the left extension portion 640R is connected to the grip 611. Unlike the example of the input device 600, either the end 640e of the right extension portion 640R or the end 640f of the left extension portion 640R may be connected to the grip 611. For example, the end 640f of the left extension portion 640 may be connected to the grip 611.

[0078] 7C, the right extension portion 640R is formed so as to cover the right side surface of the upper portion 620. The right side surface 611a of the grip 611 is not covered by the right extension portion 640R. In other words, the position of the end portion 640e of the right extension portion 640R is higher than the right side surface 611a of the grip 611. Therefore, when the user grips the grip 611 with his / her right hand or releases the right hand from the grip 611, the right extension portion 640R of the extension portion 640 does not get in the way.

[0079] As shown in Fig. 7B, the left extension portion 640L is formed to cover the left side surface of the upper portion 620. In the example of the input device 600, the upper portion 620 has a protrusion 622 extending to the left. The protrusion 622 is connected to a middle portion of the left extension portion 640L. Therefore, the extension portion 640 is connected to the upper portion 620 at two positions. With this structure, the support strength of the extension portion 640 can be improved.

[0080] As shown in Fig. 7B, the left extension 640L is longer than the right extension 640R. The position of the end 640f of the left extension 640L is lower than the height of the upper end of the grip 11. As shown in Fig. 7A, the end 640f of the left extension 640L is located forward of the button 18a provided on the grip 611. Therefore, when the user holds the grip 611 with his / her right hand, the length of the left extension 640L can be sufficiently secured while preventing interference between the left extension 640L and the fingers of the right hand.

[0081] The shape of the extension portion 640 is not limited to the example of the input device 600. For example, the extension portion 640 may have a portion that extends linearly. The front surface 641a of the extension portion 640 and the front surface 621a of the upper portion 620 do not necessarily have to be located on a common plane P1. For example, the front surface 641a of the extension portion 640 may be located on a plane that is located forward of the plane P1 including the front surface 621a of the upper portion 620 and is parallel to the plane P1. As yet another example, the center point of the right extension portion 640R and the center point of the left extension portion 640L may be different.

[0082] [Example 7] 8A to 8C are diagrams showing an input device 700 that is a seventh example of an input device. In the following explanation, the differences between the input device 600 and the input device 700 will be mainly described. For matters not explained regarding the structure of the input device 700, the structures of the input device 600 and the other input devices 100 to 500 may be applied.

[0083] As shown in FIG. 8B, the input device 700 has a grip 711, an upper portion 720 on which a plurality of operation members 13, 16, 17 are provided, and an extension portion 740 on which a plurality of tracked points H are provided.

[0084] The extension 740 extends to the right from the upper portion 720 and curves downward. The end of the extension 740 is connected to the lower end of the grip 711. Therefore, the grip 711, the upper portion 720, and the extension 740 are generally annular. A user can insert his / her right hand between the extension 740 and the grip 711. This shape of the input device 700 can improve the strength and durability of the input device 700. In addition, the structure of the member (housing) that constitutes the exterior of the input device 700 can be simplified. Unlike the input device 100 described above, the input device 700 does not have a portion extending to the left from the upper portion 720.

[0085] Moreover, the extension portion 740 extends along a plane including the front surface 721a of the upper portion 720. The front surface 741a of the extension portion 740 exists on a common plane with the front surface 721a of the upper portion 720. In the example of the input device 700, the front surface 741a of the extension portion 740, the front surface 721a of the upper portion 720, and the front surface 711a of the grip 711 are located on a common plane. This makes it possible to further simplify the structure of the members (housing) that constitute the external appearance of the input device 700.

[0086] The entire extension portion 740 has an arc shape extending in a direction along the front surface 721a of the upper portion 720. This shape of the extension portion 740 makes it possible to ensure the length of the extension portion 740 while preventing the size of the extension portion 740 from increasing in the left-right direction.

[0087] Note that the shape of the input device 700 is not limited to the example shown in the figure, and for example, the extension portion 740 may extend in a direction intersecting a plane including the front surface 721a of the upper portion 720. The front surface 721a of the upper portion 720 may be curved. In this case, the extension portion 740 may extend along a plane including only a part of the front surface 721a.

[0088] [Other ideas] Fig. 9 is a diagram showing an input device 10A. Fig. 10 is a diagram showing an input device 10B. Figs. 11A and 11B are diagrams showing an input device 10C. The structural elements and features of the above-described input devices 100 to 700 may be combined into the structural features and features of the input devices 10A to 10C.

[0089] Each of the input devices 10A, 10B, and 10C has a grip 10gp, an upper portion 10u on which a plurality of operation members are provided, and an annular portion (extension) 10rg on which a plurality of tracked points H are provided.

[0090] In the input device 10A (see FIG. 9), the upper part 10u and the grip 10gp are disposed inside the annular part 10rg. The upper end of the upper part 10u is connected to the inner surface of the annular part 10rg, and the lower end of the grip 10gp is also connected to the inner surface of the annular part 10rg. The annular part 10rg is a circle centered on a center line Ax1. In the input device 10A, the center line Ax1 is a straight line along a plane perpendicular to the left-right direction.

[0091] In the input device 10B (see FIG. 10), the upper portion 10u and the grip 10gp are also disposed inside the annular portion 10rg. The upper end of the upper portion 10u is connected to the inner surface of the annular portion 10rg, and the lower end of the grip 10gp is also connected to the inner surface of the annular portion 10rg. The annular portion 10rg is a circle centered on a center line Ax2. In the input device 10B, the center line Ax2 is a straight line along the left-right direction.

[0092] In the input device 10C (see FIGS. 11A and 11B), the annular portion 10rg is a circle centered on a center line Ax3 (see FIG. 11A). In the input device 10C, the center line Ax3 is a straight line along a plane perpendicular to the left-right direction. In detail, the center line Ax3 is a line extending obliquely forward and upward. The lower end of the grip 10gp is connected to the inner surface of the annular portion 10rg. Unlike the input devices 10A and 10B, the upper end of the annular portion 10rg is spaced forward from the upper portion 10u.

[0093] Fig. 12 is a diagram showing an input device 20A. Fig. 13 is a diagram showing an input device 20B. Fig. 14 is a diagram showing an input device 20C. Fig. 15 is a diagram showing an input device 20D. Fig. 16 is a diagram showing an input device 20E. The structures and elements of the input devices 100 to 700 described above may be combined into the structures and gist of the input devices 20A to 20E.

[0094] Each of the input devices 20A to 20E has a grip 20gp, an upper portion 20u on which a plurality of operation members are provided, and an annular portion (extension portion) 20rg on which a plurality of tracked points H are provided.

[0095] In the input device 20A (see FIG. 12), the upper portion 20u is disposed outside the annular portion 20rg. More specifically, the annular portion 20rg is located above the upper portion 20u, and the upper portion 20u is connected to the outer surface (the lower side of the outer surface) of the annular portion 20rg. The annular portion 20rg is a circle centered on a center line Ax4. In the input device 20A, the center line Ax4 is a straight line along a plane perpendicular to the left-right direction. Specifically, the center line Ax4 is a line that extends obliquely upward and backward.

[0096] In the input device 20B (see FIG. 13), the upper portion 20u is also disposed outside the annular portion 20rg. More specifically, the annular portion 20rg is located above the upper portion 20u, and the upper portion 20u is connected to the outer surface of the annular portion 20rg. The annular portion 20rg is a circle centered on a center line Ax5. In the input device 20B, the center line Ax5 is a straight line along the left-right direction.

[0097] In the input device 20C (see FIG. 14), the upper portion 20u is disposed outside the annular portion 20rg. The annular portion 20rg is located in front of the upper portion 20u, and the upper portion 20u is connected to the outer surface (rear side of the outer surface) of the annular portion 20rg. The annular portion 20rg is a circle centered on a center line Ax6. In the input device 20C, the center line Ax6 is a straight line along the left-right direction.

[0098] In the input device 20D (see FIG. 15), the center line Ax7 is a straight line along a plane perpendicular to the left-right direction. Specifically, the center line Ax7 is a straight line along the approximately vertical direction. The annular portion 20rg is located above the upper portion 20u, and the upper portion 20u is connected to the front portion of the annular portion 20rg. The grip 20gp is located below the annular portion 20rg.

[0099] The input device 20E (see FIG. 16) has an annular portion 21rg in addition to the annular portion 20rg described above. The annular portion 21rg is located below the grip 20gp and is connected to the grip 20gp. The annular portion 21rg is a circle centered on a center line Ax8. In the input device 20E, the center line Ax8 is a straight line along the left-right direction. Moreover, the annular portion 20rg connected to the upper portion 20u is annular and centered on a center line Ax5 along the left-right direction, similar to the example of the input device 20B.

[0100] FIG. 17 is a diagram showing an input device 30A. The input device 30A has a grip 30gp, an upper portion 30u on which a plurality of operation members are provided, and an extension portion 30x on which a plurality of tracked points H are provided. The extension portion 30x is connected to the upper side of the upper portion 30u. The extension portion 30x is formed so as to cover the right side and the left side of the upper portion 30u. Specifically, the extension portion 30x has a right portion 30R that extends rightward from the upper portion 30u and curves downward, and a left portion 30L that extends leftward from the upper portion 30u and curves downward, in a front view of the input device 30A. The right portion 30R covers the right side of the upper portion 30u, and the left portion 30L covers the left side of the upper portion 30u. The lower end of the right portion 30R and the lower end of the left portion 30L may be located forward or rearward of the grip 30gp. The structural elements of the above-described input devices 100 to 700 may be combined with the structural essence of the input device 30A.

[0101] FIG. 18 is a diagram showing an input device 30B. The input device 30B has a grip 30gp, an upper portion 30u on which a plurality of operation members are provided, and an extension portion 30y on which a plurality of tracked points H are provided. The extension portion 30y is formed so as to cover the right side and the left side of the upper portion 30u. The extension portion 30y is triangular in a front view of the input device 30B, and the upper portion 30u is located inside the extension portion 30y. The extension portion 30y is formed so that its apex is located on the upper side of the upper portion 30u. The right part of the extension portion 30y is connected to the right part of the upper portion 30u, and the left part of the extension portion 30y is connected to the left part of the upper portion 30. The structural elements and components of the above-mentioned input devices 100 to 700 may be combined with the structural and gist of the input device 30B.

[0102] 19A and 19B are diagrams showing an input device 40A. The input device 40A has a grip 40gp, an upper part 40u on which a plurality of operation members are provided, and an umbrella part 40m on which a plurality of tracked points H are provided. The umbrella part 40m has a shape constituting a part of a sphere. A plurality of tracked points H are arranged on the outer surface of the umbrella part 40m. The umbrella part 40m covers the upper part 40u (see FIG. 19B) and the upper part of the grip 40gp. More specifically, the umbrella part 40m covers, for example, the front and side of the upper part 40u and the front and side of the upper part of the grip 40gp. With such an arrangement of the umbrella part 40m, the tracked points H arranged on the umbrella part 40m can be appropriately detected through a camera mounted on the HMD2. For example, the upper end of the upper part 40u is connected to the inner surface of the umbrella part 40m. The structural elements of the input devices 100 to 700 described above may be combined with the structural outline of the input device 40A.

[0103] FIG. 20 is a diagram showing an input device 50A. FIG. 21 is a diagram showing an input device 50B. Each of the input devices 50A-50B has a grip 50gp, an upper portion 50u on which a plurality of operation members are provided, and a sphere portion 50s on which a plurality of tracked points H are provided. In each of the input devices 50A-50B, the plurality of tracked points H are distributed and arranged on the outer surface of the sphere portion 50s. The sphere portion 50s is attached to the upper end of the upper portion 50u. The input device 50B (see FIG. 21) has a sphere portion 51s in addition to the sphere portion 50s. The plurality of tracked points H are distributed and arranged on the outer surface of the sphere portion 51s. The sphere portion 51s is attached to the lower end of the grip 50gp. The structural elements of the input devices 100-700 described above may be combined with the structural features of the input devices 50A-50B.

[0104] FIG. 22 is a diagram showing an input device 60A. The input device 60A has a grip 60gp, an upper part 60u on which a plurality of operation members are provided, and an expanded upper part 60m on which a plurality of tracked points H are provided. A plurality of tracked points H are distributed and arranged on the outer surface of the expanded upper part 60m. The expanded upper part 60m is attached to the upper end of the upper part 60u. The expanded upper part 60m bulges to the right and has a portion 60n located to the right of the right side surface of the upper part 60u. The expanded upper part 60m has a recess 60p in its center. The input device 60A has a tracked point H at the lower part of the grip part 60gp. The structure and elements of the above-mentioned input devices 100 to 700 may be combined with the structure and gist of the input device 60A.

[0105] FIG. 23 is a diagram showing an input device 70A. The input device 70A is cylindrical and allows a user to insert a hand inside. The input device 70A surrounds the user's wrist when in use. The input device 70A may have an opening 70a for inserting a thumb. A plurality of tracked points H are distributed and disposed on the outer surface of the input device 70A. The structural elements of the above-mentioned input devices 100 to 700 may be combined into the structural outline of the input device 70A.

[0106] [summary] As described above, the input device 100-500 has the grips 11, 211, 311, 411, 511 extending in the vertical direction, the upper parts 20, 220, 320, 420, 520 located above the grips and on which the operation members 13-15 operated by fingers are arranged, and the lower parts 30, 230, 330, 430, 530 located below the grips and on which multiple tracked points H (H3) are arranged. The width of the lower part in a direction intersecting the vertical direction (left-right direction or front-back direction) is larger than the width of the grip in the same direction. This makes it easy to arrange many tracked points H in the lower parts 30, 230, 330, 430, 530. As a result, even if the input device 100-500 is arranged in an orientation in which the lower parts 30, 230, 330, 430, 530 face the camera 2a, the position and orientation of the input device 100-500 can be recognized well.

[0107] In the input device 100·500, the width W21 of the upper portion 20·520 in the left-right direction is larger than the width W22 of the upper portion 20·520 in the front-back direction. The width W32 of the lower portion 30·530 in the front-back direction is larger than the width W31 of the lower portion 30·530 in the left-right direction. With this input device 100·500, it is possible to make the direction in which the tracked points H are lined up in the upper portion 20·520 different from the direction in which the tracked points H are lined up in the lower portion 30·530. As a result, even if it is difficult to calculate the position and orientation of the input device 100·500 using the tracked points H in one portion (e.g., the upper portion 20·520), it is possible to calculate the position and orientation of the input device 100·500 using the tracked points H in the other portion (e.g., the lower portion 30·530), thereby improving the recognition accuracy of the orientation and position of the input device.

[0108] In the input devices 100 / 200, some of the multiple tracked points H are provided on the grips 11 / 211. With this input device, even if the input device 100 / 200 is placed in an orientation in which the outer surface of the grip 11 / 211 faces the camera 2a, the position and orientation of the input device 100 / 200 can be recognized using the tracked points H on the grips 11 / 211, thereby improving the recognition accuracy.

[0109] In the input device 300, the front surface 321a of the upper portion 320 has an operation member area R1 in which the operation members 13-15 are arranged, and a tracked area R2 in which a plurality of tracked points H are arranged along the edge of the operation member area R1. The front surface 321a has a step 321g between the operation member area R1 and the tracked area R2. According to this input device 300, it is possible to prevent fingers operating the operation members 13-15 arranged on the front surface 321a of the input device 300 from overlapping the tracked points H.

[0110] In the input device 500, LEDs 551, which are light sources, are mounted on a flexible substrate 550, and the flexible substrate 550 extends from the upper portion 520 through the extension portion 540 to the lower portion 530. This allows the number of components of the input device 500 to be reduced. The flexible substrate 550 extends from the upper portion 520 to the extension portion 540, and may further include a flexible substrate disposed in the lower portion 530 separately from this. In another example, the flexible substrate 550 extends from the lower portion 530 to the extension portion 540, and may further include a flexible substrate disposed in the upper portion 520 separately from this.

[0111] The input devices 600 / 700 each have an upper portion 620 / 720 having a front surface 621a / 721a on which the operation members 13 / 16 / 17 are arranged, and an extension portion 640 / 740 extending along a plane including the front surfaces 621a / 721a and provided with a plurality of tracked points H. By using the extension portion 640 / 740, it is easy to secure an area (surface area) for arranging the tracked points H. As a result, a sufficient number of tracked points H can be provided on the input devices 500 / 600 while securing a distance between two adjacent tracked points H. This improves the recognition accuracy of the attitude and position of the input device. In addition, the structure of the members (housing) constituting the external appearance of the input devices 600 / 700 can be simplified, for example, compared to a configuration in which the extension portion 640 / 740 extends in a direction perpendicular to a plane including the front surfaces 621a / 721a of the upper portion 620 / 720.

[0112] The characteristic structures described with reference to the input devices 100 to 700 and 10A to 70A may be applied to other input devices proposed in the present disclosure. For example, the step 321g of the input device 300 described with reference to Fig. 4A may be applied to the other input devices 100, 200, 400 to 700 and 10A to 70A while maintaining their characteristics. Similarly, the flexible substrate 550 of the input device 500 described with reference to Fig. 6A may be provided to the other input devices 100 to 700 and 10A to 70A while maintaining their characteristics.

[0113] In still another example, the input devices 100 to 700 and 10A to 70A may not have the operation members 13 to 17. Even in this case, the user may be able to move the input device while holding the grip and have the movement reflected in the moving image displayed on the HMD 2.

[0114] The camera for tracking the positions and orientations of the input devices 100-700 and 10A-70A does not necessarily have to be provided in the HMD 2. As described above, for example, when a moving image generated based on the positions and orientations of the input devices 100-700 and 10A-70A is displayed on an external display device (for example, a television or a personal computer monitor), the camera may be attached to this display device.

Claims

1. A plurality of tracking points each emitting light; The grip extends vertically, an upper portion located above the grip and having a front surface on which an operating member is disposed; an extension portion extending along a plane including at least a portion of the front surface, the extension portion having the plurality of tracked points; the extension portion has a portion connected to the upper portion, a portion extending rightward and downward from the connecting portion, and a portion extending leftward and downward from the connecting portion, The lower end of the extension is connected to the grip. Input devices.

2. The extension includes an annular portion extending along the plane.

2. An input device according to claim 1.

Citation Information

Patent Citations

  • Game device

    JP2007296248A

  • Operation device

    JP2011164932A

  • Force Sensing Resistor (FSR) with Polyimide Substrate, System, and Method Thereof

    JP2021524916A

  • Self-contained mixed reality head mounted display

    US20170337737A1

  • Universal Handheld Controller of a Computer System

    US20200201460A1