input device
By designing rear and front tracking areas on the input device and arranging multiple light-emitting parts, the problem of light-emitting parts being covered is solved, improving detection stability and calculation accuracy, and making it suitable for input devices of head-mounted displays.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SONY INTERACTIVE ENTERTAINMENT LLC
- Filing Date
- 2021-02-26
- Publication Date
- 2026-04-21
AI Technical Summary
On input devices, the light-emitting part is easily covered by the user's hand or arm, causing unstable camera detection, especially when the camera is mounted on a head-mounted display, affecting the accuracy of position and attitude calculation.
The design includes a tracking area consisting of a rear tracking section and a front tracking section. The rear tracking section is located on the rear side of the operating component, and the front tracking section is located on the front side. The two form part of a single sphere, and multiple light-emitting parts are arranged on the outer surface to ensure that the light-emitting parts are not covered by the user's body, thus simplifying the calculation of position and attitude.
It improves the stability of camera detection of light-emitting parts, enhances the accuracy of position and attitude calculation of input devices on head-mounted displays, and reduces the burden on users' arms.
Smart Images

Figure CN115398381B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to input devices that include a tracking component. Background Technology
[0002] There exists a technology that provides a light-emitting portion on an input device and detects the light-emitting portion using a camera to track the position and orientation of the input device. PTL1, described below, discloses an input device for game operation that is equipped with a spherical light-emitting portion. For example, the input device of PTL1 is captured by a camera mounted on a television, and the position and orientation of the input device are calculated from the video.
[0003] Patent document citation list
[0004] PTL1 Japanese Patent Publication No. 2011-164932 Summary of the Invention
[0005] [Technical Issues]
[0006] In systems such as PTL1, it is important that the light-emitting portion is visible to the camera mounted on the television and is not obstructed by the user's hand or arm. Furthermore, a system has been considered in which, unlike the system in PTL1, a camera configured to capture images of the input device is mounted on a head-mounted display, and the position and orientation of the input device are calculated based on the video captured by the camera. In this system, motion images (e.g., game images) based on the position and orientation of the input device are provided to the user via the head-mounted display.
[0007] [Solution to the problem]
[0008] Examples of input devices proposed in this disclosure include: a body comprising a handle and at least one operating member operated by a user with his / her fingers; a tracking region wherein a plurality of light-emitting portions are arranged; a first portion located behind the at least one operating member in a side view and forming part of the tracking region; and a second portion located in front of the first portion, extending in a direction different from that of the first portion and forming another portion of the tracking region. Using this structure, camera detection stability with respect to the light-emitting portions can be achieved.
[0009] Another example of the input device proposed in this disclosure includes a tracking region in which multiple light-emitting portions are provided. The tracking region has a first surface and a second surface, the first surface being located at the rear of the input device and forming part of the outer surface of the input device, and the second surface being located at the front of the input device and forming another part of the outer surface of the input device. The first and second surfaces form part of a single sphere. Using this structure, the calculation of the position and orientation of the input device based on the detection position of the light-emitting portions can be simplified.
[0010] Another example of the input device proposed in this disclosure includes a tracking region in which multiple light-emitting portions are provided. The tracking region includes a first region and a second region, the first region forming part of the outer surface of the input device and wherein multiple light-emitting portions are arranged, and the second region forming another part of the outer surface of the input device and wherein multiple light-emitting portions are arranged. The multiple light-emitting portions arranged in the first region and the multiple light-emitting portions arranged in the second region are located on a single virtual sphere. Using this structure, the calculation of the position and orientation of the input device based on the detection positions of the light-emitting portions can be simplified.
[0011] Another example of an input device proposed in this disclosure includes: a body comprising a handle and at least one operating member operated by a user with his / her fingers; a rear portion located behind the at least one operating member and covering at least the upper side of the handle in a rear view; a tracking region comprising a first region in which a plurality of light-emitting portions are arranged and a second region in which a plurality of light-emitting portions are arranged; and a beam portion for connecting the upper and rear portions of the body to each other. The first region is disposed on the rear portion, and at least a portion of the second region is disposed on the body. This structure prevents changes in the relative positions of the first and second regions, thereby improving the accuracy of position and orientation calculations of the input device. Attached Figure Description
[0012] Figure 1 This is a view illustrating an exemplary system using the input devices proposed in this disclosure.
[0013] Figure 2 This is a front view showing a first example of the input device proposed in this disclosure.
[0014] Figure 3 yes Figure 2 The left-side view of the input device shown.
[0015] Figure 4 yes Figure 2 The right-side view of the input device shown.
[0016] Figure 5 yes Figure 2 The diagram shows the floor plan of the input device.
[0017] Figure 6 yes Figure 2 The rear view of the input device shown.
[0018] Figure 7 This is a left-side view showing a second example of the input device presented in this disclosure.
[0019] Figure 8 yes Figure 7 The rear view of the input device shown.
[0020] Figure 9 This is a front view showing a third example of the input device presented in this disclosure.
[0021] Figure 10 yes Figure 9 The left-side view of the input device shown.
[0022] Figure 11 yes Figure 9 The diagram shows the floor plan of the input device.
[0023] Figure 12 yes Figure 9 The rear view of the input device shown.
[0024] Figure 13 This is a plan view showing a fourth example of the input device proposed in this disclosure.
[0025] Figure 14 yes Figure 13 The right-side view of the input device shown.
[0026] Figure 15 yes Figure 13 The left-side view of the input device shown.
[0027] Figure 16 yes Figure 13 The view shown depicts an input device facing the input device. Figure 13 The direction indicated by the center line Pc shown.
[0028] Figure 17 yes Figure 13 The front view of the input device shown.
[0029] Figure 18 yes Figure 13 The bottom view of the input device shown.
[0030] Figure 19 This is a perspective view showing a fifth example of the input device proposed in this disclosure.
[0031] Figure 20 yes Figure 19 Perspective view of the input device shown.
[0032] Figure 21 yes Figure 19 The side view of the input device shown.
[0033] Figure 22 yes Figure 19 The diagram shows the floor plan of the input device.
[0034] Figure 23 yes Figure 19 The front view of the input device shown. Detailed Implementation
[0035] Now, examples of the input devices proposed in this disclosure are described. Here, Figure 2 In the diagram, the directions represented by Z1 and Z2 are called the "up direction" and "down direction," respectively. Figure 3 In the diagram, the directions represented by Y1 and Y2 are called the "forward direction" and the "backward direction," respectively. Figure 2 The directions represented by X1 and X2 are called the "right direction" and "left direction," respectively. These directions correspond to the way the user holds and uses the device. Figure 1 The input device 100 shown is from the user's viewing direction. Furthermore, in... Figures 2 to 23 In the image, the black circle represents the luminous part H, which will be described later.
[0036] [System Overview]
[0037] like Figure 1 As shown, input device 100 is used, for example, with head-mounted display (HMD) 2. The user wears HMD 2 on his / her head and holds input device 100 in his / her right and / or left hand. HMD 2 includes a forward-facing camera. Input device 100 is provided with a plurality of light-emitting portions H, described later. The position of the light-emitting portions H is detected by the camera. The position and orientation of input device 100 (i.e., the position and orientation of the user's hands) are calculated with reference to the position of the light-emitting portions. Input device 100 includes a plurality of operating elements (e.g., operation buttons, joysticks, or touch sensors) that the user operates with his / her fingers, as described below. The display portion of HMD 2 displays motion images (e.g., game images) generated based on the position and orientation of input device 100, operations performed on the operating elements, etc.
[0038] The position and orientation of the input device 100 can be calculated by an information processing device mounted on the HMD2 or by an external information processing device (e.g., a gaming device or personal computer independent of the HMD2). The input device 100 may include a motion sensor (e.g., an accelerometer or gyroscope). The information processing device can calculate the position and orientation of the input device 100 not only by referencing the position of the light-emitting portion H but also by referencing the output from the motion sensor. Furthermore, motion images can be generated by the information processing device mounted on the HMD2 or by an external information processing device. In the case where the external information processing device calculates the position of the input device 100 and generates a motion image, the image information acquired by the camera is transmitted to the external information processing device wirelessly or via a wired connection. The generated motion image information is transmitted from the external information processing device to the HMD2 wirelessly or via a wired connection.
[0039] Note that the input device 100 may include a microphone, a speaker, etc. Furthermore, the input device 100 may include light-emitting portions on its outer surface that are not used for position and attitude tracking, such as light-emitting portions indicating the operating state of the input device 100 or light-emitting portions used for identification among multiple input devices 100.
[0040] [Overall configuration of input devices]
[0041] The following description details the input device 100 for the right hand. The external shape of the input device 100 for the right hand is symmetrical to that of the input device 100 for the left hand. Therefore, by reversing the terms "right," "right side," "left," and "left side" used in the description, the description of the relative positions of the elements (components or parts) of the input device 100 also applies to the input device 100 for the left hand. The left and right input devices 100 may differ from each other in the number or type of operating components that the user manipulates with his / her fingers. Furthermore, the input device 100 for the right hand and the input device 100 for the left hand do not necessarily need to be symmetrical in the placement of the operating components.
[0042] like Figure 3 As shown, the main body 10 of the input device 100 includes a handle 11B and an operating portion 11A, with a plurality of operating elements disposed on the operating portion 11A. The main body 10 includes the operating portion 11A at its upper part, and the handle 11B extends downward from the operating portion 11A. Specifically, the handle 11B extends downward and backward at an angle from the operating portion 11A. The operating elements disposed on the operating portion 11A can be operated with the thumb while gripping the handle 11B. For example, the handle 11B can be gripped with the pads of the thumb, middle finger, ring finger, and little finger. Operating elements (buttons) to be operated with the index finger can be disposed on the front surface 11f of the operating portion 11A and / or the front surface of the handle 11B.
[0043] like Figure 3 As shown, for example, operation buttons 13 and 14 and operation lever 15 are placed on the operation portion 11A as operation members. Operation buttons 13 and 14 are placed on a first upper surface 11a facing upwards from the rear of the operation portion 11A and are operated, for example, with the thumb. Operation lever 15 is placed on a second upper surface 11b of the operation portion 11A and is operated, for example, with the thumb. The second upper surface 11b is a surface located in front of and facing upwards from the first upper surface 11a. Operation lever 15 is an operation member that can tilt and slide radially.
[0044] The operating components provided on the operating portion 11A are not limited to the examples described herein. For example, a touch sensor, a trigger button, or a button equipped with a touch sensor may be provided on the operating portion 11A. Furthermore, the number of operating components provided on the operating portion 11A may be one, two, four, or more. For example, multiple operating buttons may be provided on the second upper surface 11b. In the following description, operating buttons 13 and 14 and operating lever 15 are referred to as "operating components 13, 14, and 15".
[0045] The input device 100 includes a tracking region on its outer surface in which a plurality of light-emitting portions H are provided. A light-emitting element (specifically, a light-emitting diode (LED)) is positioned corresponding to the light-emitting portion H in the tracking region. For example, the outer surface of the input device 100 is formed by an outer member covering the LED. The LED is placed on the inner surface away from the outer member. Light from the LED can be guided to the outer member (light-emitting portion H) via a light-guiding member. Note that "light-emitting portion H" is the portion through which light passes in the outer member. In a structure where the outer member is formed of an opaque material and a transparent material or hole through which light passes is formed at the location of the light-emitting element, the portion through which the transparent material or hole through which light passes serves as the light-emitting portion H. On the other hand, in a structure where the transparent outer member is placed on the outermost surface of the input device 100 and the light-emitting element (LED) is placed on the inner side of the outer member, the portion facing the light-emitting element serves as the light-emitting portion H. Furthermore, in a structure where the transparent outer member is placed on the outermost surface of the input device 100, a light-guiding member is placed on the inner side of the outer member, and light from the light-emitting element is guided by the light-guiding member; the portion facing the end face (light-emitting surface) of the light-guiding member serves as the light-emitting portion H.
[0046] like Figure 3 and Figure 5 As shown, the input device 100 includes a rear tracking portion 31A and a front tracking portion 31B. Both the rear tracking portion 31A and the front tracking portion 31B are provided with multiple light-emitting portions H. The outer surfaces of the tracking portions 31A and 31B form a tracking area. The input device 100 does not have a tracking portion located on the front side of the front surface 11f of the operation portion 11A.
[0047] The main body 10, including the operating part 11A and the handle 11B, may also be provided with a light-emitting part H. That is, a portion of the outer surface of the main body 10 may also form a tracking area. In the example of the input device 100, the handle 11B has a relatively large width, so when the user grips the handle 11B with his / her right hand, the left side surface 11c of the main body 10 will not be covered by the user's hand, such as... Figure 2 As shown. Therefore, the left side surface 11c can be provided with multiple light-emitting portions H. In addition, the front surface 11f of the operation portion 11A (see...) Figure 1It is also possible to provide multiple light-emitting parts H. Other areas of the outer surface of the main body 10, such as the rear and front surfaces of the handle 11B, are not provided with light-emitting parts H.
[0048] [Position of the post-tracking section]
[0049] like Figure 3 As shown, the rear tracking portion 31A is located behind the operating members placed on the operating portion 11A. In the example of the input device 100, the rear tracking portion 31A is located behind all the operating members 13, 14, and 15 placed on the operating portion 11A. With the rear tracking portion 31A positioned in this manner, for example, compared to a structure where the tracking portion is located on the front side of the operating portion 11A, the torque acting on the input device 100 when the input device 100 is swung can be reduced, thereby reducing the burden on the user's wrist or arm.
[0050] In a side view of the input device 100, the handle 11B is tilted forward relative to the rear tracking portion 31A. The rear tracking portion 31A is located on the rear side of the front portion of the handle 11B. The position of the rear tracking portion 31A in the front-rear direction matches the position of the rear end of the handle 11B. The rear end of the handle 11B is located below the rear tracking portion 31A. Utilizing this positional relationship between the handle 11B and the rear tracking portion 31A, when the wrist is bent inward or outward while gripping the handle 11B, interference from the rear tracking portion 31A can be prevented.
[0051] like Figure 3 As shown, the uppermost part of the rear tracking portion 31A is located at a position higher than the upper surface 11b of the operating portion 11A, and is spaced rearward from the operating portion 11A. That is, the uppermost part of the rear tracking portion 31A is located above the highest operating member on the upper surface 11b. Figure 3 In the example shown, the operating lever 15) is positioned higher and spaced rearward from the operating member. Space is maintained between the operating member and the rear tracking portion 31A to allow for thumb movement in the forward / backward direction.
[0052] [Shape of the rear tracking section]
[0053] like Figure 6As shown, in the rear view of the input device 100, the rear tracking portion 31A has an arc shape. In the rear view of the input device 100, the upper part of the main body 10 is located inside the rear tracking portion 31A. In the rear view of the input device 100, the left end 31i on the inner side of the rear tracking portion 31A is located to the left of the left side surface 11c of the handle 11B. The right end 31k on the inner side of the rear tracking portion 31A is located to the right of the right side surface 11g of the handle 11B. The user can hold the handle 11B in their hand, which is located inside the rear tracking portion 31A. Multiple light-emitting portions H are arranged along the circumferential direction of the rear tracking portion 31A. Figure 5 As shown, the light-emitting part H is distributed across the entire rear tracking part 31A.
[0054] like Figure 6 As shown, in the rear view of input device 100, at least a portion of the external shape of the rear tracking portion 31A can be bent along a circle Sp around a centerline Pc extending in the front-rear direction. More preferably, in the rear view of input device 100, the external shape of the rear tracking portion 31A bends along the circle Sp within a range equal to or greater than half of the external shape of the rear tracking portion 31A. A large portion of the external shape of the rear tracking portion 31A can be bent along the circle Sp. In the example of input device 100, the entire external shape of the rear tracking portion 31A forms a portion of the circle Sp. The rear tracking portion 31A is formed around the centerline Pc at a circumferential angle exceeding 180 degrees. When the rear tracking portion 31A has an external shape that is at least partially bent along the circle Sp in this manner, the calculation of the position and orientation of input device 100 can be simplified. When the rear tracking portion 31A has an external shape that is fully bent along the circle Sp, the calculation process can be further simplified.
[0055] In the plan view of input device 100, the center line Pc (see...) Figure 6 Parallel to the extension direction of handle 11B (by Figure 5 (The direction indicated by line P2 in the diagram). Furthermore, in the side view of the input device 100, the center line Pc may be perpendicular to the center line Pv3 of the operating lever 15 (see...). Figure 4 Unlike input device 100, in the plan view, the center line Pc can be relative to the direction of extension of handle 11B (by...). Figure 5 The direction indicated by line P2 in the diagram. Furthermore, in the side view, the center line Pc can be tilted relative to the center line Pv3 perpendicular to the operating lever 15 (see...). Figure 4 The plane is tilted.
[0056] like Figure 6As shown, the multiple light-emitting portions H disposed on the rear tracking portion 31A are at the same distance from the center line Pc. In the example of the input device 100, the multiple light-emitting portions H disposed on the rear tilted surface 31b (described later) can have the same distance from the center line Pc, which is represented by L1. Furthermore, the multiple light-emitting portions H disposed on the front tilted surface 31a (described later) can also have the same distance from the center line Pc.
[0057] like Figure 3 As shown, in the side view of the input device 100, the rear tracking portion 31A extends linearly in the vertical direction. This simplifies the shape of the rear tracking portion 31A, thereby simplifying the calculation of the position and orientation of the input device 100 based on the position of the light-emitting portion H. The handle 11B extends downward and backward from the operating portion 11A. Therefore, in the side view of the input device 100, the rear tracking portion 31A is inclined relative to the handle 11B.
[0058] In addition, such as Figure 5 As shown in the plan view of the input device 100, the rear tracking portion 31A can extend linearly in the left-right direction. This simplifies the shape of the rear tracking portion 31A, thereby simplifying the calculation of the position and orientation of the input device 100 based on the position of the light-emitting portion H. In the plan view of the input device 100, the left side of the rear tracking portion 31A is located behind the operation portion 11A and does not overlap with any operation member.
[0059] When the input device 100 is used, the rear tracking portion 31A covers the upper side of the user's wrist. The rear tracking portion 31A is less likely to be covered by the user's body, thereby enhancing the detection stability of the camera mounted on the HMD2 regarding the luminous portion H. Note that the rear tracking portion 31A may have a ring shape formed 360 degrees around the center line Pc in the circumferential direction, rather than an arc shape. Furthermore, as another example, the rear tracking portion 31A may have a polygonal (e.g., quadrilateral or pentagonal) shape or a polygonal shape partially formed as an arc.
[0060] The front tracking portion 31B is connected to the upper part of the rear tracking portion 31A. The upper part of the rear tracking portion 31A is connected to the main body 10 via the front tracking portion 31B. Figure 5 As shown, the rear tracking portion 31A includes a right portion 31e located to the right of the connecting portion 31d between the rear tracking portion 31A and the front tracking portion 31B and extending downward, and a left portion 31f located to the left of the connecting portion 31d and extending downward. Portions 31e and 31f are curved in an arc shape around the centerline Pc.
[0061] like Figure 2As shown in the rear view of the input device 100, the connecting portion 31d can be located at a position higher than the horizontal plane P1 passing through the center line Pc. Furthermore, the connecting portion 31d can be located to the right of the vertical plane P2 passing through the center line Pc. That is, the connecting portion 31d can be located in the region higher than the horizontal plane P1 and to the right of the vertical plane P2. Thus, a connection can be achieved between the main body 10 and the rear tracking portion 31A via the front tracking portion 31B, which does not inhibit the movement of the thumb and index finger.
[0062] [The tilted surface of the rear tracking section]
[0063] like Figure 3 As shown, the outer surface of the rear tracking portion 31A includes a front inclined surface 31a and a rear inclined surface 31b. The rear inclined surface 31b is located behind the front inclined surface 31a. The two inclined surfaces 31a and 31b can be adjacent to each other in the front-rear direction. The inclined surfaces 31a and 31b can be connected to each other.
[0064] The forward inclined surface 31a and the rear inclined surface 31b each extend in the circumferential direction around the centerline Pc (see...). Figure 6 In the rear view of the input device 100, the front inclined surface 31a and the rear inclined surface 31b are each fully curved along a perfect circle Sp. The boundary (ridge line N) between the two inclined surfaces 31a and 31b is also curved along a perfect circle Sp over a range greater than half the length of the inclined surfaces 31a and 31b.
[0065] like Figure 3 As shown, both the forward tilted surface 31a and the backward tilted surface 31b are provided with multiple light-emitting portions H. On each of the forward tilted surface 31a and the backward tilted surface 31b, the multiple light-emitting portions H are arranged in a circumferential direction around the center line Pc. That is, the multiple light-emitting portions H on the rear tracking portion 31A are arranged in two rows.
[0066] like Figure 3 As shown, the directions facing the front tilted surface 31a (direction of normal D1) and the directions facing the rear tilted surface 31b (direction of normal D2) are different from each other. The normal D1 of the front tilted surface 31a is tilted forward relative to the direction perpendicular to the center line Pc (the plane Pv1 perpendicular to the center line Pc), while the normal D2 of the rear tilted surface 31b is tilted backward relative to the direction perpendicular to the center line Pc. This structure further enhances the detection stability of the camera mounted on the HMD2 regarding the light-emitting portion H.
[0067] like Figure 5As shown, the width Wb of the rear tilted surface 31b is greater than the width Wa of the front tilted surface 31a. When the user uses the input device 100, the rear tilted surface 31b faces the camera mounted on the user's head more frequently than the front tilted surface 31a. Utilizing the structure where the width Wb of the rear tilted surface 31b is greater than the width Wa of the front tilted surface 31a, when the input device 100 is photographed by the camera, the background of the light-emitting portion H arranged on the rear tilted surface 31b is greater than the background of the light-emitting portion H arranged on the front tilted surface 31a. Therefore, the detection accuracy of the light-emitting portion H arranged on the rear tilted surface 31b can be improved.
[0068] The width Wb of the rear tilted surface 31b and the width Wa of the front tilted surface 31a of the input device 100 are constant in the circumferential direction around the center line Pc. In contrast, the widths Wb of the rear tilted surface 31b and Wa of the front tilted surface 31a can vary depending on their position in the circumferential direction. Unlike the input device 100, the widths Wb of the rear tilted surface 31b and Wa of the front tilted surface 31a can be the same.
[0069] [Position and shape of the front tracking section]
[0070] like Figure 4 As shown, the front tracking portion 31B is located in front of the rear tracking portion 31A and extends in a direction different from that of the rear tracking portion 31A. Specifically, in the side view of the input device 100, when the rear tracking portion 31A extends in the vertical direction, the front tracking portion 31B extends in the front-back direction. Furthermore, as... Figure 5 As shown in the plan view of the input device 100, when the rear tracking portion 31A extends in the left-right direction, the front tracking portion 31B extends obliquely in the front-back direction. By using the input device 100, which includes tracking portions 31A and 31B extending in two different directions in this manner, the detection stability of the camera with respect to the light-emitting portion H can be enhanced.
[0071] like Figure 3 As shown, the front tracking portion 31B is located above the handle 11B. The front tracking portion 31B extends from the upper part of the rear tracking portion 31A and the upper part of the main body 10 (more specifically, the operating portion 11A) to the other. With the front tracking portion 31B positioned in this manner, the light-emitting portion H provided on the front tracking portion 31B can be prevented from being covered by the user's body. Figure 2 As shown, the front tracking portion 31B is connected to the upper part of the main body 10 and the upper part of the rear tracking portion 31A.
[0072] like Figure 5As shown in the plan view of the input device 100, the front tracking portion 31B is located on the right side of the upper part (operation portion 11A) of the main body 10, and extends in a direction extending from the upper part of the main body 10 toward the rear tracking portion 31A. More specifically, the front tracking portion 31B extends obliquely rearward from the right side of the upper part of the main body 10 (operation portion 11A) to connect to the rear tracking portion 31A. The front tracking portion 31B may extend obliquely rearward from the right side of the upper part of the main body 10 in a curved or straight manner.
[0073] like Figure 2 As shown, when a user grips the handle 11B, the side of their palm is located below the front tracking portion 31B. In the front view of the input device 100, a space S1, surrounded by the main body 10 and the rear tracking portion 31A, is reserved below the front tracking portion 31B. A portion of the user's palm, gripping the handle 11B, is located within this space S1.
[0074] like Figure 2 As shown, in the front view of the input device 100, the main body 10 is shifted to the left relative to the plane P2, which is the center of the input device 100 in the left-right direction. By positioning the main body 10 in this way, sufficient space S1 is reserved for placing the right hand, so that the main body 10 can be held and operated with the right hand.
[0075] like Figure 4 As shown, space is reserved above the front tracking portion 31B to allow thumb movement. When the user unfolds their hand that has been holding the handle 11B, the front tracking portion 31B is located between the base (proximal end) of the user's thumb and index finger. Therefore, the input device 100 can be prevented from falling out of the user's hand when the user opens their hand. In other words, the front tracking portion 31B can be used as a suspension portion that hangs on the base of the index finger.
[0076] In addition, such as Figure 4 As shown, when the user opens their hand, the thumb is positioned between the upper part of the rear tracking portion 31A and the front tracking portion 31B. Therefore, the upper part of the rear tracking portion 31A and the front tracking portion 31B prevent the input device 100 from detaching from the hand and pointing forward. In other words, the rear tracking portion 31A can be used as a suspension portion that rests on the thumb. For example, when the input device 100 is held in his / her hand, the user can grasp the HMD2 to adjust its position.
[0077] like Figure 5As shown in the plan view of the input device 100, the connecting portion 31d between the front tracking portion 31B and the rear tracking portion 31A is located to the right of the operating portion 11A and is spaced to the right from the handle 11B. The connecting portion 31d is located to the right of plane P2. In the plan view of the input device 100, a gap G1 is maintained between the right side surface of the handle 11B and the front tracking portion 31B. This prevents interference between the connecting portion 31d and the front tracking portion 31B and the user's thumb gripping the handle 11B.
[0078] like Figure 2 As shown, the front tracking portion 31B is connected to the rear tracking portion 31A at a position lower than the upper end (the uppermost part of the circle Sp) of the rear tracking portion 31A. The connection portion 31d between the front tracking portion 31B and the rear tracking portion 31A can be located above or at the same height as the operating portion 11A.
[0079] like Figure 2 As shown, in the front view of the input device 100, a space S1 is reserved, surrounded by the front tracking portion 31B, the main body 10, and the rear tracking portion 31A. A portion of the user's palm is placed in the space S1. Space is reserved in front of the front tracking portion 31B and above the operating portion 11A to allow thumb movement. That is, in the front view of the input device 100, the front tracking portion 31B forms a separation between the space S1 for placing the palm, middle finger, etc., and the space for allowing thumb movement.
[0080] like Figure 5 As shown, the front tracking portion 31B has an upper surface 31g. The upper surface 31g is connected to the upper surface 11b of the operating portion 11A. When the operating members 13, 14, and 15 disposed on the upper surfaces 11a or 11b of the operating portion 11A are not operated, the user can retract their thumb to the upper surface 31g of the front tracking portion 31B. In the example of the input device 100, the upper surface 11b of the operating portion 11A is a horizontal surface. In contrast, the upper surface 11b of the operating portion 11A can be formed obliquely like the upper surface 31g of the front tracking portion 31B, and the upper surfaces 11b and 31g can extend continuously to the right and upward. In this way, the movement of the thumb for operating the operating members 14 or 15 can be smooth.
[0081] [Light-emitting part]
[0082] like Figure 4 and Figure 5 As shown, the front tracking portion 31B has a side surface (front surface) 31h and a top surface 31g. The side surface 31h and the top surface 31g may each be provided with one or more light-emitting portions H. This structure enhances the camera's detection stability with respect to the light-emitting portions H.
[0083] The light-emitting part H can be set on the side surface 31h of the front tracking part 31B (suspending part). Figure 2 ), the front surface 11f of the operating part 11A ( Figure 2 ), the left side surface 11c of handle 11B ( Figure 3 The handle 11B is located on the rearward inclined surface 31b of the rear tracking portion 31A (suspension portion). The handle 11B has a relatively large width in the left-right direction, so that even when the user holds the handle 11B with his / her right hand, the left side surface 11c of the handle 11B will not be covered by fingers (specifically, the middle and ring fingers).
[0084] The upper surface 31g of the front tracking portion 31B ( Figure 5 The upper surface 11b of the operating part 11A and the forward tilting surface 31a of the rear tracking part 31A are provided with light-emitting parts H. The upper surfaces 11b and 11a of the operating part 11A and the rear surface 11e of the handle 11B (see...) Figure 5 The light-emitting part H is not set.
[0085] [Second Example]
[0086] The input device proposed in this disclosure is not limited to the input device 100 described above. Now, refer to Figure 7 and Figure 8 Input device 300 is described as another example of the input devices proposed in this disclosure. The differences between input device 300 and input device 100 are primarily described below. Contents not described may be similar to those in input device 100.
[0087] like Figure 7 As shown, the main body 310 of the input device 300 includes a handle 311B and an operating section 311A, on which multiple operating components are placed. For example, operating buttons 13 and 14 and an operating lever 15 are placed on the operating section 311A as operating components.
[0088] like Figure 7 As shown, the input device 300 includes a rear tracking portion 331A and a front tracking portion 331B. Both the rear tracking portion 331A and the front tracking portion 331B are provided with multiple light-emitting portions H, and a tracking area is formed on their outer surfaces.
[0089] like Figure 8As shown, the rear tracking portion 331A has an annular shape that completely surrounds the centerline Pc extending in the front-rear direction. Using the rear tracking portion 331A with this shape, the restrictions on the orientation of the input device 100 for achieving detection stability of the light-emitting portion H can be relaxed. In the rear view of the input device 300, the rear tracking portion 331A has a hexagonal shape surrounding the centerline Pc. The rear tracking portion 331A can have a circular or rectangular shape.
[0090] like Figure 8 As shown, the front tracking portion 331B is connected to the upper portion 331e of the rear tracking portion 331A. The rear tracking portion 331A includes an upper portion 331e, a right portion 331f extending downward from the right side of the upper portion 331e, a left portion 331g extending downward from the left side of the upper portion 331e, and a lower portion 331h extending between the right portion 331f and the left portion 331g. These four portions surround the centerline Pc.
[0091] like Figure 7 As shown in the side view of the input device 300, the handle 311B is tilted forward relative to the rear tracking portion 331A. The lower part of the rear tracking portion 331A overlaps with the rear part of the handle 311B. This positional relationship prevents the rear tracking portion 31A from interfering with the wrist when the wrist is bent inward or outward while gripping the handle 31B. In the example of the input device 300, the lower part of the rear tracking portion 31A overlaps with the rearmost part 311d of the handle 311B (see...). Figure 7 )overlapping.
[0092] like Figure 8 As shown, the lower portion 331h of the rear tracking portion 331A is connected to the handle 311B. More specifically, the lower portion 331h of the rear tracking portion 331A is connected to the lower end (rear end) of the handle 311B. The upper portion 331e of the rear tracking portion 331A is connected to the main body 10 via the front tracking portion 331B. Thus, the lower portion 331h and the upper portion 331e of the rear tracking portion 331A are supported, allowing the rear tracking portion 331A to obtain sufficient rigidity. Therefore, for example, it is possible to prevent the posture of the rear tracking portion 331A (in other words, the position of the light-emitting portion H on the rear tracking portion 331A relative to the main body 10) from being changed when an unintentional external force is applied to the rear tracking portion 331A.
[0093] like Figure 7 As shown, the outer surface of the rear tracking portion 331A includes a forward tilted surface 331a and a rear tilted surface 331b, similar to the example of the input device 100. On each of the forward tilted surface 331a and the rear tilted surface 331b, a plurality of light-emitting portions H are arranged along the extending direction of the forward tilted surface 331a and the rear tilted surface 331b.
[0094] The rear tracking portion 31A may have a rear tilted surface 31b and a front tilted surface 31a on each of the upper portion 331e, the right portion 331f, the left portion 331g, and the lower portion 331h. Then, the rear tilted surface 31b and the front tilted surface 31a on each portion may be provided with a light-emitting portion H. Furthermore, similar to the example of the input device 100, the width of the rear tilted surface 331b ( Figure 5 Wb) can be greater than the width of the forward inclined surface 331a. Figure 5 of Wa).
[0095] like Figure 7 As shown, the left side surface 311c of the handle 311B may be provided with multiple light-emitting portions H. Furthermore, the front surface 311f of the operating portion 311A may also be provided with multiple light-emitting portions H. Other areas of the outer surface of the main body 10, such as the rear and front surfaces of the handle 11B, are not provided with light-emitting portions H.
[0096] like Figure 8 As shown, below the front tracking portion 331B, a space S1 is reserved, surrounded by the main body 310 and the rear tracking portion 331A. More specifically, the space S1 is reserved, surrounded by the right side portion 331f and the lower portion 331h of the rear tracking portion 331A, the main body 310, the upper portion 331e, and the front tracking portion 331B. The main body 310 is shifted to the left relative to the plane P2, which is the center in the left-right direction passing through the input device 300. By placing the main body 310 in this way, the space S1 is increased, making it easier to operate the main body 310 by holding it with the right hand.
[0097] The front tracking portion 331B extends rearward from the right side of the operating portion 311A and is shifted to the right relative to the plane P2. This prevents the front tracking portion 331B from obstructing the movement of the thumb.
[0098] [Third Example]
[0099] Now, for reference Figures 9 to 12 Input device 400 is described as yet another example of the input devices proposed in this disclosure. The differences between input device 400 and input device 100 are primarily described below. Content not described may be similar to that in input device 100.
[0100] like Figure 10 As shown, the main body 410 of the input device 400 includes a handle 411B and an operating section 411A, on which multiple operating components are placed. For example, operating buttons 13 and 14 and an operating lever 15 are placed on the operating section 411A as operating components.
[0101] like Figure 9 As shown, the input device 400 includes a rear tracking portion 431A and a front tracking portion 431B. Both the rear tracking portion 431A and the front tracking portion 431B are provided with multiple light-emitting portions H, and their outer surfaces form a tracking area.
[0102] like Figure 12 As shown, the rear tracking portion 431A has an annular shape that completely surrounds the centerline Pc extending in the front-rear direction. That is, the rear tracking portion 431A forms 360 degrees around the centerline Pc in the circumferential direction.
[0103] like Figure 12 As shown, in the rear view of the input device 400, at least a portion of the external shape of the rear tracking portion 431A can be bent along a perfect circle Sp around a centerline Pc extending in the front-rear direction. When the rear tracking portion 431A has an external shape that is at least partially bent along the perfect circle Sp in this manner, the calculation of the position and orientation of the input device 400 can be simplified. Most of the external shape of the rear tracking portion 431A can ideally be bent along the perfect circle Sp. In the example of the input device 400, the entire rear tracking portion 431A is bent along the perfect circle Sp. Multiple light-emitting portions H disposed on the rear tracking portion 431A can have the same distance L1 to the centerline Pc (see...). Figure 12 ).
[0104] A portion of the rear tracking portion 431A (e.g., the connecting portion 431d between the rear tracking portion 431A and the front tracking portion 431B, or the connecting portion between the rear tracking portion 431A and the handle 411B) may be located outside the circle Sp. Similarly, in this case, the plurality of light-emitting portions H disposed on the rear tracking portion 431A may have the same distance L1 from the centerline Pc (see...). Figure 12 ).
[0105] like Figure 10 As shown, in the side view of the input device 400, the rear tracking portion 431A can extend linearly in the vertical direction. This simplifies the shape of the rear tracking portion 431A, thereby simplifying the calculation of the position and orientation of the input device 400 based on the position of the light-emitting portion H. In the side view of the input device 400, the rear tracking portion 431A is tilted relative to the handle 411B.
[0106] In addition, such as Figure 11 As shown in the plan view of the input device 400, the rear tracking portion 431A can extend linearly in the left-right direction. This simplifies the shape of the rear tracking portion 31A, thereby simplifying the calculation of the position and orientation of the input device 400 based on the position of the light-emitting portion H.
[0107] like Figure 10 As shown, the outer surface of the rear tracking portion 431A includes a forward tilted surface 431a and a rear tilted surface 431b, similar to the example of the input device 100. Both the forward tilted surface 431a and the rear tilted surface 431b are provided with a plurality of light-emitting portions H. The plurality of light-emitting portions H are arranged circumferentially on the forward tilted surface 431a and the rear tilted surface 431b.
[0108] like Figure 11 As shown, similar to the example of input device 100, the width Wb of the rear tilt surface 431b can be greater than the width Wa of the front tilt surface 431a. Ideally, the front tilt surface 431a and the rear tilt surface 431b are formed along the entire circumference of the rear tracking portion 431A. In contrast, the front tilt surface 431a and the rear tilt surface 431b can be formed only on a portion of the rear tracking portion 431A (e.g., the upper part of the rear tracking portion 431A).
[0109] like Figure 10 As shown, the left side surface 411c of the handle 411B may be provided with multiple light-emitting portions H. Furthermore, the front surface 411f of the operating portion 411A may also be provided with multiple light-emitting portions H. Other areas of the outer surface of the main body 10, such as the rear and front surfaces of the handle 11B, are not provided with light-emitting portions H.
[0110] like Figure 10 and Figure 11 As shown, the front tracking portion 431B extends rearward and upward from the right side of the operating portion 411A to connect to the upper part of the rear tracking portion 431A. Figure 10 As shown, the front tracking portion 431B can extend backward and upward in a curved manner.
[0111] The light-emitting portion H can be disposed on both surfaces of the front tracking portion 431B. This improves the detection accuracy of the light-emitting portion H disposed on the front tracking portion 431B. In the example of the input device 400, the light-emitting portion H can be disposed on the upper surface (front surface) 431h of the front tracking portion 431B (see...). Figure 11 ) and right surface 431i (see Figure 11 )superior.
[0112] The lower part of the rear tracking portion 431A is connected to the rearmost (lowest) part of the handle 411B. Simultaneously, the upper part of the rear tracking portion 431A is connected to the main body 410 via the front tracking portion 431B. Thus, the lower and upper parts of the rear tracking portion 431A are supported, allowing the rear tracking portion 431A to obtain sufficient rigidity. Therefore, for example, it is possible to prevent changes in the attitude of the rear tracking portion 431A relative to the main body 10 when an unintentional external force is applied to it. Note that in this specification, the upper part of the rear tracking portion 431A is the horizontal plane P1 passing through the center of the rear tracking portion 431A in the vertical direction (see...). Figure 9 The part above the horizontal plane P1 is the part below the lower part of the following tracking part 31A.
[0113] The tracking region on the outer surface of the input device 400 comprises a curved surface forming a single spherical surface Sr (the same sphere) at at least two locations separated from each other. This shape facilitates the computational processing of the position and orientation of the input device 100 based on the position of the light-emitting portion H detected by the camera. Tracking portions 431A and 431B, along with the main body 410, are located inside the spherical surface Sr.
[0114] The input device 400 has curved surfaces at its rear and front. Specifically, as shown... Figure 10 and Figure 11 As shown, the rear tilting surface 431b of the rear tracking portion 31A is disposed at the rear of the input device 400. The rear tilting surface 431b forms part of a virtual sphere Sr and curves along the sphere Sr. In the plan view of the input device 400, the rear tilting surface 431b is located behind the operating members 13, 14, and 15 operated by the thumb. In the rear view of the input device 400, the rear tilting surface 431b has an annular shape surrounding the handle 411B (see...). Figure 12 Unlike the input device 400, the rear tracking section 431A can have an arc shape.
[0115] The rear tilt surface 431b is located at the rear of the input device 100. This placement of the rear tilt surface 431b makes it easier for the camera mounted on the HMD2 to capture light from the light-emitting portion H on the rear tilt surface 31b.
[0116] like Figure 10 and Figure 11 As shown, the front surface 411f of the operating portion 411A is provided at the front of the input device 400. The front surface 411f of the operating portion 411A is a surface located on the front side of the operating members 13, 14, and 15. The front surface 411f of the operating portion 411A forms a part of the spherical surface Sr and curves along the spherical surface Sr.
[0117] Instead of the front surface 411f of the operating part 411A, or together with the front surface 411f of the operating part 411A, the front surface (upper surface) 431h of the front tracking part 431B can form part of the spherical Sr.
[0118] like Figure 9 As shown, in the front view of the input device 400, the space S1, surrounded by the main body 410 and the rear tracking portion 431A, is retained below the front tracking portion 431B. The user's palm is placed in the space S1. The main body 410 is shifted to the left relative to the plane P2, which is centered in the left-right direction passing through the input device 400.
[0119] like Figure 11 As shown, the connecting portion 431d between the front tracking portion 31B and the rear tracking portion 31A is located on the right side of plane P2. In the plan view of the input device 100, the front tracking portion 431B is spaced to the right from the right side surface of the handle 411B. In the plan view of the input device 100, a gap G1 is maintained between the right side surface of the handle 411B and the front tracking portion 431B. This prevents interference between the connecting portion 431d and the front tracking portion 431B and the user's thumb gripping the handle 11B. The front tracking portion 431B can extend from the right side of the operating portion 411A to the right and tilted backward. This increases the gap G1.
[0120] [Fourth Example]
[0121] Now, for reference Figures 13 to 19 Input device 500 is described as yet another example of an input device proposed in this disclosure. Hereinafter, the differences between input device 500 and the input devices described so far (particularly input device 400) will be primarily described. Content not described may resemble that found in the input devices described so far.
[0122] like Figure 13 As shown, the main body 510 of the input device 500 includes a handle 511B and an operating section 511A, on which multiple operating components are placed. For example, operating buttons 13 and 14 and an operating lever 15 are placed as operating components on the operating section 511A. Furthermore, operating buttons 16 and 17 may also be placed on the operating section 511A.
[0123] like Figure 13 As shown, the input device 500 includes a rear tracking portion 531A and a front tracking portion 531B. The rear tracking portion 531A has an annular shape (see Figure 531B). Figure 16 The front tracking portion 531B connects the upper part of the main body 510 (specifically, the operation portion 511B) and the rear tracking portion 531A to each other.
[0124] [Pre-tracking section]
[0125] like Figure 17 As shown, the front tracking portion 531B extends to the right from the upper part of the main body 510 (operation portion 511A). The front tracking portion 531B is located at a position relative to the centerline Pc of the rear tracking portion 531A (see Figure 1). Figure 16 The high position. Below the front tracking section 531B, space S1 is reserved for placing four fingers other than the thumb.
[0126] like Figure 17 As shown, at the front of the front tracking portion 531B, the upper surface 531h of the front tracking portion 531B is connected to the upper surface 511b of the operating portion 511A without any steps. Thus, the user can smoothly move his / her finger on the upper surface of the operating portion 511A.
[0127] like Figure 17 As shown, the front portion of the front tracking portion 531B and the upper surfaces 531h and 511b of the operating portion 511A can be substantially parallel to the horizontal plane P4. This also facilitates smooth movement of the user's finger. Here, the horizontal plane P4 is, for example, a plane perpendicular to the center line Pv3 of the operating lever 15. The straight line Pv3 can also extend in the pressing direction of the operating buttons 13 and 14.
[0128] like Figure 14 As shown, at the rear of the front tracking portion 531B, the upper surface 531h of the front tracking portion 531B extends rearward and upward at an angle. This increases the width of the front tracking portion 531B in the vertical direction. Consequently, the connection strength between the front tracking portion 531B and the rear tracking portion 531A is increased. Furthermore, since the position of the upper surface 531h is relatively low in the front of the front tracking portion 531B, a sufficiently large space can be maintained between the operating portion 511A (or the front of the front tracking portion 531B) and the rear tracking portion 531A to allow movement of the thumb of the operating member placed on the operating portion 511A, using this thumb to operate the operating member.
[0129] like Figure 17 As shown, at the front of the front tracking portion 531B, the lower surface 531j of the front tracking portion 531B can also be substantially parallel to the horizontal plane P4. Thus, when the user presses the trigger button 18, which will be described later, with his / her index finger, the user can smoothly move his / her index finger along the lower surface 531j of the rear tracking portion 531A.
[0130] like Figure 14 and Figure 17As shown, at the rear of the front tracking portion 531B, the lower surface 531j of the front tracking portion 531B extends rearward and downward at an angle. This increases the width of the front tracking portion 531B in the vertical direction. Consequently, the connection strength between the front tracking portion 531B and the rear tracking portion 531A is increased. Furthermore, since the lower surface 531j is positioned relatively high in the front of the front tracking portion 531B, a sufficiently large space can be reserved below the front of the front tracking portion 531B to allow movement of the index finger of the operating member (trigger button 18 described later) placed on the front side of the operating portion 511A.
[0131] The lower part of the rear tracking portion 531A connects to the rearmost (lowest) part of the handle 511B. Furthermore, as described above, the upper surface 531h of the front tracking portion 531B extends rearward and upward at an angle, and the lower surface 531j of the front tracking portion 531B extends rearward and downward at an angle. Therefore, the connection portion between the front tracking portion 531B and the rear tracking portion 531A has a larger dimension in the vertical direction. This increases the rigidity of the rear tracking portion 531A. Then, for example, it can prevent changes in the relative position of the rear tracking portion 531A and the front tracking portion 531B (or the operating portion 511A) when an unintentional external force is applied to the rear tracking portion 531A.
[0132] like Figure 14 As shown in the side view of the input device 500, the lower surface 531j of the front tracking portion 531B overlaps with the handle 511B. Therefore, when using the input device 500, the back of the hand holding the handle 511B faces the rear of the front tracking portion 531B in the left-right direction. Thus, for example, when the user temporarily releases the handle 511B, the area of the rear of the front tracking portion 531B in contact with the back of the hand increases. Therefore, it is easier to maintain the relative posture of the input device 500 and the hand.
[0133] Note that the shape and placement of the front tracking portion 531B are not limited to the example of the input device 500. The front tracking portion 531B can extend backward and upward at an angle from the operating portion 511A. In this case, the upper surface 531h of the front tracking portion 531B and the upper surface 511b of the operating portion 511A can also be inclined.
[0134] [Orientation of the post-tracking component]
[0135] like Figure 14 and Figure 16 As shown, the rear tracking portion 531A has a rearward-opening annular shape. The rear tracking portion 531A has an annular shape that completely surrounds the center line Pc2. That is, the rear tracking portion 531A forms 360 degrees around the center line Pc2 in the circumferential direction.
[0136] In the example of input device 500, the center line Pc2 is a line that extends backward at an angle. More specifically, as... Figure 13 As shown in the plan view of the input device 500, the center line Pc2 is inclined relative to the vertical plane P5. The vertical plane P5 can be a plane that extends substantially along the handle 511B. Furthermore, the vertical plane P5 may include the center line Pv3 of the operating lever 15. When the user grips the handle 511B, the center of the rear tracking portion 531A is offset relative to the handle 511B / located on the side with a wider range of flexion motion of the wrist in the left-right direction. That is, the annular rear tracking portion 531A has a larger opening area on the side with a larger range of wrist movement relative to the handle 511B. With the handle 511B and the rear tracking portion 531A in these relative positions, when the user grips the handle 511B, the rear tracking portion 531A can be prevented from interfering with the user's wrist or arm, thereby enabling comfortable operation.
[0137] like Figure 13 As shown, the handle 511B is shifted to the left relative to the vertical plane P2 passing through the center in the left-right direction of the input device 500. The centerline Pc2 of the rear tracking portion 531A is a straight line extending backward and to the right at an angle. In other words, when the user grips the handle 511B, the handle 511B is offset / located on the side with a narrower range of flexion of the wrist in the left-right direction relative to the center of the input device 500, and the center of the rear tracking portion 531A is offset / located on the side with a wider range of flexion of the wrist in the left-right direction relative to the handle 511B. That is, the opening area of the annular rear tracking portion 531A is larger on the side with a larger range of wrist movement relative to the handle 511B. Because the rear tracking portion 531A is tilted in this way, when the user grips the handle 511B with his / her right hand, the rear tracking portion 531A can be prevented from interfering with the user's wrist or arm, thereby enabling comfortable operation.
[0138] and Figures 13 to 18 The example shown is different; the input device 500 can be used with the left hand. In this case, the handle 511B is shifted to the right relative to the plane P2, which is the center of the input device 500 in the left-right direction. At the same time, the center line Pc2 of the rear tracking portion 531A is a straight line extending backward and tilted to the left.
[0139] like Figure 14As shown, the centerline Pc2 of the rear tracking portion 531A can be inclined relative to the horizontal plane P4. More specifically, the centerline Pc2 can extend backward and upward relative to the horizontal plane P4. In other words, when the user grips the handle 511B, the center of the rear tracking portion 531A is offset / located relative to the handle 511B on the side with a wider range of wrist flexion in the vertical direction. That is, the area of the annular opening is larger on the side with a larger range of wrist movement relative to the handle 511B. Similarly, with the rear tracking portion 531A inclined in this way, when the user grips the handle 511B, the rear tracking portion 531A can be prevented from interfering with the user's wrist or arm, thereby enabling comfortable operation. Note that the horizontal plane P4 can be a plane substantially perpendicular to the centerline Pv3 of the operating lever 15.
[0140] Unlike input device 500, the rear tracking portion 531A does not necessarily need to form a 360-degree circle around the centerline Pc2. For example, in the rear view of input device 500, the rear tracking portion 531A may be an arc that only covers the upper side of the handle 511B. Similarly, in this case, as in input device 500, the centerline Pc2 of the rear tracking portion 531A may be inclined relative to the horizontal plane P4 and / or the vertical plane P5.
[0141] [Placement of the light-emitting parts]
[0142] like Figure 17 As shown, the front surface 511f of the operation portion 511A and the front surface (side surface) 531i of the front tracking portion 531B are provided with a plurality of light-emitting portions H arranged in the left-right direction. In the example of the input device 500, the front surface 511f of the operation portion 511A is provided with two light-emitting portions H, and the front tracking portion 531B is provided with a single light-emitting portion H. The number of light-emitting portions H provided on the front tracking portion 531B can be two or more.
[0143] like Figure 17 As shown, the light-emitting portions H disposed on the front surfaces 511f and 531i can be arranged along the horizontal plane P4. In contrast, the arrangement direction of the light-emitting portions H can be tilted relative to the horizontal plane P4.
[0144] Furthermore, the front tracking portion 531B does not necessarily need to have a light-emitting portion H. For example, if the operating portion 511A has a large dimension in the left-right direction, although the front surface 511f of the operating portion 511A can have more light-emitting portions H, the front tracking portion 531B does not necessarily need to have a light-emitting portion H. In this case, although the front tracking portion 531B is not used as a tracking portion, it can be used as a beam portion to connect the operating portion 511A and the rear tracking portion 531A to each other and to provide strength for the rear tracking portion 531A.
[0145] like Figure 13 and Figure 15 As shown, the outer surface of the rear tracking portion 531A includes a forward tilted surface 531a and a rear tilted surface 531b, similar to the rear tracking portion 431A of the input device 400. Both the forward tilted surface 531a and the rear tilted surface 531b are provided with multiple light-emitting portions H. The multiple light-emitting portions H are arranged along the extending direction of the rear tracking portion 531A (circumferential direction around the center line Pc2). Similar to the rear tracking portion 431A of the input device 400, the width of the rear tilted surface 531b ( Figure 5 Wb) can be greater than the width of the forward inclined surface 531a. Figure 5 of Wa).
[0146] The positions of the light-emitting portions H disposed on the forward inclined surface 531a and the rear inclined portion 531b can be offset from each other in the extending direction of the rear tracking portion 531A (circumferential direction around the center line Pc2). This increases the distance between the light-emitting portions H, thereby facilitating the identification of the positions of two adjacent light-emitting portions H. Therefore, the mounting height on the HMD2 (see...) can be improved. Figure 1 The accuracy of the camera on the input device 500 in detecting its position and orientation.
[0147] The tracking area on the outer surface of the input device 500 includes a curved surface forming a single spherical surface Sr (identical spherical surface) on both the front and rear sides of the operating member (operating lever 15, etc.). Specifically, as... Figure 13 and Figure 15 As shown, the rearward tilted surface 531b located at the rear of the input device 500 forms part of the virtual sphere Sr and curves along the sphere Sr. Furthermore, as... Figure 14 As shown, the front surface 511f of the operating portion 511A also forms part of the spherical surface Sr and curves along the spherical surface Sr. Furthermore, as... Figure 13As shown, the front surface 531i of the front tracking portion 531B also forms part of the spherical surface Sr. This shape facilitates the calculation and processing of the position and orientation of the input device 500 based on the position of the light-emitting portion H detected by the camera mounted on the HMD2.
[0148] In this way, multiple light-emitting portions H are disposed on the rear inclined surface 531b of the rear tracking portion 531A and the front surfaces 531i and 511f of the front tracking portion 531B and the main body 510. Furthermore, surfaces 531b, 531i, and 511f are curved surfaces forming part of a sphere Sr. Therefore, the multiple light-emitting portions H disposed on the rear inclined surface 531b and the multiple light-emitting portions H disposed on the front surfaces 531i and 511f are located on a single virtual sphere Sr. Using the light-emitting portions H arranged in this manner, the calculation processing of the position and orientation of the input device 500 based on the position of the light-emitting portions H detected by the camera mounted on the HMD2 can be facilitated. Furthermore, the handle 511B and the operating member are placed within the virtual sphere Sr. Therefore, when the user uses the input device by gripping the handle 511B, the light-emitting portions H are not covered by the user's hand. Moreover, since the light-emitting portions H are located on the virtual sphere Sr within which the user's hand rests, the calculation processing of the hand's position can be facilitated.
[0149] Note that, unlike the input device 500, one or both of the rear tilted surface 531b of the rear tracking portion 531A and the front surfaces 531i and 511f of the front tracking portion 531B and the main body 510 do not necessarily need to be curved surfaces. For example, the front surfaces 531i or 511f can be planes that extend upward and backward at an angle. Furthermore, the rear tilted surface 531b can be a plane that extends backward at an angle toward the centerline Pc2. In the same case, the plurality of light-emitting portions H on the front side of the operating member (operating lever 15, etc.) and the plurality of light-emitting portions H on the rear side of the operating member can be located on a single sphere Sr. Specifically, the plurality of light-emitting portions H arranged on the rear tilted surface 531b and the plurality of light-emitting portions H arranged on the front surfaces 531h and 511f can be located on a single virtual sphere Sr. This facilitates the calculation and processing of the position and attitude of the input device 500 based on the position of the light-emitting portions H detected by the camera mounted on the HMD2.
[0150] like Figure 15 As shown, the forward-tilting surface 531a of the forward tracking portion 531B is a surface that extends backward at an incline toward the centerline Pc2. Figure 14 As shown, the front surface of the front tracking portion 531B extends rearward in a curved manner to connect to the rear inclined portion 531b on the right side of the rear tracking portion 531A. Therefore, the front inclined surface 531a is not formed on the right side of the rear tracking portion 531A.
[0151] In the input device 500, no light-emitting portion H is provided in the area other than the front surfaces 531h and 511f of the rear tracking portion 531A and the front tracking portion 531B, and the main body 510. Unlike the input device 500, for example, the left side surface 511c of the handle 511B (see...) Figure 15 The device may also include a light-emitting portion H. Furthermore, unlike the input device 500, the light-emitting portion H can be disposed on the upper surface 531h and the front surface (side surface) 531i of the front tracking portion 531B. This further improves the detection accuracy regarding the light-emitting portion H disposed on the front tracking portion 531B.
[0152] [Operating Components]
[0153] As described above, the input device 500 includes operation buttons 13, 14, 16, and 17 as its operating components, and an operation lever 15 (see [link]). Figure 13 For example, operation buttons 13 and 14 are for selecting or manipulating game characters or objects. Meanwhile, operation button 16 is a function button for sharing the game and is used to capture the game screen of the currently playing game or capture still images from replaying motion graphics and store the captured images in the HMD2 or a server device connected to the HMD2. For example, operation button 17 is a button for displaying various functions that the user can select. For example, a user can operate operation button 17 to select the game application he / she wants to play from multiple ongoing game applications.
[0154] like Figure 13 As shown, operation buttons 13 and 14, and operation button 16, can be placed on opposite sides of the lever 15. For example, operation buttons 13 and 14 can be placed on the left side of the lever 15, and operation button 16 can be placed on the right side of the lever 15. With this placement, the user can place his / her thumb in the initial position (at the lever 15) and smoothly move his / her thumb from the lever 15 to operation buttons 13, 14, or 16 as needed.
[0155] Operation button 17 can be located on the rear side of operation lever 15. Operation buttons 13, 14, 16, and 17, located on the upper surface 511b of operation section 511A, are thumb-operated buttons. These buttons are arranged circumferentially around operation lever 15. Therefore, the user can place his / her thumb in the initial position (operation lever 15) and smoothly move his / her thumb from operation lever 15 to any of operation buttons 13, 14, 16, and 17 as needed.
[0156] like Figure 15As shown, the trigger button 18 can be positioned below the front surface 511f of the operating portion 511A. The body 510 may include a drive mechanism configured to move the trigger button 18. For example, when the trigger button 18 is pressed, the drive mechanism generates a reaction force on the movement of the trigger button 18. For example, the drive mechanism may include an electric motor as its drive source.
[0157] like Figure 15 As shown, the main body 510 may include an operation button 19 on a handle 511B. The operation button 19 may be located on a side surface of the handle 511B. The input device 500 may be a right-handed device, and the operation button 19 may be located, for example, on the left side surface 511c of the handle 511B. By placing the operation button 19 in this way, the user can operate the operation button 19 with his / her middle finger.
[0158] One or more operation buttons 13, 14 and 16 to 18 described so far may each have a touch sensing function that detects the contact or proximity of a user's finger with the button surface. In addition, the lever 15 may also have a touch sensing function that detects the contact or proximity of a user's finger with the upper surface of the lever 15.
[0159] [Summarize]
[0160] As described above, in input devices 100, 300, 400, or 500, the main body 10, 110, 310, 410, or 510 includes a handle 11B, 311B, 411B, or 511B and at least one operating member 13, 14, 15, 16, 17, 18, or 19 operated by the user with his / her fingers. Input devices 100, 300, 400, or 500 include a rear tracking portion 31A, 331A, 431A, or 531A located behind at least one operating member and forming part of a tracking area, and a front tracking portion 31B, 331B, 431B, or 531B located in front of the rear tracking portion and extending in a direction different from the direction of the rear tracking portion. In this way, input devices 100, 300, 400, or 500 include two tracking portions extending in different directions, thereby enhancing the detection stability of the camera mounted on the HMD2 with respect to the light-emitting portion H.
[0161] The front tracking portion 31B, 331B, 431B, or 531B extends from the upper part of the main body and from one of the rear tracking portions 31A, 331A, 431A, or 531A to the other. Thus, even when the user releases the handle, the front tracking portion 31B, 331B, 431B, or 531B is held in the hand, thereby preventing the input device from falling.
[0162] The front tracking portion 31B, 331B, 431B, or 531B connects the upper part of the main body 10, 110, 310, 410, or 510 and the rear tracking portion 31A, 331A, 431A, or 531A to each other. This increases the rigidity of the input device and prevents changes in the relative position of the rear tracking portion 331A with the main body 10, 110, 310, 410, or 510.
[0163] The front tracking portion 31B, 331B, 431B or 531B has a shape that is located between the edge portion of the user's thumb and palm when the user unfolds the hand that has been holding the handle.
[0164] In the plan view of the input device, the front tracking portion 31B, 331B, 431B or 531B is located on the upper right side of the main body 10, 110, 310, 410 or 510, and extends from the upper part of the main body toward the rear tracking portion 31A, 331A, 431A or 531A.
[0165] In the plan view of the input device, the main body 10, 110, 310, 410, or 510 is shifted to the left relative to the plane P2, which is the center in the left-right direction passing through the input device, and the front tracking portion 31B, 331B, 431B, or 531B is shifted to the right relative to the plane P2. This allows for easy operation by holding the main body with the right hand and prevents the front tracking portion from obstructing thumb movement.
[0166] The front tracking portion 31B, 331B, 431B, or 531B extends from the upper part of the main body to the right and rear to connect to the rear tracking portion 31A, 331A, 431A, or 531A on the right side of plane P2. With this structure, it is easier to retain space that allows finger movement.
[0167] In the plan view of the input device, the connection between the front tracking portion 31B, 331B, 431B or 531B and the rear tracking portion 31A, 331A, 431A or 531A is spaced apart from the handle to the right. This maintains a gap G1 between the right side surface of the handle and the front tracking portion. This prevents the connection between the front and rear tracking portions, as well as the front tracking portion itself, from interfering with the thumb.
[0168] In the plan view of the input device, the main body 10, 110, 310, 410 or 510 is shifted to the left relative to the plane P2 which is the center in the left-right direction passing through the input device, and in the front view of the input device, the front tracking portion 31B, 331B, 431B or 531B extends to the right from the upper part of the main body 10, 110, 310, 410 or 510.
[0169] The upper part of the rear tracking portion 31A, 431A, or 531A has an arc shape, covering at least the upper side of the handle in the rear view of the input device. As a result, the light-emitting portion H on the rear tracking portion 31A, 431A, or 531A is not easily hidden by the camera mounted on the HMD2, thereby improving the accuracy of the input device's attitude and position detection.
[0170] In the rear view of the input device, the rear tracking portion 331A, 431A, or 531A has a ring shape. Therefore, for example, even if the orientation of the input device is reversed in the vertical direction, the accuracy of the input device's orientation and position detection can be improved.
[0171] The rear tracking portion 531A has an annular shape surrounding a centerline Pc2 that extends obliquely rearward. This prevents interference between the user's wrist and the rear tracking portion. The rear tracking portion 531A may also have an arcuate shape that covers the obliquely rearward centerline Pc2.
[0172] The rear tracking portion 431A or 531A is essentially circular. This facilitates the computational processing of the input device's position and orientation based on the location of the luminous portion H detected by the camera.
[0173] The rear tracking section 431A or 531A is connected to the lower part of the handle. The connection between the rear tracking section 431A or 531A and the handle rarely interferes with the use of the input device.
[0174] In the side view of the input device, the rear tracking portion 31A, 331A, 431A, or 531A is located on the rear side of the front of the handle.
[0175] The rear tracking portion 531A has an annular shape surrounding a centerline Pc2, which extends rearward and upward in a side view of the input device. This prevents interference between the user's wrist and the rear tracking portion. The rear tracking portion 531A may also have an arcuate shape surrounding the centerline Pc2.
[0176] The handle is shifted to the left relative to the center of the input device in the left-right direction. The rear tracking portion 531A has an annular shape around a center line Pc2, which extends backward and to the right in the plan view of the input device. This prevents interference between the user's wrist and the rear tracking portion. The rear tracking portion 531A may have an arcuate shape around the center line Pc2.
[0177] In input device 400 or 500, the tracking region has a rear tilted surface 431b or 531b formed on the rear of input device 400 or 500 and a front surface 411f, 511f, or 531i formed on the front of input device 400 or 500. The rear tilted surface 431b or 531b and the front surface 411f, 511f, or 531i form part of a single spherical surface Sr. This facilitates the computational processing of the position and orientation of input device 400 or 500 based on the position of the luminous portion H detected by the camera.
[0178] In the plan view of input device 400 or 500, the rear tilted surface 431b or 531b is located behind at least one operating member (e.g., operating lever 15), and the front surfaces 411f, 511f, or 531i are located in front of at least one operating member (e.g., operating lever 15). This relaxes the restrictions on the orientation of input device 400 or 500 for achieving detection stability with respect to the light-emitting portion H.
[0179] In input device 400 or 500, the rear tilting surface 431b or 531b has an arcuate or annular shape that at least covers the upper side of handle 411B or 511B. The light-emitting portion H on the rear tracking portion 431A or 531A is not easily hidden by the camera mounted on HMD2, thereby improving the accuracy of attitude and position detection of the input device.
[0180] In input device 400 or 500, the tracking area includes a rear-tilted surface 431b or 531b on which multiple light-emitting portions H are arranged, and a front surface 411f, 511f, or 531i on which multiple light-emitting portions H are arranged. The multiple light-emitting portions H arranged on the rear-tilted surface 431b or 531b and the multiple light-emitting portions H arranged on the front surfaces 411f, 511f, or 531i are located on a single virtual sphere Sr. This facilitates the computational processing of the position and orientation of input device 400 or 500 based on the position of the light-emitting portions H detected by the camera.
[0181] In the plan view of input device 400 or 500, a plurality of light-emitting portions H arranged on the rearward tilted surface 431b or 531b are located behind at least one operating member (e.g., operating lever 15), and a plurality of light-emitting portions H arranged on the front surface 411f, 511f or 531i are located in front of at least one operating member (e.g., operating lever 15). This relaxes the restrictions on the orientation of input device 400 or 500 for achieving detection stability with respect to the light-emitting portions H.
[0182] In input device 400 or 500, at least one of a plurality of light-emitting portions H arranged on a rearwardly inclined surface 431b or 531b is disposed on a surface facing the rear upper part of the input device. Furthermore, a front surface 411f, 511f, or 531i of the plurality of light-emitting portions H is disposed thereon, facing the front direction of input device 400 or 500. This relaxes the restrictions on the orientation of input device 400 or 500 required to achieve detection stability with respect to the light-emitting portions H.
[0183] Input devices 100, 300, 400, or 500 include bodies 10, 110, 310, 410, or 510, each body including a handle and at least one operating element (e.g., a lever 15) operated by the user with his / her fingers. Furthermore, input devices 100, 300, 400, or 500 include rear tracking portions 31A, 331A, 431A, or 531A located behind at least one operating element and covering at least the upper side of the handle in a rear view. Additionally, input devices 100, 300, 400, or 500 include beam portions for connecting the upper portion of the body 10, 110, 310, 410, or 510 and the rear tracking portions 31A, 331A, 431A, or 531A to each other (front tracking portions 31B, 331B, 431B, or 531B correspond to the "beam portion" in the aforementioned input devices). It can prevent the relative position of the rear tracking part and the main body 10, 110, 310, 410 or 510 (that is, the light-emitting part H set on the rear tracking part and the light-emitting part H set on the main body) from changing, thereby improving the calculation accuracy of the position and attitude of the input device.
[0184] Note that in the examples of input devices 100, 300, 400, or 500, the front tracking portions 31B, 331B, 431B, or 531B do not necessarily need to be connected to the main body 10, 110, 310, 410, or 510 and the rear tracking portions 31A, 331A, 431A, or 531A. That is, the front tracking portions 31B, 331B, 431B, or 531B can be connected to only one of the main body 10, 110, 310, 410, or 510 and the rear tracking portions 31A, 331A, 431A, or 531A. In this case, when the user opens their hand that is already gripping the handle 11B, the front tracking portion 31B is located between the base (proximal end) of the user's thumb and forefinger. This prevents the input device 100 from falling from the user's hand when they open their hand.
[0185] [Fifth Example]
[0186] Figures 19 to 23This figure illustrates yet another example of the input device proposed in this disclosure. The input device 200 for the right hand will now be described in detail. The external shape of the input device 200 for the right hand is symmetrical to that of the input device 200 for the left hand. The number and type of operating elements placed on the operating portion 211A, described later, may differ between the left and right input devices 200. Furthermore, the operating elements may be asymmetrically placed between the input device 200 for the right hand and the input device 200 for the left hand.
[0187] like Figure 19 As shown, the input device 200 includes a main body 210, which includes a handle 211B and an operating portion 211A, with multiple operating components disposed on the operating portion 211A. The main body 210 includes the operating portion 211A on its upper part, and the handle 211B is formed below the operating portion 211A. The operating components disposed on the operating portion 211A can be operated with the thumb or forefinger while gripping the handle 211B. As operating components, for example, operation buttons 213 and 214 and an operating lever 215 are disposed on the operating portion 211A. Operation button 213 is disposed on the front surface 211a of the operating portion 211A and is operated, for example, with the forefinger. For example, operation button 214 and operating lever 215 are disposed on the upper surface of the operating portion 211A and are operated with the thumb. In the input device 200, multiple operation buttons 216 are disposed on the handle 211B.
[0188] like Figure 22 As shown, the input device 200 includes a tracking region in which a plurality of light-emitting portions H are arranged. The tracking region includes the outer surface of the rear curved portion 231A and the outer surface of the front connecting portion 231B (see Figure 231B). Figure 23 ).
[0189] like Figure 22 As shown, the rear-bending portion 231A includes an inner wall portion 231a and an outer wall portion 231c. The inner wall portion 231a extends rearward from the main body 210. The outer wall portion 231c is spaced to the right from the inner wall portion 231a. A user can grip a handle 211B located between the inner wall portion 231a and the outer wall portion 231c with their right hand. When the user grips the handle 211B, the inner wall portion 231a is located inside the hand, and the outer wall portion 231c is located outside the hand. A rear connecting portion 231b is located behind the inner wall portion 231a and the outer wall portion 231c and connects the upper parts of the inner wall portion 231a and the outer wall portion 231c. The lower parts of the inner wall portion 231a and the lower parts of the outer wall portion 231c are not connected to each other. Therefore, in the rear view of the input device 200, the rear-bending portion 231A has a generally U-shaped downward opening. When the input device 200 is used, the backward-curved portion 231A covers the upper side of the user's wrist.
[0190] like Figure 22 As shown, multiple light-emitting portions H are arranged on each of the inner wall portion 231a, the outer wall portion 231c, and the rear connecting portion 231b. Utilizing the rear-bending portion 231A with this shape, the light-emitting portions H disposed on the rear-bending portion 231A are less likely to be covered by the user's body, thereby enhancing the detection stability of the camera mounted on the HMD2 regarding the light-emitting portions H.
[0191] like Figure 22 As shown, the front connecting portion 231B is located in front of the rear curved portion 231A. In the plan view of the input device 100, the rear connecting portion 231b extends in the left-right direction over the upper side of the user's wrist. The outer wall portion 231c extends forward from the rear connecting portion 231b in a curved manner. The front connecting portion 231B further curves to extend forward and tilt to the left. In the example of the input device 100, the inner wall portion 231a, the outer wall portion 231c, the rear connecting portion 231b, and the front connecting portion 231B extend in different directions from each other, and all have an elliptical shape that elongates in the front-back direction in the plan view.
[0192] like Figure 23 As shown, the front connecting part 231B is located between the upper part of the outer wall portion 231c and the upper part of the main body 210 (operation portion 211A), and connects the two upper parts to each other. Figure 21 As shown, the front connecting portion 231B is located on the upper right side of the main body 210 (see figure). Figure 23 The front connecting portion 231B extends rearward from the upper part of the main body 210 in a curved manner, thereby connecting to the upper part of the outer wall portion 231c. With the front connecting portion 231B positioned in this way, when the user opens their hand that is already gripping the handle 211B, the front connecting portion 231B is located between the base (proximal end) of the user's thumb and forefinger. Therefore, when the user opens their hand, the input device 100 can be prevented from falling from their hand.
[0193] like Figure 22 As shown, the main body 210 is shifted to the left relative to the plane P3, which is the center of the input device 200 in the left-right direction. At the same time, the front connecting portion 231B is shifted to the right relative to the plane P3. With this positioning, the main body 210 can be easily operated by holding it with the right hand.
Claims
1. An input device, comprising: The main body includes a handle and at least one operating component, the at least one operating component being configured to receive a user operation, the user operation being based on a device that generates video, separate from the input device; A tracking region, wherein multiple light-emitting portions are arranged, the multiple light-emitting portions being configured to emit light captured by a camera included in the device, wherein the tracking region includes: The first part, in a side view in a direction rearward from the at least one operating member, includes a first plurality of light emitters; and The second part extends in a direction different from that of the first part in a forward direction, and includes a second plurality of light emitters.
2. The input device according to claim 1, wherein, The second portion extends from one of the upper part of the body and the first portion toward the upper part of the body and the other of the first portion.
3. The input device according to claim 1, wherein, The second part connects the upper part of the main body to the first part.
4. The input device according to claim 1, wherein, The shape of the second part is such that when the user unfolds his / her hand that has been holding the handle, the second part is located between the edge of the user's thumb and palm.
5. The input device according to claim 1, in, In the plan view of the input device, the second part is located on the upper right or left side of the main body, and The second part extends from the upper part of the main body toward the first part.
6. The input device according to claim 1, wherein, In the plan view of the input device, the main body is shifted toward a first side relative to a plane passing through the center in the left-right direction of the input device, and the second part is shifted toward a second side relative to a plane passing through the center in the left-right direction of the input device, the second side being the opposite side of the first side.
7. The input device according to claim 6, wherein, The second portion extends rearward from the upper part of the body toward the second side to connect to the first portion on the second side of the plane.
8. The input device according to claim 2, in, The second part is connected to the first part, and In the plan view of the input device, the connection between the second part and the first part is spaced to the right or left from the handle.
9. The input device according to claim 6, wherein, In the front view of the input device, the second portion extends from the upper part of the body toward the second side.
10. The input device according to claim 1, wherein, In a side view of the input device, the first portion extends in the direction in which the first portion intersects with the handle.
11. The input device according to claim 1, wherein, In a rear view of the input device, the first portion has an arc-shaped upper portion that at least covers the upper side of the handle.
12. The input device according to claim 11, wherein, In the rear view of the input device, the first portion has a ring shape.
13. The input device according to claim 1, wherein, The first part has an annular or arcuate shape that surrounds or covers a rearwardly inclined centerline.
14. The input device according to claim 12, wherein, The first part is basically circular.
15. The input device according to claim 1, wherein, The first part is connected to the lower part of the handle.
16. The input device according to claim 1, wherein, In a side view of the input device, the first portion is located behind the front of the handle.
17. The input device according to claim 1, wherein, In a side view of the input device, the first portion has an annular or arcuate shape that surrounds or covers a center line that extends backward and upward at an angle.
18. The input device according to claim 1, in, The handle is shifted relative to the center of the first part in the left-right direction in one of the left and right directions, and In the plan view of the input device, the first part has an annular or arcuate shape that surrounds or covers a centerline that extends backwards in one of the left and right directions.
Citation Information
Patent Citations
Operation device
JP2011164932A
Virtual reality hand gesture generation
US20190138107A1