Glove-type orthotic device

Abstract

To provide technology for realizing a new glove-type orthotic device for motion capture suitable for playing musical instruments. [Solution] The glove-type orthosis 30 is a glove-type orthosis for motion capture of musical instrument performance. The glove-type orthosis 30 comprises a wrist portion 32 for wrapping around the wrist and having a wrist marker 32m, a back-of-hand covering portion 34 for covering the back of the hand and having a back-of-hand marker 34m, and finger portions 36 having annular portions 36k for inserting the fingers and finger markers 36m. When a user puts on the glove-type orthosis 30, at least the tips of each finger and the palm are exposed.

Description

Technical Field

[0001] The present invention relates to a glove-type device for motion capture.

Background Art

[0002] For example, Patent Document 1 describes a technique of applying motion data of a user himself / herself captured using motion capture to a CG (Computer Graphics) video of an animation character.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is known a technique of linking the motion of a performer (measured person) and the motion of an avatar in real time by simultaneously and real-time executing the capture of motion data of the performer (measured person) using motion capture and the application of the motion data to the avatar. However, it has been difficult to apply the conventional technique to the use of linking in real time a performer (measured person) who actually plays a musical instrument and an avatar who plays a musical instrument in a virtual space.

[0005] That is, hand movement is essential and most important for playing a musical instrument. However, conventional glove-type devices for motion capture mostly cover from the wrist to the fingertips. Therefore, it has been difficult for a performer (measured person) to wear the glove-type device and play a guitar, a piano, etc.

[0006] The problem that this invention aims to solve is to provide a technology for realizing a new glove-type orthotic device for motion capture that is suitable for playing musical instruments. [Means for solving the problem]

[0007] The first invention for solving the above-mentioned problems is a glove-type orthosis for motion capture of musical instrument performance, comprising a wrist portion having a wrist marker and for wrapping around the wrist, a back-of-hand covering portion having a back-of-hand marker and for covering the back of the hand, and a finger portion having an annular portion for inserting the fingers and finger markers, wherein the glove-type orthosis is worn in such a way that at least the tips of each finger and the palm are exposed.

[0008] The glove-type orthosis of the first invention, when worn, exposes at least the fingertips of each finger and the palm. Because the sense of touch of the fingertips, fingertips, and palm is not obstructed, the performer (person being measured) can play a musical instrument much more easily than with conventional glove-type orthoses.

[0009] The second invention is a glove-type orthosis in which the finger portions are independently configured for each of the first to fifth fingers, and are of a length such that at least the tip of each finger beyond the distal phalanx is exposed when the glove is worn.

[0010] According to the glove-type orthosis of the second invention, since it is independently constructed for each of the first to fifth fingers, it is easier for the performer (person being measured) to play an instrument.

[0011] The third invention is a glove-type orthosis in which, in the above-mentioned glove-type orthosis, a specific finger portion among the finger portions for each of the second to fifth fingers has a shorter length along the finger compared to the other finger portions.

[0012] The fourth invention is a glove-type orthosis in which the specific finger portion is a finger portion for the second finger.

[0013] According to the glove-type orthosis of the third or fourth invention, if, for example, the finger portion of the second finger is designated as a specific finger portion, the exposed area of ​​the second finger will be larger than that of the other fingers when the glove is worn. Therefore, when playing a musical instrument that primarily utilizes the second finger, the performer (person being measured) will find it easier to play.

[0014] The fifth invention is a glove-type orthosis in which the specific finger portion has a length along the finger that engages with the third joint of the second finger.

[0015] According to the glove-type orthosis of the fifth invention, a specific finger portion is of a length that engages with the third joint of the second finger. Therefore, the finger portion of the second finger is of a length that does not engage with the part beyond the third joint, resulting in a larger exposed area.

[0016] The sixth invention is a glove-type orthosis described above, wherein the finger portion for the first finger and the other finger portions each have one of the corresponding finger markers, and further comprises an independent portion having the finger marker for the second finger and engaging with the second joint of the second finger.

[0017] The glove-type orthosis of the sixth invention makes it possible to capture the movement of each individual finger, and also allows for the largest possible exposed area of ​​the second finger when worn, thus ensuring ease of playing. [Brief explanation of the drawing]

[0018] [Figure 1] A side view showing an example configuration of a motion capture system. [Figure 2] A view from the back of the hand showing a glove-type orthosis being worn. [Figure 3] A view from the palm side of a glove-type orthosis being worn on the hand. [Figure 4] A cross-sectional view showing an example of a marker fixing structure. [Figure 5] A diagram showing a person playing an instrument while wearing a glove-type orthotic device. [Figure 6]View of the glove-type device of the second embodiment worn on the hand as seen from the back side. [Figure 7] View of the glove-type device of the second embodiment worn on the hand as seen from the palm side. [Figure 8] View of the glove-type device of the third embodiment worn on the hand as seen from the back side [Figure 9] View showing a modified example of the independent part. [Figure 10] View showing a modified example of the independent part.

Best Mode for Carrying Out the Invention

[0019] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. However, it is needless to say that the forms to which the present invention is applicable are not limited to the following embodiments.

[0020] 〔First Embodiment〕 FIG. 1 is a side view showing a configuration example of a motion capture system 1000. The motion capture system 1000 is a system that realizes optical motion capture. That is, the motion capture system 1000 photographs the state in which the subject 2 (actor), who is a performer, plays the musical instrument 3 with a plurality of cameras 4 that emit infrared light.

[0021] The subject 2 wears a motion capture suit 10 (including an upper suit, a lower suit, a beanie hat, and a foot wrap), a motion capture head mount 12, and a glove-type device 30, and plays the musical instrument 3.

[0022] In the example in Figure 1, subject 2 is shown playing an electric guitar as instrument 3, but the type of instrument 3 is not limited to this. For example, it could be a classical guitar, ukulele, biwa, harp, or other stringed instrument. It could also be a percussion instrument that uses sticks, such as a drum set. It could also be a piano or keyboard. Furthermore, in the example in Figure 1, both a right-hand glove-type orthosis 30R and a left-hand glove-type orthosis 30 are shown as the glove-type orthosis 30, but depending on the instrument, one of them may be a conventional glove-type orthosis.

[0023] The motion capture suit 10, the motion capture head mount 12, and the glove-type device 30 each have markers 6 at key locations.

[0024] The motion capture system 1000 includes a control computer system 1100. The control computer system 1100 acquires captured data from each camera 4 via a wired or wireless network 9.

[0025] The control computer system 1100 extracts markers 6 from images captured by multiple cameras 4 in real time, tracks each marker 6, and calculates the 3D position coordinates of each marker 6 in real time based on the principle of triangulation. The control computer system 1100 then controls the bone model of the avatar 8, to which markers 6 have been pre-associated with the joints, in real time based on the 3D position coordinates of each marker 6 calculated in the virtual 3D space.

[0026] Therefore, the motion capture system 1000 can generate and display computer graphics 18, including an avatar 8 that reflects the motion of the subject 2 in real time. These computer graphics 18 can be distributed to viewers as live video via the internet or the like. Furthermore, by equipping the motion capture system 1000 with a microphone, it can collect the sounds of the subject 2 playing an instrument or singing in real time, and output and distribute the audio together with the computer graphics 18.

[0027] Next, we will describe the glove-type orthosis 30. The right-hand glove-type orthosis 30R and the left-hand glove-type orthosis 30L are made symmetrically. Therefore, from here on, we will describe the glove-type orthosis 30 using the left-hand glove-type orthosis 30L as a representative example.

[0028] Figure 2 shows an example of the configuration of the glove-type orthosis 30, and is a view of the glove being worn on the hand from the back of the hand. Figure 3 shows an example of the configuration of the glove-type orthosis 30, and is a view of the glove being worn on the hand from the palm side.

[0029] The glove-type orthosis 30 is an orthosis that is worn in such a way that at least the tips of each finger and the palm are exposed, and comprises a wrist portion 32, a back-of-hand covering portion 34, and finger portions 36.

[0030] The wrist portion 32 has a wrist marker 32m (marker 6) and is a part that can be secured to the wrist by wrapping it around the wrist. The wrist portion 32 may also have, for example, a flexible belt portion 32b that can be wrapped around the wrist and adjusted in length using hook-and-loop fasteners.

[0031] The upper hand covering portion 34 has an upper hand marker 34m (marker 6) and a sheet portion 34s that covers the back of the hand. The sheet portion 34s is made of, for example, neoprene fabric.

[0032] The finger portions 36 (36a, 36b, 36c, 36d, 36e) are independently constructed for each of the first to fifth fingers, and are of a length that exposes at least the tip of each finger beyond the distal phalanx when worn.

[0033] The finger portion 36 has an annular portion 36k for inserting the corresponding finger and a finger marker 36m (marker 6).

[0034] The ring portion 36k is made of, for example, neoprene fabric. The ring portion 36k of the first finger encircles the middle phalanx of the first finger from the dorsal to the ventral side, and the dorsal end of the ring portion 36k is connected to the sheet portion 34s of the dorsal covering portion 34.

[0035] The ring portions 36k of the third, fourth, and fifth fingers encircle the corresponding proximal phalanges from the dorsal to the ventral side, and the dorsal end of the ring portion 36k is connected to the sheet portion 34s of the dorsal covering portion 34. Alternatively, the ring portions 36k of the third, fourth, and fifth fingers may be long enough to cover from the proximal phalanges to the very tips of the fingers, leaving only the fingertips exposed.

[0036] The ring portion 36k of the second finger is finished as a narrow ring so that it wraps around the ventral side of the third joint of the second finger, forming a cord-like structure. In other words, when considering the length of the ring portions 36k of the second to fifth fingers along the finger, the length of the ring portion 36k of the finger portion 36b (a specific finger portion) corresponding to the second finger is the length that engages with the third joint of the second finger, and is shorter than that of the other finger portions.

[0037] Each of the finger portions 36 (36a, 36c, 36d, 36e) of the first, third, fourth, and fifth fingers has a finger marker 36m fixed to the outer surface (front view from the back of the hand) of the annular portion 36k.

[0038] The finger portion 36b (specific finger portion) corresponding to the second finger has a finger marker 36m for the second finger fixed to an independent portion 38 that engages with the second joint independently of the annular portion 36k of the second finger.

[0039] The independent portion 38 comprises a sheet-like independent covering portion 380 that covers the dorsal side of the second joint of the second finger, a midphalangeal annular portion 381, and a proximal annular portion 382. The independent covering portion 380 is made of, for example, neoprene fabric. The midphalangeal annular portion 381 and the proximal annular portion 382 may be realized by sewing together a narrow portion that is integral with the independent covering portion 380 to form a ring, or by sewing a silicone ring or rubber ring onto the independent sheet-like independent covering portion 380.

[0040] The midphalanx annular portion 381 is used by placing it over the midphalanx side of the second joint when viewed from the ventral side of the second finger. The proximal phalanx annular portion 382 is used by placing it over the proximal phalanx side of the second joint when viewed from the ventral side of the second finger. The midphalanx annular portion 381 and the proximal phalanx annular portion 382 fix the independent covering portion 380 to the dorsal side of the second joint of the second finger.

[0041] By ensuring that the annular portion 381 on the middle phalangeal side and the annular portion 382 on the proximal phalangeal side do not enter the inner corner (the valley of flexion) when the second joint is bent, the ease of bending the second joint is achieved while reducing the feeling of a foreign object when bending.

[0042] Figure 4 is a cross-sectional view showing an example of the fixing structure of the markers 6 (wrist marker 32m, back of hand marker 34m, finger marker 36m) of the glove-type orthosis 30.

[0043] The fabric 40 of the sheet portion 34s, the annular portion 36k, and the independent covering portion 380 has holes 42 at the installation positions of the marker 6. A stud 44 is inserted into the hole 42 from the back side toward the front side, and a protruding cap 46 is placed over the protrusion of the stud 44 that protrudes toward the front side. The protrusion of the stud 44 is fitted into and fixed in the internal space formed within the protrusion of the protruding cap 46, and the fabric 40 is sandwiched between the stud 44 and the protruding cap 46. The recess of the marker 6 is then fitted into and fixed to the protrusion of the protruding cap 46. Of course, the method of fixing the marker 6 of the glove-type orthosis 30 may be other than this method.

[0044] Person 2 puts on the glove-type orthosis 30 following the steps (1) to (4) below. (1) With the sheet portion 34s of the upper covering portion 34 facing the back of the hand, insert the fingers corresponding to the ring portions 36k of the first to fifth fingers. (2) Adjust the adjustable belt portion 32b of the wrist portion 32 and secure it to the wrist. (3) The independent portion 38 is attached so that the finger marker 36m of the second finger is on the dorsal side of the second joint. At that time, the middle phalanx ring portion 381 is placed on the ventral side of the second finger from the valley of the second joint on the middle phalanx side, and the proximal phalanx ring portion 382 is placed on the ventral side of the second finger from the valley of the second joint on the proximal phalanx side.

[0045] When the glove-type orthosis 30 is fitted, at least the fingertips and palm of each finger are exposed. More specifically, for the first, third, fourth, and fifth fingers, both the dorsal and ventral sides of the fingers are exposed from the middle phalanx to the distal phalanx. For the second finger, the dorsal side of the second joint is covered by an independent portion 38, but the pads of the distal, middle, and proximal phalanges are exposed.

[0046] As described above, this embodiment makes it possible to realize a new glove-type orthotic device 30 for motion capture that is suitable for playing musical instruments.

[0047] Using the glove-type orthosis 30, the subject 2 can directly pluck the strings of the guitar-type instrument 3 with their fingertips and directly press down on the strings on the neck with their fingertips and fingertips, as shown in Figure 5. Therefore, it becomes possible to press down on the strings at the precise position based on the sense of touch with the fingertips and fingertips, which is important for playing the guitar-type instrument 3, so the subject 2 can play the instrument 3 in a state close to not wearing an orthosis on their hand. Techniques such as barre chords and string bending using the second finger can also be performed freely.

[0048] The glove-type orthosis 30 does not have markers 6 corresponding to the distal phalanges of the fingers, but the control computer system 1100 estimates and determines the three-dimensional position coordinates of the markers 6 corresponding to the distal phalanges. Therefore, the probability of marker 6 being replaced due to occlusion is greatly reduced, and the finger movements of the avatar 8 can be accurately reproduced in the same way as those of the person being measured 2.

[0049] Therefore, it becomes possible to conduct avatar-play type live streaming by capturing the performer's (subject's) instrument playing movements in real time as digital data using motion capture, and then controlling an avatar to play the instrument using that digital data.

[0050] [Second Embodiment] Next, a second embodiment of a glove-type orthotic device to which the present invention is applied will be described. In the following sections, we will mainly describe the differences from the glove-type orthosis 30 of the first embodiment. Elements similar to those of the glove-type orthosis 30 of the first embodiment will be denoted by the same reference numerals as in the first embodiment, and redundant explanations will be omitted.

[0051] Figure 6 shows an example of the configuration of the glove-type orthosis 30B of the second embodiment, and is a view from the back of the hand when worn. Figure 7 shows an example of the configuration of the glove-type orthosis 30B, and is a view from the palm side when worn on the hand. The glove-type orthosis 30B is also available in left-hand and right-hand versions, and these are made symmetrically.

[0052] The finger portion 36 of the glove-type orthosis 30B in the second embodiment has a first annular portion 361, a second annular portion 362, and a band-shaped portion 364. The band-shaped portion 364 is connected to the sheet portion 34s of the back-covering portion 34 and connects the second annular portion 362 and the first annular portion 361. The finger marker 36m of the glove-type orthosis 30B is fixed to the outer surface of the band-shaped portion 364.

[0053] For the first finger, the first annular portion 361 elastically tightens around the first joint by passing over it, and fixes the fingertip side of the band-shaped portion 364 to the finger. This can be achieved, for example, by sewing a silicone ring or a rubber ring to the band-shaped portion 364. The second annular portion 362 elastically tightens around the second joint by passing over it, and fixes the back of the band-shaped portion 364 to the finger. This can be achieved, for example, by sewing a silicone ring or a rubber ring to the band-shaped portion 364. Alternatively, similar to the annular portion 36k of the second finger in the first embodiment, a narrow portion may be provided at the end of the sheet portion 34s of the back-of-the-hand covering portion 34 and formed into a loop.

[0054] For the third to fifth fingers, the first annular portion 361 elastically tightens around the second joint by passing over it, and secures the fingertip side of the band-shaped portion 364 to the finger. This can be achieved, for example, by sewing a silicone ring or a rubber ring to the band-shaped portion 364. The second annular portion 362 elastically tightens around the third joint by passing over it, and secures the back of the band-shaped portion 364 to the finger. This can be achieved, for example, by sewing a silicone ring or a rubber ring to the band-shaped portion 364. Alternatively, similar to the annular portion 36k of the second finger in the first embodiment, a narrow portion may be provided at the end of the sheet portion 34s of the back-of-the-hand covering portion 34 and formed into a loop.

[0055] Furthermore, the first annular portion 361 may achieve engagement with the finger through two rings, similar to the midphalangeal annular portion 381 and proximal annular portion 382 in the independent portion 38 of the first embodiment.

[0056] The glove-type orthosis 30B provides the same effects as the glove-type orthosis 30 of the first embodiment. In addition, when worn, the ventral sides of the proximal phalanges of the first, third, fourth, and fifth fingers are also exposed. Therefore, for example, with a guitar-type instrument 3, it is suitable for playing in which the strings of the neck are pressed directly with the pads of the first, third, fourth, and fifth fingers.

[0057] [Third Embodiment] Next, a third embodiment of a glove-type orthotic device to which the present invention is applied will be described. In the following sections, we will primarily describe the differences between this embodiment and the glove-type orthosis 30 of the first embodiment. Elements similar to those of the glove-type orthosis 30 of the first embodiment and the glove-type orthosis 30B of the second embodiment are denoted by the same reference numerals as in the first and second embodiments, and redundant explanations are omitted.

[0058] Figure 8 shows an example of the configuration of the glove-type orthosis 30C of the third embodiment, and is a view from the back of the hand when worn.

[0059] The finger portion 36 of the glove-type orthosis 30C has independent portions 38 (38a, 38b, 38c, 38d, 38e) for all fingers from the first to the fifth finger. However, for the first finger, finger portion 36a is attached to the distal phalanx of the first finger.

[0060] The glove-type orthosis 30C provides the same effects as the glove-type orthosis 30 of the first embodiment. In addition, when worn, the ventral sides of the proximal phalanges of the first, third, fourth, and fifth fingers are also exposed. Therefore, for example, with a guitar-type instrument 3, it is suitable for playing in which the strings of the neck are pressed directly with the pads of the first, third, fourth, and fifth fingers.

[0061] [Variation] Although examples of embodiments to which the present invention is applied have been described above, the forms to which the present invention can be applied are not limited to the above forms, and components can be added, omitted, or modified as appropriate.

[0062] (Variation 1) As variations to accommodate different types of instruments 3 and user preferences, the fingers having independent portions 38 in the finger portions 36 can be appropriately configured. For example, based on the first and second embodiments, a glove-type orthosis can be realized in which one or more of the third to fifth fingers have independent portions 38 in the finger portions 36.

[0063] (Variation 2) In the above embodiment, an example was shown in which the independent portion 38 is made of neoprene fabric, but it may be made of other materials. For example, as shown in Figure 9, the independent covering portion 380, the middle nodal side annular portion 381, and the proximal nodal side annular portion 382 in the independent portion 38 of the first embodiment may be integrally molded as a thin film silicone rubber annular body.

[0064] The independent portion 38D has a hole 42 in the portion corresponding to the independent covering portion 380, and the finger marker 36m(6) may be fixed with the stud 44 and the projection cap 46 (see Figure 4).

[0065] (Variation 3) In the above embodiment, the independent portion 38 is elastically deformed by passing the string-like or narrow band-like mid-phalangeal annular portion 381 and proximal-phalangeal annular portion 382 through the pad of the finger and is fixed to the finger by elastic tightening. However, it may also be configured to be fastened with tape.

[0066] For example, in the independent portion 38E shown in Figure 10, a finger marker 36m is fixed to a projection of the projection base 47. The projection base 47 has a first tape attachment portion 49a and a second tape attachment portion 49b, flanked by a thin-walled portion 48. The first tape attachment portion 49a and the second tape attachment portion 49b are plate-like portions that rest on the back of the finger. The thin-walled portion 48 makes the first tape attachment portion 49a and the second tape attachment portion 49b more flexible relative to the projection base 47.

[0067] The user aligns the projection base 47 with the second joint (or a position shifted towards the middle or proximal phalanx of the second joint), and aligns the first tape application portion 49a and the second tape application portion 49b in the length direction of the finger. Then, the middle phalanx of the second finger is wrapped and secured with the elastic tape 50a together with the first tape application portion 49a, and the proximal phalanx of the second finger is wrapped and secured with the elastic tape 50b together with the second tape application portion 49b.

[0068] While the independent section 38E requires more effort to attach and detach from the finger compared to other configurations, it can be fixed more securely, making it a viable option for users who play intensely. [Explanation of symbols]

[0069] 2… Person being measured 3…Musical Instruments 6… Marker 30… Glove-type orthotic device 32... Wrist area 32m... Wrist marker 34...Instep covering part 34m... Marker for the top of the court 36...Finger part 36k... Ring portion 36m... Finger marker 38…Independent part 1000…Motion Capture System 1100... Control computer system

Claims

1. A glove-type device for motion capture of musical instrument performance, It has a wrist marker, a wrist portion for wrapping around the wrist, It has a marker for the back of the hand, and a back-of-hand covering portion that covers the back of the hand, A finger portion having a ring-shaped section for inserting a finger and a finger marker, Equipped with, A glove-type orthosis that is worn in a way that exposes at least the fingertips of each finger and the palm of the hand.

2. The aforementioned finger portions are independently constructed for each of the first to fifth fingers, and are of a length such that at least the tip of each finger beyond the distal phalanx is exposed when worn. The glove-type orthotic device according to claim 1.

3. A specific finger portion of the aforementioned finger portion for each of the second to fifth fingers has a shorter length along the finger compared to the other finger portions. The glove-type orthotic device according to claim 2.

4. The aforementioned specific finger portion is the finger portion for the second finger. The glove-type orthotic device according to claim 3.

5. The aforementioned specific finger portion has a length along the finger that engages with the third joint of the second finger. The glove-type orthotic device according to claim 4.

6. The finger portion for the first finger and the other finger portions each have one of the corresponding finger markers. Having the finger marker on the second finger, an independent portion that engages with the second joint of the second finger, The glove-type orthosis according to claim 5, further comprising the following:

Images