System and sandbag

Abstract

To prevent reality of an experience from being lost in a system for providing the experience that gives a physical impact.SOLUTION: A system (S1) includes: a first member (13); a second member (11) that applies an impact to the first member due to an action of a user (U1), at least one of the first and second members having flexibility; a plurality of capacitive sensors (141) that is regularly arranged at predetermined intervals along a surface of the first member; a conductive member (12) that is arranged on a surface of the second member; and an output unit (15) that provides a detection signal that indicates intensity of the impact received by the first member from the second member to a device which executes processing based on the detection signal on the basis of the number of capacitive sensors in which capacitance with the conductive member has changed when the second member gives the impact to the first member.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a system and a punching bag. [Background technology]

[0002] Conventionally, there is known a boxing game machine as described in Patent Document 1. This game machine includes a striking bag, pressure sensors provided at multiple locations on the striking bag, a TV monitor for displaying images of a player's dummy and a virtual opponent, a speaker for outputting sound effects, and control means for moving the image on the TV monitor based on the output of the pressure sensor and outputting sound effects from the speaker. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 1-274780 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional game machines such as that described in Patent Document 1 detect the strength of a blow using a pressure sensor. Since the pressure sensor detects the strength of the pressure received according to the degree of deformation, it may take time to return to the original state after being deformed by a blow. For this reason, conventional game machines may not be able to recognize blows that are repeated in a short cycle. Furthermore, conventional game machines are provided with one pressure sensor on each part of the striking bag that receives blows (corresponding to the front of the face, the chin, the abdomen, etc.). For this reason, if a blow misses the pressure sensor, the game machine may not be able to recognize the blow. A situation in which the game machine does not recognize a blow even though the user is striking is problematic from the viewpoint of the reality of the experience.

[0005] One aspect of the present invention has been made in consideration of the above-mentioned problems, and aims to provide a system for providing an experience of applying a physical shock, in which the reality of the experience is not compromised. [Means for solving the problem]

[0006] In order to solve the above problems, a system according to one embodiment of the present invention includes a first member and a second member that applies an impact to the first member due to a user's action, at least one of which is flexible, a plurality of capacitance sensors arranged regularly at predetermined intervals along a surface of the first member, a conductive member arranged on the surface of the second member, and an output unit that provides a detection signal indicating the strength of the impact received by the first member from the second member to a device that performs processing based on the detection signal, based on the number of capacitance sensors whose capacitance between the conductive member and the capacitance sensor changes as a result of the second member applying an impact to the first member. Effect of the Invention

[0007] According to each aspect of the present invention, in a system for providing an experience of applying a physical shock, it is possible to prevent the reality of the experience from being impaired. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the electrical configuration of the system. [Diagram 3] FIG. 2 is a diagram showing an example of an arrangement of a plurality of capacitance sensors included in the system. [Figure 4] 1A and 1B are diagrams illustrating a concept of setting intervals between capacitance sensors. [Diagram 5] 13 is a diagram showing an example of a third member (sixth member) included in the system. FIG. [Figure 6] 4 is a flowchart showing the flow of operation of the system. [Figure 7]FIG. 11 is a diagram illustrating an example of a system according to a second embodiment of the present invention. [Figure 8] 13A and 13B are diagrams showing modified examples of punching bags included in the system. [Figure 9] 13A and 13B are diagrams showing examples of impacts (punches) that can be detected by a punching bag according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] <Embodiment 1: Boxing Experience System> The system according to this embodiment is a boxing experience system (hereinafter, system S1). The system S1 provides users U1 and U2 with a competitive boxing experience in a virtual space.

[0011] [System configuration] As shown in FIG. 1, the system S1 includes a first set 1, a second set 2, and a simulation device 3. These can communicate with each other via a communication network N. The opponent of the user U1 may be a user U2 different from the user U1, or may be a computer. When the opponent is a computer, the system S1 does not need to include the second set 2.

[0012] [First set] The first set 1 is a set of various members used by a user U1. As shown in Fig. 1 and Fig. 2, the first set 1 according to this embodiment includes a pair of gloves 11, a pair of conductive members 12, a punching bag 13, a first impact detection unit 14a, a second impact detection unit 14b, an output unit 15, a headgear 16a, wear 16b, a head mounted display (hereinafter, HMD) 17, and an access point (hereinafter, AP) 18.

[0013] (Gloves) The pair of gloves 11 is a second member according to this embodiment. The pair of gloves 11 are worn on both hands of a user. Each glove 11 has flexibility. The glove 11 applies an impact to the punching bag 13 due to a striking motion (movement of throwing a fist) of the user U1.

[0014] (Conductive material) The conductive member 12 is disposed on the surface of the glove 11. The conductive member 12 according to this embodiment is disposed on the surface layer of the portion of the glove 11 that collides with the punching bag 13. The conductive member is conductive rubber or conductive cloth. This allows the conductive member to bend in accordance with the deformation of the glove 11 when the glove 11 gives an impact to the punching bag 13.

[0015] (Sandbag) The punch bag 13 is a first member according to this embodiment. The punch bag 13 has flexibility. The punch bag 13 according to this embodiment is configured so that the surface portion is deformed (depressed or bent) by an external impact. The punch bag 13 according to this embodiment has a cylindrical shape extending in the vertical direction and has a height of about a human height (1.5 to 2 m). The lower end of the punch bag 13 according to this embodiment is placed on the floor. The lower end of the punch bag 13 may be a weight or may be fixed to the floor. The punch bag 13 may be suspended from above.

[0016] 8, the sandbag 13 may include a main body 131, a support member 132, and a detection unit 133. The support member 132 is a member that supports the main body. When the sandbag 13 is suspended from above, the support member 132 is composed of a frame or the like that has rigidity and is connected to the upper end of the main body 131. On the other hand, when the lower end of the sandbag 13 is a weight 134 or is fixed to the floor, the support member 132 is a support 132 that is provided so as to extend vertically. The lower end of the support 132 is supported by the weight 134 (base) or is fixed to the floor. The main body 131 is provided so as to cover the side of the support 132. In the example shown in FIG. 8, the main body 131 also covers the upper part of the support 132. The detection unit 133 is provided on the support member 132. The detection unit 133 detects an action from the main body 131 to the support 132 when the glove 11 applies an impact to the main body 131. The "action" includes at least one of the magnitude of the force received by the support 132 from the main body 131, the direction of the force, and the moment. The detection unit 133 according to this embodiment is configured with, for example, a force sensor. The force sensor is provided at the lower part of the support 132, at the joint between the frame and the main body 131, and the like. The force sensor detects a force Fx in the X-axis direction (for example, a horizontal direction facing the first and second impact detection units 14a and 14b described later), a force Fy in the Y-axis direction (a horizontal direction perpendicular to the X-axis direction), and a force Fz in the Z-axis direction (vertical direction) that the support 132 receives from the main body 131, as well as a moment Mx about the X-axis, a moment My about the Y-axis, and a moment Mz about the Z-axis that the support 132 receives from the main body 131. The detection unit 133 may be configured with a load cell.

[0017] (First and second impact detection units) The first impact detection unit 14a is provided on the upper part of the punching bag 13 (at a position corresponding to the head of a person standing upright). As shown in Fig. 2, the first impact detection unit 14a includes a plurality of capacitance sensors 141. The plurality of capacitance sensors 141 are regularly arranged at predetermined intervals along the surface of the punching bag 13. When the glove 11 comes into contact with the capacitance sensor 141 (when the conductive member 12 approaches or comes into contact with the capacitance sensor 141), the capacitance sensor 141 increases the capacitance between the conductive member 12.

[0018] As shown in Fig. 3, the multiple capacitance sensors 141 according to this embodiment are arranged in a matrix in a diagonal direction. The arrangement of the multiple capacitance sensors 141 may be, for example, a matrix in a horizontal and vertical direction, or may be a concentric circle. As shown in Fig. 4, the intervals between the capacitance sensors 141 are set so that the number of capacitance sensors 141 that simultaneously contact the conductive member 12 can increase as the impact (degree of deformation of the glove 11 and the punching bag) given by the glove 11 to the punching bag 13 increases.

[0019] The capacitance sensor according to this embodiment is an embroidery sensor. The embroidery sensor is made of conductive thread attached to the surface layer of the punchbag 13. "Attached" also includes "sewn." That is, the conductive thread forming the embroidery sensor may be sewn directly to the surface of the punchbag 13, or may be sewn to a sheet-like member attached to the surface of the punchbag 13. The embroidery sensor is provided such that a single conductive thread does not come into contact with itself and completely fills the inside of the contour (e.g., a rectangle) of the capacitance sensor in one stroke.

[0020] The second impact detection unit 14b is provided in the center (a position corresponding to the abdomen of a person standing upright) of the punching bag 13. The second impact detection unit 14b is configured similarly to the first impact detection unit 14a, except for the position where it is provided.

[0021] (Output section) The output unit 15 is provided on the sandbag 13. The output unit 15 according to this embodiment is a board connected to each of the capacitance sensors 141 of the first and second impact detection units 14a and 14b. The output unit 15 provides a detection signal to the simulation device 3 based on the number of capacitance sensors whose capacitance between the conductive member and the glove 11 has changed as the glove 11 has applied an impact to the sandbag 13. The "detection signal" is a signal indicating the strength of the impact the sandbag 13 has received from the glove 11. The output unit 15 according to this embodiment provides a detection signal to the simulation device 3 based on the position and the number of capacitance sensors whose capacitance between the conductive member and the glove 11 has changed as the glove 11 has applied an impact to the sandbag 13. That is, the "detection signal" output by the output unit 15 according to this embodiment is a signal indicating the position where the sandbag 13 has received an impact from the glove 11 and the strength of the impact (the position where the glove 11 has applied an impact to the sandbag 13 and the strength of the impact).

[0022] Furthermore, in the case where the sandbag 13 includes the detection unit 133, the output unit 15 according to this embodiment provides a second detection signal to the simulation device 3. The "second detection signal" is a signal indicating an action from the main body 131 to the support 132 caused by the glove 11 giving an impact to the main body 131. In the case where the detection unit 133 is configured with a force sensor, the second detection signal is a signal indicating the magnitude and direction of the force (the X-axis, Y-axis, and Z-axis components Fx, Fy, and Fz of the force) received by the support 132 from the main body 131, detected by the force sensor, as well as the moments Mx, My, and Mz.

[0023] The output unit 15 according to this embodiment transmits the detection signal and the second detection signal to the simulation device 3 via a wireless communication module and AP 18 (not shown). The output unit 15 may be configured to provide the detection signal and the second detection signal directly to the second set 2 (without going through the simulation device 3). The output unit 15 may also be configured to provide the detection signal and the second detection signal via a wired connection. In that case, the first set 1 may not include a wireless communication module and AP 18.

[0024] (Headgear and clothing) The headgear 16a and the wear 16b are a sixth member according to this embodiment. The headgear 16a and the wear 16b are worn by the user U1. The headgear 16a is worn on the head of the user U1. The wear 16b is worn on the torso of the user U1. As shown in FIG. 5, the headgear 16a and the wear 16b are provided with a plurality of transducers 161 on the surfaces that contact the user U1. The headgear 16a is provided with transducers 161 on the surfaces that contact the temples, cheeks, and chin of the user U1. The wear 16b is provided with transducers 161 on the surfaces that contact the solar plexus, flanks, and upper right half of the body (where the liver is located). The headgear 16a and the wear 16b each include an input unit 162. The input unit 162 acquires a control signal from the simulation device 3. Then, the input unit 162 supplies power to the vibrator 161 in response to the acquired control signal to vibrate the vibrator 161. The first set 1 may include only either the headgear 16a or the wear 16b. In addition, if the boxing experience does not involve a counterattack from an opponent, the first set 1 may not include the headgear 16a or the wear 16b.

[0025] (HMD) The HMD 17 displays an image representing the virtual space acquired from the simulation device 3. The HMD 17 is also worn on the head of the user U1. This allows the user U1 to obtain a sense of realism as if he or she were present in the virtual space. The HMD 17 according to this embodiment displays VR images. Therefore, the user U1 wearing the HMD 17 can be immersed in the sensation of being present in a more realistic virtual space. The HMD 17 may have a built-in speaker.

[0026] (AP) The AP 18 relays communications between the output section 15, the headgear 16a and the wear 16b, the second set 2 and the simulation device 3.

[0027] [Second set] The second set 2 is a set of various members used by another user U2 who is an opponent of the user U1. The second set 2 according to the present embodiment includes a pair of gloves 21, a pair of conductive members 22, a punching bag 23, a third impact detector 24a, a fourth impact detector 24b, an output unit 25, a headgear 26a, wear 26b, an HMD 27, and an AP 28.

[0028] The pair of gloves 21 is a fifth member according to this embodiment. The pair of conductive members 22 is another conductive member according to this embodiment. The punch bag 23 is a fourth member according to this embodiment. The capacitance sensor 241 provided in the third impact detection unit 24a and the fourth impact detection unit 24b is another capacitance sensor according to this embodiment. The output unit 25 is another output unit according to this embodiment. The headgear 26a and the wear 26b are a third member according to this embodiment. The vibrator 261 provided in the headgear 26a and the wear 26b is another vibrator according to this embodiment. Each member of the second set 2 is configured similarly to each member of the first set 1, except that the user and the place of use are different.

[0029] [Simulation device] The simulation device 3 is an example of a device that executes processing based on the detection signal and the second detection signal. As shown in FIG.

[0030] (Memory) The memory 32 stores a control program for operating the simulation device 3. The memory 32 according to this embodiment also stores image data for generating a virtual space.

[0031] (Processor) The processor 31 generates an image of a virtual space including the opponent of the user U1 based on the detection signal and the second detection signal from the output unit 15 of the first set 1, and supplies the generated image to the HMD 17 worn by the user U1. The processor 31 generates a VR (Virtual Reality) image reproducing a ring and the opponent standing on it. Then, the processor 31 transmits data of the generated VR image to the HMD 17 via a communication module and the AP 18 (not shown). When the processor 31 receives the detection signal and the second detection signal from the output unit 15 of the first set 1, the processor 31 generates a VR image of the opponent according to the position where the punching bag 13 received an impact from the glove 11 and the strength of the impact indicated by the detection signal, and the magnitude, direction of the force, and moment of the force received by the support member 132 of the punching bag 13 from the main body 131 indicated by the second detection signal. Specifically, the processor 31 generates VR images of, for example, an opponent with a look of agony, an opponent staggering, an opponent falling, etc. For example, if the magnitude of the force that the support 132 received from the main body 131, as indicated by the second detection signal, is equal to or greater than a predetermined value, and the strength of the impact indicated by the detection signal is also equal to or greater than a predetermined value (the glove 11 hits the first impact detection unit 14a or the second impact detection unit 14b of the punching bag 13), the processor 31 generates a VR image of the opponent with a large degree of damage (the way his / her facial expression is distorted, how he / she stumbles, how he / she falls). If the strength of the impact indicated by the detection signal and the magnitude of the force indicated by the second detection signal are equal to or greater than a predetermined value, and the direction of the force indicated by the second detection signal is the X-axis direction (the first impact detection unit 14a or the second impact detection unit 14b receives a straight punch as shown in FIG. 9), the processor 31 generates a VR image of the opponent who is punched in the face or stomach and stumbles backward (away from the user U1) or falls. Furthermore, when the strength of the impact indicated by the detection signal and the magnitude of the force indicated by the second detection signal are equal to or greater than a predetermined value, and the direction of the force indicated by the second detection signal is in the Y-axis direction (when a hook punch as shown in FIG. 9 is received by the first impact detection unit 14a or the second impact detection unit 14b), the processor 31 generates a VR image of the opponent being punched in the face or stomach, staggering or falling with their face or upper body twisted to the side.Also, when the strength of the impact indicated by the detection signal and the magnitude of the force indicated by the second detection signal are equal to or greater than a predetermined value, and the direction of the force indicated by the second detection signal is upward in the Z-axis direction (when the first impact detection unit 14a or the second impact detection unit 14b receives an upper punch as shown in FIG. 9), the processor 31 generates a VR image of the opponent who is punched in the face and staggers backward while looking up or falls, or a VR image of the opponent who is punched in the stomach and staggers forward (toward the user U1) or crouches down. On the other hand, in cases other than the above, the processor 31 generates a VR image of the opponent who is less damaged. Examples of "cases other than the above" include a case where the strength of the impact indicated by the detection signal is equal to or less than a predetermined value (including zero), a case where the position where the impact indicated by the detection signal was received is the periphery of the first impact detection unit 14a or the second impact detection unit 14b, and the like. The processor 31 then transmits data of the generated VR image to the HMD 17.

[0032] In addition, based on the detection signal from the output section 15 of the first set 1, the processor 31 transmits a control signal to the headgear or wear of the second set 2 (worn by another user U2) instructing it to vibrate the vibrator 161 located at a position corresponding to the capacitance sensor that has changed the capacitance.

[0033] In addition, the processor 31 in this embodiment generates an image of a virtual space including the opponent of user U2 based on other detection signals and other second detection signals from the output section 25 of the second set 2, and supplies the generated image to the HMD 27 worn by user U2.

[0034] In addition, based on the detection signal and the second detection signal (other detection signals and other second detection signals) from the punching bag 23 of the second set 2, the processor 31 transmits a control signal to the headgear 16a or wear 16b of the first set 1 (worn by the user U1) instructing it to vibrate the vibrator 161 located at a position corresponding to the capacitance sensor that has changed the capacitance.

[0035] The processor 31 also calculates a striking point based on the detection signal (positions and number of the capacitance sensors 141, 241 in contact with the conductive members 12, 22) and the second detection signal acquired from the output units 15, 25. The striking point is a numerical value indicating the effectiveness of the striking. The processor 31 then generates a VR image including a number, a scale, or the like indicating the striking point. The processor 31 calculates the striking point by taking into consideration at least one of the following, in addition to the strength of the striking: whether the part struck is an effective striking part; whether the opponent is guarding; and whether the opponent has avoided the attack. The effective striking part may be a part (face, stomach, etc.) corresponding to the part of the punching bag 13 where the first impact detection unit 14a and the second impact detection unit 14b are provided, or a part (solar plexus, chin, etc.) corresponding to a part of the first impact detection unit 14a and the second impact detection unit 14b. If the part where the strike is made is the effective striking part (the glove 11 hits the first impact detection part 14a or the second impact detection part 14b of the punch bag 13), the strike point is calculated to be higher than when the strike is made to a part other than the effective striking part (the glove 11 hits a part of the punch bag 13 where the first impact detection part 14a and the second impact detection part 14b are not provided). If the strike is made to a part other than the effective striking part, the strike point may be negative (a deduction in points). If a specific impact (straight, uppercut, etc.) is made to the effective striking part, the processor may calculate the strike point to be even higher. If the strike is made when the opponent is guarding, the strike point is calculated to be lower than when the opponent is not guarding or avoiding the attack. If the opponent avoids the attack, the strike point is not calculated or is calculated to be 0. The strike point may be calculated by referring to a table showing the relationship between the position and number of the capacitance sensors 141, 241 in contact with the conductive members 12, 22 and the posture and pose of the opponent. In addition, the impact point may be calculated using a formula that indicates these relationships, or a trained model constructed by machine learning using these relationships as training data.

[0036] Processor 31 also accumulates the calculated hit points and generates a VR image including numbers, scales, etc. indicating the accumulated value. Processor 31 also determines whether or not the accumulated value has reached a predetermined value. Then, when the accumulated value reaches the predetermined value (when the accumulated value reaches the predetermined value first in the case of a fight), processor 31 generates a VR image indicating that the fight has been won (the opponent has been knocked out).

[0037] The processor 31 may be configured to obtain video data of the boxer actually boxing, for example, captured by a wearable camera attached to the boxer, and create a VR video based on the data. In this way, the user U1 can feel as if he or she is experiencing high-level boxing by a boxer. The processor 31 may also be configured to generate a virtual space that is not a VR video and an avatar of the user U1 that exists in the virtual space.

[0038] The processor 31 may also be configured to generate sounds in the virtual space and transmit them to the HMD 17. The sounds include step sounds, strike sounds, gongs, and the like. The processor 31 may also perform the above-described operations based on the detection signal and the second detection signal based only on the detection signal (without using the second detection signal).

[0039] The processor 31 may be connected to an interface device provided at the location where the first set 1 is placed and the location where the second set 2 is placed. The interface device includes a plurality of force plates laid out on the floor, and an output unit that provides the simulation device 3 with output signals of the force plates that detect the foot pressure of the users U1 and U2, and third detection signals that indicate the positions of the users U1 and U2 on the floor and the postures of the users, which are specified based on the positions of the force plates. The processor 31 may be configured to determine whether the user U2 has avoided the hit of the user U1 based on the third detection signal (the position and posture of the user U2) output by the interface device on the user U2 side when the user U1 hits the punch bag 13.

[0040] <Boxing experience system operation> The system S1 configured as described above starts operation when a predetermined start condition is satisfied, such as when the power of the system S1 is turned on, when the user U1 puts on the glove 11, when the user U1 stands at a predetermined battle position, when the user U1 performs a predetermined start operation, etc.

[0041] When the system S1 starts operating, as shown in Fig. 6, the simulation device 3 first generates VR images of the ring and the opponents (step A1), and provides the data to the HMDs 17 and 27 worn by the users U1 and U2, respectively (step A2). Then, the HMDs 17 and 27 that receive the VR image data display the VR images on their display units (step B1). This starts the boxing experience in the virtual space for the users U1 and U2.

[0042] When users U1 and U2 wearing gloves 11 and 21 strike punches on punching bags 13 and 23 (first and second impact detectors 14a and 14b, third and fourth impact detectors 24a and 24b) while VR images are displayed on HMD 17, the capacitance between conductive members 12 and 22 of gloves 11 and 21 and capacitance sensors 141 and 241 of punching bags 13 and 23 in contact with conductive members 12 and 22 changes (step C1). Then, output units 15 and 25 provide the detection signal and the second detection signal, the other detection signal and the other second detection signal to simulation device 3 (step C2).

[0043] Then, every time the simulation device 3 acquires the detection signal, the second detection signal, the other detection signal, and the other second detection signal, it identifies the vibrator 161, 261 provided at the position corresponding to the capacitance sensor that has changed the capacitance based on the detection signal, the other detection signal, as the vibrator 161, 261 to be vibrated (step A3). Then, the simulation device 3 provides the headgear 16a, 26a or the wear 16b, 26b with a control signal or other control signal instructing the identified vibrator 161, 261 to vibrate (step A4). Then, the headgear 16a, 26a or the wear 16b, 26b that has acquired the control signal or other control signal vibrates the vibrator 161, 261 instructed by the control signal or other control signal (step D1).

[0044] Moreover, each time the detection signal, the second detection signal, the other detection signal, and the other second detection signal are acquired, the simulation device 3 generates a VR image of the opponent according to the position where the punching bag 13, 23 received the impact from the glove 11, 21, and the strength of the impact, which are indicated by the detection signal and the other detection signal, and the magnitude of the force, the direction of the force, and the moment, which are indicated by the second detection signal and the other second detection signal, that the support member 132 of the punching bag 13, 23 received from the main body 131 (step A5). Then, the simulation device 3 supplies the data of the generated VR image to the HMD 17, 27 worn by the users U1, U2 (step A6). Then, the HMD 17, 27 that has acquired the VR image data displays VR images of the opponent with a look of agony, the opponent staggering, the opponent falling, and the like (step B2).

[0045] [System effects] In boxing, strikes are repeated in short cycles. However, the system S1 detects strikes from changes in capacitance between the capacitance sensor 141 arranged on the punch bag 13 and the conductive member 12 provided on the glove 11. The capacitance increases or decreases immediately when the distance between the capacitance sensor 141 and the glove 11 changes. Therefore, the system S1 can reliably recognize strikes that are repeated in short cycles.

[0046] In boxing, it is not always possible to land a pinpoint strike on a specific location. However, the system S1 detects strikes using the first to fourth impact detection units 14a, 14b, 24a, and 24b, which are configured with a plurality of capacitance sensors regularly arranged at a predetermined interval (with a spread). Therefore, even if the user's strike deviates from the intended location, the system S1 can recognize the strike.

[0047] In addition, since the punching bag 13 and the glove 11 are flexible, the number of capacitance sensors 141 in contact with the conductive member 12 changes depending on the strength of the impact. This allows the system S1 to recognize the strength of the blow. In other words, the system S1 can prevent the reality of the experience from being impaired in a system for providing an experience of a physical impact.

[0048] Furthermore, the simulation device 3 according to this embodiment calculates and accumulates the hitting points based on the acquired detection signal and the second detection signal, and provides them to the HMDs 17 and 27. As a result, the users U1 and U2 can visually recognize the attack points (damage inflicted on the opponent by hitting) and the accumulated value (cumulative damage inflicted on the opponent so far) in addition to the VR image of the opponent and the impact from the vibrator, and can experience boxing with a more game-like feel.

[0049] <Embodiment 2: Catch Ball> Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals will be given to members having the same functions as those described in the first embodiment, and the description thereof will not be repeated.

[0050] The system according to this embodiment is a catch ball experience system (hereinafter, referred to as system S2). The system S2 provides a user U3 with a catch ball experience in a virtual space.

[0051] [System configuration] As shown in FIG. 7, the system S2 includes a first set 1A, a second set 2A, and a simulation device 3A.

[0052] [First set] The first set 1A is a set of various members used by users U3 and U4 who actually play catch. The first set 1A according to this embodiment includes an output unit 15 and an AP 18 similar to those of the first set 1 according to the above-mentioned embodiment 1, as well as a ball 11A, a conductive member 12A, a first catcher's mitt 13A, and an impact detection unit 14c.

[0053] (ball) The ball 11A is a second member according to this embodiment. The ball 11A is held by the user U3. The ball 11A impacts the first catcher's mitt 13A due to the pitching motion (motion of throwing the ball 11A) of the user U3. The ball 11A may or may not have flexibility.

[0054] (Conductive material) Conductive member 12A according to this embodiment is disposed on the entire surface layer of ball 11 A. Conductive member 12A is conductive leather, conductive rubber, or conductive cloth.

[0055] (First catcher's mitt) The first catcher's mitt 13A is a first member according to this embodiment. The first catcher's mitt 13A has flexibility. The first catcher's mitt 13A according to this embodiment is held by a user U4. The first catcher's mitt 13A may be fixed to a wall or the like.

[0056] (Impact detection section) The impact detection unit 14c is provided in the center of the first catcher's mitt 13A (the surface that contacts the palm of the user U4). The impact detection unit 14c is configured similarly to the first impact detection unit 14a according to the first embodiment, except for the provided members. [Second set] The second set 2A is a set of various members used by a user U5 who has a simulated experience of playing catch. The second set 2 according to this embodiment includes an HMD 27 and an AP 28 similar to those of the second set 2 according to the first embodiment, and a second catcher's mitt 26c.

[0057] (Second catcher's mitt) The second catcher's mitt 26c is a third member according to this embodiment. The second catcher's mitt 26c is worn on the hand of the user U5. The second catcher's mitt 26c is provided with at least one vibrator 261 on a surface that comes into contact with the palm of the user U5. The second catcher's mitt 26c also includes an input unit 262. The input unit 262 acquires a control signal from the simulation device 3A. Then, the input unit 262 supplies power to the vibrator 261 in response to the acquired control signal to vibrate the vibrator 261.

[0058] [Simulation device] The processor 31 of the simulation device 3A generates an image of a virtual space including a pitcher, and supplies the generated image to the HMD 17 worn by the user U5. The processor 31 generates a VR (Virtual Reality) image reproducing the pitcher. The processor 31 of the simulation device 3A also estimates the ball speed based on the detection signal (the number of capacitance sensors 141 in contact with the conductive member 12A) acquired from the output unit 15. The processor 31 then generates a VR image including a number, a scale, or the like indicating the ball speed. The ball speed may be estimated, for example, by referring to a table indicating the relationship between the number of capacitance sensors 141 in contact with the conductive member 12A and the ball speed, or may be estimated using a formula indicating these relationships, or a trained model constructed by machine learning using these relationships as teacher data. The simulation device 3A is configured similarly to the simulation device 3 according to the above-mentioned embodiment 1, except that the content of the generated VR image is different and that the ball speed is estimated.

[0059] <Catch ball experience system in action> The system S2 configured as described above starts operation when a predetermined start condition is satisfied. The start condition may be when the power of the system S2 is turned on, when the user U5 puts on the second catcher's mitt 26c, when the user U5 is in a predetermined catching position, when a predetermined start operation is performed by the user U5, etc.

[0060] When the system S2 starts operating, the simulation device 3A first generates a VR image of the pitcher (step A1), and provides the data to the HMD 27 worn by the user U5 (step A2). Then, the HMD 27 that receives the VR image data displays the VR image on the display unit (step B1). This starts the user U5's experience of playing catch in the virtual space.

[0061] While the VR image is displayed on the HMD 17, when the user U3 holding the ball 11A throws the ball to the location of the impact detection unit 14c in the first catcher's mitt 13A, the capacitance between the conductive member 12A of the ball 11A and the capacitance sensor 141 of the first catcher's mitt 13A in contact with the conductive member 12A changes (step C1). Then, the output unit 15 provides the detection signal and other detection signals to the simulation device 3A (step C2).

[0062] Then, every time the detection signal is acquired, the simulation device 3A identifies the transducer 261 provided at a position corresponding to the capacitance sensor that has changed the capacitance as the transducer 261 to be vibrated based on the detection signal (step A3). Then, the simulation device 3 provides the second catcher's mitt 26c with a control signal instructing the vibration of the identified transducer 261 (step A4). Then, the second catcher's mitt 26c that has acquired the control signal vibrates the transducer 261 instructed by the control signal (step D1).

[0063] Furthermore, each time a detection signal is acquired, the simulation device 3A generates a VR video of the pitcher making a pitching motion (step A5). The simulation device 3A then supplies the generated VR video data to the HMD 27 worn by the user U5 (step A6). The HMD 27 that has acquired the VR video data then displays the VR video of the pitcher making a pitching motion (step B2).

[0064] [System effects] In playing catch, the ball is not always thrown to the center of the catcher's mitt. However, the system S2 detects the pitch using the impact detection unit 14c, which has a plurality of capacitance sensors regularly arranged at a predetermined interval (having a spread). Therefore, even if the ball thrown by the user U3 deviates from the intended position, the system S2 can recognize the pitch.

[0065] In addition, since the first catcher's mitt 13A has flexibility, the number of capacitance sensors 141 in contact with the conductive member 12A changes depending on the strength of the impact. This allows the system S2 to recognize the strength of the pitch. In other words, the system S2 can prevent the reality of the experience from being impaired in a system for providing the experience of applying a physical impact.

[0066] Furthermore, the simulation device 3A according to this embodiment estimates the ball speed of the ball 11A based on the acquired detection signal and provides it to the HMD 17. Therefore, the user U5 can visually recognize the ball speed of the ball 11A in addition to the VR image of the ball and the impact from the vibrator, and can experience a more interesting game of catch.

[0067] <Modification> The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. In other words, embodiments obtained by appropriately combining the technical means disclosed in the different embodiments are also included in the technical scope of the present invention.

[0068] For example, in the above-mentioned first embodiment, both the glove 11 and the punching bag 13 are flexible, but it is sufficient that either one of the glove 11 or the punching bag 13 is flexible.

[0069] Moreover, the systems S1 and S2 according to the above-mentioned first and second embodiments are provided with the simulation device 3 that generates VR images. However, instead of the simulation device 3, the systems S1 and S2 may be provided with a simpler device that displays the good or bad position of the collision, the strength (numerical value) of the collision, and the like.

[0070] In addition, some or all of the functions of the processor may be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks may be realized by, for example, a quantum computer.

[0071] 〔summary〕 The system according to a first aspect of the present invention comprises a first member and a second member that applies an impact to the first member due to a user's action, at least one of which is flexible, a plurality of capacitance sensors arranged regularly at predetermined intervals along a surface of the first member, a conductive member arranged on the surface of the second member, and an output unit that provides a detection signal indicating the strength of the impact received by the first member from the second member to a device that performs processing based on the detection signal, based on the number of capacitance sensors whose capacitance between the conductive member and the first member has changed as a result of the second member applying an impact to the first member.

[0072] A system according to a second aspect of the present invention may be configured in the above-mentioned first aspect such that the capacitance sensor is an embroidery sensor made of conductive thread attached to a surface portion of the first member.

[0073] A system according to aspect 3 of the present invention may be configured as in aspect 1 or 2 above, where the first member is a punching bag, the second member is a glove, and the conductive member is disposed on a surface portion of the second member at a portion that collides with the first member.

[0074] A system according to aspect 4 of the present invention may be configured in the above-mentioned aspect 3, wherein the punching bag comprises a main body, a support member supporting the main body, and a detection unit provided on the support member for detecting an action from the main body to the support member resulting from the glove applying an impact to the main body, and the output unit provides a second detection signal indicating the action detected by the detection unit to the device.

[0075] A system according to aspect 5 of the present invention may be configured as in aspect 4 above, where the support member is a pillar extending vertically, the main body is arranged to cover the side of the pillar, and the detection unit is composed of a force sensor provided at the bottom of the pillar.

[0076] A system according to aspect 6 of the present invention may be configured as in aspect 3 above, further comprising a simulation device that generates an image of a virtual space including the user's opponent based on the detection signal and supplies the generated image to a head-mounted display worn by the user, and the output unit provides the detection signal to the simulation device.

[0077] A system according to aspect 7 of the present invention may be configured in such a way that, in the above-mentioned aspect 6, the output unit provides the simulation device with a detection signal indicating the position at which the first member received an impact from the second member and the strength of the impact based on the position and number of the capacitance sensors whose capacitance between the conductive member and the second member has changed as a result of the second member applying an impact to the first member, and further includes a third member worn by a user other than the user and having a plurality of vibrators on a surface that comes into contact with the other user, and the simulation device transmits a control signal to the third member instructing it to vibrate the vibrator provided at a position corresponding to the capacitance sensor whose capacitance has changed based on the detection signal.

[0078] The system according to aspect 8 of the present invention, in accordance with aspect 7 above, may further include a fourth member and a fifth member that applies an impact to the fourth member due to the action of the other user, at least one of which is flexible, a plurality of other capacitance sensors arranged regularly at predetermined intervals along the surface of the fourth member, another conductive member arranged on the surface of the fifth member, another output unit that provides the simulation device with another detection signal indicating the position at which the fourth member was impacted by the fifth member and the strength of the impact based on the position and number of the other capacitance sensors whose capacitance between the other conductive member and the other capacitance sensors has changed as a result of the fifth member applying an impact to the fourth member, and a sixth member that is worn by the user and has a plurality of other vibrators provided on a surface that comes into contact with the user, and the simulation device may be configured to transmit to the sixth member another control signal instructing it to vibrate the other vibrator provided at a position corresponding to the other capacitance sensor in contact with the fourth member based on the other detection signal.

[0079] The punching bag of aspect 9 of the present invention is a punching bag for providing a user with a boxing experience, and is configured to comprise a main body, a support member supporting the main body, a plurality of capacitance sensors arranged regularly at predetermined intervals along the surface of the main body, a force sensor provided on the support member, and an output unit that provides a detection signal indicating the strength of the impact received by the main body from the glove and a second detection signal indicating the action from the main body to the support member caused by the glove impacting the main body based on the detection signal and the second detection signal based on the number of capacitance sensors whose capacitance between the glove and a conductive member arranged on its surface changes when the glove impacts the main body. [Explanation of symbols]

[0080] S1, S2: system, 1, 1A: first set, 2, 2A: second set, 11, 21: glove (second member, fifth member), 11A: ball (second member), 12, 12A, 22: conductive member, 13, 23: sandbag (first member, fourth member), 131: main body, 132: support member (pillar), 133: detection unit (force sensor), 134: weight, 13A: first catcher's mitt (first member), 14a: first impact detection unit, 14b: second impact detection unit, 14c: impact detection unit sensing unit, 141, 241: capacitance sensor, 15, 25: output unit, 16a, 26a: headgear, 16b, 26b: wear, 161, 261: transducer, 162, 262: input unit, 17, 27: head mounted display, 18, 28: access point, 24a: third impact detection unit, 24b: fourth impact detection unit, 26c: second catcher's mitt, 3, 3A: simulation device, 31: processor, 32: memory, U1, U2, U3, U4, U5: user

Claims

1. A first member and a second member that applies an impact to the first member due to a user's action, at least one of the first member and the second member having flexibility; A plurality of capacitance sensors regularly arranged at predetermined intervals along a surface of the first member; A conductive member disposed on a surface of the second member; an output unit that provides a detection signal indicating the strength of the impact that the first member received from the second member based on the number of capacitance sensors in which the capacitance between the capacitance sensor and the conductive member has changed as a result of the second member applying an impact to the first member, to a device that executes processing based on the detection signal; Equipped with A system characterized by:

2. the capacitance sensor is an embroidery sensor made of a conductive thread attached to a surface layer of the first member; 2. The system of claim 1 .

3. the first member is a punching bag; the second member is a glove; the conductive member is disposed on a surface layer portion of the second member at a portion where the second member collides with the first member; 3. The system according to claim 1 or 2.

4. The punching bag is The main body, A support member for supporting the main body; a detection unit provided on the support member and configured to detect an action from the main body to the support member when the glove applies an impact to the main body; Equipped with The output unit provides a second detection signal indicative of the action detected by the detection unit to the device.

4. The system of claim 3.

5. The support member is a column extending in a vertical direction, The main body is provided to cover a side surface of the support, The detection unit is composed of a force sensor provided at the lower part of the support.

5. The system of claim 4.

6. a simulation device that generates an image of a virtual space including the user's opponent based on the detection signal and supplies the generated image to a head mounted display worn by the user; The output unit provides the detection signal to the simulation device.

4. The system of claim 3.

7. the output unit provides, to the simulation device, a detection signal indicating a position at which the first member received an impact from the second member and a strength of the impact, based on a position and a number of the capacitance sensors at which a capacitance between the capacitance sensor and the conductive member has changed in response to the second member applying an impact to the first member; a third member that is worn by a user different from the user and has a plurality of vibrators provided on a surface that contacts the user, the simulation device transmits, based on the detection signal, a control signal to the third member, the control signal instructing the third member to vibrate the vibrator provided at a position corresponding to the capacitance sensor whose capacitance has been changed; 7. The system of claim 6.

8. a fourth member and a fifth member that applies an impact to the fourth member due to a motion of the other user, at least one of the fourth member and the fifth member having flexibility; a plurality of other capacitance sensors regularly arranged at predetermined intervals along a surface of the fourth member; Another conductive member disposed on a surface of the fifth member; and another output unit that provides the simulation device with another detection signal indicating the position where the fourth member received an impact from the fifth member and the strength of the impact, based on the position and the number of the other capacitance sensors in which the capacitance between the other capacitance sensors and the other conductive member has changed as a result of the fifth member applying an impact to the fourth member; A sixth member is worn by the user and has a plurality of other vibrators provided on a surface that contacts the user, the simulation device transmits, to the sixth member, another control signal instructing the sixth member to vibrate the another vibrator provided at a position corresponding to the another capacitive sensor that has come into contact with the fourth member, based on the another detection signal; 8. The system of claim 7.

9. A punching bag for providing a user with a boxing experience, comprising: The main body, A support member for supporting the main body; a plurality of capacitance sensors regularly arranged at predetermined intervals along a surface of the main body; A force sensor provided on the support member; an output unit that provides a detection signal indicating the strength of the impact that the main body received from the glove and a second detection signal indicating an action from the main body to the support member caused by the impact of the glove on the main body, based on the number of capacitance sensors in which the capacitance between the conductive member and the glove has changed as a result of the glove applying an impact to the main body, to a device that executes processing based on the detection signal and the second detection signal; Equipped with A punching bag characterized by

Images