Tactile sense presentation system

Abstract

To provide a tactile sense presentation system capable of presenting tactile sense in conjunction with a plurality of operation tools.SOLUTION: A tactile sense presentation system comprises: a plurality of operation tools which move in response to user operation; a presentation part which presents a tactile sense to the user through the operation tools; and a change part which changes the tactile sense in accordance with the total amount of operation applied to the plurality of operation tools.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a tactile presentation system. [Background technology]

[0002] In recent years, services that provide a virtual space called the Metaverse have been launched using technologies such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). By wearing a head-mounted display, users can enter the Metaverse as an avatar. In the Metaverse, users can see three-dimensional images displayed on the head-mounted display and hear sounds generated by speakers. Users can also move virtual objects displayed as three-dimensional images by operating controllers attached to both hands.

[0003] The above technologies provide users with visual and auditory sensations, but there are also technologies that provide tactile sensations in addition to these. For example, Japanese Patent Application Laid-Open Publication No. 2017-138651 (Patent Document 1) discloses a force feedback device (tactile feedback device) that presents the force feedback of a virtual object displayed on a video screen to an operator. Furthermore, Japanese Patent Application Laid-Open Publication No. 2019-75096 (Patent Document 2) discloses a technology that changes resistance force depending on the distance between two haptic-enabled devices. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-138651 [Patent Document 2] Japanese Patent Application Publication No. 2019-75096 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present disclosure is to provide a tactile presentation system that can present tactile sensations linked to multiple operating tools. [Means for solving the problem]

[0006] The tactile presentation system according to the present disclosure includes a plurality of operating tools that move in response to user operations, a presentation unit that presents tactile sensations to the user through the operating tools, and a modification unit that modifies the tactile sensations in response to the total amount of operation on the plurality of operating tools. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a functional block diagram showing a schematic configuration of a tactile presentation system according to the first and second embodiments. [Figure 2] FIG. 2 is a table showing standard tactile data used in the tactile presentation system according to the first embodiment. [Figure 3] FIG. 3 is a table showing heavy tactile data used in the tactile presentation system according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing the operation of the tactile presentation system according to the first embodiment. [Figure 5] FIG. 5 is a table showing tactile data used in the tactile presentation system according to the second embodiment. [Figure 6] FIG. 6 is a flowchart showing the operation of the tactile presentation system according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] <Outline of the embodiment> The tactile presentation system according to this embodiment includes a plurality of operating tools that move in response to user operation, a presentation unit that presents tactile sensations to the user through the operating tools, and a modification unit that changes the tactile sensation in response to the total amount of operation on the plurality of operating tools.

[0009] The change unit may increase the tactile sensation when the total amount of operation exceeds a predetermined value.

[0010] The change unit may change the tactile sensation provided through each operating tool in accordance with the amount of operation of each operating tool.

[0011] The tactile presentation method according to this embodiment is a method for controlling the tactile sensation of multiple operating tools that move in response to user operation, and includes a step of presenting the tactile sensation to the user through the operating tools, and a step of changing the tactile sensation in response to the total amount of operation performed on the multiple operating tools.

[0012] The tactile presentation program according to this embodiment is a program for controlling the tactile sensation of multiple operating tools that move in response to user operation, and is a program for causing a computer to execute the steps of presenting the tactile sensation to the user through the operating tools and changing the tactile sensation in response to the total amount of operation on the multiple operating tools.

[0013] <Details of the embodiment> The present embodiment will now be described in detail with reference to the accompanying drawings, in which the same or corresponding parts are designated by the same reference numerals and will not be described repeatedly.

[0014] First Embodiment <Configuration> 1, a tactile presentation system 10 according to the first embodiment includes a CPU (Central Processing Unit) 11, an application program 12, and a database (DB) 13. The application program 12 includes a tactile presentation program for causing the CPU 11 to function as a tactile control unit 121. The database 13 includes a tactile database 131. The tactile control unit 121 and the tactile database 131 will be described in detail later.

[0015] The tactile presentation system 10 further includes a plurality of operation tools 14 and a plurality of tactile output devices 15 corresponding to the plurality of operation tools 14 .

[0016] The operating device 14 includes, for example, a knob used to adjust the speaker volume. When the user rotates the operating device 14 clockwise, the speaker volume increases. Conversely, when the user rotates the operating device 14 counterclockwise, the speaker volume decreases. In this embodiment, three operating devices 14 are provided. One operating device 14 is for the left speaker, another for the right speaker, and yet another for the center speaker.

[0017] The haptic output device 15 includes an angle sensor 151 and an MRF device 152. When a user rotates the operating tool 14, the angle sensor 151 detects the angle by which the operating tool 14 has rotated from its initial position as the amount of rotation. The MRF device 152 includes a magnetorheological fluid (MRF) (not shown), a disk (not shown) disposed within the MRF, a rotation axis (not shown) for rotating the disk, and a coil (not shown) wound around the MRF. This rotation axis coincides with the rotation axis of the operating tool 14. The haptic output device 15 may be, for example, a rotational resistance generator as disclosed in Japanese Patent Application Laid-Open No. 2017-138651 or Japanese Patent Application Laid-Open No. 2020-17159.

[0018] The haptic control unit 121 controls the haptic sensation to be presented according to the amount of rotation detected by the angle sensor 151. Specifically, the haptic control unit 121 controls the amount of current supplied to the coil of the MRF device 152. This causes the MRF device 152 to present a haptic sensation to the fingers of the person operating the manipulation tool 14. In addition to the MRF device 152, actuators such as motors and vibration elements can also be used. The haptic sensation can be presented by the operation of the actuator according to the amount of current.

[0019] The haptic database 131 includes, for example, the standard haptic data shown in FIG. 2 and the heavy haptic data shown in FIG. 3. As shown in FIG. 2, the standard haptic data includes multiple rotation amounts and multiple corresponding current values. The rotation amounts include angles from 0 degrees to 90 degrees in 1-degree increments. The current value is 0.00 A at 0 degrees, gradually increases from 0 degrees to 89 degrees, and returns to 0.00 A at 90 degrees. As shown in FIG. 3, like the standard haptic data, the heavy haptic data also includes multiple rotation amounts and multiple corresponding current values. However, the current value of the heavy haptic data is larger than the current value of the standard haptic data for all rotation amounts from 0 degrees to 90 degrees, and is always the same 3.00 A. Note that the current value of the heavy haptic data does not need to be a constant value and may include a portion that increases or decreases depending on the rotation amount.

[0020] <Operation> Next, with reference to FIG. 4, the operation of the tactile presentation system 10, particularly the tactile control unit 121 (tactile presentation method) will be described.

[0021] In the tactile presentation system 10, the tactile control unit 121 reads out standard tactile data from the tactile database 131 (step S11). The tactile control unit 121 acquires each amount of rotation detected by each angle sensor 151 (step S12). The tactile control unit 121 refers to the read-out standard tactile data, identifies each current value corresponding to each amount of rotation detected by the angle sensor 151, and controls each tactile output device 15 to supply that current to each MRF device 152, which then presents a tactile sensation to the user (step S13).

[0022] The haptic control unit 121 calculates the sum of the acquired rotation amounts (hereinafter referred to as the "total rotation amount") (step S14). The haptic control unit 121 determines whether the calculated total rotation amount is greater than a predetermined reference rotation amount (for example, 50 degrees) (step S15). If it is not greater (NO in step S15; the total rotation amount is equal to or less than the reference rotation amount), the haptic control unit 121 proceeds to step S17. On the other hand, if it is greater (YES in step S15; the total rotation amount exceeds the reference rotation amount), the haptic control unit 121 reads out heavy haptic data from the haptic database 131 (step S16).

[0023] The haptic control unit 121 determines whether or not to end the series of operations described above (step S17). If not (NO in step S17), the haptic control unit 121 returns to step S12 and repeatedly executes the same information processing as above. On the other hand, if the series of operations has ended (YES in step S17), the haptic control unit 121 ends the information processing.

[0024] As described above, the tactile presentation system 10 according to the first embodiment can present tactile sensations linked to the multiple operating tools 14. Specifically, when the total rotation amount of the multiple operating tools 14 exceeds a reference rotation amount (for example, 50 degrees), resistance to the force exerted by the user to rotate the operating tool 14 increases. As a result, the total volume output from the multiple speakers can be prevented from becoming too loud.

[0025] Second Embodiment Unlike the first embodiment, in the second embodiment, the tactile database 131 shown in Fig. 1 includes, for example, the tactile data shown in Fig. 5. As shown in Fig. 5, the tactile data includes a standard current value Istd (for example, 1.00 A), a reference rotation amount φref (for example, 50 degrees), and a maximum current value Imax (for example, 3.00 A).

[0026] The operation (tactile presentation method) of the tactile presentation system 10, particularly the tactile control unit 121, will be described with reference to Fig. 6. In the second embodiment, the tactile control unit 121 reads out the tactile data shown in Fig. 5 from the tactile database 131 (step S21). The tactile control unit 121 acquires the rotation amounts φleft, φcenter, and φright detected by the angle sensors 151 (step S12).

[0027] The haptic control unit 121 determines whether the reference rotation amount φref is equal to or less than the total rotation amount (φleft+φcenter+φright) of the current rotation amounts of the speaker operating tools (step S22). If it is equal to or less than this (YES in step S22; the reference rotation amount φref is equal to or less than the total rotation amount φleft+φcenter+φright), the haptic control unit 121 sets the output current value Iout to the maximum current value Imax (step S25). On the other hand, if it is greater (NO in step S22; the reference rotation amount φref is greater than the total rotation amount φleft+φcenter+φright of the speaker operating tools), the haptic control unit 121 calculates the output current value Iout according to the following formula (1) or (2) (step S23). Iout=Istd+(φref-(φleft+φcenter+φright)) -1 …(1) Iout=Istd×(1+(φref-(φleft+φcenter+φright)) -1 …(2)

[0028] The variables in the formula are as follows: Iout: Output current value Istd: Standard current value φref: Reference rotation amount φleft: current rotation amount of the left speaker operating tool 14 φcenter: current rotation amount of the center speaker operating tool 14 φright: current rotation amount of the right speaker operating tool 14

[0029] The haptic control unit 121 determines whether the calculated output current value Iout is greater than the maximum current value Imax (step S24). If it is greater (YES in step S24; the output current value Iout exceeds the maximum current value Imax), the haptic control unit 121 sets the output current value Iout to the maximum current value Imax (step S25). On the other hand, if the following occurs (NO in step S24; the output current value Iout is equal to or less than the maximum current value Imax), the haptic control unit 121 sets the calculated output current value Iout to the output current value Iout. The haptic control unit 121 provides the set output current value Iout to the multiple haptic output devices 15 and controls each haptic output device 15 to supply the output current to each MRF device 152, thereby causing each MRF device 152 to present a haptic sensation to the user (step S13).

[0030] The haptic control unit 121 determines whether or not to end the series of operations described above (step S17). If not (NO in step S17), the haptic control unit 121 returns to step S12 and repeatedly executes the same information processing as above. On the other hand, if the series of operations has ended (YES in step S17), the haptic control unit 121 ends the information processing.

[0031] As described above, the tactile presentation system 10 according to the second embodiment can present tactile sensations linked to the multiple operating tools 14. Specifically, as the total rotation amount of the multiple operating tools 14 increases, the resistance to the force of the user attempting to rotate the operating tools 14 increases. However, when the total rotation amount reaches the reference rotation amount φref, the output current value Iout is set to the maximum current value Imax. As a result, it is possible to prevent the output current value supplied to each MRF device 152 from becoming too large.

[0032] <Other embodiments> The operating device 14 may be a knob as described above, or a lever, dial, knob, or similar. The operating device 14 may also be an object used to adjust the brightness of lighting. In this case, it is possible to prevent the total amount of light output from multiple lighting fixtures from becoming too large. The operating device 14 may also be an object used to adjust the output of various devices, such as an induction stove or gas stove, air conditioner, heated carpet, or floor heating unit.

[0033] In addition, after the system is started, sound may be output based on a predetermined position of the operating tool 14, the volume of the sound may be measured, the measured volume may be compared with an estimated volume based on the predetermined position of the operating tool 14, and the reference rotation amount may be corrected based on the result.

[0034] The haptic output device 15 is not limited to one using an MRF, but may be another passive type device, or an active type device using a motor, etc. Also, it may be a device that combines passive and active types.

[0035] Furthermore, a non-transitory storage medium storing a program for causing a computer to function as the tactile presentation system 10 is also included in the embodiments of the present invention.

[0036] Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various improvements and modifications are possible. [Explanation of symbols]

[0037] 10: Tactile presentation system 14: Operating tool

Claims

1. a plurality of operating tools that move in response to user operations; a presentation unit that presents a tactile sensation to the user through the operating tool; a change unit that changes the tactile sensation according to a total amount of operation of the plurality of operating tools.

2. The tactile presentation system according to claim 1, The change unit increases the size of the haptic sensation when the total amount of operation exceeds a predetermined value.

3. The tactile presentation system according to claim 1, The change unit changes the tactile sensation provided through each operating tool in accordance with the amount of operation of each operating tool.

4. A tactile sensation presentation method for controlling tactile sensations of a plurality of operating tools that move in response to user operations, comprising: presenting a tactile sensation to the user through the operating tool; and changing the tactile sensation according to a total amount of operation of the plurality of operating tools.

5. A tactile sensation providing program for controlling tactile sensations of a plurality of operating tools that move in response to user operations, On the computer, presenting a tactile sensation to the user through the operating tool; and changing the tactile sensation according to a total amount of operation of the plurality of operating tools.

Images