Haptic feedback system

Abstract

To provide a haptic feedback system which makes it easier for a user to feel haptic sensation as the user gets used to operations.SOLUTION: A haptic feedback system is provided, comprising a modification unit for changing haptic sensation according to proficiency of a user, and a presentation unit for presenting the user with haptic sensation changed by the modification unit.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a tactile presentation system. [Background technology]

[0002] In recent years, services that provide a virtual space called the Metaverse have been launched using technologies such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). By wearing a head-mounted display, users can enter the Metaverse as an avatar. In the Metaverse, users can see three-dimensional images displayed on the head-mounted display and hear sounds generated by speakers. Users can also move virtual objects displayed as three-dimensional images by operating controllers attached to both hands.

[0003] While the above technologies provide users with visual and auditory sensations, there are also technologies that provide tactile sensations in addition to these. For example, Japanese Patent Application Laid-Open Publication No. 2017-138651 (Patent Document 1) discloses a force feedback device (tactile feedback device) that presents the force feedback of a virtual object displayed on a video screen to an operator. Japanese Patent Application Laid-Open Publication No. 2021-28772 (Patent Document 2) discloses a force feedback device (tactile feedback device) that allows an operator to perform pinching, grasping, and other actions, and that can present the desired force feedback to the operator's fingers when performing those actions. Japanese Patent Application Laid-Open Publication No. 6887526 (Patent Document 3) also discloses an information processing device that can improve the realism of tactile feedback. This device increases resistance based on tactile history. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-138651 [Patent Document 2] Patent Publication No. 2021-28772 [Patent Document 3] Patent No. 6887526 Summary of the Invention [Problem to be solved by the invention]

[0005] Although a tactile presentation device can present a tactile sensation to a user, it is difficult for the user to feel the tactile sensation until they become accustomed to the operation.

[0006] An object of the present disclosure is to provide a tactile presentation system that allows a user to feel tactile sensations more easily as the user becomes accustomed to the operation. [Means for solving the problem]

[0007] A tactile presentation system according to the present disclosure includes a change unit that changes the tactile sensation according to a user's level of proficiency, and a presentation unit that presents the tactile sensation changed by the change unit to the user. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a functional block diagram showing a schematic configuration of a tactile presentation system according to an embodiment. [Figure 2] FIG. 2 is a table showing tactile data used in the tactile presentation system shown in FIG. [Figure 3] FIG. 3 is a flow diagram showing the operation of the tactile presentation system shown in FIG. [Figure 4] FIG. 3 is a table showing the proficiency levels used in the tactile presentation system shown in FIG. [Figure 5] FIG. 4 is a table showing the on / off states of the tactile output devices for the five fingers used in the tactile presentation system shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] <Outline of the embodiment> The tactile presentation system according to this embodiment includes a change unit that changes the tactile sensation according to the user's level of proficiency, and a presentation unit that presents the tactile sensation changed by the change unit to the user.

[0010] The tactile presentation system may further include a setting unit for setting a proficiency level.

[0011] The proficiency may include the number of times the user has logged into the haptic presentation system.

[0012] The level of proficiency may include the amount of time the user has used the haptic presentation system.

[0013] The presenting unit may include a plurality of haptic output devices, and the changing unit may selectively activate the plurality of haptic output devices according to the level of proficiency.

[0014] The change unit may increase the number of haptic output devices to be activated as the level of proficiency increases.

[0015] The tactile presentation method according to this embodiment is executed by a computer and includes the steps of changing the tactile sensation according to the user's level of proficiency, and presenting the tactile sensation changed by the change unit to the user.

[0016] The tactile presentation program according to this embodiment causes a computer to execute the steps of changing the tactile sensation according to the user's level of proficiency and presenting the tactile sensation changed by the change unit to the user.

[0017] <Details of the embodiment> The present embodiment will now be described in detail with reference to the accompanying drawings, in which the same or corresponding parts are designated by the same reference numerals and will not be described repeatedly.

[0018] <Configuration> Referring to FIG. 1, a tactile presentation system 10 according to an embodiment includes a tactile presentation device 12 and a smartphone 14.

[0019] The tactile presentation device 12 includes an angle sensor 121 that detects the movement (motion) of a person's finger over time via a movable piece, and a tactile control unit 122 that controls the tactile sensation to be presented in accordance with the finger movement detected by the angle sensor 121. Specifically, when a user wearing the tactile presentation device 12 operates the movable piece with their finger, the angle sensor 121 detects the angle by which the movable piece has rotated from its initial position as the position of the finger. The user may move their finger slowly or quickly. The angle sensor 121 may detect the angle (position) of the finger over time. In this case, the detected angle of the finger is a function of time.

[0020] The smartphone 14 includes a visual control unit 141 that controls an image to be displayed in accordance with the finger movement detected by the angle sensor 121, and an auditory control unit 142 that controls a sound to be generated in accordance with the finger movement detected by the angle sensor 121. A portable information terminal with a telephone function can be used as the smartphone 14. In addition to a basic program, an application program that causes a computer to function as the visual control unit 141 and the auditory control unit 142 is installed on the smartphone 14.

[0021] The tactile presentation device 12 includes a wireless communication unit 123 , a battery 124 , a tactile data buffer 125 , a tactile control unit 122 , an MRF device (tactile output equipment) 126 , and an angle sensor 121 .

[0022] Smartphone 14 includes wireless communication unit 143, CPU (Central Processing Unit) 144, touch panel 145, and speaker 146. Smartphone 14 further includes database (DB) 147 and application program 148. Database 147 includes visual database 149, auditory database 150, and tactile database 151. Application program 148 includes a program for causing CPU 144 to function as visual control unit 141, a program for causing CPU 144 to function as auditory control unit 142, and a program for causing CPU 144 to function as proficiency control unit 152.

[0023] The visual database 149 stores in advance a plurality of visual data corresponding to a plurality of virtual objects. Each piece of visual data includes a visual signal (image signal) that represents the visual appearance of the corresponding virtual object. The visual database 149 stores in advance a plurality of audio data corresponding to a plurality of virtual objects. Each piece of audio data includes an audio signal (audio signal) that represents the audio appearance of the corresponding virtual object. The proficiency control unit 152 changes the tactile sensation according to the user's proficiency. Details will be described later. The touch panel 145 has a display function for displaying images and an input function for receiving operations by the user's fingers. The speaker 146 generates sounds (voice, music, sound effects, etc.).

[0024] The wireless communication units 123 and 143 include, for example, short-range wireless modules, and the tactile presentation device 12 and the smartphone 14 are connected to each other wirelessly. However, the tactile presentation device 12 and the smartphone 14 are not limited to being connected to each other wirelessly, and may be connected to each other by wire.

[0025] The haptic data buffer 125 temporarily stores haptic data transmitted from the smartphone 14. The MRF device 126 includes a magnetorheological fluid (not shown) and a coil (not shown) wound around the magnetorheological fluid. The haptic control unit 122 controls the amount of current supplied from the battery 124 to the coil of the MRF device 126. This allows the MRF device 126 to present an appropriate haptic sensation to the finger of the person operating the haptic presentation device 12. In addition to the MRF device 126, actuators such as motors and vibration elements can also be used. The haptic sensation can be presented by the operation of the actuator according to the amount of current.

[0026] The haptic presentation device 12 may be, for example, a force feedback device disclosed in Japanese Patent Application Laid-Open No. 2017-138651 or Japanese Patent Application Laid-Open No. 2021-28772. This force feedback device is worn on the user's hand, and when the user moves their five fingers, it can present haptic sensations via the movable pieces worn on each finger. The force feedback device includes multiple rotational resistance generators (haptic output devices) corresponding to the multiple fingers. Each of the rotational resistance generators includes a magnetorheological fluid (MRF).

[0027] When expressing the tactile sensation of a reaction to finger movement, the tactile data includes multiple finger positions and multiple corresponding current values, as shown in Figure 2. The finger positions include the finger angles in 1-degree increments from 0 to 90 degrees. Multiple current values ​​are set for each finger.

[0028] <Operation> Next, a description will be given of the operation of the tactile presentation system 10, particularly the mastery control unit 152. The mastery control unit 152 executes steps S11 to S14 and S16 to S20, which will be described later.

[0029] As shown in FIG. 3, a user logs in to the tactile presentation system 10 using the smartphone 14 (step S11). The smartphone 14 accesses the account of the logged-in user and reads and sets the user's proficiency level from the user information 153 (step S12). The proficiency level may be set so that it increases with the number of logins, as shown in FIG. 4, for example. Instead of the number of logins, the proficiency level may be set so that it increases with the usage time. Instead of the number of logins and usage time, the proficiency level may be set according to a flag. For example, when the tactile presentation system 10 is used for a game, a flag may be set according to the progress of the game, the player's level, a proficiency test, etc. The proficiency level may be calculated using a predetermined formula based on the number of logins, the usage time, and the flag. Alternatively, the proficiency level may be any index indicating the user's level of proficiency with the tactile presentation system 10.

[0030] As shown in FIG. 5, the smartphone 14 changes the tactile sensation to be presented by turning on or off the five tactile output devices provided on the five fingers according to the set proficiency level (step S13). For example, when the proficiency level is "0," the lowest level, the tactile output device on the index finger is turned on, but the tactile output devices on the other fingers are turned off. When the proficiency level is "1," the second lowest level, the tactile output devices on the index finger and middle finger are turned on, but the tactile output devices on the other fingers are turned off. When the proficiency level is "2," the tactile output devices on the thumb, index finger, and middle finger are turned on, but the tactile output devices on the other fingers are turned off. When the proficiency level is "3," the second highest level, the tactile output devices on the thumb, index finger, middle finger, and ring finger are turned on, but the tactile output device on the little finger is turned off. When the proficiency level is "4," the highest level, the tactile output devices on all fingers are turned on. Here, a plurality of haptic output devices are selectively activated according to the level of proficiency, and the higher the level of proficiency, the greater the number of haptic output devices that are activated, but conversely, the fewer the number of haptic output devices that are activated may also be used.

[0031] The smartphone 14 reads out the tactile data for the tactile output device of the turned-on finger from the tactile database 151 and transmits it to the tactile presentation device 12 (step S14).

[0032] The tactile presentation device 12 presents a tactile sensation to the user based on the tactile data transmitted from the smartphone 14 (step S15). Specifically, the tactile presentation device 12 stores the tactile data transmitted from the smartphone 14 in the tactile data buffer 125. In the tactile presentation device 12, the tactile control unit 122 acquires the position of the finger detected by the angle sensor 121. The tactile control unit 122 controls the MRF device 126, which presents a tactile sensation to the user. Specifically, the tactile control unit 122 reads tactile data corresponding to the position of the finger detected by the angle sensor 121 from the tactile data buffer 125 and transmits the read tactile data to the MRF device 126. The MRF device 126 provides a tactile sensation to the finger of the user operating the tactile presentation device 12 based on the tactile data transmitted from the tactile control unit 122.

[0033] The smartphone 14 monitors the user's proficiency while the user is using the tactile presentation system 10 (step S16). If the user's proficiency has changed (YES in step S16), the smartphone 14 updates the user's proficiency stored in the user information 153 to increase the user's proficiency (step S17). The smartphone 14 displays the updated proficiency on the touch panel 145 and provides audio guidance from the speaker 146 (step S18). On the other hand, if the user's proficiency has not changed (NO in step S16), the smartphone 14 determines whether to end the above-described series of operations without updating the user's proficiency (step S19). If the user does not want to end the series of operations (NO in step S19), the smartphone 14 returns to step S12 and repeats the same operations as above. On the other hand, if the user has ended the series of operations (YES in step S19), the smartphone 14 executes a logout process (step S20).

[0034] As described above, according to the tactile presentation system 10 of the embodiment, the user becomes more accustomed to the operation and the more easily he or she feels the tactile sensation.

[0035] <Other embodiments> Although the user cannot freely set the proficiency level described above, it may be possible to set the proficiency level freely, for example, by setting it according to the amount of money charged by the user.Furthermore, although the proficiency level is basically increased according to the user's familiarity with the operation, it may be decreased if the frequency of use is low, such as when the interval between logins is longer than a certain period.

[0036] The haptic output device may be a gripper (hereinafter referred to as a "tap unit") used in the virtual object tactile presentation device disclosed in Japanese Patent Application Laid-Open No. 2020-17159. This tap unit also contains a magnetorheological fluid (MRF). For example, one tap unit may be operated with the left hand and the other tap unit may be operated with the right hand.

[0037] The tactile presentation device 12 is not limited to one using an MRF, but may be another passive type device, or an active type device using a motor, etc. Also, it may be a device that combines a passive type and an active type.

[0038] The above system includes a tactile presentation device 12 and a smartphone 14 connectable thereto, but may also be a tactile presentation system such as a home game console or VR goggles in which the tactile presentation device 12 and the smartphone 14 are integrated.

[0039] The above system may further include a server or the like accessible by the smartphone 14. In this case, some of the processing of the smartphone 14 may be executed by the server. Various information processing in the above embodiments may be executed by any computer. For example, the information processing of S11 to S14 and S16 to S20 may be executed by a server instead of the smartphone 14. Furthermore, a non-transitory storage medium storing a program for causing a computer to function as the tactile presentation system 10 is also included in the embodiments of the present invention.

[0040] Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various improvements and modifications are possible. [Explanation of symbols]

[0041] 10: Tactile presentation system 12: Tactile presentation device 14: Smartphone 122: Tactile control unit 126: MRF device 151:Tactile Database 152: Proficiency control unit

Claims

1. a change unit that changes the tactile sensation according to the user's proficiency; a presentation unit that presents the tactile sensation changed by the change unit to the user.

2. The tactile presentation system according to claim 1, further comprising: A tactile presentation system including a setting unit for setting the proficiency level.

3. The tactile presentation system according to claim 2, A tactile presentation system, wherein the proficiency level includes the number of times the user has logged into the tactile presentation system.

4. The tactile presentation system according to claim 2, A tactile presentation system, wherein the proficiency level includes the amount of time the user has used the tactile presentation system.

5. The tactile presentation system according to claim 1, the presentation unit includes a plurality of tactile output devices; The change unit selectively activates the plurality of haptic output devices according to the level of proficiency.

6. The tactile presentation system according to claim 5, The change unit increases the number of activated tactile output devices as the level of proficiency increases.

7. A computer-implemented tactile presentation method, comprising: changing the tactile sensation according to the user's proficiency; and presenting the tactile sensation modified by the modification unit to the user.

8. On the computer, changing the tactile sensation according to the user's proficiency; and presenting the tactile sensation changed by the change unit to the user.

Images