Haptic feedback system

Abstract

To provide a haptic feedback system capable of providing a user with haptic feedback from a performer.SOLUTION: A haptic feedback system is provided, comprising a presentation unit for presenting a second user with haptic sensation that may be felt by touching the body of a first user, and an activation unit for activating the presentation unit when the second user meets predetermined conditions.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present disclosure relates to a tactile presentation system. [Background technology]

[0002] In recent years, communicating with others via the internet has become common. Artists, VTubers, virtual idols, and other performers are also increasingly communicating with their fans via the internet, and the practice of "tipping" in exchange for the performers' streams is on the rise. "Tipping" does not only mean sending money to performers via the internet, but also includes purchasing items such as stamps, badges, and Super Chats and sending them along with comments.

[0003] Patent Document 1 discloses a system that can provide not only stamps but also tactile sensations as tips to performers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] WO2022 / 118748A1 Summary of the Invention [Problem to be solved by the invention]

[0005] The system of Patent Document 1 does not provide tactile feedback to the performer.

[0006] An object of the present disclosure is to provide a tactile presentation system that can obtain tactile feedback from a performer. [Means for solving the problem]

[0007] The tactile presentation system according to the present disclosure includes a presentation unit that presents to a second user the tactile sensation that would be obtained if the second user came into contact with the body of a first user, and an activation unit that activates the presentation unit when the second user fulfills a predetermined condition. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a functional block diagram showing the overall configuration of a tactile presentation system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a functional block diagram showing the configuration of the performer client in FIG. [Figure 3] FIG. 3 is a functional block diagram showing the configuration of the server in FIG. [Figure 4] FIG. 4 is a functional block diagram showing the configuration of the viewer client in FIG. [Figure 5] FIG. 5 is a functional block diagram showing the configuration of the tactile presentation device in FIG. [Figure 6] FIG. 6 is a table showing reference tactile data stored in the storage unit of the server shown in FIG. [Figure 7] FIG. 7 is a flow diagram showing the operation of the tactile presentation system shown in FIGS. [Figure 8] FIG. 8 is a table showing weighting coefficient data required for correcting the reference tactile data shown in FIG. [Figure 9] FIG. 9 is a table showing tactile data obtained by thinning out a portion of the reference tactile data shown in FIG. [Figure 10] FIG. 10 is a table showing tactile data in which part of the reference tactile data shown in FIG. 6 is set to zero. [Figure 11] FIG. 11 is a flow diagram showing the switching operation between the challenge mode and the viewing mode by the tactile presentation system shown in FIGS. DETAILED DESCRIPTION OF THE INVENTION

[0009] <Outline of the embodiment> The tactile presentation system according to this embodiment includes a presentation unit that presents to a second user the tactile sensation that would be obtained if the second user came into contact with the body of a first user, and an activation unit that activates the presentation unit when the second user fulfills a predetermined condition.

[0010] The tactile presentation system may further include a setting unit that sets the predetermined conditions.

[0011] The setting unit may set the predetermined condition for a plurality of parts of the body of the first user.

[0012] The tactile presentation system may further include a selection unit that selects a desired part from the plurality of parts. The setting unit may set a predetermined condition for the part selected by the selection unit.

[0013] The setting unit may set the predetermined condition in response to an operation by the first user.

[0014] The tactile presentation system may further include an acquisition unit that acquires action parameters related to the action of the second user, and a control unit that controls the resolution of the tactile sensation based on the action parameters acquired by the acquisition unit.

[0015] The tactile presentation method according to this embodiment is executed by a computer and includes the steps of presenting to a second user the tactile sensation that would be obtained if the second user came into contact with the body of a first user, and activating the presentation of the tactile sensation when the second user achieves a predetermined condition.

[0016] The tactile presentation program of this embodiment causes a computer to execute the steps of presenting to a second user the tactile sensation that would be experienced if the second user came into contact with the body of a first user, and activating the presentation of the tactile sensation when the second user fulfills a predetermined condition.

[0017] <Details of the embodiment> Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and the description thereof will not be repeated.

[0018] <Overall system configuration> 1, a tactile presentation system 10 according to this embodiment includes a performer client computer (hereinafter simply referred to as "performer client") 12, a server computer (hereinafter simply referred to as "server") 14, a viewer client computer (hereinafter simply referred to as "viewer client") 16, and a tactile presentation device 18. The performer client 12 or the viewer client 16 and the server 14 transmit and receive data to and from each other via a network including the Internet. The viewer client 16 and the tactile presentation device 18 transmit and receive data to and from each other via short-range wireless communication.

[0019] <Performer client configuration> The performer client 12 is, for example, a PC (Personal Computer), a smartphone, or a tablet terminal. Referring to Fig. 2, the performer client 12 includes a processing unit 120, a storage unit 121, a communication unit 122, a camera 123, a microphone 124, a display 125, and a speaker 126. These are electrically connected to each other.

[0020] The processing unit 120 is a processor that uses a CPU (Central Processing Unit) and / or a GPU (Graphics Processing Unit). The processing unit 120 reads out a program 127 and data 128 stored in the storage unit 121, and executes predetermined information processing.

[0021] The storage unit 121 is a memory using, for example, a read-only memory (ROM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a solid state drive (SSD), or a hard disk drive (HDD). The storage unit 121 stores a program 127 executed by the processing unit 120 and data 128 referenced by the processing unit 120. The program 127 may be a program stored in an external storage medium that is read by the processing unit 120 and copied to the storage unit 121. The program 127 may also be a program downloaded from the server 14 or another server via the communication unit 122 and stored in an executable state.

[0022] The communication unit 122 realizes communication with the server 14 via the network. The communication unit 122 includes a communication device that connects to the network. The processing unit 120 transmits and receives data to and from the server 14 via the communication unit 122.

[0023] The camera 123 captures images of the performers. The microphone 124 detects the performers' voices. The display 125 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The speaker 126 generates sounds.

[0024] <Server configuration> 3, the server 14 includes a processing unit 140, a storage unit 141, and a communication unit 142. These are electrically connected to each other.

[0025] The processing unit 140 is a processor that uses a CPU and / or a GPU. The processing unit 140 reads out a program 143 and data 144 stored in the storage unit 141, and executes predetermined information processing.

[0026] The storage unit 121 is a memory using, for example, an SRAM, a DRAM, an SSD, or an HDD. The storage unit 141 stores a program 143 executed by the processing unit 140 and data 144 referenced by the processing unit 140. The program 143 may be a program stored in an external storage medium that is read by the processing unit 140 and copied to the storage unit 141. The program 143 may also be a program downloaded from another server via the communication unit 142 and stored in an executable format.

[0027] The communication unit 142 realizes communication with the performer client 12 and the viewer client 16 via the network. The communication unit 142 includes a communication device that connects to the network. The processing unit 140 transmits and receives data to and from the performer client 12 and the viewer client 16 via the communication unit 142.

[0028] <Viewer client configuration> The viewer client 16 is, for example, a smartphone, a tablet terminal, or a PC. The viewer client 16 may be a dedicated game device integrated with a haptic presentation device 18, that is, a game console including the haptic presentation device 18 in the controller portion.

[0029] 4, the viewer client 16 includes a processing unit 160, a storage unit 161, a communication unit 162, a camera 163, a microphone 164, a touch panel 165, a display 166, and a speaker 167. These are electrically connected to one another.

[0030] The processing unit 160 is a processor that uses a CPU and / or a GPU. The processing unit 160 reads out a program 168 and data 169 stored in the storage unit 161, and executes predetermined information processing.

[0031] The storage unit 161 is a memory using, for example, an SRAM, a DRAM, an SSD, or an HDD. The storage unit 161 stores a program 168 executed by the processing unit 160 and data 169 referenced by the processing unit 160. The program 168 may be a program stored in an external storage medium that is read by the processing unit 160 and copied to the storage unit 161. The program 168 may also be downloaded from the server 14 or another server via the communication unit 162 and stored in an executable state.

[0032] The communication unit 162 realizes communication with the server 14 via a network. The communication unit 162 includes a communication device that connects to the network. The processing unit 160 transmits and receives data to and from the server 14 via the communication unit 162. The communication unit 162 includes a short-range wireless communication module, for example, a Bluetooth (registered trademark) communication module. The processing unit 160 transmits and receives data to and from the tactile presentation device 18 via the communication unit 162.

[0033] Camera 163 captures images of the viewer. Microphone 164 detects the viewer's voice. Touch panel 165 is attached to the top surface of display 166 and receives input in response to operations by the viewer. Display 166 is, for example, a liquid crystal display or an organic EL display. Speaker 167 generates sound.

[0034] <Configuration of the tactile presentation device> 5, the tactile presentation device 18 includes a processing unit 180, a storage unit 181, a communication unit 182, an MRF (Magneto-Rheological Fluid) device 183, and a sensor 184. These are electrically connected to each other.

[0035] The processing unit 180 is a processor that uses a CPU or an MPU (Micro-Processing Unit). The processing unit 180 reads out a program 185 and data 186 stored in the storage unit 181, and executes predetermined information processing.

[0036] The storage unit 181 is a memory using, for example, a ROM or RAM. The storage unit 181 functions as an auxiliary storage device for the processing unit 180, and stores haptic data for controlling the MRF device 183 in a rewritable manner.

[0037] The communication unit 182 includes a short-range wireless communication module, for example, a Bluetooth (registered trademark) communication module. The processing unit 180 transmits and receives data to and from the viewer client 16 via the communication unit 182.

[0038] The MRF device 183 includes a magnetorheological fluid whose viscosity changes in response to magnetic force. The sensor 184 detects the displacement (angle) of the operation piece and outputs it to the processing unit 180.

[0039] The tactile presentation device 18 may be, for example, the one (tap unit) disclosed in Japanese Patent Application Laid-Open No. 2020-17159. The tactile presentation device 18 is a device that can be operated by an operator (viewer) holding a finger along an operation piece and moving the finger. The tactile presentation device 18 detects the position (displacement) of the operation piece that is displaced when the operator moves the finger, controls the MRF device 183 according to the displacement, and generates a force sensation by a reaction force (rotational resistance) against the operation, thereby presenting a tactile sensation.

[0040] The tactile presentation device 18 has a yoke arranged to sandwich a disk-shaped rotor, and generates a magnetic field by passing a control current through a coil arranged in the yoke, and controls the viscosity (shear stress) of the magnetorheological fluid sealed in the gap to apply rotational resistance to the rotor.

[0041] When the viewer operates the tactile presentation device 18, the displacement of the operation piece is transmitted to the rotation shaft of the rotor of the MRF device 183. When the MRF device 183 is not operating, that is, when the control current is zero, the rotation shaft rotates freely. On the other hand, when the MRF device 183 is operating, that is, when the control current is not zero, the viscosity of the magnetorheological fluid of the MRF device 183 changes depending on the magnitude of the current flowing through the MRF device 183. The processing unit 180 continuously changes the current flowing through the MRF device 183 or vibrates it at a predetermined frequency, thereby changing the resistance force against the operation piece.

[0042] The tactile presentation device 18 may employ a motor or a piezoelectric element instead of the MRF device 183, and may generate a force sensation by rotational force or vibration in response to an operation by the operator.

[0043] The data 144 stored in the storage unit 141 includes, for example, haptic data as shown in Fig. 6. The performer client 12 may have haptic data specific to the performer and transfer this to the server 14. Also, if there are multiple performers, the server 14 may have haptic data specific to the multiple performers.

[0044] The tactile data includes a plurality of displacements (angles) and corresponding current values. In the tactile presentation device 18, when the sensor 184 detects the displacement of the operation piece, a current corresponding to the displacement is supplied to the MRF device 183.

[0045] 6, the displacement is between 0 and 90 degrees, but is not limited to this. In this example, the displacement is set in increments of 1 degree, but it may be set more precisely, for example, in increments of 0.1 degrees. Furthermore, the haptic data may include a frequency in addition to or instead of a current value.

[0046] Furthermore, haptic data is provided for each part of the performer's body (e.g., palm, upper arm, head, cheek, earlobe). That is, data 144 includes multiple pieces of haptic data corresponding to multiple parts. Each piece of haptic data includes an object ID as information for identifying the corresponding part.

[0047] <Operation> Referring to Fig. 1, a performer uses performer client 12 to distribute his / her content live (broadcast) to multiple viewers. Specifically, referring to Fig. 2, camera 123 captures the performer's image. Microphone 124 detects the performer's voice. Processing unit 120 transmits the performer's video and audio to server 14 via communication unit 122. Server 14 transmits the performer's video and audio to viewer client 16. Instead of live distribution, content may be recorded in advance and distributed simultaneously at a specified date and time, or distributed on demand in response to viewer requests.

[0048] The tactile presentation system 10 can present to the audience the tactile sensation that would be experienced if the audience were to come into contact with the performer's body when the performer delivers content to the audience. Specifically, referring to Fig. 5, the tactile presentation device 18 controls the MRF device 183 based on the tactile data stored in the storage unit 181, thereby presenting the tactile sensation to the audience.

[0049] The tactile presentation system 10 can present the viewer with the tactile sensation of a specific part of the performer's body, particularly when the viewer achieves a predetermined condition (hereinafter sometimes referred to as a "quota"). On the other hand, when the viewer has not yet achieved the predetermined condition, that is, until the viewer achieves the predetermined condition, the tactile presentation system 10 does not present the tactile sensation. In other words, at the beginning of distribution, the presentation of the tactile sensation is locked.

[0050] The number of body parts to which haptics are presented may be one or more. The predetermined condition may be predetermined or may be arbitrarily set by the performer or viewer. The predetermined condition may be the same for all body parts or may differ for each body part. For example, the level of the predetermined condition may gradually increase in the order of unlocking, such as the palms, upper arms, head, cheeks, and earlobes. The order of unlocking may be predetermined or arbitrarily set by the performer or viewer. The performer or viewer may arbitrarily select the body parts that can be unlocked. Furthermore, multiple predetermined conditions with different levels may be set for one body part. In this case, the resolution of the haptics may increase stepwise each time the viewer achieves the predetermined conditions in order from lowest to highest. Furthermore, the performer may change the body parts that can be unlocked during the broadcast. In this case, when the viewer achieves the predetermined condition set for the changed body part, a haptic sensation is presented to the viewer. However, the predetermined condition set for the body part before the change may be maintained. Furthermore, when the viewer has fulfilled all of the predetermined conditions set for multiple body parts, a new predetermined condition may be set for a special body part that the viewer cannot select, and when the viewer has also fulfilled the newly set predetermined condition, the tactile sensation of the special body part may be presented. The details of this operation are described below.

[0051] 7, in the server 14, the processing unit 140 initially locks the presentation of tactile sensations to all parts (step S21). That is, the processing unit 140 prevents the presentation of tactile sensations to all parts (step S21).

[0052] In the performer client 12, the processing unit 120 selects one or more desired parts from among a plurality of parts on the performer's body in response to the performer's operation (step S11). The processing unit 120 also sets predetermined conditions for the selected parts in response to the performer's operation (step S12). The processing unit 120 also sets an unlocking order for the selected parts in response to the performer's operation (step S13). The performer client 12 transmits information related to the desired parts, the predetermined conditions, and the unlocking order to the server 14.

[0053] In the server 14, the processing unit 140 updates the haptic data stored in the storage unit 141 based on the above information from the server 14 (step S22). The processing unit 140 sets a selected / non-selected flag, a predetermined condition, and an unlocking order for the haptic data for each body part. Specifically, of all the haptic data stored in the storage unit 141, the processing unit 14 sets a "selected flag" for the haptic data corresponding to the body part selected in step S11, and sets a "non-selected flag" for the haptic data corresponding to the other body parts. Furthermore, for each haptic data for which the "selected flag" is set, the processing unit 14 sets the predetermined condition set in step S12 and the unlocking order set in step S13. As a result, the predetermined condition and the unlocking order are associated and stored for all the haptic data for which the "selected flag" is set.

[0054] The performer client 12 takes a picture of the performer and transmits the video and audio to the server 14 (step S14). The server 14 distributes the video and audio of the performer to a plurality of viewer clients 16 (step S23).

[0055] Meanwhile, in the viewer client 16, the processing unit 160 detects an action of the viewer, and transmits information related to the detected action to the server 14 (step S31).

[0056] In the server 14, the processing unit 140 calculates and acquires action parameters based on information related to actions from the viewer client 16 (step S24). The processing unit 140 calculates average values ​​of the action parameters based on the actions of multiple viewers, ranks the viewers in descending order of the action parameters, and transmits this information to the performer client 12 and the multiple viewer clients 16. The performer client 12 and the multiple viewer clients 16 display the current average values ​​of the action parameters and the viewer rankings based on this information (steps S15 and S32).

[0057] The processing unit 140 determines whether the acquired action parameters have met a predetermined condition (specifically, a predetermined condition set for the haptic data that is Nth in the unlocking order (N is an integer equal to or greater than 1)) (for example, whether the action parameters have exceeded a predetermined value) (step S25). The processing unit 140 continues to calculate the action parameters based on information related to the latest action until the action parameters have met the predetermined condition. Details of the action parameters will be described later.

[0058] The processing unit 140 unlocks the haptic when the action parameters meet a predetermined condition (step S26). Specifically, the processing unit 140 selects the haptic data set to be Nth in the unlocking order from among the plurality of haptic data. Here, the haptic presentation system 10 activates the presentation of a haptic sensation by the haptic presentation device 18, which will be described later, when the viewer meets the predetermined condition.

[0059] Next, the processing unit 140 controls the resolution of the tactile sensation to be presented to the viewer by the tactile presentation device 18 (step S27). Specifically, the processing unit 140 sets the tactile resolution by correcting the tactile data selected in step S26, and transmits the set tactile data to the viewer client 16. After the processing of steps S24 to S27 is performed for the tactile data that is Nth in the unlocking order, the control unit 140 performs the processing of steps S24 to S27 for the tactile data that is N+1th in the unlocking order.

[0060] In the viewer client 16, the processing unit 160 saves the set haptic data in the memory unit 161 (step S33) and transmits it to the haptic presentation device 18. The haptic presentation device 18 presents a haptic sensation having the set resolution (step S41). Specifically, in the haptic presentation device 18, upon receiving the set haptic data from the viewer client 16, the processing unit 180 stores the data in the memory unit 181, acquires the displacement (angle) detected by the sensor 184, refers to the haptic data stored in the memory unit 181, reads out a current value corresponding to the displacement, and outputs a predetermined current to the MRF device 183.

[0061] If multiple unlocks have been achieved, the processing unit 160 displays a selection screen on the display 166 for selecting the part to be shown the tactile sensation in a selectable manner. Parts that have not been unlocked may be displayed as unselectable. At this time, the conditions for achieving the quota and the current values ​​of the action parameters can be displayed in real time. The processing unit 160 transmits tactile data corresponding to the part selected by the viewer to the tactile presentation device 18.

[0062] During the above operation, the tactile presentation device 18 does not present a tactile sensation until the viewer achieves a predetermined condition (quota), i.e., when the viewer has not yet achieved the predetermined condition. Once the viewer achieves the predetermined condition, a tactile sensation is presented. Multiple levels of predetermined conditions may be set. In this case, the resolution is gradually increased each time the viewer achieves the predetermined condition, and finally, when the viewer achieves the highest level of predetermined condition, the highest resolution, complete tactile sensation is presented. After that, a similar quota occurs for the next part set in the unlock order.

[0063] The predetermined condition is, for example, the enthusiasm of the viewer. The higher the enthusiasm, the higher the resolution of the haptic sensation that is presented. The action parameter indicating the enthusiasm is, for example, as follows, and includes one or more values ​​selected from these.

[0064] (1) The total amount of tips from one viewer or all viewers The more, the higher the enthusiasm; the less, the lower the enthusiasm. (2) The average amount of tips per unit time from a single viewer or all viewers The more, the higher the enthusiasm; the less, the lower the enthusiasm. (3) The total number of taps by a viewer or all viewers The more, the higher the enthusiasm; the less, the lower the enthusiasm. (4) The average number of taps per unit time by a viewer or all viewers (tap speed) The more, the higher the enthusiasm; the less, the lower the enthusiasm. (5) The average speed of flicks by a viewer or all viewers (flick speed) The faster the more enthusiastic, the slower the less enthusiastic. (6) Volume of a single viewer or all viewers The larger the number, the higher the enthusiasm, and the smaller the number, the lower the enthusiasm. (7) The time when the eyes of one viewer or all viewers and the performer are in contact The longer the time, the higher the enthusiasm; the shorter the time, the lower the enthusiasm. (8) Heart rate of a viewer or all viewers The higher the number, the more enthusiastic the level, and the lower the number, the less enthusiastic the level. (9) The total number of shakes by a viewer or all viewers The more, the higher the enthusiasm; the less, the lower the enthusiasm. (10) The average number of shakes per unit time by a viewer or all viewers. The more, the higher the enthusiasm; the less, the lower the enthusiasm. The object of the shake is not limited to a smartphone, but may also be a tactile presentation device with an acceleration sensor.

[0065] The current value of the enthusiasm (action parameter), the value required to achieve a predetermined condition, etc. may be displayed in real time on the display 166 of the viewer client 16. An upper limit may be set for the enthusiasm. In this case, the upper limit may be displayed. The enthusiasm may be counted for each viewer. In this case, the enthusiasm may be displayed for each viewer. The resolution of the tactile sensation may be increased in stages each time the enthusiasm exceeds a predetermined value, and conversely, the resolution may be decreased in stages each time the enthusiasm falls below the predetermined value.

[0066] The server 14 determines the enthusiasm level in real time based on the actions detected by the viewer client 16 and checks which enthusiasm level quota the viewer client 16 has achieved. The server 14 associates the corrected haptic data with the video data and transmits it to the viewer client 16. If there are multiple viewers, the enthusiasm level will differ for each viewer. In this case, the enthusiasm level is determined for each viewer.

[0067] The server 14 has haptic data with the highest resolution (hereinafter referred to as "reference haptic data") prepared in advance. In step S23, in order to control the haptic resolution, the processing unit 160 corrects the haptic data according to the enthusiasm level and transmits the corrected haptic data to the haptic presentation device 18. For example, low-resolution haptic data is created as follows:

[0068] As shown in FIGS. 8(a), (b), and (c), multiple weighting coefficient data may be prepared and multiplied by the reference tactile data shown in FIG. 6. Each weighting coefficient data includes multiple displacements and weighting coefficients for the corresponding current values. The weighting coefficients for the data shown in FIG. 8(a) are all 0.7, the weighting coefficients for the data shown in FIG. 8(b) are all 0.8, and the weighting coefficients for the data shown in FIG. 8(c) are all 1. When the level of enthusiasm is low, the reference tactile data is corrected by multiplying it by the weighting coefficient data shown in FIG. 8(a). The tactile resolution provided at this time is the lowest. When the level of enthusiasm exceeds a first predetermined value, the reference tactile data is corrected by multiplying it by the weighting coefficient data shown in FIG. 8(b). The tactile resolution provided at this time is slightly higher. When the level of enthusiasm exceeds a second predetermined value higher than the first predetermined value, the reference tactile data is corrected by multiplying it by the weighting coefficient data shown in FIG. 8(c). In this case, the tactile resolution provided is the highest. In this case, all weighting factors are "1," so the reference tactile data can be used as is without correction. In this example, the weighting factors are all the same for each weighting factor data, but they may be different.

[0069] Alternatively, as shown in FIGS. 9(a), (b), and (c), a portion of the reference tactile data may be thinned. The tactile data shown in FIG. 9(a) includes displacements every 10 degrees and corresponding current values. The tactile data shown in FIG. 9(b) includes displacements every 5 degrees and corresponding current values. The tactile data shown in FIG. 9(c) includes displacements every 1 degree and corresponding current values, and is the same as the reference tactile data. When the enthusiasm level is low, the reference tactile data is thinned to obtain the tactile data shown in FIG. 9(a), thereby correcting the tactile data. The tactile resolution provided at this time is the lowest. When the enthusiasm level exceeds a first predetermined value, the reference tactile data is thinned to obtain the tactile data shown in FIG. 9(b), thereby correcting the tactile data. The tactile resolution provided at this time is slightly higher. When the enthusiasm level exceeds a second predetermined value higher than the first predetermined value, the reference tactile data is used as is as the tactile data shown in FIG. 9(c) without being thinned.

[0070] Alternatively, as shown in Figures 10(a), (b), and (c), a portion of the reference tactile data may be set to zero. In the tactile data shown in Figure 10(a), the current value corresponding to a wide range of displacement is zero. In the tactile data shown in Figure 10(b), the current value corresponding to a narrow range of displacement is zero. In the tactile data shown in Figure 10(c), the current value corresponding to the entire range of displacement is not zero. In other words, the reference tactile data is used as is as the tactile data shown in Figure 10(c). When the enthusiasm level is low, the tactile data is corrected by setting a wide range of the reference tactile data to zero to obtain the tactile data shown in Figure 10(a). The tactile resolution provided at this time is the lowest. When the enthusiasm level exceeds a first predetermined value, the tactile data is corrected by setting a narrow range of the reference tactile data to zero to obtain the tactile data shown in Figure 10(b). The tactile resolution provided at this time is slightly higher. When the enthusiasm level exceeds a second predetermined value that is higher than the first predetermined value, the reference haptic data is used as is as the haptic data shown in FIG. 10(c).

[0071] Alternatively, a bias may be applied to the current value. In this case, the bias is gradually reduced and finally set to zero. Alternatively, the frequency may be corrected instead of the current value.

[0072] <Mode switching> In the above embodiment, the viewer operates the viewer client 16 etc. while watching the streamed video of the performer to achieve a predetermined condition, but in addition to the period during which the viewer watches the streamed video of the performer (viewing mode), a period during which the viewer achieves a predetermined condition (challenge mode) may also be set.

[0073] For example, as shown in FIG. 11, in the performer client 12, the processing unit 120 selects the challenge mode or the viewing mode in accordance with the performer's instructions (step S41), determines the selected mode (step S42), and if the challenge mode is selected, transitions to the challenge mode (step S43), or if the viewing mode is selected, transitions to the viewing mode (step S44).

[0074] The challenge mode activates the acquisition of action parameters in step S21, and deactivates the control of haptic resolution in step S23 and the presentation of haptics in steps S31 to S33. On the other hand, the viewing mode deactivates the acquisition of action parameters in step S21, and activates the control of haptic resolution in step S23 and the presentation of haptics in steps S31 to S33.

[0075] Here, the mode is switched in response to instructions from the performer, but it may also be switched automatically. When the mode is switched, the viewer may be notified of this. In challenge mode, the performer broadcasts video as usual. Meanwhile, the viewer performs the operations necessary to achieve the specified conditions while watching the performer's broadcast video. When the challenge mode ends, the mode switches from challenge mode to viewing mode either in response to instructions from the performer or automatically. In viewing mode, the viewer experiences a haptic sensation corresponding to the achieved specified conditions through the haptic presentation device 18 while watching the performer's broadcast video. In this case, not only the haptic sensation but also the resolution of the audio and video may be changed depending on the achieved conditions. Furthermore, whether the current mode is challenge mode or viewing mode may be displayed on the display 166 of the viewer client 16.

[0076] <Ranking Rewards> Furthermore, multiple viewers may compete for the highest enthusiasm ranking. In this case, the display 166 of each viewer client 16 visually displays the viewer's own ranking and the top viewers (for example, the viewer in first place, viewers in second place or higher, viewers in third place or higher, and viewers who have acquired an action parameter equal to or greater than a predetermined value). The haptic presentation device 18 presents haptics only to the top viewers. In this case, the haptic presentation device 18 may be provided not only on the viewer side but also on the performer side. Preferably, the haptic presentation device 18 is an active type in which the operation of one haptic presentation device moves the other haptic presentation device 18. Viewers other than the top viewers can view the streamed video of the communication between the performer and the top viewers, but cannot experience haptics.

[0077] Specifically, as in the above, the challenge mode activates the acquisition of action parameters in step S21, and deactivates the control of haptic resolution in step S23 and the presentation of haptics in steps S31 to S33. On the other hand, the viewing mode deactivates the acquisition of action parameters in step S21, and activates the control of haptic resolution in step S23 and the presentation of haptics in steps S31 to S33. However, here, the control of haptic resolution and the presentation of haptics by all viewer clients 16 are not activated, but only the control of haptic resolution and the presentation of haptics by the viewer clients 16 associated with the top-ranked viewers are activated. In other words, haptics are presented only to viewers who have acquired action parameters greater than a predetermined value (for example, the value of the action parameter acquired by the first-ranked viewer, the value of the action parameter acquired by the second-ranked viewer, and the value of the action parameter acquired by the third-ranked viewer).

[0078] The current enthusiasm level may be displayed in real time on the display 166 of the viewer client 16, superimposed on the video being distributed, or may be notified by audio from the speaker 167. Also, the part of the body that is providing the tactile sensation may be displayed or notified in real time.

[0079] In the above embodiment, quotas are achieved in order according to the order of unlocking, but this is not limiting. For example, the processing unit 160 of the viewer client 16 can switch the tactile sensation for unlocking (the predetermined condition to be achieved) based on the viewer's selection. In this case, the processing unit 140 of the server 14 stores the action parameters at the time the tactile sensation for unlocking is switched in the storage unit 141. Then, when the tactile sensation is switched again and returns to the previous tactile sensation, the stored action parameters are read out and updated according to the viewer's action. This makes it possible to ensure that the viewer's efforts up to that point are not wasted.

[0080] In the above-described embodiment, it is also possible to set a part that appears only when a specific number of parts have been released.

[0081] <Other embodiments> The various information processes in the above embodiment may be executed by any computer. For example, the information processes in steps S21 to S27 may be executed by the viewer client 16 instead of the server 14.

[0082] The above system includes the tactile presentation device 18 and a smartphone connectable thereto, but may also be a tactile presentation system including a touch panel monitor that integrates the tactile presentation device 18 and the smartphone.

[0083] The tactile presentation device 18 is not limited to one using an MRF, but may be another passive type device, or an active type device using a motor or the like. It may also be a device that combines passive and active types. A non-transitory storage medium that stores a program for causing a computer to function as the tactile presentation system 10 is also included in the embodiments of the present invention.

[0084] Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various improvements and modifications are possible. [Explanation of symbols]

[0085] 10: Tactile presentation system 12: Performer client 14: Server 16: Viewer client 18: Tactile presentation device

Claims

1. a presentation unit that presents to a second user a tactile sensation that would be obtained if the second user came into contact with the body of the first user; an activation unit that activates the presentation unit when the second user achieves a predetermined condition.

2. The tactile presentation system according to claim 1, further comprising: A tactile presentation system including a setting unit that sets the predetermined conditions.

3. The tactile presentation system according to claim 2, The setting unit sets the predetermined conditions for a plurality of parts of the body of the first user.

4. The tactile presentation system according to claim 3, further comprising: a selection unit for selecting a desired site from the plurality of sites; The setting unit sets the predetermined condition for the part selected by the selection unit.

5. The tactile presentation system according to claim 2, The setting unit sets the predetermined condition in response to an operation of the first user.

6. The tactile presentation system according to claim 1, further comprising: an acquisition unit that acquires action parameters related to the action of the second user; a control unit that controls the resolution of the tactile sensation based on the action parameters acquired by the acquisition unit.

7. A computer-implemented tactile presentation method, comprising: presenting to a second user a tactile sensation that would be obtained if the second user had come into contact with the body of the first user; and activating the presentation of the tactile sensation when the second user achieves a predetermined condition.

8. On the computer, presenting to a second user a tactile sensation that would be obtained if the second user had come into contact with the body of the first user; and activating the presentation of the tactile sensation when the second user achieves a predetermined condition.

Images