Information processing apparatus, information processing method and program

Abstract

[Problem] To provide an information processing device, an information processing method, and a program that enable intuitive operations to be performed regarding the setting of a perception position of tactile stimulation. [Solution] The information processing device is provided with: a display control unit that displays information related to a tactile presentation device and a perception position on the tactile presentation device specified by a user; and a generation unit that generates an output control signal to be output to a plurality of tactile stimulation units based on the perception position and the positions of the plurality of tactile stimulation units provided in the tactile presentation device, so that tactile stimulation is perceived at the perception position.

Description

Technical Field

[0001] The present application relates to an information processing device, an information processing method, and a program. Background Art

[0002] Conventionally, various technologies have been proposed for providing tactile stimulation, such as vibration, to a user.

[0003] In Patent Document 1 mentioned below, a technique is disclosed for causing a predetermined device to output tactile stimulation in response to the occurrence of an event in a virtual space.

[0004] Reference List

[0005] Patent Literature

[0006] Patent Document 1: JP 2015-166890 A Summary of the invention

[0007] Technical issues

[0008] Depending on the target position to which the tactile stimulation is to be provided, it is sometimes desirable to output different amounts of tactile stimulation. However, in the technology disclosed in Patent Document 1, exactly the same amount of tactile stimulation is output regardless of position information.

[0009] Furthermore, the only way to confirm the effect of tactile presentation is to check the waveform of the signal output to each tactile presentation device. Therefore, it is difficult to understand the actual effect of tactile presentation.

[0010] In this regard, in the present application, an information processing device, an information processing method, and a program are proposed that enable an intuitive operation regarding setting of a perception position of tactile stimulation to be performed.

[0011] Solution to the problem

[0012] According to the present disclosure, an information processing device is provided, which includes: a display control unit, which displays information related to a tactile presentation device and displays a perception position in the tactile presentation device specified by a user; and a generation unit, which generates an output control signal to be output to multiple tactile stimulation units according to the perception position and according to the positions of multiple tactile stimulation units set in the tactile presentation device, so that tactile stimulation is perceived at the perception position.

[0013] According to the present disclosure, there is provided an information processing method implemented in a processor, the information processing method comprising: displaying information related to a tactile presentation device and a perception position in the tactile presentation device specified by a user; and generating an output control signal to be output to a plurality of tactile stimulation units according to the perception position and according to the positions of a plurality of tactile stimulation units arranged in the tactile presentation device, so that tactile stimulation is perceived at the perception position.

[0014] According to the present disclosure, a program is provided that causes a computer to function as: a display control unit that displays information related to a tactile presentation device and displays a perception position in the tactile presentation device specified by a user; and a generation unit that generates an output control signal to be output to a plurality of tactile stimulation units based on the perception position and based on the positions of the plurality of tactile stimulation units set in the tactile presentation device, so that tactile stimulation is perceived at the perception position.

[0015] Advantageous Effects of the Invention

[0016] As described above, according to the present application, an intuitive operation regarding the setting of the perception position of tactile stimulation can be performed.

[0017] The above-described effects are not necessarily limiting in scope, and any other effects indicated in this written description or any other effects that may be conceivable from this written description may be achieved instead of or in addition to the above-described effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a diagram for explaining the overview of an information processing system according to an embodiment of the present application.

[0019] Figure 2 is a diagram showing an exemplary case in which a tactile sensation output from each tactile stimulation unit is displayed as a waveform.

[0020] Figure 3 2 is a diagram for explaining the reduction in the number of processes achieved in the perceptual effect design according to the present embodiment.

[0021] Figure 4 is a block diagram showing an exemplary configuration of an information processing device and an exemplary configuration of a tactile presentation device according to the present embodiment.

[0022] Figure 5 : is a diagram showing an example of a setting screen for setting the position of the tactile stimulation unit according to the present embodiment.

[0023] Figure 6 is a diagram showing an example of a setting screen for setting a perception effect according to the present embodiment.

[0024] Figure 7 : is a diagram showing an example of a setting screen that enables setting of a waveform type of tactile stimulation according to the present embodiment.

[0025] Figure 8 : is a diagram showing an example of a reproduction screen for reproducing a set perception effect according to the present embodiment.

[0026] Fig. 9 : is a diagram showing an example of a recommended arrangement of a plurality of tactile stimulation units according to the present embodiment.

[0027] Fig.10 : is a diagram showing an example of modification of the arrangement of the plurality of tactile stimulation units according to the present embodiment.

[0028] Fig.11 : is a diagram showing an example of optimized display of a movement path of a position perception according to the present embodiment.

[0029] Fig.12 This is a flowchart for explaining a determination operation performed to determine tactile stimulation according to the present embodiment.

[0030] Fig.13 It is a diagram for explaining the tactile indicator according to the present embodiment.

[0031] Fig.14 is a block diagram showing an exemplary configuration of a tactile indicator according to the present embodiment.

[0032] Fig.15 1 is a diagram for explaining adjustment of the presentation size of tactile stimulation performed by button operation of the tactile indicator according to the present embodiment.

[0033] Fig.16 1 is a diagram for explaining a case where a moving path of a sensed position passing through a body is set according to the present embodiment.

[0034] Fig.17 is a diagram for explaining a case in which a perception effect is set using only a tactile indicator without using a tactile presentation device according to the present embodiment.

[0035] Fig.18 It is a diagram for explaining the setting of the perception effect using the doll according to the present embodiment.

[0036] Fig.19 It is a diagram for explaining various ways of setting a sensory effect using a doll according to the present embodiment. DETAILED DESCRIPTION

[0037] The preferred embodiments of the present application are described in detail below with reference to the accompanying drawings. In this written description and the accompanying drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, and description thereof will not be repeated.

[0038] The description is given in the following order.

[0039] 1. Overview of the information processing system according to the embodiment of the present application

[0040] 2. Configuration

[0041] 2-1. Configuration of information processing device

[0042] 2-2. Configuration of tactile presentation device

[0043] 3. Example of the setting screen for the perception effect

[0044] 4. Operation

[0045] 5. Tactile indicators

[0046] 6. Summary

[0047] <<1. Overview of information processing system according to an embodiment of the present application>>

[0048] Figure 1 1 is a diagram for explaining an overview of an information processing system according to an embodiment of the present application. Figure 1 As shown, the information processing system according to the embodiment of the present application includes a tactile presentation device 10 that provides tactile stimulation to a user, and includes an information processing device 20 that performs output setting of the tactile stimulation.

[0049] The shape of the tactile sense presentation device 10 is not particularly limited, and examples of the shape include a vest-type device that a user wears. Figure 1 The tactile presentation device 10 shown includes a plurality of tactile stimulation units 100 (also referred to as actuators) and two sound output units 102. For example, in the tactile presentation device 10, a predetermined number (e.g., six) of tactile stimulation units 100 may be arranged on the front side and the back side of the user. As an example, the individual tactile stimulation units 100 are arranged to have such a positional relationship that each tactile stimulation unit 100 arranged on the front side is positioned opposite to a tactile stimulation unit 100 arranged on the back side.

[0050] exist Figure 1, an example in which the tactile presentation device 10 is a vest type (sleeveless clothing) is shown. However, this is not the only possible case, and the tactile presentation device 10 may alternatively have sleeves. In this case, in addition to arranging the tactile stimulation unit 100 in the chest area and the abdomen area of ​​the user, one or more tactile stimulation units 100 may be arranged at positions corresponding to both arms of the user. In addition, the tactile presentation device 10 is not limited to Figure 1 The outer garment shown; and alternatively may be pants or socks, shoes, a belt, a hat, gloves or a mask. In addition, Figure 1 In the tactile presentation device 10 shown, the sound output unit 102 is arranged on the left shoulder and the right shoulder. However, the present working example is not limited to this case. Alternatively, there may be only one sound output unit 102, or there may be three or more sound output units 102. Still alternatively, instead of including the sound output unit 102 in the tactile presentation device 10, the sound output unit 102 may be arranged in the relevant predetermined space as an independent device, or may be included in some other wearable device other than the tactile presentation device 10 (e.g., a headphone or a headset), or may be included in a portable device (e.g., a portable music player, a smart phone, or a portable gaming device).

[0051] Furthermore, the tactile presentation device 10 is not limited to the clothing accessories shown in the examples, and examples of the tactile presentation device 10 may also include a controller, a gun-type controller, a bed, and a chair.

[0052] (Tactile stimulation unit 100)

[0053] In the case where the tactile stimulation units 100 included in the tactile presentation device 10 independently generate vibrations, the generated vibrations can be sensed only in the surrounding area of ​​each tactile stimulation unit 100. Therefore, if the tactile stimulation units 100 are arranged far away from each other, the vibrations respectively generated by each tactile stimulation unit 100 can be discretely sensed in the user's body.

[0054] Among them, a perceptual illusion called phantom sensation has been explained in medicine. Phantom sensation refers to a perceptual illusion in which a person perceives only a single stimulus in the stimulated position when stimuli are provided to different positions on the skin at the same time. For example, if two tactile stimulation units 100 provided on the user's body are caused to output stimulation at the same time, it is known that the position of the stimulation perceived by the user (hereinafter referred to as "perception position") is usually between the two tactile stimulation units 100.

[0055] Among them, by changing the output intensity of the tactile stimulation unit 100, the range of tactile stimulation that can be provided by the tactile stimulation unit 100 can be continuously expanded without changing the arrangement distance between the individual tactile stimulation units 100. For example, an explanation of an example of the relationship between the output intensity of two tactile stimulation units 100 and the perceived position is given. For example, it is assumed that over time, the output intensity of the first tactile stimulation unit 100 is continuously weakened, such as "1", "0.6" and "0"; and the output intensity of the second tactile stimulation unit 100 is continuously enhanced, such as "0", "0.6" and "1". In this case, the perceived position (perceived by the user) can be continuously moved from the contact position of the first tactile stimulation unit 100 to the contact position of the second tactile stimulation unit 100.

[0056] (background)

[0057] When designing tactile signals of various tactile presentation devices, it is desirable to perform intuitive operations. However, even if the tactile stimulation provided by each tactile stimulation unit 100 (actuator) is displayed as Figure 2 The waveforms (tactile signals) shown, the actual perceived effect (i.e., which body part is felt in what way) is also unclear.

[0058] In this regard, in the present embodiment, the GUI is used to implement the designation of the perception position and the perception intensity; and the output signal to the corresponding tactile stimulation unit is automatically generated based on the designated perception position and the designated perception intensity. Therefore, the user becomes able to perform intuitive operations related to the setting of the perception position of the tactile stimulation.

[0059] Furthermore, according to the present embodiment, the number of processes in the perceptual effect design can be reduced. More specifically, for example, Figure 3 As shown in the left part of FIG, the following three steps are usually performed in a repetitive manner: after imagining the perception effect to be achieved (perception position and perception intensity), controlling the output of each tactile stimulation unit; confirming (feeling) the perception effect; and imagining / correcting the perception effect to be achieved using the GUI again, performing output control, and actually feeling the perception effect. In contrast, according to the present embodiment, Figure 3As shown in the right part of , the perceptual effect design can be intuitively performed by repeatedly performing the following two steps: using the GUI to control the perceptual effect to be achieved (i.e., specifying the perceptual position and the perceptual intensity); and confirming (feeling) the perceptual effect. The perceptual effect (i.e., the perceptual position and the perceptual intensity) can be specified by performing a mouse operation or a touch operation in the GUI, or can be specified using a controller such as a 3D indicator; and the output of the tactile presentation device 10 is changed in a manner that provides the relevant perceptual effect. In this way, by specifying the actual feeling (i.e., specifying what the intensity is at which position), it becomes possible to eliminate the user's control over each tactile stimulation unit 100 and achieve automation.

[0060] <<2. Configuration>>

[0061] Refer to the following Figure 4 A specific description of the configuration of the information processing device 20 and the configuration of the tactile presentation device 10 according to the present embodiment will be described.

[0062] <2-1. Configuration of Information Processing Device 20>

[0063] Reference Figure 4 , the information processing device 20 according to the present embodiment includes a control unit 200 , a communication unit 210 , an operation input unit 220 , a display unit 230 , and a storage unit 240 .

[0064] (Control Unit 200)

[0065] The control unit 200 functions as an arithmetic processing device and a control device, and controls the overall operation in the information processing device 20 according to various programs. The control unit 200 is implemented using, for example, an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. In addition, the control unit 200 may include a ROM (Read Only Memory) for storing programs and operating parameters to be used, and a RAM (Random Access Memory) for temporarily storing parameters that are subject to change.

[0066] Furthermore, the control unit 200 according to the present embodiment can also function as the perception position / intensity decision unit 201 , the screen generation unit 202 , and the output control unit 203 .

[0067] ·Perception position / intensity determination unit 201

[0068] The perception position / intensity decision unit 201 functions as a generation unit that decides (calculates) the vibration intensity for the tactile stimulation unit 100 corresponding to the target perception position according to the designated perception position and the designated perception intensity (so that the designated perception intensity is perceived at the designated perception position), and generates an output control signal to be output to the tactile stimulation unit 100. Herein, the designated perception position also includes a moving path of the perception position.

[0069] The sensing position and its moving path can be set on the surface of the user's body. For example, a tactile stimulation can be provided to the user in a manner such that the sensing position moves from a position representing a starting point on the user's body to a position representing an end point in a continuous manner. Alternatively, the moving path of the sensing position can also be set to a path that engages the first side of the user's body, the inside of the user's body, and the second side on the opposite side of the first side. In this article, the first side can be the front side of the user, and the second side can be the back side of the user. Alternatively, for example, the first side can be the surface of the visible side of a predetermined part such as an arm, and the second side can be the lower side of the part. For example, when the moving path is a path that engages a position on the front side of the user, the inside of the user's body, and a position on the back side of the user; then it becomes possible to provide the user with a piercing perception from the front side through the body to the back side.

[0070] The perception position / intensity determination unit 201 may also set a perception range.

[0071] Furthermore, the perception position / intensity decision unit 201 may also associate the perception position with a timing corresponding to the content being reproduced (e.g., movie or game content). Thus, using the tactile presentation device 10, a predetermined tactile stimulus can be applied to a user who is viewing the content at a predetermined timing.

[0072] First, the perception position / intensity determination unit 201 identifies a plurality of (e.g., three) tactile stimulation units 100 located near a designated perception position. Then, based on the positional relationship of each tactile stimulation unit 100 with the designated perception position and based on the designated perception intensity, the perception position / intensity determination unit 201 determines the output intensity of each tactile stimulation unit 100. That is, based on the designated perception position, the designated perception intensity, and the distance from the tactile stimulation unit 100 disposed nearby; the perception position / intensity determination unit 201 adjusts the output intensity of the tactile stimulation unit 100 (i.e., generates an output control signal to be output to each tactile stimulation unit 100). With regard to the adjustment of the output intensity of the tactile stimulation unit 100 for providing a predetermined tactile stimulation to a target position on the user's body, the technology disclosed in PCT / JP2017 / 14379 is used.

[0073] For example, when the first tactile stimulation unit 100 and the second tactile stimulation unit 100 are located near a designated perception position, the perception position / intensity determination unit 201 determines the output intensity of the first tactile stimulation unit 100 based on the distance from the contact position of the first tactile stimulation unit 100 on the user's body to the target perception position. Similarly, the perception position / intensity determination unit 201 determines the output intensity of the second tactile stimulation unit 100 based on the distance from the contact position of the second tactile stimulation unit 100 on the user's body to the target perception position.

[0074] A more detailed description of the above functions is given below. First, a description is given of an example of adjusting the output intensity of two tactile stimulation units 100, which are positioned so that the target perception position exists between the contact positions of the two tactile stimulation units 100. For example, based on the positional relationship between the target perception position and the middle position of the contact position of the first tactile stimulation unit 100 and the second tactile stimulation unit 100, the perception position / intensity decision unit 201 decides the output intensity of the first tactile stimulation unit 100 and the output intensity of the second tactile stimulation unit 100.

[0075] For example, the perception position / intensity decision unit 201 may decide the output intensity of the first tactile stimulation unit 100 and the output intensity of the second tactile stimulation unit 100 so that the total value of the output intensity of the first tactile stimulation unit 100 and the output intensity of the second tactile stimulation unit 100 increases inversely proportional to the distance between the intermediate position and the target perception position. Alternatively, if the target perception position is closer to the contact position of the first tactile stimulation unit 100 than to the contact position of the second tactile stimulation unit 100, the perception position / intensity decision unit 201 may decide the output intensity of the first tactile stimulation unit 100 so that the output intensity of the first tactile stimulation unit 100 increases in proportion to the distance between the contact position of the first tactile stimulation unit 100 and the target perception position. The same is true for the second tactile stimulation unit 100 (i.e., the opposite relationship also holds true).

[0076] At the same time, based on the positional relationship between the intermediate position and the target perception position, the perception position / intensity decision unit 201 changes the ratio of the output intensity of the first tactile stimulation unit 100 to the output intensity of the second tactile stimulation unit 100 .

[0077] Screen generation unit 202

[0078] The screen generation unit 202 can generate a setting screen for setting a target perception position and a target perception intensity. In the setting screen, as information related to the tactile presentation device 10, an image indicating the position of the tactile stimulation unit 100 in the tactile presentation device 10 is displayed, and an image indicating the external shape of the tactile presentation device 10 is displayed. Therefore, the user can use the image to specify the position (perception position) for tactile stimulation. In addition, the user can be allowed to freely set the position of the tactile stimulation unit 100 in a virtual manner. In addition, if the position of the tactile stimulation unit 100 is pre-set and known, an image indicating the position of the tactile stimulation unit 100 is displayed. In addition, although the position of the tactile stimulation unit 100 is pre-set and known, if the setting does not present the position to the user (for example, if the position of the tactile stimulation unit 100 represents a trade secret), an image indicating only the external shape of the tactile presentation device 10 can be displayed. Among them, in the setting screen, the moving path of the perception position can be input. In addition, multiple sensing positions (moving paths of multiple sensing positions) can also be set. In addition, the perception position and the perception strength can also be set so that the tactile stimulation is generated at a predetermined position at a predetermined timing corresponding to the reproduction of the predetermined content. In the setting screen, the perception position and the perception strength can be specified by performing a mouse operation or a touch operation, or can be specified using a controller such as a 3D pointer. Figures 5 to 11 A description is given of a specific example of the setting screen according to the present embodiment.

[0079] The screen generation unit 202 may also generate a screen for displaying the output control signal (waveform) generated by the perception position / intensity determination unit 201 and output to the tactile stimulation unit 100 .

[0080] Output control unit 203

[0081] The output control unit 203 performs output control of the tactile stimulation on the tactile presentation device 10 according to the decision made by the perception position / intensity decision unit 201. Therefore, for example, when the user actually wears and feels the tactile presentation device 10, he or she becomes able to confirm the effect (perception effect) of the specified tactile stimulation. More specifically, the output control unit 203 outputs the generated output control signal (controlling the generation of vibration) to a plurality of predetermined tactile stimulation units 100 determined by the perception position / intensity decision unit 201. In addition, the output control unit 203 can perform reproduction control on the content (video) reproduced in the display device (display, HMD, projector, PC or smart phone); and according to the reproduction of the content, output control of the tactile stimulation from the tactile presentation device 10 can be performed at a predetermined timing. In addition, the output control unit 203 can also perform control to reproduce sounds such as impact sounds relative to the tactile stimulation provided from the sound output unit 102 of the tactile presentation device 10. In addition, the output control unit 203 can also perform control to display various screens generated by the screen generation unit 202 in the display unit 230.

[0082] (Communication unit 210)

[0083] The communication unit 210 sends information to other devices and receives information from other devices. For example, under the control of the output control unit 203, the communication unit 210 sends a control signal for output of tactile stimulation to each tactile stimulation unit 100 (or tactile presentation device 10). In addition, under the control of the output control unit 203, the communication unit 210 sends a control signal for displaying a target image for reproduction to a display device (not shown), and sends a control signal for outputting a target sound for reproduction to each sound output unit 102 (or tactile presentation device 10).

[0084] The communication unit 210 establishes a communicative connection with other devices using, for example, a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), near-field wireless communication, a mobile communication network (LTE (Long Term Evolution)) or 3G (third generation cellular communication method).

[0085] (Operation Input Unit 220)

[0086] The operation input unit 220 receives an operation instruction from the user and outputs the operation details to the control unit 200. The operation input unit 220 may be a touch sensor, a pressure sensor, or a proximity sensor. Alternatively, the operation input unit 220 may have a physical configuration such as a keyboard, a mouse, a button, a switch, and a joystick.

[0087] (Display unit 230)

[0088] The display unit 230 is a display device that outputs a setting screen for enabling setting of a perception effect. Examples of the display unit 230 include a display device such as a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display.

[0089] (Storage unit 240)

[0090] The storage unit 240 is implemented using a ROM (Read Only Memory) for storing programs and operation parameters to be used in the operation of the control unit 200 and a RAM (Random Access Memory) for temporarily storing parameters subject to change.

[0091] So far, a specific description has been given about the configuration of the information processing device 20 according to the present embodiment. However, the configuration of the information processing device 20 is not limited to Figure 4 The example shown. Alternatively, for example, a plurality of devices may be used to configure the information processing device 20. Still alternatively, the information processing device 20 may further include a sound input unit and a sound output unit.

[0092] Meanwhile, the information processing device 20 is not limited to Figure 1 The PC shown in the figure can be implemented using a smart phone, a cellular phone, a tablet terminal or a dedicated terminal as an alternative. In addition, at least some parts of the control unit 200 of the information processing device 20 can be implemented using a server on the network. In addition, the display unit 230 can be implemented using a projector, and the setting screen can be projected onto a wall, a table or a screen. In this case, for the user's operation input relative to the projection screen, a separately installed camera device can be used to detect the touch operation relative to the projection screen.

[0093] <2-2. Configuration of Tactile Presentation Device 10>

[0094] Refer to the following Figure 4 The configuration of the tactile presentation device 10 according to this embodiment will be described. Figure 4 As shown, the tactile presentation device 10 includes a plurality of tactile stimulation units 100 a to 100 c , a control unit 110 , a communication unit 120 , and a sound output unit 102 .

[0095] The control unit 110 functions as an arithmetic processing device and a control device, and controls the overall operation in the tactile presentation device 10 according to various programs. The control unit 110 is implemented using, for example, an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. In addition, the tactile presentation device 10 may include a ROM (Read Only Memory) for storing programs and operating parameters to be used, and a RAM (Random Access Memory) for temporarily storing parameters that are subject to change.

[0096] For example, according to a control signal for the output of tactile stimulation corresponding to each tactile stimulation unit 100 received from the information processing device 20 via the communication unit 120, the control unit 110 controls the output of tactile stimulation (e.g., vibration) in each of the tactile stimulation units 100a to 100c.

[0097] The communication unit 120 sends information to other devices and receives information from other devices. For example, the communication unit 120 receives a control signal for outputting a tactile stimulation corresponding to each tactile stimulation unit 100 from the information processing device 20. In addition, the communication unit 120 receives a control signal for outputting a target sound for reproduction from the information processing device 20. The communication unit 120 establishes a communicable connection with other devices using, for example, a wired / wireless LAN (local area network), Wi-Fi (registered trademark), Bluetooth (registered trademark), near field wireless communication, a mobile communication network (LTE (Long Term Evolution)) or 3G (third generation cellular mobile method).

[0098] Each tactile stimulation unit 100 is an actuator that provides tactile stimulation to the user. For example, the tactile stimulation unit 100 generates vibration as a tactile stimulation. However, the tactile stimulation provided by the tactile stimulation unit 100 is not limited to vibration, and stimulations such as cold, warm, wind, water or pressure may be considered alternatively.

[0099] The sound output unit 102 includes a speaker for reproducing a sound signal and an amplifier circuit for the speaker.

[0100] So far, a description has been given of an exemplary configuration of the tactile presentation device 10 according to the present embodiment. However, the configuration of the tactile presentation device 10 according to the present embodiment is not limited to Figure 4 For example, the tactile presentation device 10 may be configured not to include the sound output unit 102 .

[0101] <<3. Example of the setting screen for the perception effect>>

[0102] Refer to the following Figures 5 to 11 A specific description is given regarding an example of a setting screen for setting a perception effect according to the present embodiment.

[0103] Figure 5 4 is a diagram showing an example of a setting screen 40 for setting the position of the tactile stimulation unit 100 according to the present embodiment. Figure 5As shown, in the setting screen 40, on the display 401 indicating the shape of the jacket-type tactile presentation device 10, for example; Displays 402a to 402g representing the tactile stimulation unit 100 are displayed. By operating the cursor 403 using a mouse operation, a touch operation or some other controller, the displays 402a to 402g representing the tactile stimulation unit 100 can be moved to an arbitrary position. Alternatively, the position of the tactile stimulation unit 100 can be known. That is, the 3D data of the tactile presentation device 10 that has been generated can be incorporated, and the external shape of the tactile presentation device 10 and the position of the tactile stimulation unit 100 set in the tactile presentation device 10 can be displayed.

[0104] exist Figure 5 In the example shown, the front image and the side image are displayed. In addition, the back image can also be displayed. Alternatively, the display can be switched between the front image, the side image and the back image according to the user operation.

[0105] Figure 6 4 is a diagram showing an example of a setting screen 42 for setting a perception effect according to the present embodiment. Figure 6 As shown, in the setting screen 42, a display 420 indicating the arrangement of the plurality of tactile stimulation units 100 is displayed. The user specifies the position for generating tactile stimulation (i.e., specifies the perception position) by performing a mouse operation. At the specified position, a perception position display 423 is displayed. In addition, in the case where the perception position is to be continuously moved, the user can also specify a moving path 424 by performing a mouse operation. In addition, the user can also specify the moving speed of the perception position.

[0106] When the reproduction button 426 in the setting screen 42 is selected, a video indicating the moving path of the sensed position is reproduced. That is, a video in which the sensed position display 423 moves along the moving path 424 can be reproduced. This enables the user to confirm the setting. In addition, when the reproduction button 426 is selected, the information processing device 20 can reproduce the video indicating the moving trajectory of the sensed position in the setting screen 42 displayed in the display unit 230, and can ensure that the corresponding output control of the tactile stimulation is performed from the connected tactile presentation device 10. This enables the user to instantly receive feedback on the sensed effect.

[0107] Figure 7 4 is a diagram showing an example of a setting screen 44 that enables setting of the waveform type of tactile stimulation. For example, various types of tactile stimulation, such as impact vibration, can be considered. Figure 7As shown, the user can drag the mouse and move a tactile stimulus of any waveform type (the corresponding waveform data is also referred to as a "library") to any perception position 443, and can set the type of tactile stimulus at the perception position 443 (for example, the type of vibration waveform). Regarding the library, a large number of libraries can be preset, or the information processing device 20 can generate a library by incorporating any audio waveform and video data. The information processing device 20 includes a filter / algorithm for converting media into a tactile stimulus signal. In addition, the information processing device 20 can also recommend the most suitable library based on the position and length of the moving path of the perception position specified by the user and based on the moving speed of the perception position.

[0108] Figure 8 FIG. 4 is a diagram showing an example of a reproduction screen for reproducing a set perception effect. Figure 8 As shown, in the reproduction screens 46-1 to 46-3, the following contents are displayed: a display screen 460 of the perception position, a seek bar 462, and a content bar 464 indicating the (time) length of the tactile stimulation set at the relevant perception position. When the reproduction button 463 is selected, the change of the perception position is displayed, and the seek position of the corresponding tactile stimulation content is also changed. In addition, the intensity at the perception position is displayed as, for example, the size of the display 461 of the perception position. Figure 8 In the example shown, at the perception position 461b displayed in the reproduction screen 46-2, it can be seen that the perception strength has increased compared to the perception position 461a indicating the start point. The user can confirm the perception position and the perception strength by moving the seek bar.

[0109] In addition, as shown in the reproduction screen 46-3, a plurality of perception effects may also be arranged. In this case, as shown in the reproduction screen 46-3, a content strip 466 of tactile stimulation corresponding to the perception position 465 may also be displayed.

[0110] Furthermore, the user may be enabled to arbitrarily adjust the time length of the content strips 464 and 466 (ie, the length of the tactile stimulation).

[0111] In which, although not shown in the accompanying drawings, the corresponding (synchronized) video content and acoustic content can also be displayed in combination in the reproduction picture for reproducing the perceptual effect; and together with the change in the perceptual position, the change in the search position of the content can be confirmable.

[0112] Furthermore, in a setting screen for setting perceptual effects, the quality of stimulation (e.g., presentation amplitude, gradual increase / decrease, and temperature control) and effects related to other modalities (e.g., lighting effects, video effects, and acoustic effects) may be controllable.

[0113] Furthermore, in the present embodiment, even if a plurality of different types of tactile stimulation units 100 (having different frequency characteristics, different response performances, or different sizes) are used, control can be performed by correcting the differences between them.

[0114] In addition, in the present embodiment, when an excessive output can be expected, a warning can be displayed to ensure that the tactile presentation device 10 does not malfunction. For example, in the present embodiment, an output control signal is generated for the purpose of setting a specified sensing position and a specified sensing intensity. However, the output can be automatically corrected so that with respect to any problem of placing a burden on the human body, such as a tactile presentation period that is too long or too strong, or a driving period that is too long so as to generate heat, or a low-temperature burn or a high-temperature burn caused by a temperature presentation device; a pre-simulation is performed, and a warning is displayed in the setting screen accordingly, so as to avoid any burden on the user.

[0115] Furthermore, in the present embodiment, in the setting screen, the intensity of the tactile sense presentation can be indicated using the size of the mark, and the length of the presentation period can be indicated using the color or transparency of the mark.

[0116] Furthermore, in the present embodiment, when the movement of the perceived position is too fast (ie, the path is long), the most appropriate path may be displayed and automatic adjustment may be performed.

[0117] In addition, in this embodiment, the actual output does not need to be strictly associated with the perceived effect specified by the user. For example, even if it is set to generate 100 different tactile stimuli in a short period of time, the actual output can be limited to about 10 times. In this case, the count or display period after optimization can be displayed in the setting screen or not.

[0118] When the perception position is close to the abdomen (using an expression such as a ball hitting the abdomen), the volume of the headphones (i.e., the volume of the corresponding sound) can be reduced. On the other hand, when the perception position is close to the chest, the volume can be increased. Therefore, according to the perception position, the acoustic effect and the video effect can be automatically adjusted.

[0119] Furthermore, in the present embodiment, control signals within several minutes in the tactile presentation device 10 may be outputted eventually, or the tool itself may be used as a player (reproduction software).

[0120] (Recommendation on Arrangement of Tactile Stimulation Unit 100)

[0121] In the example described above, the arrangement of the tactile stimulation unit 100 is determined before the perception position is set. However, the present embodiment is not limited to this case. Alternatively, based on any perception position and any movement path specified by the user, the information processing device 20 can recommend the most suitable arrangement of the tactile stimulation unit 100. For example, as the most suitable arrangement, such an arrangement can be considered, by which tactile presentation can be performed at least at the set perception position, and the arrangement enables power saving and load reduction. At this time, the user can be enabled to input the number of available tactile stimulation units 100 and information such as restrictions on the installable range.

[0122] Fig. 9 1 is a diagram showing an example of a recommended arrangement of a plurality of tactile stimulation units 100. First, Fig. 9 As shown in the left part of FIG. 48 , in the setting screen 48-1, only the outline form of the tactile presentation device 10 is displayed. Fig. 9 As shown in the middle part of FIG. 48 , in the setting screen 48-2, the user draws one or more movement paths 481a and 481b of the perception position within the outline form of the tactile presentation device 10, and performs the perception effect setting. Fig. 9 As shown in the right part of , in the setting screen 48-3, for example, when the optimal position display button 483 is selected, the most suitable arrangement of multiple tactile stimulation units 100 (ie, display 484a to display 484f) is displayed so that the set perceptual effect can be achieved.

[0123] The recommendations regarding the most appropriate arrangement of the plurality of tactile stimulation units 100 also include suggestions for corrections regarding the already arranged tactile stimulation units 100. Fig.10 Provide relevant instructions.

[0124] Fig.10 1 is a diagram showing an example of a modification of the arrangement of the plurality of tactile stimulation units 100. First, as in Fig.10 As shown in the left part of FIG. 50 , in the setting screen 50-1, when the display 501a to the display 501i indicating the positions of the plurality of tactile stimulation units 100 set in advance (or arbitrarily set by the user) are displayed; the user operates the mouse and draws the moving paths 503a and 503b of the target perception position. Then, as shown in FIG. Fig.10 As shown in the middle part of the figure, in the setting screen 50-2, when the user selects the optimal arrangement display button 504, the information processing device 20 calculates the most suitable position of the tactile stimulation unit 100 based on the moving paths 503a and 503b of the designated perception position; and as shown in the figure, displays 505a to 505i indicating the most suitable position of the tactile stimulation unit 100 are displayed in an overlapping manner. Fig.10In the example shown, it can be seen that the displays 501c, 501f and 501i of the pre-set tactile stimulation unit 100 are misaligned with the displays 505c, 505f and 505i indicating the most suitable positions; and the above misalignment is corrected.

[0125] Then, if Fig.10 As shown in the right part of the figure, in the setting screen 50-3, when the user selects the optimization display button 506, the state in which the tactile stimulation unit 100 is changed to its most suitable position is displayed, and the state is finally determined. According to the most suitable position of the tactile stimulation unit 100 presented in this way, the user becomes able to adjust the arrangement of the actual tactile stimulation unit 100 in the tactile presentation device 10.

[0126] Refer to the following Fig.11 Describes recommendations regarding the most appropriate path for a specified location-aware path. Fig.11 is a diagram showing an example of optimized display of a moving path of a perceived position.

[0127] like Fig.11 As shown, in the setting screen 52-1, first, the user inputs the perceived position and the moving path 520. Then, in the setting screen 52-2, when the optimization path display button 521 is selected, the information processing device 20 calculates the most suitable path for the perceived position and displays the most suitable path as the most suitable path 522. The most suitable path can be calculated by considering, for example, the influence on the human body, the load on the tactile stimulation unit 100, and the arrangement of the surrounding tactile stimulation units 100.

[0128] Then, if Fig.11 As shown in the right part of FIG. 5 , in the setting screen 52 - 3 , when the user selects the path optimization button 523 , the optimization of the moving path of the perception position is finally determined.

[0129] <<4. Operation>>

[0130] Refer to the following Fig.12 Operations performed in the information processing system according to the present embodiment will be described. Fig.12 This is a flowchart for explaining a determination operation performed to determine tactile stimulation according to the present embodiment.

[0131] like Fig.12 As shown, first, an input device such as a mouse or a touch-sensitive panel is used to designate a position (and intensity) at which a tactile stimulation is to be perceived in the GUI (step S103).

[0132] Then, the information processing device 20 decides the tactile stimulation unit 100 to be used in the tactile presentation and decides the presentation intensity (the magnitude of the tactile control signal output from the tactile stimulation unit 100 ) based on the specified perception position (and perception intensity) (step S106 ).

[0133] The content determined in this way can be output to the tactile presentation device 10 in response to, for example, the operation of a reproduction button in the GUI. The user can perform intuitive setting of the perceptual effect in the GUI, and can confirm the set perceptual effect by instantly perceiving the set perceptual effect in the tactile presentation device 10; and can adjust the setting in a repetitive manner.

[0134] The setting of the perception effect is not limited to using a mouse or a touch-sensitive panel. Alternatively, a tactile indicator (3D indicator) can be used to input the setting directly onto a real object. A description of such an indicator is given below.

[0135] <<5. Tactile Indicator>>

[0136] Fig.13 1 is a diagram for explaining the tactile indicator 60 according to the present embodiment. Fig.13 As shown, when the tactile indicator 60 moves toward the tactile presentation device 10, it becomes possible to intuitively draw a track 601 on the tactile presentation device 10 (real object), and set the perceived position and the moving path of the perceived position. The track 601 drawn on the tactile presentation device 10 can be displayed in the display unit 640 of the tactile presentation device 10; or the visible light of the LED can be emitted from the tactile presentation device 10 and the track 601 on the tactile presentation device 10 can be made visible.

[0137] Alternatively, the tactile presentation control (output control of tactile stimulation) in the tactile presentation device 10 can be performed in real time so that the tactile indicator 60 or the information processing device 20 connected to the tactile indicator 60 can provide tactile stimulation along the trajectory drawn using the tactile indicator 60. Therefore, the user becomes able to specify the moving path of the perceived position in real time and can feel the perceived effect. Among them, the user wearing the tactile presentation device 10 can operate the tactile indicator 60 himself / herself. Even if the user does not have specialized technical knowledge, he or she can confirm the perceived effect in real time using the tactile indicator 60, and can create data based on his or her experience.

[0138] Identification of trajectory 601 can be performed in the following manner, for example: using a distance sensor of IR (infrared) emitted from the tactile indicator 60 to detect the distance d of the target (tactile presentation device 10) and obtaining the three-dimensional position of the target (i.e., the relative position relative to the tactile indicator 60); and using a posture sensor installed in the tactile indicator 60, such as a gyroscope sensor or an acceleration sensor, to obtain the movement of the tactile indicator 60.

[0139] Among them, for the position of the tactile stimulation unit 100 set in the tactile presentation device 10; the position can be a known position, or the position can be detected using a camera installed in the tactile indicator 60; or the user can use the tactile indicator 60 to specify and store the position (relative position) of the tactile stimulation unit 100.

[0140] Among them, in the tactile indicator 60, an operation input unit 620 is set, such as a record start / stop button or a reproduction start / stop button. When the user selects the record start button, the tactile indicator 60 emits infrared rays and starts to recognize the three-dimensional position of the target (tactile presentation device 10). Subsequently, when the record stop button is pressed, the tactile indicator 60 ends the recognition of the three-dimensional position and stores the moving path of the recognized three-dimensional position (that is, the trajectory 601 is stored on the tactile presentation device 10). In addition, when the reproduction start button is selected, the tactile indicator 60 starts the output control from the tactile presentation device 10 so that the stored data is played back, that is, tactile stimulation is provided along the stored trajectory 601 on the tactile presentation device 10.

[0141] <5-1. Configuration>

[0142] Refer to the following Fig.14 An exemplary configuration of the tactile indicator 60 according to the present embodiment will be described. Fig.14 As shown, the tactile indicator 60 includes a control unit 600 , a communication unit 610 , an operation input unit 620 , a sensor 630 , a display unit 640 , a tactile presentation unit 650 , and a storage unit 660 .

[0143] The control unit 600 functions as an arithmetic processing device and a control device, and controls the overall operation in the tactile indicator 60 according to various programs. The control unit 600 is implemented using, for example, an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. In addition, the control unit 600 may include a ROM (Read Only Memory) for storing programs and operating parameters to be used, and a RAM (Random Access Memory) for temporarily storing parameters that are subject to change.

[0144] The control unit 600 according to the present embodiment can perform the following operations in response to the user operation input from the operation input unit 620: library (tactile type) selection, intensity adjustment, recording start / stop (storing recorded multi-channel tactile data), reproduction / stop (playback of recorded data), setting of tactile presentation size (narrow / wide), tactile presentation mode selection (surface tracking (presentation boundary contrast setting (clear / blurred)), penetration expression (presentation of the feeling of being shot), temperature adjustment (presentation setting of temperature feeling), and force adjustment (presentation setting of force feeling). In this article, information about vibration, temperature, and force can be included in a single library.

[0145] In addition, based on the detection result obtained by the sensor 630, the control unit 600 can identify the track on the tactile presentation device 10. More specifically, for example, the control unit 600 uses infrared rays or a beacon (Bluetooth) or uses a camera to detect the distance d from the tactile presentation device 10; and obtains the position (three-dimensional position) of the tactile presentation device 10 relative to the tactile indicator 60. Then, the control unit 600 detects the movement of the tactile indicator 60 according to the detection result of the posture sensor, and identifies the track on the tactile presentation device 10 together with the three-dimensional position of the tactile presentation device 10. In addition, the control unit 600 can identify the shape of the tactile presentation device 10 by analyzing a captured image captured by a camera installed in the tactile indicator 60, and can also identify the relative position relative to the tactile presentation device 10.

[0146] In addition, the control unit 600 can obtain the position of the tactile stimulation unit 100 set in the tactile presentation device 10, and can generate an output control signal in the tactile stimulation unit 100 for the purpose of tactile presentation along a specified trajectory. In this article, the generation method is the same as the method described with reference to the tactile position / intensity determination unit 201 of the information processing device 20. Among them, the position of the tactile stimulation unit 100 set in the tactile presentation device 10 can be input by the user using the tactile indicator 60. For example, the user points to the tactile stimulation unit 100 in the tactile presentation device 10 using the tactile indicator 60, and obtains the target three-dimensional position using the tactile indicator 60, and registers the three-dimensional position as the "position of the tactile stimulation unit 100". In addition, in the tactile presentation device 10, when a mark (such as an LED, an infrared mark, or a QR code (registered trademark)) is set at a position corresponding to the position of the tactile stimulation unit 100, the control unit 600 can detect the mark using a camera image and obtain the position of the tactile stimulation unit 100.

[0147] Alternatively, the control unit 600 may obtain the three-dimensional position information from the tactile presentation device 10 or from each tactile stimulation unit 100 .

[0148] The communication unit 610 sends information to other devices and receives information from other devices. For example, the communication unit 610 can obtain update information of the library from the network, can upload record data, and can send the record data to the information processing device 20. In addition, the communication unit 610 can send an output control signal (a control signal for the output of tactile stimulation) to the tactile presentation device 10 or the tactile stimulation unit 100. The communication unit 610 uses, for example, a wired / wireless LAN (local area network), Wi-Fi (registered trademark), Bluetooth (registered trademark), near field wireless communication, a mobile communication network (LTE (Long Term Evolution)) or 3G (third generation cellular mobile method) to establish a communicable connection with other devices.

[0149] The operation input unit 620 receives an operation instruction from the user and outputs the operation details to the control unit 600. The operation input unit 620 may be a touch sensor, a pressure sensor, or a proximity sensor. Alternatively, the operation input unit 620 may have a physical configuration such as a keyboard, a mouse, a button, a switch, and a joystick.

[0150] The sensor 630 includes, for example, a three-dimensional position sensor (an infrared sensor, a beacon, or a distance sensor of a so-called camera) or a posture sensor (a gyro sensor or an acceleration sensor). In addition, the sensor 630 may include an infrared camera or an RGB camera that detects a mark indicating the position of the tactile stimulation unit 100 provided in the tactile presentation device 10.

[0151] The display unit 640 is a display device that outputs various operation screens and a screen that displays an input trajectory (movement path of a sensed position). Examples of the display unit 640 include a display device such as a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display.

[0152] The tactile presentation unit 650 has a function of giving feedback to the hand of the user holding the tactile indicator 60. For example, the tactile presentation unit 650 can provide vibration, force, or temperature as a tactile stimulus. For example, when the user is inputting a sense effect to the tactile presentation device 10, the tactile presentation unit 650 can present the vibration in real time. Therefore, even when the operator of the tactile indicator 60 is not wearing the tactile presentation device 10, he or she can understand the set tactile sensation in real time.

[0153] The storage unit 660 is implemented using a ROM (Read Only Memory) for storing programs and operating parameters to be used in the operation of the control unit 600 and a RAM (Random Access Memory) for temporarily storing parameters subject to change. For example, the storage unit 660 can be used to store data and recorded data.

[0154] So far, a detailed description has been given about the configuration of the tactile indicator 60 according to the present embodiment. Fig.14 The illustrated configuration is merely exemplary, and the present embodiment is not limited to this configuration. Alternatively, for example, the tactile indicator 60 may be configured not to include the display unit 640 or the tactile presentation unit 650 .

[0155] <5-2. Example of setting operation of perception effect>

[0156] A description is given below of a specific example of a setting operation of a sense effect using the tactile indicator 60 according to the present embodiment with reference to the drawings.

[0157] Fig.15 1 is a diagram for explaining adjustment of the presentation size of the tactile stimulus performed by button operation of the tactile indicator 60. The presentation size of the tactile stimulus can be changed according to, for example, the pressing amount of a predetermined button in the tactile indicator 60. For example, Fig.15 As shown in the left part of FIG, when the amount of pressing the button is small, the size becomes smaller (narrower); and as shown in FIG. Fig.15 As shown in the right part of FIG. , when the amount of pressing of the button is large, the presentation size becomes larger (wider). In this article, the LED emitted from the tactile indicator 60 can be used to make the relevant tracks 602a and 602b visible.

[0158] Fig.16 is a diagram for explaining the case of setting a moving path of a sensed position passing through a body. In the tactile indicator 60, the type of tactile stimulation presentation can be selected; and for example, "penetration mode" and "surface tracking mode" can be considered. If the penetration mode is selected, as shown in Figure 7 As shown, it becomes possible to input a movement path that connects the front side of the user's body wearing the tactile presentation device 10 to the back side through the internal connection, that is, it becomes possible to input a movement path that passes through the user's body. In this state, if the body is tracked using the tactile indicator 60, it becomes possible to provide a perception as if the body was completely cut in half by a sword. On the other hand, in "surface tracking mode", the boundary contrast of the tactile presentation can also be set. For example, in "surface tracking-pencil", a perception in which the boundaries of the tactile presentation are clear can be presented. In contrast, in "surface tracking-brush", a perception in which the boundaries of the tactile presentation are blurred can be presented.

[0159] Furthermore, if the tactile indicator 60 is moved back and forth in a substantially vertical direction relative to the tactile presentation device 10 , it becomes possible to change the intensity of pressure presentation according to the distance.

[0160] Fig.171 is a diagram for explaining a case where a perception effect is set using only the tactile indicator 60 without using the tactile presentation device 10. Fig.17 As shown, a trajectory can be drawn while keeping the front end of the tactile indicator 60 in direct contact with the body (an example of a real object), and a moving path of a sensed position on the body can be set. The tactile indicator 60 can obtain three-dimensional coordinate information of its front end. At this time, tactile presentation, such as vibration or temperature change, can also be performed at the front end of the tactile indicator 60.

[0161] In the case of actually reproducing the moving path of the set perception position in the tactile presentation device 10, the tactile indicator 60 or the information processing device 20 considers the three-dimensional position information representing the trajectory recorded on the body, or considers the position information of each tactile stimulation unit 100 set in the tactile presentation device 10 placed on the body; and determines the output level from the surrounding tactile stimulation units 100 (i.e., determines the strength of the tactile control signal).

[0162] Fig.18 This is a diagram for explaining the setting of the perception effect using a doll. Fig.18 As shown, for example, when the user wears the tactile presentation device 10, the user uses the tactile indicator 60 to draw a track on the doll 70 (an example of a real object), and feedback about the tactile stimulation corresponding to the track can be received in the tactile presentation device 10 (in real time). At this time, a laser pointer can be used in the tactile indicator 60 to emit light and make the sensed position visible. The tactile indicator 60 obtains the three-dimensional position of the doll using a distance sensor, detects its own movement using a posture sensor, and thus detects the track drawn on the body of the doll. Alternatively, the tactile indicator 60 can use a camera to obtain the irradiation position of the laser pointer on the doll, and thus can detect the track drawn on the body of the doll.

[0163] Alternatively, the user draws a trajectory by moving the tactile indicator 60 while pressing a record button of the tactile indicator 60. When the user releases the record button, the tactile indicator 60 stores data equivalent to a plurality of channels (i.e., stores an output control signal for each tactile stimulation unit 100 generated according to the drawn trajectory).

[0164] Fig.19 is a diagram used to illustrate various ways of using dolls to set perceptual effects. Fig.19As shown in the upper part of FIG, when the doll 70 is illuminated by the laser pointer of the tactile indicator 60 and the position is checked, the user can regard the doll 70 as a person wearing the tactile presentation device 10 and can input a moving path of the perceived position. Herein, there is no particular limitation on the size of the doll 70. When the size of the doll 70 is different from the size of the tactile presentation device 10 (or the size of the person wearing the tactile presentation device 10), the tactile indicator 60 performs proportion matching according to the size of the doll and the size of the tactile presentation device 10 (or the size of the human body).

[0165] like Fig.19 As shown in the middle part of , the intensity of the tactile presentation can be represented by the intensity of the illumination of the laser pointer. The user can operate the button of the tactile indicator 60 and adjust the intensity of the tactile presentation. In this article, there is visual feedback to the user's adjustment. Therefore, for example, when the tactile presentation is weak, the user can illuminate the indicator 606a with a light color; and when the tactile presentation is strong, the user can illuminate the indicator 606b with a dark color.

[0166] like Fig.19 As shown in the lower part of , the range of tactile presentation can also be represented according to the size of the irradiation of the laser pointer. The user can operate the button of the tactile pointer 60 and adjust the range of tactile presentation. In this article, there is visual feedback to the user's adjustment. Therefore, for example, when the range of tactile presentation is narrow, a small indicator 607a is used for irradiation; and when the range of tactile presentation is wide, a large indicator 607b is used for irradiation.

[0167] <<5. Conclusion>>

[0168] As described above, in the information processing system according to the embodiment of the present application, an intuitive operation related to the setting of the perception position of tactile stimulation can be performed.

[0169] Although the present application is described in detail in the form of embodiments with reference to the accompanying drawings, the technical scope of the present application is not limited to the embodiments described above. That is, the present application is to be interpreted as including all modifications that may be thought of by those skilled in the art and fall completely within the basic teachings set forth herein, such as other embodiments, additions, alternative configurations, and deletions.

[0170] For example, in hardware such as CPU, ROM, and RAM of the tactile presentation device 10, the information processing device 20, or the tactile indicator 60, a computer program for realizing the functions of the tactile presentation device 10, the information processing device 20, or the tactile indicator 60 may be created. In addition, a computer-readable storage medium having the computer program stored therein may also be provided.

[0171] The effects described in this written description are only illustrative and exemplary and are not limiting in scope. That is, in addition to or in place of the effects described above, the technology disclosed in this application enables other effects that may be conceived by those skilled in the art to be obtained.

[0172] Among them, the configuration as described below also falls within the technical scope of the present application.

[0173] (1) An information processing device comprising:

[0174] a display control unit that displays information related to the tactile presentation device and displays a sensed position in the tactile presentation device specified by a user; and

[0175] A generating unit generates an output control signal to be output to the plurality of tactile stimulation units according to the sensing position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that tactile stimulation is sensed at the sensing position.

[0176] (2) The information processing device according to (1), wherein the information related to the tactile presentation device represents information indicating positions of the plurality of tactile stimulation units in the tactile presentation device.

[0177] (3) The information processing device according to (1), wherein the information related to the tactile sense presentation device represents information indicating an external shape of the tactile sense presentation device.

[0178] (4) The information processing device according to any one of (1) to (3), wherein the generation unit generates the output control signal according to the perception position and the perception intensity specified by the user.

[0179] (5) The information processing device according to any one of (1) to (4), wherein the generation unit generates the output control signal so that a tactile stimulation of a type selected by the user is perceived at the perception position.

[0180] (6) The information processing device according to (5), wherein the display control unit displays a selection screen of a plurality of types of tactile stimulation.

[0181] (7) The information processing device according to (5), wherein the display control unit displays a recommendation screen for recommending an appropriate type of tactile stimulation according to the perception position specified by the user.

[0182] (8) The information processing device according to any one of (1) to (7), wherein the display control unit performs a display indicating a movement path of the perceived position.

[0183] (9) The information processing device according to (8), wherein the display control unit displays a video indicating movement of the perceived position and displays a seek bar of the video.

[0184] (10) The information processing device according to (9), wherein the display control unit further displays video content reproduced when the tactile stimulation is presented at the perception position.

[0185] (11) The information processing device according to (9) or (10), wherein the information processing device performs control to output the generated output control signal to the tactile presentation device according to reproduction of a video indicating movement of the perceived position.

[0186] (12) The information processing device according to any one of (1) to (11), wherein the display control unit displays a recommendation screen in which the positions of the plurality of tactile stimulation units are optimized according to the perception position specified by the user.

[0187] (13) The information processing device according to any one of claims (1) to 12 (middle), wherein the display control unit displays a recommendation screen in which the perception position is optimized according to the perception position specified by the user and according to the positions of the plurality of tactile stimulation units.

[0188] (14) The information processing device according to any one of (1) to (13), wherein the perceived position and the moving path of the perceived position are input using a controller that obtains a three-dimensional position on a real object.

[0189] (15) An information processing method implemented in a processor, comprising:

[0190] show

[0191] information related to the tactile presentation device, and

[0192] a perceived location in the tactile presentation device specified by a user; and

[0193] An output control signal to be output to the plurality of tactile stimulation units is generated according to the perception position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that tactile stimulation is perceived at the perception position.

[0194] (16) A program for causing a computer to:

[0195] a display control unit that displays information related to the tactile presentation device and displays a sensed position in the tactile presentation device specified by a user; and

[0196] A generating unit generates an output control signal to be output to the plurality of tactile stimulation units according to the sensing position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that tactile stimulation is sensed at the sensing position.

[0197] Reference numerals list

[0198] 10. Tactile presentation device

[0199] 100 Tactile stimulation units

[0200] 102 Sound output unit

[0201] 110 Control unit

[0202] 120 Communication Unit

[0203] 20 Information processing device

[0204] 200 Control Unit

[0205] 201 Perception position / intensity determination unit

[0206] 202 Screen generation unit

[0207] 203 Output control unit

[0208] 210 Communication Unit

[0209] 220 Operation input unit

[0210] 230 Display unit

[0211] 240 storage units

[0212] 60 Tactile indicators

[0213] 600 Control Unit

[0214] 610 Communication Unit

[0215] 620 Operation input unit

[0216] 630 Sensor

[0217] 640 Display Unit

[0218] 650 Tactile Presentation Unit

[0219] 660 storage units

Claims

1. An information processing device, comprising: a display control unit that displays information related to a tactile presentation device and displays a sensed position in the tactile presentation device specified by a user; as well as a generating unit, wherein the generating unit generates an output control signal to be output to the plurality of tactile stimulation units according to the sensing position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that the tactile stimulation is sensed at the sensing position, wherein the information related to the tactile presentation device shows an image indicating an external shape of the tactile presentation device, wherein the generating unit generates the output control signal so that a tactile stimulus of a type selected by the user is perceived at the perception position, and The display control unit displays a recommendation screen for recommending an appropriate type of tactile stimulation according to the perception position specified by the user.

2. The information processing device according to claim 1, wherein: The information related to the tactile presentation device further shows an image indicating positions of the plurality of tactile stimulation units in the tactile presentation device.

3. The information processing device according to claim 1, wherein: The generation unit generates the output control signal according to the perception position and the perception intensity specified by the user.

4. The information processing device according to claim 1, wherein: The display control unit displays a selection screen of a plurality of types of tactile stimulations.

5. The information processing device according to claim 1, wherein: The display control unit performs display indicating a moving path of the sensed position.

6. The information processing device according to claim 5, wherein: The display control unit displays a video indicating movement of the perceived position and displays a seek bar of the video.

7. The information processing device according to claim 6, wherein: The display control unit also displays video content reproduced when the tactile stimulation is presented at the perception position.

8. The information processing device according to claim 6, wherein: The information processing device performs control to output the generated output control signal to the tactile presentation device according to reproduction of a video indicating movement of the perceived position.

9. The information processing device according to claim 1, wherein: The display control unit displays a recommendation screen in which the positions of the plurality of tactile stimulation units are optimized according to the perception position designated by the user.

10. The information processing device according to claim 1, wherein: The display control unit displays a recommendation screen in which the perception position is optimized according to the perception position designated by the user and according to the positions of the plurality of tactile stimulation units.

11. The information processing device according to claim 1, wherein: The perceived position and the moving path of the perceived position are input using a controller that obtains a three-dimensional position on a real object.

12. An information processing method implemented in a processor, comprising: show: information related to the tactile presentation device, and a sensing location in the tactile presentation device specified by a user; as well as generating an output control signal to be output to the plurality of tactile stimulation units according to the perception position and according to the positions of the plurality of tactile stimulation units provided in the tactile presentation device, so that a tactile stimulation of a type selected by the user is perceived at the perception position, wherein the information related to the tactile presentation device shows an image indicating an external shape of the tactile presentation device, and The information processing method further includes: displaying a recommendation screen for recommending a suitable type of tactile stimulation according to the perception position specified by the user.

13. A computer program product causing a computer to: a display control unit that displays information related to a tactile presentation device and displays a sensed position in the tactile presentation device specified by a user; and a generating unit, wherein the generating unit generates an output control signal to be output to the plurality of tactile stimulation units according to the sensing position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that the tactile stimulation is sensed at the sensing position, in, the information related to the tactile presentation device shows an image indicating an external shape of the tactile presentation device, wherein the generating unit generates the output control signal so that a tactile stimulus of a type selected by the user is perceived at the perception position, and The display control unit displays a recommendation screen for recommending an appropriate type of tactile stimulation according to the perception position specified by the user.

14. A computer-readable storage medium storing a program, the program causing a computer to function as: a display control unit that displays information related to a tactile presentation device and displays a sensed position in the tactile presentation device specified by a user; and a generating unit, wherein the generating unit generates an output control signal to be output to the plurality of tactile stimulation units according to the sensing position and according to the positions of the plurality of tactile stimulation units arranged in the tactile presentation device, so that the tactile stimulation is sensed at the sensing position, in, the information related to the tactile presentation device shows an image indicating an external shape of the tactile presentation device, wherein the generating unit generates the output control signal so that a tactile stimulus of a type selected by the user is perceived at the perception position, and The display control unit displays a recommendation screen for recommending an appropriate type of tactile stimulation according to the perception position specified by the user.

Images