Information processing device, information processing method and storage medium

Abstract

An information processing device is provided, which includes a perception control unit that uses an auditory or visual effect to make a user perceive a propagation direction of a tactile stimulus relative to the user based on the user's position and a desired tactile stimulus presentation position.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing method, and a storage medium. Background Art

[0002] In recent years, various technologies utilizing tactile stimulation such as vibration have been developed. For example, Patent Document 1 listed below discloses a speaker device that includes an actuator serving as a vibration source and transmits vibration generated in the actuator to a diaphragm, thereby outputting sound.

[0003] Reference List

[0004] Patent Literature

[0005] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2012-105021 Summary of the invention

[0006] Problems to be solved by the present invention

[0007] The technology disclosed in Patent Document 1 and the like enables vibration, which is a type of tactile stimulation, to be used as sound output, but does not enable the user to correctly perceive the propagation direction of the tactile stimulation.

[0008] Therefore, the present disclosure has been made in view of the above circumstances, and the present disclosure provides a novel and improved information processing device, information processing method, and storage medium that enable a user to more appropriately perceive the propagation direction of tactile stimulation relative to the user.

[0009] Means of solving the problem

[0010] According to the present disclosure, an information processing device is provided, comprising a perception control unit, which enables the user to perceive the propagation direction of the tactile stimulus relative to the user through auditory effects or visual effects based on the user's position and the desired tactile stimulus presentation position.

[0011] In addition, according to the present disclosure, there is provided an information processing method executed by a computer, the method comprising enabling the user to perceive the propagation direction of the tactile stimulus relative to the user through auditory or visual effects based on the user's position and the desired tactile stimulus presentation position.

[0012] In addition, according to the present disclosure, a storage medium storing a program is provided, wherein the program enables a computer to present tactile stimulation based on the user's position and the desired position, so that the user can perceive the propagation direction of the tactile stimulation relative to the user through auditory or visual effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] [ Figure 1 ] Figure 1 A specific example of the tactile sense presentation device according to the present embodiment is shown.

[0014] [ Figure 2 ] Figure 2 A specific example of the arrangement of the tactile sense presentation device according to the present embodiment is shown.

[0015] [ Figure 3 ] Figure 3 A specific example of content provided by using the tactile presentation device according to the present embodiment is shown.

[0016] [ Figure 4 ] Figure 4 This is an explanatory diagram of the tactile presentation device according to the present embodiment controlling the presentation of tactile stimulation according to the stepping manner of the user.

[0017] [ Figure 5 ] Figure 5 is a block diagram showing a configuration example of an information processing system according to the present embodiment.

[0018] [ Figure 6 ] Figure 6 is a block diagram showing a configuration example of an information processing system according to the present embodiment.

[0019] [ Figure 7 ] Figure 7 This is an explanatory diagram of an overview of the functions of the information processing system according to the present embodiment.

[0020] [ Figure 8 ] Figure 8 This is an explanatory diagram of an overview of the functions of the information processing system according to the present embodiment.

[0021] [ Fig. 9 ] Fig. 9 This is an explanatory diagram of an overview of the functions of the information processing system according to the present embodiment.

[0022] [ Fig.10 ] Fig.10 This is an explanatory diagram of an overview of the functions of the information processing system according to the present embodiment.

[0023] [ Fig.11 ] Fig.11 is a block diagram showing a configuration example of a host device according to the present embodiment.

[0024] [ Fig.12 ] Fig.12 : is a block diagram showing a configuration example of a tactile presentation device according to the present embodiment.

[0025] [ Fig.13 ] Fig.13: is a flowchart showing an example of the processing flow of each device according to the present embodiment when presenting tactile stimulation and auditory or visual effects.

[0026] [ Fig.14 ] Fig.14 is an explanatory diagram of an overview of the functions of the information processing system according to the first modification example.

[0027] [ Fig.15 ] Fig.15 is an explanatory diagram of an overview of the functions of the information processing system according to the first modification example.

[0028] [ Fig.16 ] Fig.16 is a flowchart showing an example of a processing flow of each device according to the first modification example when presenting tactile stimulation.

[0029] [ Fig.17 ] Fig.17 is an explanatory diagram of an overview of the functions of the information processing system according to the second modification example.

[0030] [ Fig.18 ] Fig.18 is an explanatory diagram of an overview of the functions of the information processing system according to the second modification example.

[0031] [ Fig.19 ] Fig.19 is an explanatory diagram of an overview of the functions of the information processing system according to the third modification example.

[0032] [ Fig. 20 ] Fig. 20 is an explanatory diagram of an information processing system according to a fourth modification example.

[0033] [ Fig.21 ] Fig.21 is an explanatory diagram of an overview of the functions of the information processing system according to the fourth modification example.

[0034] [ Fig. 22 ] Fig. 22 : is a block diagram showing a hardware configuration example of a tactile presentation device or a host device according to the present embodiment. DETAILED DESCRIPTION

[0035] Hereinafter, preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings. Note that in the present specification and the accompanying drawings, repeated descriptions of components having substantially the same functional configuration are omitted by assigning the same reference numerals.

[0036] Note that the description is given in the following order.

[0037] 1. Overview

[0038] 2. Configuration examples for each device

[0039] 3. Example of processing flow for each device

[0040] 4. Modify the example

[0041] 5. Hardware Configuration Example

[0042] 6. Conclusion

[0043] <1. Overview>

[0044] First, an overview of an embodiment according to the present disclosure is described.

[0045] (1.1. Overview of tactile presentation device)

[0046] Figure 1 1 shows a specific example of the tactile presentation device 100 according to the present embodiment. The tactile presentation device 100 includes a plurality of tactile presentation units 140 (in Figure 1 Controlling these tactile presentation units 140 enables presentation of tactile stimulation to any target. It should be noted that the number or arrangement of the tactile presentation units 140 included in the tactile presentation device 100 is not particularly limited.

[0047] As used herein, the "tactile stimulation" presented by the tactile presentation unit 140 includes, for example, vibration, but is not necessarily limited thereto, and may include, for example, stimulation related to temperature, stimulation related to force sensation, electrical stimulation, etc. (i.e., multiple types of tactile stimulation may be presented). Below, the case where the tactile stimulation is vibration is mainly described. More specifically, as Figure 1 As shown, the tactile presentation unit 140 is provided with an actuator 10 near its surface (in Figure 1 The vibration actuator 10 enables the presentation of vibration to any target. It should be noted that the number or arrangement of the actuators 10 included in the tactile presentation unit 140 is not particularly limited. In addition, in the case where the tactile stimulus to be presented is not vibration, the tactile presentation unit 140 is provided with a desired configuration depending on the type of tactile stimulus to be presented.

[0048] In this embodiment, if Figure 2 As shown, a plurality of tactile presentation devices 100 (in Figure 2 In the example of FIG. 1 , the tactile presentation devices 100a to 100i are arranged on the ground in a state of being closely adjacent to each other. This enables the information processing system according to this embodiment to present vibration to any target (e.g., user) on these tactile presentation devices 100. For example, Figure 3As shown, it is assumed that an image of a "pond" is displayed on a plurality of tactile presentation devices 100 (the tactile presentation device 100 may display the image by itself, or an external projector may project the image onto the tactile presentation device 100), and user u1 and user u2 are on these tactile presentation devices 100. Then, in the case where user u1 walks in the area where the image of the pond is displayed, the tactile presentation device 100 located at the foot of user u1 (the tactile presentation device 100 in contact with user u1) presents vibration to user u1, so that user u1 has the perception of walking in the pond (active presentation of tactile stimulation). At the same time, the tactile presentation device 100 located at the foot of user u2 (the tactile presentation device 100 in contact with user u2) presents vibration to user u2, so that user u2 perceives the impact of the collision of waves generated and propagated due to user u1 walking in the pond (passive presentation of tactile stimulation).

[0049] In addition, the tactile presentation unit 140 may include not only the actuator 10 but also a pressure-sensitive sensor. This enables the tactile presentation device 100 to output not only whether the presentation target of the tactile stimulation is stepped on the tactile presentation device 100, but also the stepping force, the range and area of ​​the applied force, etc., so that the type and intensity of the vibration to be presented can be controlled according to the results of these outputs. For example, Figure 4 As shown in FIG. 14, when the user walks at the position from the tactile presentation unit 140A to the tactile presentation unit 140C, it is assumed that the user walks with the heel ( Figure 4 A), the back of the sole ( Figure 4 B) the front of the sole ( Figure 4 C) and toes ( Figure 4 In this case, the force (stepping force) applied to the tactile presentation unit 140, the range and area of ​​the applied force, etc. are Figure 4 Therefore, the tactile presentation device 100 uses each of the tactile presentation units 140 (in Figure 4 In the case of the tactile presentation unit 140a to the tactile presentation unit 140c), the type and intensity of the vibration to be presented can be controlled, so that various presentations of tactile senses can be achieved. For example, the tactile presentation device 100 enables the user to have the feeling of walking on sand or snow.

[0050] It should be noted that the above describes the effect of placing multiple tactile presentation devices 100 on the ground in a state of close proximity to each other. However, it should be noted that the phrase "in a state of close proximity to each other" means being positioned very close to each other, but does not necessarily mean contacting each other. In addition, multiple tactile presentation devices 100 may not necessarily be arranged on the ground, but may be arranged in, for example, clothing worn by the user (of course, there is no restriction on clothing). In addition, the presentation target of the tactile stimulation is not particularly limited, and may be, for example, a user (person), an animal, or various objects (e.g., a robot, a vehicle, etc.). Below, a case where the user is the presentation target of the tactile stimulation is described by way of example.

[0051] (1.2. Configuration example of information processing system)

[0052] Figure 5 FIG. 2 shows a configuration example of an information processing system according to the present embodiment. Figure 5 As shown, the information processing system according to the present embodiment includes the above-mentioned multiple tactile presentation devices 100 , a host device 200 , and a content control device 300 .

[0053] The content control device 300 is a device that controls all contents provided by the information processing system according to the present embodiment. More specifically, the content control device 300 determines the type, substance, etc. of the content to be provided to the user, and progresses the content. It is to be noted that "content" includes, but is not necessarily limited to, for example, experience-based attractions, games, concerts, dramas, etc. Figure 5 As shown, the content control device 300 is coupled to communicate with the host device 200, and when determining the type, substance, etc. of content and progressing the content, transmits information on the progress status of the content to the host device 200.

[0054] The host device 200 is a device (information processing device) that controls the tactile presentation device 100 to provide tactile stimulation as the content progresses. More specifically, the host device 200 receives information about the progress status of the content from the content control device 300, and based on the information, generates tactile presentation information for providing tactile stimulation by the tactile presentation device 100. Figure 5 As shown, the host device 200 is coupled to communicate with at least one of the plurality of tactile presentation devices 100, and sends the generated tactile presentation information to the tactile presentation device 100. The host device 200 continues to generate and send the tactile presentation information to the tactile presentation device 100 until the content ends.

[0055] The tactile presentation device 100 is a device (information processing device) that presents tactile stimulation to any target. More specifically, a plurality of tactile presentation devices 100 are arranged on the ground in close proximity to each other as described above, and based on the tactile presentation information sent from the host device 200, vibration is presented to any target thereon (e.g., a user, etc.).

[0056] Here, the multiple tactile presentation devices 100 include a first tactile presentation device and a second tactile presentation device. When the first tactile presentation device receives tactile presentation information from the host device 200, it sends the tactile presentation information to the peripheral tactile presentation device 100. When the second tactile presentation device receives tactile presentation information from the peripheral tactile presentation device 100, it presents tactile stimulation based on the tactile presentation information.

[0057] The first tactile presentation device is a tactile presentation device 100 (in Figure 5 In the example of the present invention, the first tactile presentation device 100a is used as the tactile presentation device 100a), and the information (e.g., tactile presentation information) received from the host device 200 is sent to other tactile presentation devices 100, thereby spreading the information among the plurality of tactile presentation devices 100. That is, when the information sent from the host device 200 is spread among the plurality of tactile presentation devices 100, the first tactile presentation device is used as the starting point. In addition, the first tactile presentation device sends the information received from another tactile presentation device 100 to the host device 200.

[0058] The second tactile presentation device is a tactile presentation device 100 that presents tactile stimulation to any target based on tactile presentation information diffused among the plurality of tactile presentation devices 100. More specifically, a plurality of second tactile presentation devices exist in the system, and present tactile stimulation in combination with each other based on the tactile presentation information, thereby presenting tactile stimulation to be propagated to the presentation target of the tactile stimulation. It should be noted that each tactile presentation device 100 can be used as either the first tactile presentation device or the second tactile presentation device, or can be used as both the first tactile presentation device and the second tactile presentation device. Figure 5 In the example of FIG. 5 , all the tactile presentation devices 100 (the tactile presentation devices 100 a to 100 f ) may be used as the second tactile presentation devices.

[0059] In this way, based on the tactile presentation information diffused from the first tactile presentation device as a starting point, the second tactile presentation device presents tactile stimulation, thereby reducing the processing load of the host device 200. For example, the host device 200 does not need to separately generate tactile presentation information and send it to the tactile presentation device 100 (second tactile presentation device) that presents tactile stimulation.

[0060] It should be noted that Figure 5The illustrated configuration is merely an example, and the configuration example of the information processing system according to the present embodiment is not necessarily limited to Figure 5 For example, the host device 200 and the content control device 300 may be implemented by a single device. Figure 6 As shown, the host device 200 can be coupled to communicate with a plurality of tactile presentation devices 100 (tactile presentation device 100a to tactile presentation device 100f). Figure 6 In the case of, all the tactile presentation devices 100 (the tactile presentation devices 100a to 100f) coupled to communicate with the host device 200 can be used as the first tactile presentation device. In this way, all of the multiple tactile presentation devices 100 can be used as the first tactile presentation device, so that the host device 200 can select the optimal tactile presentation device 100 as the first tactile presentation device.

[0061] (1.3. Functional Overview)

[0062] Subsequently, an overview of the functions of the information processing system according to the present embodiment is described.

[0063] First, consider an existing information processing system including a tactile presentation unit 20 that enables presentation of tactile stimulation similar to the tactile presentation unit 140 according to the present embodiment. In some cases, the existing information processing system may not enable the user to correctly perceive the propagation direction of the tactile stimulation relative to the user.

[0064] For example, Figure 7 As shown, consider the case where the vibration presented to the desired vibration source (tactile stimulation presentation position) propagates toward the user u1 while attenuating (at Figure 7 In the example of , the vibration presented by the tactile presentation unit 201 is propagated to the tactile presentation unit 20k, the tactile presentation unit 20j, ..., and the tactile presentation unit 20a). The tactile presentation unit 20 basically presents the vibration using data in a frequency band (low-frequency band) that is unlikely to be perceived by the auditory sense, so although the user u can perceive the vibration, the user u1 cannot perceive the direction in which the presented vibration propagates. Therefore, in some cases, the existing information processing system may not be able to provide highly complex content.

[0065] In view of the above, the present inventor has created a technology according to the present disclosure. The information processing device according to the present embodiment enables the user to perceive the propagation direction of tactile stimulation relative to the user through auditory or visual effects based on the user's position and the desired tactile stimulation presentation position.

[0066] For example, consider a case where the tactile presentation unit 140 according to the present embodiment includes an actuator 10 (hereinafter, referred to as a "broadband actuator") capable of outputting data of frequency components not only within a human inaudible range but also within a human audible range. In this case, Figure 8 As shown, the information processing device according to this embodiment can specify the tactile presentation unit 140 (in Figure 8 In the example of the tactile presentation unit 140a and the tactile presentation unit 140b), the tactile presentation unit 140 vibrates, and the other tactile presentation units 140 (in Figure 8 In the example of the present invention, the tactile presentation units 140c to 1401 use the sound information to present the sound. In other words, the information processing device according to the present embodiment causes the tactile presentation units 140 that are not used to present the vibration among the plurality of tactile presentation units 140 to output the data of the frequency components within the audible range of the human, thereby generating an auditory effect.

[0067] This enables the user u1 to perceive, with the aid of the sound to be presented, that the vibration presented to the desired vibration source (tactile stimulation presentation position) propagates toward the user u1 while attenuating. Figure 8 In the example of the tactile presentation unit 140c to the tactile presentation unit 140l), it is difficult for the user u1 to perceive the tactile stimulation. However, such a tactile presentation unit 140 is used to present the sound, so that each tactile presentation unit in the tactile presentation unit 140 can be effectively utilized. It should be noted that in the case where the tactile presentation device 100 or other external device includes an acoustic output device such as a speaker, the information processing device according to the present embodiment can use such an acoustic output device to present the sound.

[0068] It should be noted that, as used herein, “tactile stimulation presentation position” refers to a position where a tactile stimulation is actually presented or a position where a tactile stimulation is virtually presented. More specifically, the tactile stimulation presentation position may be a position where the tactile presentation unit 140 actually presents the tactile stimulation, or may be a position where the tactile presentation unit 140 (in the absence of the tactile presentation unit 140) presents the tactile stimulation. Figure 8 In the case of the tactile presentation unit 1401), the position of the tactile stimulation is virtually presented, such as Figure 8 The tactile stimulus presentation locations are shown in .

[0069] In addition, in the case where the tactile presentation device 100 is provided with a configuration such as a display or a lamp, or in the case where a projection device capable of projecting an image onto the tactile presentation device 100 is provided in an external device, the information processing device according to the present embodiment can control these configurations so that the user u1 can perceive the propagation direction of the vibration through a visual effect. More specifically, the information processing device according to the present embodiment can use control information for displaying an image or lighting a lamp, etc., to produce a visual effect in the configuration of the display, the lamp, etc.

[0070] In addition, the tactile presentation device 100 for generating an auditory or visual effect may be, for example, a tactile presentation device 100 located within the range of propagation of the tactile stimulus, but is not necessarily limited thereto (a tactile presentation device 100 located outside the range of propagation of the tactile stimulus may be used). In addition, in the above description, control related to the presentation of vibration or sound is performed in the unit of the tactile presentation unit 140; however, control may be performed in the unit of the actuator 10 provided in the tactile presentation unit 140.

[0071] In addition, the information processing device according to the present embodiment can enable the user to perceive not only the propagation direction of the tactile stimulus relative to the user, but also the separation distance between the user's position and the desired tactile stimulus presentation position through auditory or visual effects based on the user's position and the desired tactile stimulus presentation position. For example, the information processing device according to the present embodiment can use audio-visual information as sound information to locate the sound image to the tactile stimulus presentation position, so that the user can also perceive the separation distance between the user's position and the desired tactile stimulus presentation position. It should be noted that the method for enabling the user to perceive the separation distance between the user's position and the desired tactile stimulus presentation position is not limited to this. For example, the information processing device according to the present embodiment can adjust the volume of the sound generated by each tactile presentation unit 140, so that the user can perceive the separation distance between the user's position and the desired tactile stimulus presentation position.

[0072] like Fig. 9 As shown, the propagation direction of the tactile stimulus perceived by user u1 relative to user u1 (in Fig. 9 ) and the separation distance between the position of user u1 and the desired tactile stimulus presentation position (in Fig. 9 described as the “separation distance” in ), thereby enabling perception of the location of where the tactile stimulus is presented.

[0073] like Fig.10 As shown, when the tactile stimulation presentation position moves, this enables the user u1 to also perceive the moving direction, moving speed, etc. of the tactile stimulation presentation position based on the changes in the propagation direction of the tactile stimulation and the changes in the separation distance.

[0074] It should be noted that the device that implements the above-mentioned "information processing device according to the present embodiment" is not particularly limited. Figure 5 and Figure 6 The tactile presentation device 100 or the host device 200 described above can realize the information processing device according to the present embodiment. Hereinafter, a case where the tactile presentation device 100 realizes the information processing device according to the present embodiment will be described by way of example.

[0075] <2. Configuration example of each device>

[0076] The overview of the present embodiment has been described above. Subsequently, a configuration example of each device according to the present embodiment is described.

[0077] (2.1. Configuration Example of Host Device 200)

[0078] First, refer to Fig.11 A configuration example of the host device 200 is described. Fig.11 2 is a block diagram showing a configuration example of the host device 200. Fig.11 As shown, the host device 200 includes: a control unit 210, a communication unit 220, and a storage unit 230. In addition, the control unit 210 includes a tactile control unit 211 and a perception control unit 212.

[0079] The control unit 210 is configured to collectively control all processes to be performed by the host device 200. For example, the control unit 210 is capable of controlling activation and stop of each configuration. It should be noted that the essence of the control of the control unit 210 is not particularly limited. For example, the control unit 210 can control processes (e.g., processes related to an OS (operating system)) that are generally performed in various servers, general-purpose computers, PCs (personal computers), tablet PCs, etc.

[0080] The tactile control section 211 is configured to generate tactile presentation information for presenting a tactile stimulus of the tactile presentation device 100 present at the tactile stimulus presentation position. Thereafter, in the case where another tactile presentation device 100 presents a tactile stimulus to be propagated, another tactile presentation information generated based on the tactile presentation information generated by the tactile control section 211 (or, the tactile presentation information generated by changing the tactile presentation information generated by the tactile control section 211) is used. The processing related to the propagation of the tactile stimulus is described in detail in a later section. The tactile control section 211 controls the communication unit 220 so that the tactile presentation information is sent to the first tactile presentation device.

[0081] The perception control unit 212 is configured to control processing related to various outputs (outputs other than tactile stimulation) of the plurality of tactile presentation devices 100. In addition to tactile stimulation, the tactile presentation device 100 can also perform, for example, image display, sound output, etc. (not limited thereto). Therefore, the perception control unit 212 generates control information for various outputs of the tactile presentation device 100 (for example, control information for displaying an image, control information for lighting a lamp, or sound information for outputting a sound, etc.) based on information about the progress status of the content provided from the content control device 300, and controls the communication unit 220 so as to transmit the control information to the first tactile presentation device.

[0082] The communication unit 220 is configured to communicate with the content control device 300 and the first tactile presentation device. For example, the communication unit 220 communicates with these devices wirelessly directly or via a network access point in a system such as a wired LAN (Local Area Network), a wireless LAN, Wi-Fi (Wireless Fidelity, a registered trademark), infrared communication, Bluetooth (registered trademark), or near field / contactless communication.

[0083] The storage unit 230 is configured to store various types of information. For example, the storage unit 230 stores programs, parameters, etc. to be used by the control unit 210 or the communication unit 220. In addition, the storage unit 230 can store processing results of the control unit 210, information received from an external device by the communication unit 220, etc. It should be noted that the essence of the information stored by the storage unit 230 is not limited thereto.

[0084] The configuration example of the host device 200 has been described above. Fig.11 The described configuration is merely an example, and the configuration of the host device 200 is not limited to such an example. For example, the host device 200 may not include Fig.11 Some configurations shown in or may include Fig.11 In addition, a configuration not shown in the figure may be provided in an external device (not shown). Fig.11 The configuration shown in , and the host device 200 can implement each of the above functions by linking to communicate with the external device.

[0085] (2.2. Configuration Example of Tactile Presentation Device 100)

[0086] Then, refer to Fig.12 A configuration example of the tactile presentation device 100 is described. Fig.12 1 is a block diagram showing a configuration example of the tactile presentation device 100. Fig.12As shown, the tactile presentation device 100 includes: a control unit 110, a communication unit 120, a sensor unit 130, a tactile presentation unit 140, an output unit 150, and a storage unit 160. In addition, the control unit 110 includes a tactile control unit 111 and a perception control unit 112. It should be noted that when used as the first tactile presentation device or when used as the second tactile presentation device, the tactile presentation device 100 can have a similar configuration ( Fig.12 It should be noted that, unless explicitly stated otherwise, the subject matter described hereinafter applies to both the first tactile presentation device and the second tactile presentation device.

[0087] The control unit 110 is configured to collectively control all processes to be performed by the tactile presentation device 100. For example, the control unit 110 is capable of controlling activation and deactivation of each configuration. It should be noted that the essence of the control of the control unit 110 is not particularly limited. For example, the control unit 110 may control processes (e.g., OS-related processes) that are typically performed in various servers, general-purpose computers, PCs, tablet PCs, and the like.

[0088] The tactile control unit 111 is configured to present tactile stimulation to any target based on the tactile presentation information. More specifically, when the tactile presentation information generated by the host device 200 is provided to the first tactile presentation device, the tactile control unit 111 of the first tactile presentation device determines whether it is necessary to present the tactile stimulation by its own device (in other words, determine whether the own device is the tactile presentation device 100 present at the tactile stimulation presentation position) based on the information included in the tactile presentation information (for example, identification information about the tactile presentation device 100, etc.). Then, when it is determined that the tactile stimulation needs to be presented by the own device, the tactile control unit 111 controls the tactile presentation unit 140 based on the tactile presentation information, thereby presenting the tactile stimulation.

[0089] In the case where it is determined that the tactile stimulation does not need to be presented by the own device, the tactile control unit 111 of the first tactile presentation device sends the tactile presentation information to another peripheral tactile presentation device 100 without presenting the tactile stimulation. In this way, the tactile presentation information is linked via one or more tactile presentation devices 100 to communicate with the tactile presentation device 100 present at the tactile stimulation presentation position, and the tactile control unit 111 of the tactile presentation device 100 present at the tactile stimulation presentation position controls the tactile presentation unit 140 based on the tactile presentation information, thereby presenting the tactile stimulation.

[0090] Thereafter, the tactile stimulation is propagated. To describe the propagation manner of the tactile stimulation, in the case of receiving tactile presentation information from a peripheral tactile presentation device 100, the tactile control unit 111 of the tactile presentation device 100 (the second tactile presentation device) that presents the tactile stimulation presents the tactile stimulation based on the tactile presentation information, and also generates tactile presentation information reflecting the change of the tactile stimulation caused by the propagation (for example, the attenuation of the vibration), and provides the generated tactile presentation information to another peripheral tactile presentation device 100 (a tactile presentation device 100 other than the tactile presentation device 100 that has sent the tactile presentation information). This enables the tactile stimulation to be propagated between the tactile presentation devices 100.

[0091] It should be noted that, as referenced Figure 8 As described, the tactile control unit 111 causes the tactile presentation unit 140 that the user is riding (touching) to present tactile stimulation. More specifically, the tactile control unit 111 specifies the tactile presentation unit 140 that the user is riding through sensor information of the pressure-sensitive sensor included in the sensor unit 130, etc., and causes the tactile presentation unit 140 to present vibrations, without causing other tactile presentation units 140 to present tactile stimulation. It is difficult for the user to perceive tactile stimulation for tactile presentation units 140 other than the tactile presentation unit 140 that the user is riding; however, the tactile control unit 111 causes these tactile presentation units 140 not to present tactile stimulation, thereby making it possible to reduce waste of processing.

[0092] The perception control unit 112 is configured to enable the user to perceive the propagation direction of the tactile stimulus relative to the user through auditory or visual effects based on the user's position and the desired tactile stimulus presentation position. For more specific description, it is assumed that the tactile presentation device 100 specifies the user's position through sensor information of the pressure-sensitive sensor included in each sensor unit 130, and the user's position is shared between the tactile presentation devices 100. In addition, it is assumed that the tactile presentation information to be diffused to each tactile presentation device 100 stores information about the tactile stimulus presentation position. Then, based on the user's position and the desired tactile stimulus presentation position, the perception control unit 112 causes the tactile presentation unit 140 (the tactile presentation unit 140 other than the tactile presentation unit 140 on which the user is riding) to output sound, and causes the output unit 150 to output an image. It should be noted that the substance of the sound and image to be output is determined based on the control information provided from the host device 200, etc.

[0093] In addition, the perception control unit 112 can enable the user to perceive not only the propagation direction of the tactile stimulus relative to the user, but also the separation distance between the user's position and the desired tactile stimulus presentation position through auditory or visual effects based on the user's position and the desired tactile stimulus presentation position. For example, the perception control unit 112 can control each configuration using the sound and image information included in the control information provided from the host device 200 to localize the sound and image to, for example, the tactile stimulus presentation position, so that the user can perceive the separation distance between the user's position and the desired tactile stimulus presentation position.

[0094] The communication unit 120 is configured to communicate with an external device. More specifically, the communication unit 120 of the first tactile presentation device communicates with the host device 200 and another tactile presentation device 100, and the tactile presentation device 100 other than the first tactile presentation device communicates with another tactile presentation device 100. The communication unit 120 communicates with these devices wirelessly directly or via a network access point in a system such as a wired LAN, a wireless LAN, Wi-Fi (registered trademark), infrared communication, Bluetooth (registered trademark), or near field / contactless communication.

[0095] The sensor unit 130 is configured to obtain various types of sensor information. For example, the sensor unit 130 is provided with a sense sensor so that the control unit 110 (including the tactile control unit 111, the perception control unit 112, etc.) can output whether the user steps on the tactile presentation device 100, the stepping force, the range and area of ​​the applied force, and thus each configuration can be controlled according to the results of these outputs. It should be noted that the type of sensor included in the sensor unit 130 is not particularly limited.

[0096] The tactile presentation unit 140 is configured to present tactile stimulation based on the control of the tactile control unit 111, and to present sound based on the control of the perception control unit 112. More specifically, the tactile presentation unit 140 is a broadband actuator capable of outputting data of frequency components not only within the inaudible range of humans but also within the audible range of humans. It should be noted that the tactile presentation unit 140 can be an electrical element that presents force perception, or can be a temperature change element (for example, a Peltier element, etc.) that presents temperature perception (in the case where the tactile presentation unit 140 is an electrical element or a temperature change element, it is impossible to present sound, so the sound is presented through other configurations). In addition, as described above, the type of tactile stimulation to be presented by the tactile presentation unit 140 is not particularly limited.

[0097] The output unit 150 is configured to perform various outputs based on the control of the perception control unit 112. For example, the output unit 150 includes a display device such as a display, thereby being able to perform various image displays, and includes a sound output device such as a speaker, thereby being able to perform various sound outputs (e.g., sound effects, etc.). It should be noted that the output device included in the output unit 150 is not limited thereto.

[0098] The storage unit 160 is configured to store various types of information. For example, the storage unit 160 stores programs, parameters, etc. to be used by each configuration of the tactile presentation device 100. In addition, the storage unit 160 may store processing results of each configuration, information received from an external device by the communication unit 120, etc. It should be noted that the essence of the information stored in the storage unit 160 is not limited thereto.

[0099] A description has been given above of a configuration example of the tactile presentation device 100. Fig.12 The above configuration described is merely an example, and the configuration of the tactile presentation device 100 is not limited to such an example. For example, the tactile presentation device 100 may not include Fig.12 Some configurations shown in or may include Fig.12 In addition, a configuration not shown in the figure may be provided in an external device (not shown). Fig.12 The configuration shown in FIG. 1 , and the tactile presentation device 100 can implement each of the above functions by linking to communicate with an external device.

[0100] <3. Example of processing flow for each device>

[0101] A description has been given above of a configuration example of each device according to the present embodiment. Fig.13 , an example of the processing flow of each device according to the present embodiment is described when presenting tactile stimulation and auditory or visual effects.

[0102] In step S1000, the tactile control section 111 of the tactile presentation device 100 determines whether the same tactile presentation information has been received in the past. For example, the tactile control section 111 determines whether the same tactile presentation information has been received in the past based on the identification information about the tactile presentation information stored in the tactile presentation information. In the case where it is determined that the same tactile presentation information has been received in the past (step S1000 / yes), in step S1004, the tactile control section 111 discards the tactile presentation information. This prevents the same tactile stimulation from being presented in an overlapping manner using the same tactile presentation information.

[0103] When it is determined that the same tactile presentation information has not been received in the past (step S1000 / No), in step S1008, the tactile control section 111 and the perception control section 112 determine whether the user is in contact with the own device based on the sensor information output by the sensor unit 130, etc. In the case where it is determined that the user is in contact with the own device (step S1008 / Yes), in step S1012, the tactile control section 111 controls the tactile presentation unit 140 based on the tactile presentation information to present tactile stimulation. In the case where it is determined that the user is not in contact with the own device (step S1008 / No), in step S1016, the perception control section 112 controls each configuration to produce an auditory or visual effect.

[0104] In step S1020, the haptic control unit 111 and the perception control unit 112 determine whether the end condition of the process of the own device is satisfied. In the case where it is determined that the end condition of the process of the own device is not satisfied (step S1020 / No), the haptic control unit 111 and the perception control unit 112 continue the process from step S1008 to step S1016. In the case where it is determined that the end condition of the process of the own device is satisfied (step S1020 / Yes), a series of processes of the haptic presentation device 100 end.

[0105] It should be noted that although Fig.13 Although not shown, in the case where the tactile stimulation is propagated to another peripheral tactile presentation device 100 , the tactile control section 111 generates tactile presentation information for presenting the tactile stimulation by the other tactile presentation device 100 , and provides the generated tactile presentation information to the other tactile presentation device 100 .

[0106] <4. Modification Example>

[0107] An example of the processing flow when each device according to the present embodiment presents tactile stimulation and auditory or visual effects has been described above. Subsequently, a modification example according to the present embodiment is described.

[0108] (4.1. First Modification Example)

[0109] First, a first modified example according to the present embodiment is described.

[0110] It has been described above that the tactile presentation device 100 for producing an auditory or visual effect is, for example, an effect of the tactile presentation device 100 located within the range where the tactile stimulus propagates. However, in this system, in the case where multiple users utilize the information processing system according to the present embodiment, in some cases, the auditory or visual effect produced for one user may interfere with the normal experience of another user.

[0111] For example, in the above Figure 8In the case where the separation distance between the tactile presentation unit 140 generating the sound and the user u1 is far, in some cases, the tactile presentation unit 140 may not allow the user u1 to perceive the sound unless the sound is generated at a loud volume. At this time, when another user u2 is present near the tactile presentation unit 140, a loud sound is generated near the user u2, thereby causing interference with the normal experience of the user u2. For example, in Figure 8 In the example, the presence of user u2 near the tactile presentation unit 1401 that generates a loud sound interferes with the normal experience of user u2.

[0112] Therefore, the perception control unit 112 according to the first modified example determines the range of the configuration to be controlled to produce the auditory effect based on the user's position and the desired tactile stimulation presentation position. More specifically, the perception control unit 112 according to the first modified example determines the tactile presentation unit 140 to be controlled to produce the auditory effect from the plurality of tactile presentation units 140 based on the user's position and the desired tactile stimulation presentation position.

[0113] For example, before the time when the tactile stimulus reaches the user from the tactile stimulus presentation location, such as Fig.14 As shown in, according to the first modified example, the perception control unit 112 can decide a predetermined number of tactile presentation units 140 that are positioned closer to the tactile stimulation presentation position from the tactile presentation units 140 surrounding the tactile presentation unit 140 where the user is located as the tactile presentation units 140 to be controlled to produce the auditory effect.

[0114] In addition, after the tactile stimulus reaches the user, Fig.15 As shown, the perception control unit 112 can determine a predetermined number of tactile presentation units 140 located farther away from the tactile stimulation presentation position from the tactile presentation units 140 surrounding the tactile presentation unit 140 where the user is located as the tactile presentation units 140 to be controlled to produce the auditory effect.

[0115] Then, the perception control section 112 adjusts the volume of the sound to be generated by the tactile presentation unit 140 determined as the control target, or for example positions its sound image, so that the user can perceive that the tactile stimulation has propagated to the user and then has passed through the user. It should be noted that the method for determining the tactile presentation unit 140 to be controlled to generate the auditory effect is not limited to referring to Fig.14 and Fig.15 Describe the method.

[0116] Then, refer to Fig.16 , an example of a processing flow of each device according to the first modified example is described when presenting tactile stimulation and auditory or visual effects.

[0117] In step S1100, the tactile control section 111 of the tactile presentation device 100 determines whether the same tactile presentation information has been received in the past. In the case where it is determined that the same tactile presentation information has been received in the past (step S1100 / Yes), in step S1104, the tactile control section 111 discards the tactile presentation information. This prevents the same tactile stimulation from being presented in an overlapping manner using the same tactile presentation information.

[0118] In the case where it is determined that the same tactile presentation information has not been received in the past (step S1100 / No), in step S1108, the tactile control unit 111 and the perception control unit 112 determine whether the user is in contact with the own device based on the sensor information output by the sensor unit 130, etc. In the case where it is determined that the user is in contact with the own device (step S1108 / Yes), in step S1112, the tactile control unit 111 controls the tactile presentation unit 140 based on the tactile presentation information to present tactile stimulation. In the case where it is determined that the user is not in contact with the own device (step S1108 / No), in step S1116, the perception control unit 112 determines whether the own device should produce an auditory or visual effect. For example, the perception control unit 112 determines, for example, whether a tactile presentation unit 140 to be controlled to produce an auditory effect is provided based on the user's position and the desired tactile stimulation presentation position.

[0119] If it is determined that the own device should produce an auditory or visual effect (step S1116 / Yes), in step S1120, the perception control unit 112 controls each configuration to produce an auditory or visual effect. If it is determined that the own device should not produce an auditory or visual effect (step S1116 / No), the processing of step S1120 is omitted.

[0120] In step S1124, the haptic control unit 111 and the perception control unit 112 determine whether the end condition of the processing of the own device is satisfied. In the case where it is determined that the end condition of the processing of the own device is not satisfied (step S1124 / No), the haptic control unit 111 and the perception control unit 112 continue the processing from step S1108 to step S1120. In the case where it is determined that the end condition of the processing of the own device is satisfied (step S1124 / Yes), a series of processing of the haptic presentation device 100 ends.

[0121] It should be noted that although Fig.16 Although not shown, in the case where the tactile stimulation is propagated to another peripheral tactile presentation device 100 , the tactile control section 111 generates tactile presentation information for presenting the tactile stimulation by the other tactile presentation device 100 , and provides the generated tactile presentation information to the other tactile presentation device 100 .

[0122] (4.2. Second Modification Example)

[0123] Subsequently, a second modified example according to the present embodiment is described.

[0124] In the above, it has been described that in order to generate an auditory or visual effect, for example, an effect using control information (for example, control information for displaying an image, control information for lighting a light, or sound information for outputting a sound) generated by the perception control section 212 of the host device 200 is used. However, in some cases, the perception control section 212 of the host device 200 may not be able to generate the control information from the viewpoint of processing load or the like.

[0125] Therefore, based on the tactile presentation information for presenting vibration (tactile stimulation) by the tactile presentation unit 140 (hereinafter, which may be referred to as "first information" in some cases), the perception control unit 112 according to the second modified example generates information for producing an auditory or visual effect (hereinafter, which may be referred to as "second information" in some cases).

[0126] For example, the perception control unit 112 according to the second modification example may be as follows Fig.17 As shown in B, Fig.17 The tactile presentation information of frequency components mainly in the non-audible range shown in A is moved toward the audible range side by a predetermined frequency (hereinafter, this processing is referred to as "pitch shifting") to increase the tactile presentation information as frequency components in the audible range, thereby generating second information for producing sound.

[0127] In addition, if Fig.18 As shown, the perception control unit 112 according to the second modified example can analyze the tactile presentation information to extract the envelope indicating the amplitude of the tactile presentation information, and perform mapping of a pre-prepared audible sound source (e.g., white noise, etc.) to the envelope to generate second information for generating sound.

[0128] In addition, the perception control section 112 according to the second modification example can convert information about the output intensity, output frequency, etc. of the tactile stimulation stored in the tactile presentation information according to a predetermined algorithm, thereby generating second information for displaying an image or lighting a lamp. This enables the perception control section 112 to control the substance of the image, the brightness of the lamp, etc. according to the output intensity or output frequency of the tactile stimulation.

[0129] For example, in the case where tactile presentation information (first information) is provided from the peripheral tactile presentation device 100, the perception control section 112 according to the second modified example immediately (in real time) generates the second information in the above-mentioned various methods, and causes an auditory or visual effect to be produced. This enables the tactile presentation device 100 to produce an auditory or visual effect even in the case where the perception control section 212 of the host device 200 cannot generate control information, so that the propagation direction of the tactile stimulus, etc. can be perceived. It should be noted that the method for generating the second information is not limited to the above-mentioned example.

[0130] (4.3. Third Modification Example)

[0131] Subsequently, a third modified example according to the present embodiment is described.

[0132] There may be a case where the user cannot perceive normal tactile stimulation because the tactile presentation device 100 generates an auditory effect so that the user can perceive the propagation direction of the tactile stimulation. For example, in the case where the tactile presentation device 100 uses sound information to generate an auditory effect, such as Fig.19 As shown, in some cases, the low-frequency components (in Fig.19 The component described as “a frequency band component causing the perception of tactile stimulation” in the text may cause the user to perceive tactile stimulation that should not be perceived due to the component.

[0133] Therefore, the perception control section 112 according to the third modification example distinctively controls the frequency band components lower than the predetermined frequency and the frequency band components equal to or higher than the predetermined frequency in the information for producing the auditory effect.

[0134] For example, the perception control unit 112 according to the third modified example can output a frequency band component lower than a predetermined frequency and a frequency band component equal to or higher than a predetermined frequency according to various different configurations. More specifically, the perception control unit 112 according to the third modified example can use sensor information of, for example, a pressure-sensitive sensor provided in the sensor unit 130 to specify the position of the user so that a frequency band component lower than a predetermined frequency, in which a tactile stimulus is more likely to be perceived by the user, is output from a configuration (e.g., a broadband actuator or a speaker) located farther from the user, and a frequency band component equal to or higher than a predetermined frequency is output from a configuration located closer to the user.

[0135] In addition, the perception control section 112 according to the third modification example can discard low-frequency components of the sound information without outputting frequency band components lower than a predetermined frequency because low-frequency components have less influence on the auditory sense than high-frequency components.

[0136] (4.4. Fourth Modification Example)

[0137] Subsequently, a fourth modified example according to the present embodiment is described.

[0138] Although the above has been described by way of example Figure 2 The case where multiple tactile presentation devices 100 are arranged on the ground in a state of being closely adjacent to each other as shown in the examples above, but the arrangement of the tactile presentation devices 100 is not limited thereto. Therefore, in the fourth modified example according to the present embodiment, as a variation of the arrangement of the tactile presentation devices 100, a case where multiple tactile presentation devices 100 are arranged on clothing worn by the user is described.

[0139] More specifically, if Fig. 20 As shown, a plurality of tactile presentation devices 100 (in Fig. 20 In the example of the tactile presentation device 100a to the tactile presentation device 100f) and a plurality of output units 150 (in Fig. 20 The output unit 150a and the output unit 150b (in an example of the embodiment) capable of outputting sound are arranged on the clothing 30. For example, a predetermined number (for example, six) of tactile presentation devices 100 may be arranged on each of the front side and the back side of the user.

[0140] Also in the fourth modified example according to the present embodiment, similar to those described above, the first tactile presentation device is linked to communicate with the host device 200, and is also linked to communicate with another tactile presentation device 100 on the clothing 30 of the same user, thereby propagating various types of information (e.g., tactile presentation information, control information, etc.) from the first tactile presentation device as a starting point. This enables the information processing system according to the fourth modified example to propagate tactile stimulation on the user's body.

[0141] In addition, in the case where there are multiple users, the first tactile presentation device on the clothing 30 of one user is linked to communicate with the host device 200, and is also linked to communicate with another tactile presentation device 100 in each clothing 30 of the same user and another user, which can make it possible to propagate various types of information from the first tactile presentation device on the clothing 30 of one user. This enables the information processing system according to the fourth modified example to propagate tactile stimulation between multiple users.

[0142] Also in the fourth modified example of the present embodiment, similar to those described above, the tactile presentation device 100 enables the user to perceive the propagation direction of the tactile stimulus relative to the user through an auditory or visual effect. Here, in the case where the tactile stimulus propagates between multiple users, in some cases, unless the sound is generated at a loud volume, the tactile presentation device 100 may not enable the user to perceive the sound at a long separation distance between the users.

[0143] For example, assuming that users u1 to u4 are arranged side by side in a row, as shown in FIG. Fig.21 As shown, the desired vibration is applied to the tactile presentation device 100 on the clothing 30 of user u4 (in other words, the tactile stimulation presentation position corresponds to the tactile presentation device 100 on the clothing 30 of user u4). In addition, in the case where the vibration propagates in the order of user u4, user u3, user u2, and user u1, in some cases, the sound output from the output unit 150 (output unit 150a and output unit 150b) of each user to be combined with the propagation may cause interference with the normal experience of each user because the sound has a large volume.

[0144] Therefore, in order to produce an auditory effect, the perception control section 112 according to the fourth modified example controls only the output unit 150 on the clothing 30 worn by the target user that enables perception of the propagation direction of the tactile stimulation. Fig.21 In the example of , the perception control unit 112 according to the fourth modified example controls the output unit 150 on the clothing 30 worn by the user u1 to generate sound, so that the user u1 can perceive the tactile stimulation (vibration) propagating in the order of the user u4, the user u3, the user u2 and the user u1 (i.e., the direction of vibration propagation, etc.). This prevents interference with the normal experience of other users.

[0145] <5. Hardware Configuration Example>

[0146] The modification examples according to the present embodiment have been described above. Fig. 22 The hardware configuration example of the tactile presentation device 100 or the host device 200 according to the present embodiment described above is described. Fig. 22 1 is a block diagram showing a hardware configuration example of an information device 900 embodying the tactile presentation device 100 or the host device 200 according to the present embodiment. Information processing of the tactile presentation device 100 or the host device 200 according to the present embodiment is realized through cooperation between software and hardware described below.

[0147] like Fig. 22 As shown, the information device 900 includes: a CPU (central processing unit) 901, a ROM (read only memory) 902, a RAM (random access memory) 903, and a host bus 904a. In addition, the information device 900 includes: a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a driver 909, a coupling port 911, a communication device 913, and a sensor 915. Instead of the CPU 901 or in addition to the CPU 901, the information device 900 may include a processing circuit such as a DSP or an ASIC.

[0148] The CPU 901 functions as an arithmetic processor and a controller, and controls the overall operation within the information device 900 according to various programs. In addition, the CPU 901 may be a microprocessor. The ROM 902 stores programs to be used by the CPU 901, arithmetic parameters, and the like. The RAM 903 temporarily stores programs to be used in the execution of the CPU 901, parameters appropriately changed in the execution, and the like. The CPU 901 may be embodied as, for example, the control unit 110 of the tactile presentation device 100 or the control unit 210 of the host device 200.

[0149] The CPU 901, the ROM 902, and the RAM 903 are coupled to each other via a host bus 904a including a CPU bus, etc. The host bus 904a is coupled to an external bus 904b such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 904. It is to be noted that the host bus 904a, the bridge 904, and the external bus 904b do not necessarily need to be configured separately; these functions may be installed in one bus.

[0150] The input device 906 may be implemented by a device such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a joystick through which information is input by a user. In addition, the input device 906 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external coupling device such as a mobile phone or a PDA that is compatible with the operation of the information device 900. Furthermore, the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by a user by using the above-mentioned input device, and outputs the generated input signal to the CPU 901. By operating the input device 906, the user of the information device 900 can input various data to the information device 900 or give instructions for processing operations.

[0151] The output device 907 is formed by a device capable of visually or auditorily notifying the user of the acquired information. Examples of such devices include display devices such as CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, and lamps, sound output devices such as speakers and headphones, and printing devices. In addition, in the present embodiment, the output device 907 may be formed by an actuator that presents vibration, an electrical element that presents stimulation related to force perception, a temperature change element that presents stimulation related to temperature, and the like. The output device 907 may, for example, embody the tactile presentation unit 140 or the output unit 150 of the tactile presentation device 100.

[0152] The storage device 908 is a device for storing data formed as an example of a storage unit of the information device 900. The storage device 908 is implemented, for example, by a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The storage device 908 may include a storage medium, a recorder for recording data in the storage medium, a reader for reading data from the storage medium, a deletion device for deleting data recorded in the storage medium, etc. The storage device 908 stores a program to be executed by the CPU 901, various data, various data acquired from the outside, etc. The storage device 908 may be embodied, for example, as the storage unit 160 of the tactile presentation device 100 or the storage unit 230 of the host device 200.

[0153] The drive 909 is a reader / writer for a storage medium, and is built in the information device 900 or externally attached to the information device 900. The drive 909 reads information recorded in an attached removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the read information to the RAM 903. In addition, the drive 909 can also write information in a removable storage medium.

[0154] The coupling port 911 is an interface to be coupled to an external device, and is a coupling port with an external device capable of transmitting data by USB (Universal Serial Bus) or the like, for example.

[0155] The communication device 913 is a communication interface for coupling to the network 920, for example, formed by a communication device, etc. The communication device 913 is, for example, a communication card for a wired or wireless LAN (local area network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (wireless USB), etc. In addition, the communication device 913 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various types of communication, etc. For example, the communication device 913 is capable of sending signals to the Internet or other communication devices, etc., and receiving signals from the Internet or other communication devices, etc., according to a predetermined protocol such as TCP / IP. The communication device 913 may be embodied, for example, as the communication unit 120 of the tactile presentation device 100 or the communication unit 220 of the host device 200.

[0156] The sensor 915 is, for example, each of the following various sensors: for example, a pressure-sensitive sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, a sound sensor, or a distance sensor. The sensor 915 acquires information about the state of the information device 900 itself, such as the posture and travel speed of the information device 900, and information about the surrounding environment of the information device 900, such as the surrounding brightness and noise of the information device 900. In addition, the sensor 915 may include a GPS sensor that receives a GPS signal to measure the latitude, longitude, and altitude of the device. The sensor 915 may be embodied as, for example, the sensor unit 130 of the tactile presentation device 100.

[0157] It is to be noted that the network 920 is a wired or wireless transmission path for information transmitted from a device coupled to the network 920. For example, the network 920 may include a public network such as the Internet, a telephone network, a satellite communication network, various types of LANs (Local Area Networks) including Ethernet (registered trademark), WAN (Wide Area Network), etc. In addition, the network 920 may include a private network such as an IP-VPN (Internet Protocol-Virtual Private Network).

[0158] An example of a hardware configuration that enables the functions of the information device 900 according to the present embodiment to be implemented has been described above. Each of the components described above may be implemented using a general-purpose component, or may be implemented by hardware dedicated to the functions of the respective components. Therefore, the hardware configuration to be utilized may be appropriately changed according to the technical level when implementing the present embodiment.

[0159] It should be noted that a computer program for realizing each function of the information device 900 according to the present embodiment as described above can be created, and the computer program can be installed on a PC or the like. In addition, a computer-readable recording medium storing such a computer program can also be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. In addition, without using a recording medium, the above-mentioned computer program can be distributed, for example, via a network.

[0160] <6. Conclusion>

[0161] As described above, the information processing device according to the present embodiment enables the user to perceive the propagation direction of the tactile stimulus relative to the user through auditory or visual effects based on the user's position and the desired tactile stimulus presentation position. In addition, the information processing device according to the present embodiment can enable the user to perceive not only the propagation direction of the tactile stimulus relative to the user, but also the separation distance between the user's position and the desired tactile stimulus presentation position. This enables the information processing device according to the present embodiment to provide highly complex content. It should be noted that the present disclosure can achieve not only this effect, but also the various effects described above.

[0162] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. Obviously, a person skilled in the art of the present disclosure can find various changes or modifications within the scope of the technical ideas described in the claims, and it should be understood that these changes and modifications naturally belong to the technical scope of the present disclosure.

[0163] In addition, the effects described herein are only illustrative or exemplary, and not restrictive. That is, in addition to or in place of the above effects, the technology according to the embodiments of the present disclosure may also achieve other effects that are obvious to those skilled in the art based on the description of this specification.

[0164] It is to be noted that the technical scope of the present disclosure also includes the following configurations. (1)

[0166] An information processing device includes a perception control unit, which enables the user to perceive the propagation direction of tactile stimulation relative to the user through auditory effects or visual effects based on the user's position and the desired tactile stimulation presentation position. (2)

[0168] The information processing device according to (1), wherein the desired tactile stimulation presentation position includes a position where the tactile stimulation is actually presented, or a position where the tactile stimulation is virtually presented. (3)

[0170] An information processing device according to (1) or (2), wherein the perception control unit, based on the position of the user and the desired tactile stimulation presentation position, enables the user to perceive not only the propagation direction of the tactile stimulation relative to the user, but also the separation distance between the position of the user and the desired tactile stimulation presentation position through the auditory effect or the visual effect. (4)

[0172] The information processing device according to any one of (1) to (3), wherein the perception control unit decides a range of a configuration to be controlled to produce the auditory effect based on the position of the user and the desired tactile stimulation presentation position. (5)

[0174] The information processing device according to any one of (1) to (4), wherein the tactile stimulation includes vibration. (6)

[0176] An information processing device according to (5), wherein the perception control unit causes a vibration presentation unit that is not used to present the vibration among a plurality of vibration presentation units capable of presenting the vibration to output data of a frequency component within a human auditory range, thereby producing the auditory effect. (7)

[0178] The information processing device according to (6), wherein the perception control unit determines a vibration presentation unit among the plurality of vibration presentation units to be controlled to produce the auditory effect based on the position of the user and the desired tactile stimulation presentation position. (8)

[0180] The information processing device according to (6) or (7), wherein the perception control section generates second information for producing the auditory effect or the visual effect based on first information for presenting the vibration by the vibration presenting unit. (9)

[0182] The information processing device according to any one of (1) to (8), wherein the perception control section differentially controls a frequency band component lower than a predetermined frequency and a frequency band component equal to or higher than the predetermined frequency in the information for producing the auditory effect. (10)

[0184] An information processing method executed by a computer includes making the user perceive the propagation direction of the tactile stimulus relative to the user through an auditory effect or a visual effect based on the user's position and a desired tactile stimulus presentation position. (11)

[0186] A storage medium storing a program, wherein the program enables a computer to realize: based on the user's position and the desired tactile stimulation presentation position, the user is made to perceive the propagation direction of the tactile stimulation relative to the user through an auditory effect or a visual effect.

[0187] [reference numerals list]

[0188] 100 Tactile presentation device

[0189] 110 Control unit

[0190] 111 Touch Control Unit

[0191] 112 Perception Control Department

[0192] 120 Communication Unit

[0193] 130 Sensor unit

[0194] 140 Tactile presentation unit

[0195] 150 Output Units

[0196] 160 storage units

[0197] 200 Host device

[0198] 210 Control unit

[0199] 211 Touch Control Department

[0200] 212 Perception Control Department

[0201] 220 Communication Unit

[0202] 230 storage units

[0203] 300 Content Control Device

Claims

1. An information processing device, comprising a perception control unit, which enables the user to perceive the propagation direction of the tactile stimulus relative to the user through an auditory effect or a visual effect based on the user's position and the desired tactile stimulus presentation position, in, The tactile stimulation includes vibration, wherein the perception control unit causes a vibration presentation unit that is not used to present the vibration among a plurality of vibration presentation units capable of presenting the vibration to output data of a frequency component within a human hearing range, thereby producing the auditory effect, The perception control unit determines a vibration presentation unit among the plurality of vibration presentation units to be controlled to produce the auditory effect based on the position of the user and the desired tactile stimulation presentation position, wherein, before the tactile stimulus reaches the user from the desired tactile stimulus presentation position, the perception control unit determines a predetermined number of vibration presentation units located closer to the desired tactile stimulus presentation position from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located as vibration presentation units to be controlled to produce the auditory effect, and Among them, after the tactile stimulation reaches the user, the perception control unit determines a predetermined number of vibration presentation units that are positioned farther away from the desired tactile stimulation presentation position from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located as vibration presentation units to be controlled to produce the auditory effect.

2. The information processing device according to claim 1, wherein: The desired tactile stimulation presentation position includes a position where the tactile stimulation is actually presented, or a position where the tactile stimulation is virtually presented.

3. The information processing device according to claim 1, wherein: Based on the position of the user and the desired tactile stimulation presentation position, the perception control unit enables the user to perceive not only the propagation direction of the tactile stimulation relative to the user, but also the separation distance between the position of the user and the desired tactile stimulation presentation position through the auditory effect or the visual effect.

4. The information processing device according to claim 1, wherein: The perception control section determines a range of a configuration to be controlled to produce the auditory effect based on the position of the user and the desired tactile stimulation presentation position.

5. The information processing device according to claim 1, wherein: The perception control section generates second information for producing the auditory effect or the visual effect based on first information for presenting the vibration through the vibration presenting unit.

6. The information processing device according to claim 1, wherein: The perception control section differentially controls a frequency band component lower than a predetermined frequency and a frequency band component equal to or higher than the predetermined frequency in the information for producing the auditory effect.

7. An information processing method executed by a computer, the method comprising causing the user to perceive a propagation direction of the tactile stimulus relative to the user through an auditory effect or a visual effect based on the user's position and the desired tactile stimulus presentation position, in, The tactile stimulation includes vibration, wherein a vibration presenting unit that is not used to present the vibration among a plurality of vibration presenting units capable of presenting the vibration outputs data of a frequency component within a human hearing range, thereby producing the auditory effect, wherein, based on the position of the user and the desired tactile stimulation presentation position, a vibration presentation unit among the plurality of vibration presentation units to be controlled to produce the auditory effect is determined, wherein, before the tactile stimulus reaches the user from the desired tactile stimulus presentation position, a predetermined number of vibration presentation units located closer to the desired tactile stimulus presentation position are determined as vibration presentation units to be controlled to produce the auditory effect from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located, and Among them, after the tactile stimulation reaches the user, a predetermined number of vibration presentation units located farther away from the desired tactile stimulation presentation position are determined as vibration presentation units to be controlled to produce the auditory effect from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located.

8. A storage medium storing a program, wherein the program enables a computer to: based on a position of a user and a desired presentation position of a tactile stimulus, enable the user to perceive a propagation direction of the tactile stimulus relative to the user through an auditory effect or a visual effect, in, The tactile stimulation includes vibration, wherein a vibration presenting unit that is not used to present the vibration among a plurality of vibration presenting units capable of presenting the vibration outputs data of a frequency component within a human hearing range, thereby producing the auditory effect, wherein, based on the position of the user and the desired tactile stimulation presentation position, a vibration presentation unit among the plurality of vibration presentation units to be controlled to produce the auditory effect is determined, wherein, before the tactile stimulus reaches the user from the desired tactile stimulus presentation position, a predetermined number of vibration presentation units located closer to the desired tactile stimulus presentation position are determined as vibration presentation units to be controlled to produce the auditory effect from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located, and Among them, after the tactile stimulation reaches the user, a predetermined number of vibration presentation units located farther away from the desired tactile stimulation presentation position are determined as vibration presentation units to be controlled to produce the auditory effect from a plurality of vibration presentation units surrounding the vibration presentation unit where the user is located.

Images