Information processing apparatus, information processing method, and program

Abstract

Provided is an information processing apparatus equipped with a search unit that searches for haptic presentation information from a haptic database containing the haptic presentation information and one or more pieces of haptic meta-information associated with the haptic presentation information, based on haptic search information used in searching for the haptic presentation information for realizing a haptic presented to a user, and an output unit that outputs information related to the searched haptic presentation information.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program. BACKGROUND

[0002] Conventionally, a technology for presenting various types of information perceived by a user's sense of touch (e.g., a vibration stimulus) to the user has been proposed. For example, Patent Literature 1 discloses a technology of generating a signal configured to cause a sense of touch effect in accordance with a predetermined condition, and outputting the generated signal to a sense of touch presentation device.

[0003] LIST OF CITATIONS

[0004] PATENT LITERATURE

[0005] [Patent Literature 1] JP 2017-194981 A SUMMARY

[0006] PROBLEMS TO BE SOLVED BY THE INVENTION

[0007] As described above, conventionally, a technology for presenting a sense of touch to a user has been proposed. On the other hand, since a large amount of various types of information related to a sense of touch as described above is accumulated, if information desired by a user can be retrieved from the accumulated information related to a sense of touch, like a word in a dictionary, it is considered that the convenience of the user can be further improved.

[0008] Therefore, the present disclosure proposes a novel and improved information processing apparatus, an information processing method, and a program capable of providing information for more appropriately realizing a sense of touch desired by a user based on information for retrieving a sense of touch.

[0009] SOLUTION TO PROBLEM

[0010] According to the present disclosure, there is provided an information processing apparatus including: a retrieval unit that retrieves, based on sense of touch retrieval information for retrieving sense of touch presentation information for realizing a sense of touch presented to a user, the sense of touch presentation information from a sense of touch database including the sense of touch presentation information and one or more sense of touch meta-information associated with the sense of touch presentation information; and an output unit that outputs information related to the retrieved sense of touch presentation information.

[0011] Further, according to the present disclosure, there is provided an information processing method including: retrieving, based on sense of touch retrieval information for retrieving sense of touch presentation information for realizing a sense of touch presented to a user, by a processor, the sense of touch presentation information from a sense of touch database including the sense of touch presentation information and one or more sense of touch meta-information associated with the sense of touch presentation information; and outputting, by the processor, information related to the retrieved sense of touch presentation information.

[0012] Further, according to the present disclosure, there is provided a program for causing a computer to function as an information processing apparatus including: a search unit that searches, based on haptic search information for searching for haptic presentation information for realizing a haptic presented to a user, the haptic presentation information from a haptic database including the haptic presentation information and one or more haptic meta-information associated with the haptic presentation information; and an output unit that outputs information related to the searched haptic presentation information. BRIEF DESCRIPTION OF DRAWINGS

[0013] [ Figure 1 ] Figure 1 is a diagram showing a configuration of an information processing system according to an embodiment of the present disclosure.

[0014] [ Figure 2 ] Figure 2 is a diagram showing an example of a data structure of a haptic database.

[0015] [ Figure 3 ] Figure 3 is a list showing an example of a haptic meta-information type.

[0016] [ Figure 4 ] Figure 4 is a functional block diagram showing a configuration of an information processing apparatus according to an embodiment of the present disclosure.

[0017] [ Figure 5 ] Figure 5 is a diagram for describing an example in which the haptic database is updated by the update unit.

[0018] [ Figure 6 ] Figure 6 is a diagram for describing an example in which the haptic database is updated by the update unit based on a relationship between two haptic meta-information groups.

[0019] [ Figure 7 ] Figure 7 is a diagram for describing an example in which the haptic database is updated by the update unit based on a relationship between two haptic meta-information groups.

[0020] [ Figure 8 ] Figure 8 is a functional block diagram showing a configuration of a processing unit.

[0021] [ Figure 9 ] Figure 9 is a diagram showing a signal waveform of vibration as an example of the searched haptic presentation information.

[0022] [ Figure 10 ] Figure 10 is a diagram showing a spectrum of the signal waveform shown in Figure 9 .

[0023] [ Figure 11 ] Figure 11 is a functional block diagram showing a configuration of a user terminal.

[0024] [ Figure 12 ] Figure 12 is a graph showing a state of retrieving haptic presentation information.

[0025] [ Figure 13 ] Figure 13 is a graph showing a signal waveform of a vibration related to a haptic presented to a user.

[0026] [ Figure 14 ] Figure 14 is a flowchart showing a flow of updating a haptic database by an information processing apparatus according to an embodiment of the present disclosure.

[0027] [ Figure 15 ] Figure 15 is a flowchart showing a flow of an update process of a haptic database.

[0028] [ Figure 16 ] Figure 16 is a flowchart showing an outline of a processing example by an information processing apparatus and a user terminal according to an embodiment of the present disclosure.

[0029] [ Figure 17 ] Figure 17 is a flowchart showing a first specific example of a processing by an information processing apparatus and a user terminal according to an embodiment of the present disclosure.

[0030] [ Figure 18 ] Figure 18 is a flowchart showing a second specific example of a processing by an information processing apparatus and a user terminal according to an embodiment of the present disclosure.

[0031] [ Figure 19 ] Figure 19 is a flowchart showing a first application example of a processing by an information processing apparatus and a user terminal according to an embodiment of the present disclosure.

[0032] [ Figure 20 ] Figure 20 is a flowchart showing a second application example of a processing by an information processing apparatus and a user terminal according to an embodiment of the present disclosure.

[0033] [ Figure 21 ] Figure 21 is a functional block diagram showing an example of a hardware configuration of an information processing apparatus according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0034] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that, in this specification and the accompanying drawings, components having substantially the same function are denoted with the same reference numerals, and overlapping description is omitted.

[0035] Note that the description will be given in the following order.

[0036] 1. Overall configuration of information processing system

[0037] 1.1. Haptic database

[0038] 1.2. Configuration and functions of information processing device

[0039] 1.3. Configuration and functions of user terminal

[0040] 2. Update example

[0041] 3. Processing example

[0042] 3.1. Outline of processing example

[0043] 3.2. First specific example

[0044] 3.3. Second specific example

[0045] 4. Application example

[0046] 4.1. First application example

[0047] 4.2. Second application example

[0048] 5. Hardware configuration example

[0049] 6. Supplement

[0050] <1. Overall configuration of information processing system>

[0051] Next, an information processing system 1 according to an embodiment of the present disclosure will be described with reference to Figure 1 The information processing system 1 according to the embodiment of the present disclosure includes a server 10, an information processing device 20, and a user terminal 30. The server 10, the information processing device 20, and the user terminal 30 are connected to each other through a network 40. Figure 1

[0052] Note that the network 40 can include a public line network such as a telephone line network, the Internet, or a satellite communication network, a local area network (LAN), a wide area network (WAN), or the like. In addition, the network 40 can include a private line network such as an Internet Protocol- Virtual Private Network (IP-VPN).

[0053] ​The server 10 stores information collected based on various known services such as a social network service (SNS). More specifically, the server 10 stores information transmitted by a user based on the SNS or the like. For example, the information stored in the server 10 includes haptic presentation information for realizing a haptic. In addition, the haptic presentation information can be stored in the server 10 together with at least one of various types of information such as text information, image information, or audio information. If necessary, the various types of information stored in the server 10 are transmitted to the information processing apparatus 20 via the network 40. Note that, in the present specification, a haptic can be various types of sensations felt on the skin, for example, in addition to a sensation perceived by a vibration stimulus, a pressure sensation, a force sensation, a pain sensation, or a temperature.

[0054] The information processing apparatus 20 retrieves haptic presentation information for realizing a haptic to be presented to a user from the haptic database based on haptic retrieval information. In addition, the information processing apparatus 20 transmits the retrieved haptic presentation information to the user terminal 30. Note that, in the present embodiment, the haptic database is stored in the information processing apparatus 20, but the haptic database can also be stored in any one of the server 10, the information processing apparatus 20, and the user terminal 30. Details of the data structure of the haptic database will be described later.

[0055] The user terminal 30 presents a haptic to a user based on information related to haptic presentation information transmitted from the information processing apparatus 20. The user terminal 30 presents a haptic, for example, by giving a vibration stimulus to a hand or the like of the user. In addition, the user terminal 30 has a function of displaying various types of information (for example, a retrieval result of haptic presentation information of the information processing apparatus 20).

[0056] <<1.1. Haptic Database>>

[0057] Here, an example of a data structure of a haptic database will be described with reference to Figure 2 FIG. 1. Figure 2 is a diagram illustrating an example of a data structure of a haptic database DB. The haptic database DB includes haptic presentation information and one or more haptic meta-information associated with the haptic presentation information. Here, the haptic meta-information is information for classifying the haptic presentation information. Furthermore, the haptic database DB according to the present embodiment preferably includes device-related information depending on a device that presents a haptic.

[0058] As Figure 2 indicated in FIG. 1, a plurality of haptic presentation information is stored in the haptic database DB. For example, haptic presentation information A and haptic presentation information B are illustrated in the haptic database DB of Figure 2 . Note that, although the haptic presentation information A and the haptic presentation information B are illustrated in the haptic database DB of Figure 2Two haptic presentation information are shown in the middle, but three or more haptic presentation information can be stored in the haptic database DB.

[0059] The haptic presentation information is information for realizing a haptic presented to the user. More specifically, the user terminal 30 generates, for example, a vibration corresponding to the haptic presentation information based on the haptic presentation information, thereby presenting a haptic to the user. For example, the haptic presentation information can be information representing a signal waveform of a vibration presented to the user. In addition, the haptic presentation information can be data representing one or more parameters extracted from a signal waveform of a vibration presented to the user.

[0060] One or more haptic meta-information is associated with these types of haptic presentation information. In Figure 2 In the haptic database DB shown, haptic meta-information is stored for each haptic meta-information type to which the haptic meta-information is classified. Figure 2 Two types of haptic meta-information, haptic meta-information type A and haptic meta-information type B, are shown. Note that the number of types of haptic meta-information stored in the haptic database DB can be one or three or more.

[0061] For example, Figure 2 In the middle, as haptic meta-information associated with the haptic presentation information A, haptic meta-information AA1 and haptic meta-information AA2 of the haptic meta-information type A, and haptic meta-information AB1 and haptic meta-information AB2 of the haptic meta-information type B are shown. In addition, with respect to the haptic presentation information B, each of the haptic meta-information type A and the haptic meta-information type B can also be associated. In addition, a plurality of haptic presentation information can include shared haptic meta-information.

[0062] Figure 2 Two haptic meta-information of the haptic meta-information type A are shown as haptic meta-information associated with the haptic presentation information A, but one or three haptic meta-information of the haptic meta-information type A can be associated with the haptic presentation information A. Note that, for other haptic meta-information types, one or more haptic meta-information can be associated with each type of haptic presentation information. In addition, haptic meta-information related to all haptic meta-information types can not necessarily be associated with haptic presentation information.

[0063] For example, when a device presents a haptic based on haptic presentation information representing a specific signal waveform, the haptic felt by the user differs depending on the shape, mechanism, etc. of the device that presents the haptic. Therefore, with respect to the haptic presentation information, it is difficult to present an appropriate haptic to different devices. Therefore, in order for a device to present an appropriate haptic, it is necessary to process the haptic presentation information into information corresponding to the device. Therefore, by processing the haptic presentation information using device-related information, the user can feel an appropriate haptic corresponding to the device.

[0064] In the haptic database DB according to the present embodiment, each haptic presentation information is associated with device-related information. Here, the device-related information is information corresponding to a device that presents a haptic based on the haptic presentation information. More specifically, the device-related information is information for converting the haptic presentation information into information corresponding to the device. For example, such a device can be provided in a haptic presentation unit described later, which can be included in the user terminal 30.

[0065] The data structure of the haptic database DB has been described. When the haptic presentation information is retrieved from the haptic database DB, haptic retrieval information is used. The haptic retrieval information is information that can be compared with the haptic meta-information, and is information related to an expectation of a haptic expected by a user. More specifically, the haptic retrieval information is information having contents listed in the list of the haptic meta-information type described later Figure 3 with reference to FIG. 6. In addition, the haptic retrieval information can be the haptic presentation information itself, or can be information obtained by combining the haptic presentation information and processing information. The processing information can be, for example, information for processing the haptic presentation information into information corresponding to a device so that the device presents a haptic. When the haptic presentation information is retrieved, for example, haptic meta-information identical or similar to the haptic retrieval information is found, and the haptic presentation information associated with the found haptic meta-information is retrieved. A haptic is presented to the user based on the retrieved haptic presentation information. Note that the method of retrieving the haptic presentation information described here is merely an example of a retrieval method, and the method of retrieving the haptic presentation information using the haptic database DB is not limited to such a retrieval method.

[0066] Next, specific examples of the above-described haptic meta-information types will be described in detail with reference to Figure 3 FIG. 6. Figure 3 is a list showing examples of the haptic meta-information types. Hereinafter, the haptic meta-information types shown in Figure 3 will be described in order from the top.

[0067] For example, the haptic meta-information type can be text. The haptic meta-information of the text can be, for example, text information such as "fluffy". The text information can be associated with, for example, haptic presentation information for realizing a fluffy haptic.

[0068] The haptic meta-information type can be a still image. The haptic meta-information of the still image can be, for example, image information such as a photo or a sticker. For example, the image information can be information representing a still image including a chick image. The image information of the chick can evoke a "fluffy" haptic of the chick's feathers. Thus, the image information can be associated with, for example, haptic presentation information for realizing a fluffy haptic. In addition, the haptic meta-information type can be a moving image other than a still image.

[0069] Further, the haptic meta-information type can include audio information about audio of the user. The audio information can be information about the speed, pitch, or emotion of the utterance of the user. For example, haptic presentation information stored in the haptic database is retrieved using haptic retrieval information input by the user. Here, the haptic retrieval information can be audio of the user. In this case, the information processing apparatus 20 can extract information about the speed, pitch, or emotion of the utterance from the input audio. The haptic retrieval information can be retrieved by comparing the extracted information with haptic meta-information that is audio information stored in the haptic database. For example, assume that the user inputs the content of the utterance "fluffy" as the haptic retrieval information. Here, the audio information can include information estimated from the speed or the like of the utterance, for example, information about the emotion of the user, in addition to the character information of "fluffy". Thus, by including the audio information in the haptic meta-information, it is possible to more appropriately provide information for realizing haptics in accordance with the emotion of the user or the like.

[0070] Further, the haptic meta-information type can be haptic motion. Here, the haptic motion of the user is an operation of the user to which haptics are presented. The haptic meta-information of the haptic motion of the user can be motion data, for example, a vector related to motion data representing the motion (movement) of the finger or the like of the user of a touch device or the like. In addition, the haptic meta-information of the haptic motion of the user can be a physical quantity such as the acceleration, speed, and displacement amount of the user, or a conversion thereof per unit time. The information about the haptic motion is information that can more directly express haptics desired by the user. Thus, when the haptic meta-information includes information about the haptic motion, it is possible to more appropriately provide information for realizing haptics desired by the user.

[0071] Further, the haptic meta-information type can be the motion of an object. More specifically, the haptic meta-information type can be the motion of an object (hereinafter, also referred to as a "presentation object") assumed to be presented to the user as haptics. The haptic meta-information related to the motion of the presentation object can be, for example, motion data such as a vector of the motion data of the presentation object. In addition, the haptic meta-information related to the motion of the presentation object can be the acceleration, speed, and displacement amount of the presentation object, or a physical quantity such as a conversion thereof per unit time.

[0072] Further, the haptic meta-information type can be the part (hereinafter, also referred to as a "contact part") of the user with which the device starts to make contact and present haptics. In general, the way in which the user feels haptics differs depending on the contact part. Thus, the user is presented with haptics corresponding to the haptic meta-information of the contact part, thereby more appropriately presenting haptics desired by the user.

[0073] Further, the haptic meta-information type can be the surface structure of the presentation object. The haptic meta-information about the surface structure of the presentation object can be, for example, information about the unevenness, hardness, or softness of the surface of the presentation object.

[0074] Further, the haptic meta-information type can be signal waveform information. The signal waveform information is information about a signal waveform representing a haptic presented to a user. The haptic meta-information related to the signal waveform information can be, for example, information such as a frequency characteristic of a signal waveform, a beat component, a ratio of a low frequency sound component, a ratio of a high frequency sound component, or attack decay sustain release (ASRD). Here, the ADSR is four parameters related to a characteristic shape of a sound waveform, and examples thereof can include parameters representing attack, decay, sustain after decay, and release.

[0075] Further, the haptic meta-information type can be a user characteristic of a user to whom a haptic is presented. The haptic meta-information of the user characteristic can be user information representing a user characteristic. For example, the user information can be, for example, information such as age or body size. When the haptic meta-information includes the user information, information for implementing a haptic corresponding to the user characteristic is appropriately provided to the user. Further, in a case where the haptic meta-information type is an age of a user to whom a haptic is presented, an age restriction can be applied according to a content of the haptic presentation information, a part of the user to whom the haptic is presented, and the like.

[0076] Further, the haptic meta-information type can be a type of a presentation part that is a part of a user to whom a haptic is presented. In general, a frequency of vibration that is easily felt varies according to a part to which a haptic is presented to a user. Therefore, by associating the haptic meta-information about a presented part with the haptic presentation information, it is possible to present a haptic that is adapted to the presented part.

[0077] Further, as the tactile presentation information, a waveform signal that is adapted to the presented portion can be stored in the tactile database DB. For example, only a waveform signal for presenting a tactile sensation to the palm can be stored in the tactile database DB as the tactile presentation information. In this case, for portions other than the palm, parameters that are adapted to the respective portions are stored in the tactile database DB as the tactile presentation information. In the case where a tactile sensation is presented to a portion other than the palm, a waveform signal for presenting a tactile sensation to the palm is processed based on the parameters that are adapted to the portion where the tactile sensation is presented. A tactile sensation is presented to the user based on the processed information. More specifically, a frequency difference from the frequency of the palm can be stored in the tactile database DB as the parameters for the portions other than the palm. When a tactile sensation is presented to the user, the frequency of the waveform signal for presenting a tactile sensation to the palm is corrected to a desired frequency by such a difference. Note that the basic signal waveform is not limited to the signal waveform for presenting a tactile sensation to the palm, and can be based on a signal waveform related to another portion. Therefore, the tactile database DB does not need to store a waveform signal corresponding to each portion where a tactile sensation is presented. Therefore, the tactile database DB only needs to store information of parameters that are implemented with a smaller amount of data than the information of the waveform signal, and thus the tactile database DB can be implemented with a smaller amount of data. Note that the processing of the waveform signal or the like is performed by, for example, the processor 252 described later.

[0078] Further, the tactile meta-information type can be an information type regarding a frequency of a signal waveform implemented by the tactile presentation information. For example, the tactile meta-information type can be monotonicity, sharpness, or the like of a signal waveform. Here, the monotonicity is a degree of change in frequency per unit time or a degree of change in amplitude per unit time in a signal waveform of a presented tactile sensation. In addition, the tactile meta-information type can be the sharpness. The sharpness is, for example, roughness or sharpness. In general, when more types of frequencies are included in a waveform signal per unit time that represents a tactile sensation, such a tactile sensation is more "rough". On the other hand, when fewer types of frequencies are included in a waveform signal per unit time that represents a tactile sensation, such a tactile sensation is more "sharp".

[0079] Further, the tactile meta-information type can be a continuous presentation amplification factor. The tactile meta-information regarding the continuous presentation amplification factor is, for example, a parameter for enhancing the intensity of a presented tactile sensation over time according to the content of the presented tactile sensation or the portion where the tactile sensation is presented. In general, when a tactile sensation is continuously presented to the same portion of the body, a person becomes accustomed to the feeling (or numbness) of the portion where the tactile sensation is presented. Therefore, when the same intensity of stimulation is presented, the person feels that the stimulation is weakened at the portion where the tactile sensation is presented. The intensity of the presented tactile sensation is increased based on the continuous presentation amplification factor, so that the user can continue to feel the same tactile sensation at the portion where the tactile sensation is presented without becoming accustomed or the like.

[0080] Further, as will be described later, the tactile presentation information can be included in content stored in the server 10 using an SNS or the like. The tactile presentation information included in such content can be stored in the tactile database DB. In this case, the tactile presentation information can include information about a creator of such content. More specifically, the tactile presentation information can include a profile of an information provider who provides the tactile presentation information. As a result, since the tactile presentation information is retrieved based on the profile of the information provider, the user can be presented with the tactile that the creator of the content intended more appropriately.

[0081] Further, the tactile meta-information type can be information for retrieval. The information for retrieval is information that can be used to retrieve the tactile presentation information. The information for retrieval can be generated based on artificial intelligence (AI) technology. The information for retrieval can be generated based on, for example, various known machine learning algorithms. By using the information for retrieval as the tactile meta-information, for example, even information that is not stored in the server 10 or the like can be used as the tactile meta-information.

[0082] The tactile meta-information type has been described with reference to Figure 3 Note that the information about the signal waveform, monotonicity, or articulation can be a parameter included in the tactile presentation information. In addition, the tactile meta-information type is not limited to the examples described with reference to Figure 3 The tactile meta-information type can be appropriately deleted from or added to the list shown in Figure 3 In addition, the tactile retrieval information includes information about content corresponding to the above-described tactile meta-information type. Therefore, the tactile presentation information can be more specific information of the tactile that the user desires.

[0083] <<1.2. Configuration and Functions of Information Processing Apparatus>>

[0084] Next, the information processing apparatus 20 according to the embodiment of the present disclosure will be described with reference to Figure 4 Figure 4 ​is a functional block diagram showing a configuration of the information processing apparatus 20 according to the embodiment of the present disclosure. The information processing apparatus 20 according to the embodiment of the present disclosure has a function of retrieving the haptic presentation information from the haptic database based on the haptic retrieval information for retrieving the haptic presentation information in order to realize the haptics presented to the user. In addition, the information processing apparatus 20 has a function of outputting information related to the retrieved haptic presentation information. Furthermore, the information processing apparatus 20 has a function of updating a relationship between at least two or more of the plurality of haptic presentation information or the plurality of haptic meta-information included in the haptic database. The function of the information processing apparatus 20 is realized by cooperation of the communication control unit 210, the communication unit 215, the storage unit 220, the update unit 230, the retrieval unit 240, the processing unit 250, and the output unit 255 included in the information processing apparatus 20. Hereinafter, each functional unit included in the information processing apparatus 20 will be described.

[0085] The communication control unit 210 has a function of controlling communication performed between the information processing apparatus 20 and various devices connected to the network 40. More specifically, the communication control unit 210 controls the communication unit 215 to control communication between the information processing apparatus 20 and various devices connected to the network 40. For example, the communication unit 215 receives information stored in the server 10 and transmits the information to the communication control unit 210. In addition, the communication unit 215 transmits the haptic retrieval information transmitted from the user terminal 30 to the communication control unit 210. Furthermore, the communication unit 215 transmits the haptic presentation information retrieved from the haptic database to the user terminal 30 via the network 40.

[0086] The storage unit 220 stores various types of information, such as information transmitted to the information processing apparatus 20 or information generated in the information processing apparatus 20. For example, the storage unit 220 stores the haptic database. If necessary, the haptic database is used for retrieval by the retrieval unit 240. In addition, the haptic database is updated by the update unit 230 if necessary. Note that the storage unit 220 can also store the haptic retrieval information transmitted to the information processing apparatus 20 from the user terminal 30 or the like. Such haptic retrieval information is used for retrieval of the haptic presentation information, for example, by the retrieval unit 240.

[0087] The update unit 230 has a function of updating a relationship between at least two or more of the plurality of haptic presentation information or the plurality of haptic meta-information included in the haptic database stored in the storage unit 220. The information processing apparatus 20 retrieves the haptic presentation information based on the information. Therefore, by updating the relationship between the information, the information processing apparatus 20 can more accurately retrieve the haptic presentation information. As a result, information necessary to realize the haptics is more appropriately provided to the user.

[0088] Reference will be made to Figure 5An example of updating the haptic database by the update unit 230 is described. Assume Figure 5 The haptic database 221 shown in the center of FIG. 2 is stored in the storage unit 220. Various types of information such as haptic presentation information, image information (e.g., a photo, a sticker, etc.), audio information, and text information are transmitted to the information processing apparatus 20 from various external devices such as the server 10 via the network 40. These types of information are transmitted from the communication control unit 210 to the update unit 230. The update unit 230 extracts haptic-related information related to haptics from the transmitted information, and stores the haptic-related information in the haptic database 221.

[0089] In Figure 5 the example shown in FIG. 2, in the haptic database 221, haptic-related information is extracted from the first information 260 and the second information 270, and stored in the haptic database 221. The first information 260 is information in which first image information 261 including a chick image 262, first text information of "fluffy", and first haptic presentation information 263 are integrated. The first haptic presentation information 263 is haptic presentation information for realizing the haptics of the chicken body hair included in the first image information 261. On the other hand, the second information 270 is information in which second image information 271 including a teddy bear image 272, second text information of "fluffy", and second haptic presentation information 273 are integrated. The second haptic presentation information 273 is haptic presentation information for realizing the haptics of the teddy bear.

[0090] The update unit 230 extracts the first image information 261, the second image information 271, the first text information, the second text information, the first haptic presentation information 263, and the second haptic presentation information 273, which are included in the first information 260 and the second information 270, and stores these in the haptic database 221. At this time, the update unit 230 stores the first haptic presentation information 263 included in the first information 260 in the haptic database 221 in association with the first image information 261 and the first text information. Further, the update unit 230 stores the second haptic presentation information 273 included in the second information 270 in the haptic database 221 in association with the second image information 271 and the second text information. The image information or the text information is associated with the haptic presentation information as haptic meta-information.

[0091] Here, an example in which the update unit 230 updates the haptic database based on a relationship between a plurality of haptic meta-information stored in the haptic database 221 will be described. More specifically, the update unit 230 updates a haptic similarity between first haptic presentation information associated with first haptic meta-information and second haptic presentation information associated with second haptic meta-information based on a similarity between the first haptic meta-information and the second haptic meta-information. For example, in some cases, there is a positive correlation between the similarity and the haptic similarity. That is, when the similarity is high, the haptic similarity can also be high. In the present embodiment, when a certain haptic presentation information is retrieved, haptic presentation information similar to the haptic presentation information can also be retrieved. Therefore, by updating the haptic similarity based on the similarity, information for realizing a haptic desired by the user can be more appropriately provided. In Figure 5 In the example illustrated, the update unit 230 increases the haptic similarity between the first haptic presentation information 263 and the second haptic presentation information 273 when the first haptic meta-information and the second haptic meta-information are similar to each other. In the example illustrated, the update unit 230 decreases the haptic similarity between the first haptic presentation information 263 and the second haptic presentation information 273 when the first haptic meta-information and the second haptic meta-information are not similar to each other. Figure 5 In the example illustrated, an example in which the first haptic meta-information and the second haptic meta-information are text information will be described.

[0092] As described above, the haptic database 221 stores the first text information and the second text information that are "fluffy". The update unit 230 determines that the first text information and the second text information are the same. Here, "match" is included in the expression "similar". Therefore, the update unit 230 increases the haptic similarity between the first haptic presentation information 263 associated with the first text information and the second haptic presentation information 273 associated with the second text information.

[0093] Here, an effect obtained by updating the haptic database as described above will be described. As described above, haptic presentation information is retrieved from the haptic database. When a certain haptic presentation information is retrieved, haptic presentation information similar to the retrieved haptic presentation information can also be retrieved. For example, haptic presentation information similar to a certain retrieved haptic presentation information can also be retrieved. In the example described above, the similarity between the first haptic presentation information 263 and the second haptic presentation information 273 is increased. As a result, in a case where the retrieval unit 240 described later determines that the first haptic presentation information 263 and the second haptic presentation information 273 are similar to each other, the second haptic presentation information 273 is also retrieved when the first haptic presentation information 263 is retrieved. In some cases, the second haptic presentation information 273 can be haptic presentation information that can realize a haptic more desired by the user than the first haptic presentation information 263. Therefore, as described above, by correcting the similarity between the first haptic presentation information and the second haptic presentation information according to the similarity between the first haptic meta-information and the second haptic meta-information, a haptic more desired by the user can be more appropriately presented.

[0094] Next, another specific example of an example in which the update unit 230 associates the haptic presentation information stored in the haptic database with the haptic meta-information (here, character information) will be described. For example, the update unit 230 can associate the haptic presentation information and the haptic meta-information by utilizing the big data stored in the server 10. For example, assume that the information indicating that the evaluation note such as "rough" or "wet" is made on the sand, which is a product purchased by the user, is included in the above-described big data. In this case, for example, assume that based on the transmission history of the haptic presentation information to the user terminal 30, certain haptic presentation information in the haptic database is associated with the haptic meta-information of "rough". At this time, the update unit 230 can update the haptic database by associating the character information of "sand" with the haptic presentation information as the haptic meta-information.

[0095] Further, the update unit 230 can update the haptic similarity between a plurality of haptic presentation information according to the number of times of use (that is, the transmission to the user terminal 30 or the like) of the haptic presentation information. Specifically, when a plurality of haptic presentation information is used at a similar rate based on certain haptic search information, the update unit 230 increases the haptic similarity between these pieces of haptic presentation information. For example, when certain haptic presentation information and haptic presentation information different from the haptic presentation information are transmitted to the user terminal 30 the same number of times based on the haptic search information of "rough", the update unit 230 can increase the haptic similarity between the two pieces of haptic presentation information. In this way, the update unit 230 can update the haptic database based on the number of times of actual use of the haptic presentation information or the like. Therefore, the haptic database is a database that matches the usage of the haptic presentation information by the user. As a result, the information for realizing the haptic is more appropriately provided to the user. Here, the update unit 230 increases the haptic similarity between the haptic presentation information associated with two pieces of text information based on the similarity between the two pieces of text information. Not limited to the text information, the update unit 230 can update the haptic similarity between the haptic presentation information associated with two pieces of image information based on the similarity between the two pieces of image information.

[0096] Further, the update unit 230 can update the haptic database based on a search result of the search unit 240, which will be described later. Thus, the haptic database is updated to a more suitable haptic database according to the past search result. As a result, the accuracy of the search of the haptic presentation information is improved, and the information for realizing the haptics is more appropriately provided to the user. For example, when the search unit 240 retrieves a plurality of haptic presentation information, the update unit 230 can update the haptic database by increasing the haptic similarity between the plurality of haptic presentation information. When a plurality of haptic presentation information is retrieved based on a certain haptic search information, there is a possibility that these haptic presentation information can realize similar haptics. Thus, by increasing the haptic similarity between these haptic presentation information, the haptic presentation information for realizing similar haptics can be easily searched. As a result, since the user can select the desired haptic presentation information from the similar haptic presentation information, the information for realizing the haptics can be more appropriately provided to the user.

[0097] Further, the update unit 230 can update the haptic database based on a frequency at which the haptic presentation information has been adopted (adoption frequency) and the haptic retrieval information used to retrieve the adopted haptic presentation information. Here, to adopt the haptic presentation information can mean that the retrieved haptic presentation information is used to realize the haptics actually presented to the user. For example, the update unit 230 can update the probability of retrieving the haptic presentation information based on the adoption frequency at which the haptic presentation information has been adopted and the haptic retrieval information used to retrieve the adopted haptic presentation information. Here, a case in which a plurality of haptic presentation information is retrieved based on a certain haptic retrieval information will be described as an example. In this case, the update unit 230 can update the haptic database such that, among the plurality of haptic presentation information, the haptic presentation information having a higher adoption frequency is retrieved with a higher probability based on the certain haptic retrieval information. Further, the update unit 230 can update the haptic database such that the haptic presentation information having a lower adoption frequency is retrieved with a lower probability based on the certain haptic retrieval information. In the present embodiment, for example, when the user determines that the haptic presentation information is inappropriate, even the retrieved haptic presentation information can not be used to realize the haptics. Therefore, it is considered that, by the haptic presentation information having a higher adoption frequency, the haptics desired by the user can be realized more appropriately. Therefore, the update unit 230 updates the haptic database based on the adoption frequency of the haptic presentation information and the haptic retrieval information used to retrieve the adopted haptic presentation information, so that the information used to realize the haptics can be provided to the user more appropriately. In addition, the update unit 230 can update the haptic database with respect to detection of haptic presentation information similar to the haptic presentation information targeted by the adoption frequency based on the adoption frequency of the haptic presentation information and the haptic retrieval information used to retrieve the adopted haptic presentation information. For example, the update unit 230 can update the haptic database such that, among the plurality of retrieved haptic presentation information, the haptic presentation information similar to the haptic presentation information having a high adoption frequency is also retrieved with a higher probability based on the haptic retrieval information used to retrieve the haptic presentation information having a high adoption frequency.

[0098] Next, another example in which the update unit 230 updates the haptic database will be described with reference to Figure 6 and Figure 7 Figure 6 and Figure 7 are diagrams for describing an example in which the update unit 230 updates the haptic database based on a relationship between two haptic meta information groups. Here, the haptic meta information group is a collection of a plurality of haptic meta information.

[0099] First, an example in which the update unit 230 updates the haptic database will be described with reference to Figure 6 Figure 6 ​​A first haptic meta-information group 280 that is a first set of a plurality of haptic meta-information stored in the haptic database, and a second haptic meta-information group 281 that is a second set of a plurality of haptic meta-information stored in the haptic database are shown. A third haptic presentation information 283 and a fourth haptic presentation information 284 are associated with the first haptic meta-information group 280 and the second haptic meta-information group 281, respectively. In this case, the first haptic meta-information group 280 and the second haptic meta-information group 281 have a shared haptic meta-information group 282. In this case, the update unit 230 can update the haptic database by associating the third haptic presentation information 283 associated with the first haptic meta-information group 280 but not associated with the second haptic meta-information group 281 with the second haptic meta-information group 281. The third haptic presentation information 283 associated with the first haptic meta-information group 280 can be, for example, haptic presentation information for realizing a haptic as evoked by the second haptic meta-information group 281. Thus, by updating the haptic database in this way, the user retrieves more appropriate haptic presentation information.

[0100] As described above, the first haptic meta-information group 280 and the second haptic meta-information group 281 do not necessarily have the shared haptic meta-information group 282. As Figure 7 shown, even when the third haptic meta-information group 285 and the fourth haptic meta-information group 286 do not have a shared haptic meta-information group, the two haptic meta-information groups can have a first similar haptic meta-information group 287 or a second similar haptic meta-information group 288 that are similar to each other. In this case, the update unit 230 can also update the haptic database by associating haptic presentation information 289 associated with the third haptic meta-information group 285 with the fourth haptic meta-information group 286. Note that the haptic presentation information 289 associated with the third haptic meta-information group 285 and the haptic presentation information 290 associated with the fourth haptic meta-information group 286 are different haptic presentation information.

[0101] Next, returning to Figure 4 the description will be made of the retrieval unit 240 included in the information processing apparatus 20. The retrieval unit 240 has a function of retrieving haptic presentation information from the haptic database using haptic retrieval information for retrieving haptic presentation information. Here, the retrieval unit 240 uses, for example, haptic retrieval information transmitted to the information processing apparatus 20 from the user terminal 30 or the like via the network 40.

[0102] Note that although the retrieval unit 240 can retrieve a plurality of haptic presentation information from the haptic database, when the number of haptic presentation information to be retrieved is large, the total data amount of the haptic presentation information to be retrieved can be too large. Thus, an upper limit of the number of haptic presentation information to be retrieved by the retrieval unit 240 can be set. The upper limit can be, for example, about 10.

[0103] Here, the tactile search information is information that can be compared with the tactile meta-information. The search unit 240 searches for the tactile presentation information based on a relationship between the tactile search information and the tactile meta-information stored in the tactile database. For example, the search unit 240 determines a degree of similarity between the tactile search information and the tactile meta-information. When the tactile meta-information matching or similar to the tactile search information is found, the search unit 240 finds the tactile presentation information associated with the searched tactile meta-information. The searched tactile presentation information is sent to the processing unit 250 or the output unit 255. In addition, the search result of the search unit 240 is sent to the update unit 230. The search result will be described later with reference to FIG. 6. Figure 10 An example in which the search unit 240 searches for the tactile presentation information from the tactile database will be described.

[0104] The search unit 240 sends the searched tactile presentation information to the processing unit 250 or the output unit 255. The search unit 240 can send an ID corresponding to the searched tactile presentation information to the output unit 255. The ID is sent to the user terminal 30 via the network 40. The user terminal 30 can acquire the tactile presentation information by inquiring a mirror server of the information processing apparatus 20, for example, existing in the vicinity of the user terminal 30, based on the sent ID. Further, the user terminal 30 can acquire the tactile presentation information by inquiring another user terminal or the like. In this case, for the communication between the user terminal 30 and another terminal, peer-to-peer communication, Bluetooth (registered trademark) connection, or the like can be used without using the network 40.

[0105] Further, the user terminal 30 can store a similar tactile database to the tactile database stored in the information processing apparatus 20. In this case, the storage unit 220 can store the tactile database and the similar tactile database. The search unit 240 searches for the similar tactile presentation information to the tactile presentation information searched from the tactile database from the similar tactile database. The search unit 240 sends an ID of the similar tactile presentation information searched from the similar tactile database and a difference between the similar tactile presentation information and the tactile presentation information searched from the tactile database to the output unit 255. The ID and the difference are sent to the user terminal 30. The user terminal 30 reads the similar tactile presentation information based on the sent ID. Further, the user terminal 30 adds the read similar tactile presentation information and the difference to generate the target tactile presentation information. In this case, since the information processing apparatus 20 only needs to send the ID and the difference to the user terminal 30, the amount of data to be sent to the user terminal 30 can be reduced.

[0106] The processing unit 250 has a function of performing various types of processing based on the search result of the search unit 240. More specifically, the processing unit 250 has a function of generating information based on the haptic search information searched by the search unit 240, and a function of generating information indicating the search result. The processing unit 250 transmits the processing result to the output unit 255. In addition, the processing unit 250 transmits the processing result to the update unit 230 if necessary.

[0107] The processing unit 250 will be described in more detail with reference to Figure 8 The processing unit 250 will be described in more detail with reference to Figure 8 is a functional block diagram showing the configuration of the processing unit 250. As Figure 8 indicated, the processing unit 250 includes an extraction unit 251, a processor 252, and an image creation unit 253.

[0108] The extraction unit 251 has a function of extracting feature information indicating a feature of the haptic presentation information searched by the search unit 240. The extracted feature information is transmitted to the processor 252. The data amount of the extracted feature information can be smaller than that of the haptic presentation information to be extracted. The extracted feature information is transmitted to the communication control unit 210, and to the user terminal 30. Based on the transmitted feature information, a haptic is presented to the user by the user terminal 30. In this way, by extracting the feature information, the data amount required to present the haptic can be reduced.

[0109] Note that the extracted feature information can be extracted based on the haptic search information corresponding to the searched haptic presentation information. The haptic search information includes information on a haptic desired by the user. Therefore, the feature information extracted based on the haptic search information can be information matching the haptic desired by the user. Thus, by extracting the feature information based on the haptic search information, information for realizing the haptic desired by the user can be more appropriately provided.

[0110] Further, when the haptic presented based on the searched haptic presentation information is a waveform having a periodicity, the extraction unit 251 can extract information indicating one period of the waveform as the feature information. For example, the extraction unit 251 can calculate an autocorrelation function of the haptic presentation information, and extract information of one period. In addition, the extraction unit 251 can extract information indicating one period based on the haptic meta-information associated with the searched haptic presentation information. The extraction unit 251 transmits the extracted information of one period and information indicating how many one periods are included in the haptic presentation information to the communication control unit 210. These transmitted information are transmitted to the user terminal 30, and used for realizing the haptic. In this way, by extracting the information of one period from the haptic presentation information, the data amount transmitted from the information processing apparatus 20 to the user terminal 30 can be reduced.

[0111] Further, the extracted feature information can be extracted based on feeling information about a user's feeling included in the tactile search information. The feeling information can be, for example, information about a feeling such as "happy" or "angry". For example, in a case where the tactile search information is image information, the feeling information can also be acquired from the image information. For example, in a case where the tactile search information is image information including a smiling face image of a person, the feeling information of "happy" can be acquired from the image of the smiling face image using various known image recognition techniques.

[0112] Here, an example of extracting feature information from tactile presentation information based on feeling information acquired from tactile search information will be described with reference to Figure 9 and Figure 10 Figure 9 is a graph showing a signal waveform of a vibration as an example of the searched tactile presentation information. In addition, Figure 10 is a graph showing Figure 9 a spectrum of the signal waveform shown in

[0113] Figure 9 A signal waveform 500 of a vibration represented by the tactile search information is shown, in which a horizontal axis is time and a vertical axis is amplitude. Figure 10 A spectrum 510 of the signal waveform 500 shown in Figure 9 is shown, in which a horizontal axis is frequency f and a vertical axis is intensity. As shown in Figure 10 , the signal waveform 500 has a component with a frequency of 0 to f2.

[0114] In general, the feeling of "happy" is expressed by a vibration stimulus with a higher frequency than other feelings. Therefore, when a user is presented with a tactile sensation caused by a vibration stimulus with a higher frequency, the user can recall the feeling of "happy" through the stimulus. Therefore, when information about the "happy" feeling is included in the tactile search information, the extraction unit 251 can extract information about a signal waveform with a higher frequency from the signal waveform and transmit the extracted information to the communication control unit 210. For example, the extraction unit 251 can extract a frequency component 512 with a frequency of f1 or higher shown by the hatched line shown in Figure 10 , and transmit the frequency component 512 to the communication control unit 210. In addition, the extraction unit 251 can perform processing such as frequency refinement or low resolution on a frequency component 511 with a frequency lower than f1, and transmit the processed frequency component to the communication control unit 210.

[0115] Further, the feeling of "angry" is expressed by a vibration stimulus with a lower frequency than other feelings. Therefore, when a user is presented with a tactile sensation caused by a vibration stimulus with a lower frequency, the user can recall the feeling of "angry" through the stimulus. For example, the extraction unit 251 can extract a frequency component with a frequency lower than Figure 10 ​The extraction unit 251 extracts a frequency component 511 of the frequency of f1 shown in FIG. 6, and transmits the frequency component 511 to the communication control unit 210. On the other hand, the extraction unit 251 can perform processing such as frequency refinement or low resolution on a frequency component 512 having a frequency of f1 or more, and transmit the processed frequency component to the communication control unit 210. As described above, the feature information is extracted from the tactile presentation information on the basis of the user's emotional information, whereby the user can be more appropriately presented with a tactile sensation that matches the emotion.

[0116] Here, the processing when the extraction unit 251 transmits the feature information to the output unit 255 will be supplemented. The feature information extracted from the tactile presentation information can be the same as the tactile meta-information associated with the tactile presentation information. In this case, the extraction unit 251 can not transmit the feature information to the output unit 255. In addition, when all of the extracted feature information is covered by the tactile meta-information associated with the tactile presentation information to be extracted, the extraction unit 251 can not transmit all of the feature information to the output unit 255. In this case, the extraction unit 251 transmits the tactile meta-information associated with the tactile presentation information to the output unit 255. The transmitted tactile meta-information is output to the user terminal 30 or the like via the communication control unit 210.

[0117] The processor 252 has a function of processing the tactile presentation information retrieved by the retrieval unit 240. For example, when the tactile presentation information is not represented by a signal waveform itself but by a parameter or the like, the processor 252 generates information representing the signal waveform on the basis of the parameter or the like. In addition, when it is necessary to process the tactile presentation information into information corresponding to a device that presents a tactile sensation to the user, the processor 252 processes the tactile presentation information into information corresponding to the device. The processor 252 can process the tactile presentation information into information corresponding to a device on the basis of device-related information stored in the tactile database. In addition, the processor 252 can summarize the tactile presentation information. More specifically, the processor 252 can summarize the tactile presentation information by performing processing of reducing the resolution of a signal waveform represented by the tactile presentation information or the like. The summarized tactile presentation information can be used, for example, to confirm whether a tactile sensation based on the retrieved tactile presentation information is a tactile sensation desired by the user. Furthermore, the processor 252 can process the tactile presentation information in accordance with a part of the user at which a tactile sensation is presented.

[0118] The image creation unit 253 creates image data for displaying an image on the user terminal 30 or the like. For example, the image creation unit 253 creates image data for causing the user terminal 30 to display a result of the retrieval by the retrieval unit 240. Specifically, the image creation unit 253 can create image data for causing the user terminal 30 to display a number, content, or the like of the retrieved haptic presentation information. In addition, when no haptic presentation information is retrieved, the image creation unit 253 can create image data for displaying the fact that no haptic presentation information is retrieved.

[0119] The output unit 255 has a function of outputting various types of information. For example, information generated by the processing unit 250 or haptic presentation information transmitted from the retrieval unit 240 is output to the communication control unit 210 as information related to the haptic presentation information. The information related to the haptic presentation information transmitted to the communication control unit 210 is transmitted to the user terminal 30 via the network 40. As a result, the information related to the haptic presentation information is provided to the user.

[0120] <<1.3. Configuration and functions of the user terminal>>

[0121] Next, the user terminal 30 will be described with reference to Figure 11 Figure 11 is a functional block diagram showing the configuration of the user terminal 30. The user terminal 30 has a function of acquiring haptic retrieval information and transmitting the acquired haptic retrieval information to the information processing apparatus 20. Further, the user terminal 30 has a function of presenting a haptic to a user based on haptic presentation information retrieved by the information processing apparatus 20. Further, the user terminal 30 has a function of displaying a result of the retrieval of the haptic presentation information acquired by the information processing apparatus 20 from the haptic database. The functions of the user terminal 30 are realized by an input unit 310, a communication control unit 320, a communication unit 325, a haptic presentation unit 330, a storage unit 340, a display control unit 350, and a display unit 355 included in the user terminal 30.

[0122] The input unit 310 has a function of acquiring various types of information according to an operation of a user. The input unit 310 is realized by, for example, various known input devices such as a mouse and a keyboard. The input unit 310 acquires, for example, haptic retrieval information by an operation of a user. The haptic retrieval information can be, for example, information such as text information, image information, or audio information. The input unit 310 transmits the acquired information to the communication control unit 320.

[0123] ​As described above, the information processing apparatus 20 can retrieve a plurality of haptic presentation information, and information related to these haptic presentation information can be transmitted to the user terminal 30. In this case, the display unit 355 described later can display information indicating, for example, the contents of the plurality of haptic presentation information that have been retrieved. The user can refer to the contents of the plurality of haptic presentation information displayed on the display unit 355, select a haptic presentation information for realizing a desired haptics, and input information indicating the selected haptic presentation information to the input unit 310. The input unit 310 can transmit information indicating the haptic presentation information input by the user to the information processing apparatus 20 via the communication control unit 320, the communication unit 325, and the network 40. As a result, the information processing apparatus 20 can recognize the result of the user selecting the haptic presentation information.

[0124] The communication control unit 320 has a function of controlling transmission and reception of information between the user terminal 30 and another device through the communication unit 325. For example, the communication control unit 320 transmits various types of information transmitted from the input unit 310 to the communication unit 325 to transmit such information to the information processing apparatus 20 or the like via the network 40.

[0125] The communication unit 325 has a function of transmitting and receiving various types of information. For example, the communication unit 325 has a function of transmitting various types of information acquired by the input unit 310 to the information processing apparatus 20 or the like via the network 40. In addition, the communication unit 325 receives haptic presentation information acquired by the information processing apparatus 20 via the network 40. In addition, the communication unit 325 can also receive a retrieval result of the haptic presentation information acquired by the information processing apparatus 20. The information received by the communication unit 325 via the network 40 is transmitted to the communication control unit 320.

[0126] The tactile presentation unit 330 has a function of presenting a tactile sensation to the user based on information related to the tactile presentation information output from the information processing apparatus 20. For example, the tactile presentation unit 330 can also have a shape of a jacket or the like that can be worn by the user. In this case, for example, the tactile presentation unit 330 can be provided with a device that generates a vibration at a position such as the shoulder or the chest of the user. The tactile presentation unit 330 presents a tactile sensation to the user by causing the device included in the tactile presentation unit 330 to vibrate based on the information related to the tactile presentation information. When the information related to the tactile presentation information is information indicating a vibration waveform of the tactile sensation, the tactile presentation unit 330 presents a tactile sensation to the user using the information. In addition, if necessary, the tactile presentation unit 330 can convert the information related to the tactile presentation information into signal waveform information corresponding to the device included in the tactile presentation unit 330. The tactile presentation unit 330 presents a tactile sensation to the user based on the converted signal waveform information. As a result, it is possible to more appropriately present a tactile sensation to the user in accordance with the shape, mechanism, or the like of the device. The tactile presentation unit 330 can acquire information for conversion into signal waveform information corresponding to the device from the storage unit 340. In addition, when the information related to the tactile presentation information is a parameter or the like that characterizes the signal waveform information, the tactile presentation unit 330 can generate signal waveform information based on the parameter or the like and present a tactile sensation.

[0127] Further, when the tactile presentation unit 330 includes a plurality of devices for presenting a tactile sensation, the tactile presentation unit 330 can control presentation of a tactile sensation by the plurality of devices in a time series. As a result, it is possible to present a tactile sensation to the user through a complex perception. For example, the tactile presentation unit 330 can control presentation of a tactile sensation by the plurality of devices based on information about a plurality of tactile presentation information. For example, when the plurality of devices are arranged at positions along the right shoulder to the left abdomen of the user, the tactile presentation unit 330 can control the plurality of devices to present a tactile sensation of a tilt tear from the right shoulder to the left abdomen to the user.

[0128] The storage unit 340 stores various types of information such as information acquired by the user terminal 30 or information necessary for processing by the user terminal 30. For example, the storage unit 340 stores information related to the searched tactile presentation information transmitted from the information processing apparatus 20, a search result, or the like. In addition, the storage unit 340 stores information necessary for the tactile presentation unit 330 to present a tactile sensation. For example, the storage unit 340 stores information for the tactile presentation unit 330 to convert the tactile presentation information into information corresponding to the device. In addition, the storage unit 340 can store a database similar to the tactile database stored in the information processing apparatus 20. If necessary, the communication control unit 320, the tactile presentation unit 330, or the display control unit 350 refers to the information stored in the storage unit 340.

[0129] The display control unit 350 has a function of controlling display of various types of information of the display unit 355 based on image data created by the information processing apparatus 20. For example, the display control unit 350 acquires image data related to a search result of haptic presentation information of the information processing apparatus 20 from the communication control unit 320, transmits the image data to the display unit 355, and causes the display unit 355 to display the search result. In addition, if necessary, the display control unit 350 can process acquired image data and transmit the processed image data to the display unit 355. For example, the display control unit 350 can acquire image data indicating that a plurality of haptic presentation information has been searched. In this case, the display control unit 350 can process the image data so that information indicating the plurality of haptic presentation information is displayed in descending order of the number of uses by the user from the top of the screen of the display unit 355 in order. As a result, the user can recognize haptic presentation information that has been used many times with reference to the display unit 355. It is estimated that haptic presentation information that has been used many times can more appropriately realize a haptic that the user desires. Therefore, the content of the haptic presentation information is displayed on the display unit 355 in descending order of the number of uses, thereby presenting an appropriate haptic to the user.

[0130] The display unit 355 has a function of displaying various types of information as an image to the user. The display unit 355 is realized by various known image display devices such as a liquid crystal display. For example, the display unit 355 can display an image indicating the content of the searched haptic presentation information. More specifically, the display unit 355 can display an image that evokes a haptic presented based on the searched haptic presentation information. The user can recall the presented haptic by referring to such an image. In addition, when the information processing apparatus 20 searches for a plurality of haptic presentation information, the display unit 355 can display an image that evokes each haptic corresponding to the plurality of haptic presentation information. The user can select an image that evokes a haptic most desired by the user from among a plurality of images displayed on the display unit 355, and input information about the haptic corresponding to the selected image to the input unit 310. In this case, the haptic presentation unit 330 can present the selected haptic to the user.

[0131] Next, a state in which haptic presentation information is searched for will be described with reference to Figure 12 The state in which haptic presentation information is searched for will be described. Figure 12 is a diagram illustrating the state in which haptic presentation information is searched for.

[0132] Figure 12 The center of FIG. 26 illustrates a haptic database 223 stored in the storage unit 220 of the information processing apparatus 20. It is assumed that the haptic database 223 stores haptic-related information acquired from the first information 260 described with reference to Figure 5 FIG. 26. More specifically, it is assumed that the first information 260 includes Figure 5The first image information 261 of the illustrated chick image 262, the first text information "fluffy", and the first tactile presentation information 263 are stored in the tactile database 223.

[0133] Here, the user inputs third information 291 to the input unit 310 of the user terminal 30. The third information 291 includes third image information 292 having a chick image 293. The third image information 292 is transmitted from the user terminal 30 to the information processing apparatus 20 as tactile search information. According to the transmission, a signal requesting search of tactile presentation information is transmitted from the user terminal 30 to the information processing apparatus 20. The information processing apparatus 20 searches the tactile database 223 using the third image information 292. Here, the chick image 262 included in the first image information 261 is similar to the chick image 293 included in the third image information 292. The information processing apparatus 20 determines that the first image information 261 stored in the tactile database 223 is similar to the third image information 292 transmitted from the user terminal 30. The information processing apparatus 20 searches the first tactile presentation information 263 associated with the first image information 261, and transmits the first tactile presentation information 263 to the user terminal 30. The tactile presentation unit 330 can present a tactile based on the transmitted first tactile presentation information 263. In addition, the first tactile presentation information 263 received by the user terminal 30 is stored in the storage unit 340 of the user terminal 30 together with the third image information 292. As a result, the user terminal 30 can transmit the third image information 292 together with the first tactile presentation information 263 to various servers connected to a network, for example.

[0134] In general, there is a time lag between when the user terminal 30 requests the information processing apparatus 20 to search for haptic presentation information and when the user terminal 30 presents haptics. For example, when the user is viewing a moving image displayed on the display unit 355, the user can desire that the haptic presentation unit 330 present haptics to the moving image in real time. In this case, for example, an analysis unit (not shown) included in the user terminal 30 analyzes the moving image displayed on the display unit 355, and requests the information processing apparatus 20 to search for haptic presentation information based on the analysis result. For example, when the display unit 355 displays a moving image showing a state in which a horse image "clip-clop" is running, the analysis unit analyzes that the image showing that the horse is running is included in the moving image. Further, the user terminal 30 sends information indicating a state in which the horse image "clip-clop" is running to the information processing apparatus 20 as haptic search information based on such an analysis result, and requests search for haptic presentation information. However, due to the occurrence of the time lag, it can be difficult to present haptics to the haptic presentation unit 330 in real time if waiting for the information processing apparatus 20 to search for haptic presentation information. Therefore, based on the haptic presentation information stored in the user terminal 30, a temporary haptic is presented to the user in this time lag, so that it is possible to prevent the user from feeling the time lag.

[0135] Reference will be made to Figure 13 Examples in which the user terminal 30 presents a temporary haptic in order to prevent the user from feeling a time lag will be described. Figure 13 is a graph showing a signal waveform of a vibration related to a haptic presented to the user. Figure 13 A first vibration waveform 520 related to a temporary haptic presented based on haptic presentation information stored in the user terminal 30, a second vibration waveform 523 related to a haptic presented based on haptic presentation information searched by the information processing apparatus 20, and a vibration waveform 524 which is a superposition of the first vibration waveform 520 and the second vibration waveform 523 are shown in order from the top. Note that the horizontal axis indicates time, and the time at which the user inputs haptic search information to the user terminal 30 is set to 0. In addition, the vertical axis indicates the amplitude of each vibration waveform.

[0136] The user terminal 30 presents the user with the tactile sensation based on the tactile presentation information stored in the storage unit 340. More specifically, the tactile presentation unit 330 presents the user with the tactile sensation represented by the first vibration waveform 520. Before time t1, the first vibration waveform 520 is different from the vibration waveform 522 indicated by the broken line in the middle, which corresponds to the desired tactile sensation. Generally, when a person starts to feel a tactile sensation, the person cannot accurately feel the tactile sensation. Therefore, even if the first vibration waveform 520 is different from the desired vibration waveform 522, the user can feel the tactile sensation without feeling discomfort. In addition, the amplitude of the first vibration waveform 520 is smaller than the amplitude of the vibration waveform 521 from time t1 to time t2 represented by the tactile presentation information stored in the user terminal 30. That is, the first vibration waveform 520 gradually weakens from time t1 to time t2. On the other hand, the second vibration waveform 523 fades in from time t1 to time t2. After time t2, the second vibration waveform 523 becomes the waveform of the tactile sensation that the user desires.

[0137] In Figure 13 the bottom shows a vibration waveform 524 that is a superposition of the above-described first vibration waveform 520 and the second vibration waveform 523. In this way, the tactile sensation is presented to the user based on the tactile presentation information stored in the user terminal 30 until the tactile sensation is presented based on the tactile presentation information from the information processing apparatus 20. As a result, the tactile sensation that does not cause a sense of discomfort can be presented to the user. For example, when a moving image that the user views is stored in advance in the user terminal 30 or the like, the timing of displaying the moving image can be delayed. As a result, it is possible to match the timing of presenting the tactile sensation with the timing of displaying the moving image, and present the tactile sensation that does not cause a sense of discomfort to the user.

[0138] <2. Update Example>

[0139] Next, an example in which the information processing apparatus 20 updates the tactile database stored in the storage unit 220 will be described with reference to Figure 14 FIG. 14. Figure 14 is a flowchart illustrating a flow of the information processing apparatus 20 updating the tactile database according to an embodiment of the present disclosure. Hereinafter, a description will be given along the flowchart illustrated in Figure 14 FIG. 14.

[0140] First, the information processing apparatus 20 requests server information from the server 10 (step S101). More specifically, the communication unit 215 transmits a signal for requesting tactile-related information to the server 10 via the network 40.

[0141] Next, the server 10 transmits the server information to the information processing apparatus 20 (step S103). For example, the server 10 transmits image information, text information, audio information, or tactile presentation information based on SNS or the like as the server information to the information processing apparatus 20.

[0142] Next, the information processing apparatus 20 executes the update processing of the tactile database (Step S110). More specifically, the update unit 230 updates the tactile database stored in the storage unit 220 based on the server information. The update processing will be described in more detail with reference to Figure 15 the flowchart shown in FIG. 12. Figure 15 is a flowchart illustrating the update processing of the tactile database. Hereinafter, the description will be given along the flowchart shown in FIG. 12. Figure 15

[0143] First, the update unit 230 acquires the server information (Step S111). Next, the update unit 230 determines whether the tactile presentation information is included in the server information (Step S112). When it is determined that the tactile presentation information is included in the server information (Step S112: Yes), the processing proceeds to Step S113. When it is determined that the tactile presentation information is not included in the server information (Step S112: No), the update processing ends.

[0144] When it is determined Yes in Step S112, the update unit 230 extracts the tactile meta information from the server information (Step S113). Here, the tactile meta information is extracted from the image information, the text information, the audio information, the tactile presentation information, and the like included in the server information. For example, among the information included in the server information, the information related to the tactile is extracted as the tactile meta information. For example, when the server information includes the text information of "fluffy", the text information is extracted as the tactile meta information.

[0145] Next, the update unit 230 confirms the tactile meta information included in the tactile database (Step S114). More specifically, the update unit 230 compares each of the tactile meta information extracted in Step S113 with each of the tactile meta information included in the tactile database. When there is the tactile meta information that completely matches the extracted tactile meta information as the tactile meta information associated with the tactile presentation information detected in Step S112 in the tactile database (Step S115: Yes) Figure 15 the update processing shown in FIG. 12 ends. That is, when the extracted tactile meta information exists as the registration data in the tactile database, Figure 15 on the other hand, when the extracted tactile meta information does not exist as the registration data in the tactile database (Step S115: No), the processing proceeds to Step S116.

[0146] ​Next, the update unit 230 determines whether or not there is haptic meta-information similar to any of the haptic meta-information included in the haptic database in the haptic meta-information extracted in step S113 (step S116). When it is determined that there is extracted haptic meta-information similar to any of the haptic meta-information included in the haptic database (step S116: Yes), the processing proceeds to step S117. On the other hand, when it is determined that there is no extracted haptic meta-information similar to any of the haptic meta-information included in the haptic database (step S116), the processing proceeds to step S118.

[0147] When it is determined to be Yes in step S116, the update unit 230 causes the storage unit 220 to store the fact that the extracted haptic meta-information is similar to the haptic meta-information included in the haptic database (step S117).

[0148] Next, the update unit 230 updates the haptic database (step S118). More specifically, the update unit 230 stores the haptic presentation information in the haptic database in a state in which the haptic presentation information included in the server information is associated with the extracted haptic meta-information. When the haptic database is updated, the update processing ends.

[0149] The processing for updating the haptic database has been described. As described above, the information processing system 1 according to the embodiment of the present disclosure transmits the server information of the server 10 to the information processing apparatus 20 if necessary, and the information processing apparatus 20 updates the haptic database based on the server information. Therefore, as information is accumulated in the server 10, the haptic database stored in the information processing apparatus 20 is updated. As a result, the information processing apparatus 20 can retrieve the haptic presentation information with higher precision, and can provide the user with information for realizing more appropriate haptics.

[0150] <3. Processing Example>

[0151] Next, a processing example until the information processing apparatus 20 retrieves the haptic presentation information from the haptic database and the user terminal 30 presents haptics based on the retrieved haptic presentation information will be described with reference to Figures 16 to 20

[0152] <<3.1. Outline of Processing Example>>

[0153] First, an outline of the processing example of the information processing apparatus 20 and the user terminal 30 will be described with reference to the flowchart shown in Figure 16 Figure 16 is a flowchart showing an outline of the processing example of the information processing apparatus 20 and the user terminal 30 according to the embodiment of the present disclosure.

[0154] ​​First, the user terminal 30 acquires tactile search information (step S201). More specifically, the input unit 310 acquires tactile search information including image information, audio information, text information, and the like by operation of a user or the like. The acquired tactile search information is sent to the communication control unit 320.

[0155] Next, the user terminal 30 requests the information processing apparatus 20 to search for tactile presentation information (step S203). More specifically, the communication control unit 320 controls the communication unit 325 to send the tactile search information acquired in step S201 and a request signal for searching for tactile presentation information to the information processing apparatus 20. The communication unit 325 sends the tactile search information and the request information to the information processing apparatus 20 via the network 40.

[0156] Next, the information processing apparatus 20 searches for tactile presentation information from the tactile database (step S205). More specifically, the communication unit 215 receives the tactile search information and the request information. The received tactile search information and the request information are sent to the search unit 240 via the communication control unit 210. Upon receiving the request information, the search unit 240 searches for tactile presentation information from the tactile database stored in the storage unit 220 using the sent tactile search information.

[0157] Next, the information processing apparatus 20 acquires tactile presentation information (step S207). More specifically, the search unit 240 acquires the tactile presentation information searched for in step S205.

[0158] Next, the information processing apparatus 20 sends the tactile presentation information to the user terminal 30 (step S209). More specifically, the search unit 240 sends the searched tactile presentation information to the processing unit 250 or the output unit 255. The tactile presentation information sent to the processing unit 250 is subjected to various types of processing and sent to the output unit 255. The output unit 255 sends the tactile presentation information sent from the search unit 240 or the tactile presentation information processed by the processing unit 250 as information related to the tactile presentation information to the communication control unit 210. The communication control unit 210 causes the communication unit 215 to send the information related to the searched tactile presentation information to the user terminal 30 via the network 40.

[0159] Next, the user terminal 30 presents tactile sensation (step S211). More specifically, the communication unit 325 receives the information related to the tactile presentation information. For example, the communication control unit 320 acquires the received tactile presentation information, and sends the acquired tactile presentation information to the tactile presentation unit 330. The tactile presentation unit 330 presents tactile sensation to a user based on the sent tactile presentation information.

[0160] The outline of the processing example of the information processing apparatus 20 and the user terminal 30 according to the embodiment of the present disclosure has been described. As described above, the information processing apparatus 20 according to the embodiment of the present disclosure retrieves the haptic presentation information from the haptic database using the haptic retrieval information, and outputs information related to the retrieved haptic presentation information. In this way, since the information related to the haptic presentation information is output based on the haptic presentation information retrieved using the haptic retrieval information, the information for realizing the haptic desired by the user is more appropriately provided.

[0161] In addition, in the present embodiment, the haptic retrieval information that is one of text information, image information, audio information, and the like or a combination of these types of information is used. As a result, the haptic desired by the user is more explicitly expressed. Thereby, more accurate retrieval of the haptic retrieval information is performed, and the information for realizing a more appropriate haptic is provided to the user.

[0162] <<3.2. First Specific Example>>

[0163] Next, a first specific example of the processing of the information processing apparatus 20 and the user terminal 30 will be described with reference to Figure 17 Figure 17 is a flowchart illustrating the first specific example of the information processing apparatus 20 and the user terminal 30 according to the embodiment of the present disclosure. In the first specific example, the method in which the information processing apparatus 20 acquires the haptic presentation information will be described in more detail. Hereinafter, the first specific example will be described with reference to the flowchart illustrated in Figure 17

[0164] First, the processing of steps S301 and S303 is performed, but since this processing is basically the same as the processing of steps S201 and S203 illustrated in Figure 16

[0165] Upon completion of the processing of step S303, the information processing apparatus 20 retrieves the haptic meta-information (step S305). More specifically, the retrieval unit 240 retrieves the haptic meta-information similar to the haptic retrieval information from the haptic database.

[0166] Next, the retrieval unit 240 determines whether or not there is the haptic meta-information similar to the haptic retrieval information in the haptic database (step S307). When it is determined that there is the haptic meta-information similar to the haptic retrieval information (step S307: YES), the processing proceeds to step S309. On the other hand, when it is determined that there is no haptic meta-information similar to the haptic retrieval information (step S307: NO), the processing proceeds to step S311.

[0167] ​​​When Yes is determined in step S307, the information processing apparatus 20 acquires the haptic presentation information (step S309). More specifically, the search unit 240 acquires the haptic presentation information associated with the haptic meta-information similar to the haptic search information determined in step S307.

[0168] Next, the information processing apparatus 20 transmits the search result to the user terminal 30 (step S311). More specifically, when the search unit 240 acquires the haptic presentation information in step S309, the search unit 240 transmits the acquired haptic presentation information to the processing unit 250 or the output unit 255. The output unit 255 transmits information about the haptic presentation information as the search result to the communication control unit 210. On the other hand, when the haptic presentation information is not acquired, the search unit 240 transmits information indicating that the haptic presentation information is not searched to the communication control unit 320 as the search result. The communication control unit 320 controls the communication unit 325 to transmit the search result to the user terminal 30. The communication unit 325 transmits the search result to the user terminal 30 via the network 40.

[0169] Next, the user terminal 30 outputs the search result (step S313). More specifically, the communication unit 325 receives the search result, and transmits the received search result to the communication control unit 320. When the search result includes information about the haptic presentation information, the communication control unit 320 transmits the haptic presentation information to the haptic presentation unit 330. The haptic presentation unit 330 presents a haptic to the user based on the transmitted haptic presentation information. On the other hand, when the search result does not include information about the haptic presentation information, the communication control unit 320 transmits information indicating that the haptic presentation information is not searched to the display control unit 350. The display control unit 350 causes the display unit 355 to display information indicating that the haptic presentation information is not searched as information such as image information. As a result, the user can recognize that the haptic presentation information is not searched.

[0170] The first specific example has been described with reference to Figure 17 In the first specific example, when the haptic meta-information similar to the haptic search information is included in the haptic database, the user is provided with information about the haptic presentation information associated with the haptic meta-information. When the haptic search information and the haptic meta-information are similar to each other, the haptic presentation information associated with the haptic meta-information can more appropriately realize a haptic desired by the user. Therefore, according to the first specific example, the information processing apparatus 20 can more appropriately provide information for realizing a haptic desired by the user. Further, the user terminal 30 can more appropriately present a haptic desired by the user.

[0171] <<3.3. Second Specific Example>>

[0172] Next, the second specific example will be described with reference toFigure 18 The second example will be described. Figure 18 is a flowchart illustrating a second specific example of the information processing system 1 according to an embodiment of the present disclosure. The second specific example differs from the first specific example in that the search unit 240 acquires the haptic meta-information from the haptic database. Hereinafter, the second specific example will be described with reference to Figure 18 The second specific example will be described with reference to the flowchart illustrated in FIG. 4B.

[0173] First, the processes of steps S401 to S407 are executed, but since the processes are basically the same as those of steps S301 to S307 illustrated in FIG. 4A, the description thereof is omitted here. Figure 17

[0174] When it is determined YES in step S407, the information processing apparatus 20 acquires the haptic meta-information (step S409). More specifically, the search unit 240 acquires the haptic meta-information determined to be similar to the haptic search information from the haptic database.

[0175] Next, the information processing apparatus 20 transmits the search result to the user terminal 30 (step S411). When the haptic meta-information has been acquired in step S409, the search unit 240 transmits the acquired haptic meta-information to the communication control unit 210 as the search result. On the other hand, when the haptic meta-information is not acquired, the search unit 240 transmits information indicating that the haptic meta-information is not searched to the communication control unit 210 as the search result. The communication control unit 210 transmits the transmitted search result to the communication unit 215. The communication unit 215 transmits the search result to the user terminal 30 via the network 40.

[0176] Next, the user terminal 30 outputs the search result (step S413). More specifically, the communication unit 325 receives the search result, and transmits the received search result to the communication control unit 320. When the search result includes the haptic meta-information, the communication control unit 320 transmits the haptic meta-information to the haptic presentation unit 330. Here, it is assumed that the storage unit 340 stores the haptic presentation information associated with the haptic meta-information. That is, it is assumed that the storage unit 340 stores a database similar to the haptic database stored in the information processing apparatus 20. The haptic presentation unit 330 searches the transmitted haptic meta-information from the storage unit 340, and presents the haptic to the user based on the haptic presentation information associated with the searched haptic meta-information. On the other hand, when the search result does not include the haptic meta-information, the communication control unit 320 transmits information indicating that the haptic presentation unit 330 does not present the haptic to the display control unit 350. The display control unit 350 causes the display unit 355 to display the information indicating that the haptic presentation unit 330 does not present the haptic based on the transmitted information. As a result, the user can recognize that the haptic is not presented.

[0177] ​The second specific example will be described with reference to Figure 18 According to the second specific example, the search unit 240 acquires tactile meta-information based on the tactile search information. The tactile presentation unit 330 presents a tactile based on the tactile meta-information. According to the second specific example, the user terminal 30 searches the database for the tactile presentation information, like the search unit 240 included in the information processing apparatus 20. Therefore, in the second specific example, substantially, the user terminal 30 searches for the tactile presentation information based on the tactile search information, and outputs the searched tactile presentation information to the tactile presentation unit 330. In the second specific example, the information processing apparatus 20 and the user terminal 30 share the process of searching for the tactile meta-information similar to the tactile search information and the process of searching for the tactile presentation information associated with the searched tactile meta-information. As a result, the amount of processing required for the user terminal 30 to provide the tactile presentation information is reduced.

[0178] <4. Application Examples>

[0179] Next, application examples of the processes of the information processing apparatus 20 and the user terminal 30 according to the embodiments of the present disclosure will be described with reference to Figure 19 and Figure 20

[0180] <<4.1. First Application Example>>

[0181] First, a first application example of the processes of the information processing apparatus 20 and the user terminal 30 according to the embodiments of the present disclosure will be described with reference to Figure 19 Figure 19 is a flowchart illustrating the first application example of the processes of the information processing apparatus 20 and the user terminal 30 according to the embodiments of the present disclosure. Hereinafter, the first application example will be described with reference to the flowchart illustrated in Figure 19

[0182] First, the processes of steps S501 and S503 are executed, but since the processes are basically the same as the processes of steps S201 and S203 illustrated in Figure 16 , the description thereof is omitted here.

[0183] ​​​Next, the information processing apparatus 20 retrieves the tactile presentation information (step S505). More specifically, the communication unit 215 receives the tactile retrieval information from the user terminal 30, and transmits the received tactile retrieval information to the communication control unit 210. The communication control unit 210 transmits the transmitted tactile retrieval information to the retrieval unit 240. The retrieval unit 240 retrieves the tactile presentation information from the tactile database by using the transmitted tactile retrieval information. In the first application example, the retrieval unit 240 retrieves a plurality of tactile presentation information. The retrieval unit 240 transmits the plurality of retrieved tactile presentation information as candidates of the tactile presentation information to the processing unit 250 or the output unit 255.

[0184] Next, the information processing apparatus 20 transmits the candidates of the tactile presentation information to the user terminal 30 (step S507). More specifically, the output unit 255 transmits information about the plurality of tactile presentation information as candidates of the tactile presentation information to the communication control unit 210. The communication control unit 210 controls the communication unit 215, and transmits the transmitted candidates of the tactile presentation information to the user terminal 30. As a result, the candidates of the tactile presentation information are transmitted to the user terminal 30.

[0185] Next, the user terminal 30 outputs the candidates of the tactile (step S509). More specifically, the communication unit 325 receives the candidates of the tactile presentation information, and transmits the received candidates of the tactile presentation information to the communication control unit 320. The communication control unit 320 transmits the transmitted candidates of the tactile presentation information to the tactile presentation unit 330. The tactile presentation unit 330 presents the candidates of the tactile to the user based on the transmitted candidates of the tactile presentation information.

[0186] Next, the user terminal 30 requests the selected tactile candidate (step S511). More specifically, the user selects the tactile matching the tactile most desired by the user from the candidates of the tactile presented in step S509. The input unit 310 outputs the input information to the communication control unit 320. The communication control unit 320 controls the communication unit 325 to transmit information corresponding to the selected tactile to the information processing apparatus 20. As a result, the information about the selected tactile is transmitted to the information processing apparatus 20.

[0187] Next, the information processing apparatus 20 updates the tactile database (step S513). More specifically, the communication unit 215 transmits the information corresponding to the selected tactile candidate to the update unit 230 via the communication control unit 210. The update unit 230 updates the tactile database with respect to the tactile presentation information for realizing the selected tactile. For example, the update unit 230 can store the tactile retrieval information for retrieval or the information extracted from the tactile retrieval information in the tactile database as the tactile meta-information associated with the tactile presentation information for realizing the selected tactile.

[0188] Further, the update unit 230 can update the tactile database according to a selection frequency of the presented tactile sensation. For example, when the user selects two pieces of tactile presentation information retrieved based on retrieval of information based on a specific tactile sensation at a similar ratio, the update unit 230 can update the tactile database by increasing the tactile similarity between the two pieces of tactile presentation information. As a result, information for further implementing the tactile sensation is more appropriately provided to the user.

[0189] Next, the information processing apparatus 20 transmits the tactile presentation information to the user terminal 30 (step S515). More specifically, the communication control unit 210 controls the communication unit 215 to transmit information related to implementing the selected tactile presentation information to the user terminal 30.

[0190] Next, the user terminal 30 presents the selected tactile sensation (step S517). More specifically, the communication unit 325 receives information related to implementing the selected tactile presentation information, and transmits the received information related to the tactile presentation information to the communication control unit 320. The communication control unit 320 transmits the transmitted information to the tactile presentation unit 330, and the tactile presentation unit 330 presents the tactile sensation to the user.

[0191] In the first application example, the information processing apparatus 20 updates the tactile database based on the selection result of the user on the information related to the tactile presentation information. As a result, the tactile database is updated in a manner more desired by the user. As a result, information for implementing the desired tactile sensation is more appropriately provided to the user.

[0192] <<4.2. Second Application Example>>

[0193] Next, a second application example of the processing of the information processing apparatus 20 and the user terminal 30 according to an embodiment of the present disclosure will be described with reference to Figure 20 the flowchart shown in FIG. 6. Hereinafter, the second application example will be described with reference to the flowchart shown in FIG. 6. Figure 20 the flowchart shown in FIG. 6. Hereinafter, the second application example will be described with reference to the flowchart shown in FIG. 6. Figure 20

[0194] First, the processing of steps S601 and S603 is performed, but since it is basically the same as the processing of steps S201 and S203 shown in FIG. 2, the description thereof is omitted here. Figure 16

[0195] ​​Upon completion of the processing of step S603, the information processing apparatus 20 retrieves the haptic presentation information (step S605). More specifically, the communication unit 215 transmits the haptic retrieval information to the retrieval unit 240 via the communication control unit 210. The retrieval unit 240 retrieves a plurality of haptic presentation information from the haptic database by using the transmitted haptic retrieval information. The plurality of retrieved haptic presentation information is transmitted to the processing unit 250.

[0196] Next, the information processing apparatus 20 processes the haptic presentation information (step S607). More specifically, the processor 252 included in the processing unit 250 processes each of the plurality of haptic presentation information based on the confirmation information. Here, the confirmation information is information for converting the haptic presentation information into information for realizing the haptic so as to be confirmed by the user. The processor 252 creates a summarized version of the haptic presentation information based on the confirmation information. For example, the time of presenting the haptic based on the summarized version of the haptic presentation information can be shorter than the time of presenting the haptic based on the unprocessed haptic presentation information. That is, the haptic presented based on the processed haptic presentation information can be a simplified haptic compared to the haptic presented based on the unprocessed haptic presentation information.

[0197] Next, the information processing apparatus 20 transmits the candidates of the haptic presentation information to the user terminal 30 (step S609). More specifically, the processing unit 250 transmits each of the plurality of processed haptic presentation information as a candidate of the haptic presentation information to the communication control unit 320 via the output unit 255. The communication control unit 320 controls the communication unit 325 to transmit the transmitted candidate of the haptic presentation information to the user terminal 30.

[0198] Next, the user terminal 30 presents the candidates of the haptic (step S611). More specifically, the communication unit 325 receives the candidates of the haptic presentation information, and transmits the received candidates of the haptic presentation information to the haptic presentation unit 330 via the communication control unit 320. The haptic presentation unit 330 presents the candidates of the haptic to the user based on the transmitted candidates of the haptic presentation information.

[0199] Next, the user terminal 30 requests the selected haptic to the information processing apparatus 20 (step S613). More specifically, the user selects the haptic matching the haptic most desired by the user from the presented candidates of the haptic, and inputs information indicating the selected haptic to the input unit 310. The input unit 310 transmits the input information to the communication control unit 320. The communication control unit 320 controls the communication unit 325 to transmit the transmitted information to the information processing apparatus 20.

[0200] Next, the information processing device 20 processes the tactile presentation information (step S615). More specifically, the communication unit 215 receives information indicating the selected tactile sensation and transmits the received information to the processing unit 250 via the communication control unit 210. The processor 252 processes the tactile presentation information for realizing the transmitted tactile sensation based on usage information. Here, usage information is information for processing the tactile presentation information into information for more appropriately realizing the tactile sensation presented to the user. For example, usage information may be information for processing the tactile presentation information into information corresponding to the device included in the tactile presentation unit 330.

[0201] Next, the information processing device 20 sends the haptic presentation information to the user terminal 30 (step S617). More specifically, the processor 252 sends the haptic presentation information processed in step S615 to the communication control unit 210. The communication control unit 210 controls the communication unit 215 to send the processed haptic presentation information to the user terminal 30.

[0202] Next, the user terminal 30 presents the selected haptic feedback (step S619). More specifically, the communication unit 325 receives haptic feedback information and sends the received haptic feedback information to the haptic feedback unit 330 via the communication control unit 320. The haptic feedback unit 330 presents the haptic feedback to the user based on the sent haptic feedback information.

[0203] Already referred to Figure 20 A second application example is described. In this example, processor 252 generates a summary version of the haptic presentation information, and user terminal 30 presents the haptic based on this information. As a result, the amount of data sent from information processing device 20 to user terminal 30 is reduced. Furthermore, because the presented haptic is simplified, it is easier for the user to select the haptic. Consequently, it is easier to provide the user with information for implementing the haptic.

[0204] <5. Hardware Configuration Example>

[0205] Next, we will refer to Figure 21 A detailed description includes examples of the hardware configuration of the information processing apparatus 20 in the information processing system 1 according to embodiments of the present disclosure, as described above for the information processing apparatus 20. Figure 21 This is a functional block diagram illustrating an example of the hardware configuration of the information processing device 20 included in the information processing system 1 according to an embodiment of the present disclosure.

[0206] The information processing apparatus 20 included in the information processing system according to the present embodiment mainly includes a CPU 601, a ROM 602, and a RAM 603. In addition, the information processing apparatus 20 further includes a host bus 604, a bridge 605, an external bus 606, an interface 607, an input device 608, an output device 609, a storage device 610, a drive 612, a connection port 614, and a communication device 616.

[0207] The CPU 601 functions as an arithmetic processing device and a control device, and controls all or some of the operations in the information processing apparatus 20 in accordance with various computer programs recorded in the ROM 602, the RAM 603, the storage device 610, or the removable recording medium 613. The ROM 602 stores programs, operation parameters, and the like used by the CPU 601. The RAM 603 mainly stores programs used by the CPU 601, parameters appropriately changed at the time of executing the programs, and the like. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through the host bus 604 including an internal bus such as a CPU bus. For example, Figure 4 The communication control unit 210, the update unit 230, the search unit 240, the processing unit 250, and the output unit 255 illustrated in FIG. 2 can be configured by the CPU 601.

[0208] The host bus 604 is connected to the external bus 606 such as a peripheral component interconnect / interface (PCI) bus via the bridge 605. In addition, the input device 608, the output device 609, the storage device 610, the drive 612, the connection port 614, and the communication device 616 are connected to the external bus 606 via the interface 607.

[0209] The input device 608 is an operation device operated by a user, such as a mouse, a keyboard, a touch panel, a button, a switch, a joystick, and a pedal. In addition, the input device 608 can be, for example, a remote control device (so-called remote controller) using infrared rays or other radio waves, or an external connection device 615 such as a mobile phone or a PDA corresponding to the operation of the information processing apparatus 20. Furthermore, the input device 608 includes, for example, an input control circuit that generates an input signal based on information input by a user using the above-described operation device, and outputs the input signal to the CPU 601 or the like. A user of the information processing apparatus 20 can input various data to the information processing apparatus 20 and can instruct the information processing apparatus 20 in processing operations by operating the input device 608.

[0210] The output device 609 includes a device capable of visually or aurally notifying a user of acquired information. Examples of such a device include display devices such as a CRT display device, a liquid crystal display device, a plasma display device, an EL display device, and a lamp; audio output devices such as a speaker and a headphone; and a printer device. The output device 609, for example, outputs a result obtained from various types of processing executed by the information processing apparatus 20. Specifically, the display device displays a result obtained by various types of processing executed by the information processing apparatus 20 as text or an image. On the other hand, the audio output device converts an audio signal including reproduced audio data, acoustic data, or the like into an analog signal, and outputs the analog signal. In addition, the output device 609 can be a device capable of presenting a tactile sensation based on a tactile presentation information. As a result, a user can confirm the tactile sensation by using a device of the information processing apparatus 20.

[0211] The storage device 610 is a data storage device configured as an example of a storage unit of the information processing apparatus 20. The storage device 610 includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, and the like. The storage device 610 stores programs executed by the CPU 601, various data, and the like. For example, Figure 4 The illustrated storage unit 220 can be configured by the storage device 610.

[0212] The drive 612 is a reader / writer for a recording medium, and is built in the information processing apparatus 20 or externally attached to the information processing apparatus 900. The drive 612 reads information recorded on a removable recording medium 613 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory mounted, and outputs the information to the RAM 603. Further, the drive 612 can write a record in the removable recording medium 613 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory mounted. The removable recording medium 613 is, for example, a DVD medium, an HD-DVD medium, a Blu-ray (registered trademark) medium, or the like. In addition, the removable recording medium 613 can be a CompactFlash (CF) (registered trademark), a flash memory, a Secure Digital (SD) memory card, or the like. In addition, the removable recording medium 613 can be, for example, an integrated circuit (IC) card on which a non-contact IC chip is mounted, an electronic device, or the like.

[0213] The connection port 614 is a port for directly connecting to the information processing apparatus 20. Examples of the connection port 614 include a Universal Serial Bus (USB) port, an IEEE 1394 port, a Small Computer System Interface (SCSI) port, and the like. Other examples of the connection port 614 include an RS-232C port, an optical audio terminal, a High-Definition Multimedia Interface (HDMI) (registered trademark) port, and the like. By connecting the external connection device 615 to the connection port 614, the information processing apparatus 20 directly acquires various data from the external connection device 615 or provides various data to the external connection device 615.

[0214] The communication device 616 is, for example, a communication interface including a communication device for connecting to a communication network (network) 617 or the like. The communication device 616 is, for example, a communication card for a wired or wireless Local Area Network (LAN), Bluetooth (registered trademark), or Wireless USB (WUSB), or the like. In addition, the communication device 616 can be a router for optical communication, a router for Asymmetric Digital Subscriber Line (ADSL), a modem for various types of communication, or the like. The communication device 616 can transmit and receive signals to and from the Internet and other communication devices, for example, in accordance with a predetermined protocol such as TCP / IP. Further, the communication network 617 connected to the communication device 616 includes a network connected in a wired or wireless manner or the like, and can be, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like.

[0215] An example of a hardware configuration capable of realizing the functions of the information processing apparatus 20 included in the information processing system 1 according to the embodiment of the present disclosure has been shown. Each of the above-described components can be configured using a general-purpose member, or can be configured by hardware dedicated to the function of each component. Therefore, the hardware configuration to be used can be appropriately changed according to the technical level at the time of implementing the present embodiment. Although not shown in the Figure 21 Various configurations corresponding to the information processing apparatus 20 included in the information processing system 1 are naturally included, although not shown in the

[0216] Note that a computer program for realizing each function of the information processing apparatus 20 included in the information processing system 1 according to the present embodiment as described above can be created and implemented on a personal computer or the like. Further, a computer-readable recording medium storing such a computer program can also be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. In addition, the above-described computer program can be distributed via a network, for example, without using a recording medium. Further, the number of computers that execute the computer program is not particularly limited. For example, a plurality of computers (for example, a plurality of servers or the like) can execute the computer program in cooperation with each other.

[0217] <6. Supplement>

[0218] Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It will be apparent that various changes and modifications can be conceived by those skilled in the technical field of the present disclosure within the scope of the technical ideas described in the claims, and it is naturally understood that such changes and modifications also belong to the technical scope of the present disclosure.

[0219] For example, in the above-described embodiments, an example in which the tactile database is stored in the information processing apparatus 20 has been described, but the present technology is not limited to such an example. For example, the tactile database can be stored in the user terminal 30. In this case, the user terminal 30 can have a function of searching from the tactile database, or the information processing apparatus 20 or the like can search from the tactile database stored in the user terminal 30.

[0220] Further, in the above-described embodiments, an example in which the tactile presentation information is included in the content included in the SNS or the like has been described, but the present technology is not limited to such an example. For example, the content included in the SNS or the like can be used to adjust the similarity between the plurality of tactile meta-information included in the tactile database. For example, assume that a plurality of tactile meta-information is extracted from one content. In this case, the update unit 230 can update the tactile database by increasing the similarity between the plurality of extracted tactile meta-information.

[0221] Further, the effects described in the present specification are merely illustrative or exemplary effects, and are not limited. That is, in addition to or in place of the above effects, according to the description of the present specification, the technology according to the present disclosure can achieve other effects apparent to those skilled in the art from the description of the present specification. (1)

[0223] An information processing apparatus comprising:

[0224] a search unit that searches for tactile presentation information for realizing a tactile presented to a user from a tactile database including the tactile presentation information and one or more tactile meta-information associated with the tactile presentation information, based on tactile search information for searching for the tactile presentation information; and

[0225] an output unit that outputs information related to the searched tactile presentation information. (2)

[0227] The information processing apparatus according to (1), further comprising:

[0228] an updating unit that updates a relationship between two or more of the plurality of haptic presentation information or the plurality of haptic meta-information included in the haptic database. (3)

[0230] The information processing apparatus according to (2),

[0231] wherein the updating unit updates a haptic similarity between first haptic presentation information associated with first haptic meta-information and second haptic presentation information associated with second haptic meta-information based on a similarity between the first haptic meta-information and the second haptic meta-information. (4)

[0233] The information processing apparatus according to (3),

[0234] wherein the updating unit increases the haptic similarity between the first haptic presentation information and the second haptic presentation information when the first haptic meta-information and the second haptic meta-information are similar. (5)

[0236] The information processing apparatus according to any one of (2) to (4),

[0237] wherein the updating unit updates the haptic database by associating, with a second group of haptic meta-information that is a second set of haptic meta-information, haptic presentation information that is associated with a first group of haptic meta-information that is a first set of haptic meta-information and that is not associated with the second group of haptic meta-information, when the first group of haptic meta-information and the second group of haptic meta-information are similar to each other. (6)

[0239] The information processing apparatus according to any one of (2) to (5),

[0240] wherein the updating unit updates the haptic database based on a result of the searching by the searching unit. (7)

[0242] The information processing apparatus according to (6),

[0243] wherein the updating unit updates the haptic database by increasing a haptic similarity between the plurality of haptic presentation information when the searching unit searches for the plurality of haptic presentation information. (8)

[0245] The information processing apparatus according to any one of (2) to (7),

[0246] The update unit updates the haptic database based on a selection result of the user on the information related to the haptic presentation information output from the output unit. (9)

[0248] The information processing apparatus according to any one of (2) to (8), in which the update unit updates the haptic database based on a frequency of adoption of the haptic presentation information and the haptic search information used to search for the adopted haptic presentation information. (10)

[0250] The information processing apparatus according to any one of (1) to (9), further comprising:

[0251] an extraction unit that extracts feature information representing a feature of the searched haptic presentation information from the haptic presentation information searched by the search unit. (11)

[0253] The information processing apparatus according to (10),

[0254] in which the feature information is extracted based on the haptic search information corresponding to the searched haptic presentation information. (12)

[0256] The information processing apparatus according to (11),

[0257] in which the feature information is extracted based on information related to the user's emotion included in the haptic search information. (13)

[0259] The information processing apparatus according to (10) or (11),

[0260] in which when a haptic presented based on the haptic presentation information is represented by a waveform having a periodicity,

[0261] the feature information is information representing one period of the waveform. (14)

[0263] The information processing apparatus according to any one of (1) to (13),

[0264] in which the haptic meta-information includes user information related to the user. (15)

[0266] The information processing apparatus according to any one of (1) to (14),

[0267] in which the haptic meta-information includes information related to a part of the user on which the haptic is presented based on the haptic presentation information. (16)

[0269] The information processing apparatus according to (15), further comprising:

[0270] a processor that processes the retrieved haptic presentation information into information that is adapted to the part of the user. (17)

[0272] The information processing apparatus according to any one of (1) to (16),

[0273] wherein the haptic meta-information includes haptic motion information related to a haptic motion of the user. (18)

[0275] The information processing apparatus according to any one of (1) to (17),

[0276] wherein the haptic meta-information includes information related to audio of the user. (19)

[0278] The information processing apparatus according to any one of (1) to (18),

[0279] wherein the haptic meta-information includes information related to a frequency of a signal waveform realized by the haptic presentation information. (20)

[0281] An information processing method comprising:

[0282] retrieving, by a processor, haptic presentation information from a haptic database including the haptic presentation information and one or more haptic meta-information associated with the haptic presentation information, based on haptic retrieval information for retrieving the haptic presentation information for realizing haptics presented to a user; and

[0283] outputting, by the processor, information related to the retrieved haptic presentation information. (21)

[0285] A program causing a computer to function as an information processing apparatus including:

[0286] a retrieving unit that retrieves, from a haptic database including haptic presentation information and one or more haptic meta-information associated with the haptic presentation information, the haptic presentation information based on haptic retrieval information for retrieving the haptic presentation information for realizing haptics presented to a user; and

[0287] an output unit that outputs information related to the retrieved haptic presentation information.

[0288] LIST OF REFERENCE NUMERALS

[0289] 10 server

[0290] 20 information processing apparatus

[0291] 210 communication control unit

[0292] 215 communication unit

[0293] 220 storage unit

[0294] 230 update unit

[0295] 240 search unit

[0296] 250 processing unit

[0297] 255 output unit

[0298] 251 extraction unit

[0299] 252 processor

[0300] 253 image creation unit

[0301] 30 user terminal 30

[0302] 310 input unit

[0303] 320 communication control unit

[0304] 325 communication unit

[0305] 330 tactile presentation unit

[0306] 340 storage unit

[0307] 350 display control unit

[0308] 355 display unit

[0309] DB tactile database

Claims

1. An information processing apparatus comprising: a retrieval unit configured to retrieve, based on a haptic retrieval information for retrieving haptic presentation information for realizing a haptic presented to a user, the haptic presentation information from a haptic database including the haptic presentation information and one or more haptic meta-information associated with the haptic presentation information; an output unit that outputs information related to the retrieved haptic presentation information; and an update unit configured to update a relationship between two or more of a plurality of haptic presentation information or a plurality of haptic meta-information included in the haptic database, wherein: the haptic is one of a pressure sensation, a force sensation, a pain sensation, a temperature, or a vibration stimulus, and the retrieval unit is further configured to retrieve the haptic presentation information based on a relationship between the haptic retrieval information and the haptic meta-information stored in the haptic database, and wherein: the update unit is further configured to update, based on a similarity between a first haptic meta-information and a second haptic meta-information of the one or more haptic meta-information, a haptic similarity between a first haptic presentation information of the plurality of haptic presentation information associated with the first haptic meta-information and a second haptic presentation information of the plurality of haptic presentation information associated with the second haptic meta-information, and the retrieval unit is further configured to retrieve the haptic presentation information based on the updated haptic similarity. 2.The information processing apparatus according to claim 1, when the first haptic meta-information and the second haptic meta-information are similar, the update unit increases the haptic similarity between the first haptic presentation information and the second haptic presentation information. wherein 3.The information processing apparatus according to claim 1 or 2, when a first group of haptic meta-information that is a first set of the haptic meta-information and a second group of haptic meta-information that is a second set of the haptic meta-information have groups of haptic meta-information similar to each other, the update unit updates the haptic database by associating, with the second group of haptic meta-information, haptic presentation information associated with the first group of haptic meta-information and not associated with the second group of haptic meta-information. wherein 4.The information processing apparatus according to claim 1 or 2, the update unit updates the haptic database based on a retrieval result of the retrieval unit. wherein 5.The information processing apparatus according to claim 4, when the retrieval unit retrieves a plurality of haptic presentation information, the update unit updates the haptic database by increasing a haptic similarity between the plurality of haptic presentation information. wherein 6.The information processing apparatus according to claim 1 or 2, the update unit updates the haptic database based on a result of selection, by the user, of information related to the haptic presentation information output from the output unit. wherein the update unit updates the haptic database based on a frequency of adoption of the haptic presentation information and a haptic retrieval information for retrieving the adopted haptic presentation information.

7. The information processing apparatus according to claim 1 or 2, wherein 8.The information processing apparatus according to claim 1 or 2, further comprising: ​ an extraction unit that extracts feature information representing a feature of the retrieved haptic presentation information from the haptic presentation information retrieved by the search unit.

9. The information processing apparatus according to claim 8, wherein, the feature information is extracted based on haptic search information corresponding to the retrieved haptic presentation information.

10. The information processing apparatus according to claim 9, wherein the feature information is extracted based on information related to the user's emotion included in the haptic search information corresponding to the retrieved haptic presentation information.

11. The information processing apparatus according to claim 8, wherein when a haptic presented based on the haptic presentation information is represented by a waveform having a periodicity, the feature information is information representing one period of the waveform.

12. The information processing apparatus according to claim 1 or 2, wherein, the haptic meta-information includes user information related to the user.

13. The information processing apparatus according to claim 1 or 2, wherein the haptic meta-information includes information related to a part of the user on which a haptic based on the haptic presentation information is presented.

14. The information processing apparatus according to claim 13, further comprising: a processor that processes the retrieved haptic presentation information into information adapted to a part of the user.

15. The information processing apparatus according to claim 1 or 2, wherein the haptic meta-information includes haptic motion information related to a haptic motion of the user.

16. The information processing apparatus according to claim 1 or 2, wherein the haptic meta-information includes information related to audio of the user.

17. The information processing apparatus according to claim 1 or 2, wherein the haptic meta-information includes information related to a frequency of a signal waveform realized by the haptic presentation information.

18. An information processing method comprising: retrieving, by a processor, haptic presentation information for realizing a haptic presented to a user based on haptic search information for searching the haptic presentation information from a haptic database including the haptic presentation information and one or more haptic meta-information associated with the haptic presentation information; outputting, by the processor, information related to the retrieved haptic presentation information; and updating a relationship between two or more of a plurality of haptic presentation information or a plurality of haptic meta-information included in the haptic database, wherein: the haptic is one of a pressure sensation, a force sensation, a pain sensation, a temperature, or a vibration stimulus, and the haptic presentation information is retrieved based on a relationship between the haptic search information and the haptic meta-information stored in the haptic database, and wherein: based on a similarity between a first haptic meta-information and a second haptic meta-information of the one or more haptic meta-information, updating a haptic similarity between a first haptic presentation information of the plurality of haptic presentation information associated with the first haptic meta-information and a second haptic presentation information of the plurality of haptic presentation information associated with the second haptic meta-information, and the haptic presentation information is retrieved based on the updated haptic similarity.

19. A computer-readable storage medium having stored thereon a program which, when executed by a processor, causes a computer to implement the information processing method according to claim 18.

Images