Information processing device, information processing method, server device, and program

Abstract

This technology relates to an information processing device, information processing method, server device, and program that enable presentation of tactile information using existing data formats. In this technology, a smartphone is equipped with a data processing unit that provides tactile control signals to a tactile presentation device based on tactile control information embedded in image data in a specified file format. For example, this technology can be applied to a terminal device having a display that displays an image and on which a user performs touch operations.

Description

Technical Field

[0001] The present technology relates to an information processing device, an information processing method, a server device, and a program, and more particularly, to an information processing device, an information processing method, a server device, and a program capable of presenting tactile information by using an existing data format. Background Art

[0002] Conventionally, various technologies for presenting tactile stimulation such as vibration to users have been proposed. For example, a technology for generating a vibration waveform based on feature values ​​extracted from a stereo audio signal and presenting tactile stimulation is disclosed (for example, see Patent Document 1).

[0003] Reference List

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 2018-64264 Summary of the Invention

[0006] Problems to be solved by the present invention

[0007] In some cases, for example, it is desirable to transmit tactile information from a transmission side such as a server to a terminal according to a texture of an image or the like and present the tactile information to a user rather than generating the tactile information in the terminal itself.

[0008] However, in the case where a new data format including haptic information is defined, compatible devices are limited.

[0009] The present technology has been made in view of such circumstances, and can present tactile information by using an existing data format.

[0010] Solution to the problem

[0011] An information processing device according to a first aspect of the present technology includes a data processing unit configured to provide a haptic control signal to a haptic presentation device based on haptic control information embedded in image data in a predetermined file format.

[0012] An information processing method according to a first aspect of the present technology includes causing an information processing apparatus to provide a haptic control signal to a haptic presentation apparatus based on haptic control information embedded in image data in a predetermined file format.

[0013] The program according to the first aspect of the present technology causes a computer to function as a data processing unit configured to provide a haptic control signal to a haptic presentation device based on haptic control information embedded in image data in a predetermined file format.

[0014] In a first aspect of the present technology, a haptic control signal is provided to a haptic presentation device based on haptic control information embedded in image data in a predetermined file format.

[0015] A server device according to a second aspect of the present technology includes: a storage unit configured to store image data in a predetermined file format embedded with tactile control information; and a communication unit configured to send the image data to a predetermined information processing device in response to a request from the predetermined information processing device.

[0016] In a second aspect of the present technology, image data in a predetermined file format in which haptic control information is embedded is stored, and the image data is transmitted to a predetermined information processing device in response to a request from the predetermined information processing device.

[0017] Note that the program can be provided by being transmitted via a transmission medium or by being recorded on a recording medium.

[0018] The information processing device and the server device may be independent devices, or may be internal blocks forming a single device. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a block diagram showing a configuration example of a first embodiment of an image processing system to which the present technology is applied.

[0020] Figure 2 An example of image data with tactile information is shown.

[0021] Figure 3 is a cross-sectional view showing a tactile presentation mechanism of a smartphone.

[0022] Figure 4 This is an explanatory diagram of smartphone operation.

[0023] Figure 5 It is a functional block diagram of a smartphone.

[0024] Figure 6 This is an explanatory diagram of the file format of image data in which tactile data is embedded.

[0025] Figure 7 This is an explanatory diagram for controlling a tactile presentation device based on tactile data.

[0026] Figure 8 This is an explanatory diagram for controlling a tactile presentation device based on tactile data.

[0027] Figure 9 This is an explanatory diagram for controlling a tactile presentation device based on tactile data.

[0028] Figure 10 The processing performed when the image is enlarged is shown.

[0029] Figure 11 is a flow chart illustrating a haptic control process.

[0030] Figure 12 A modified example of the tactile sense presentation device is shown.

[0031] Figure 13 is another modified example of the tactile presentation device.

[0032] Figure 14 A configuration example of a second embodiment of an image processing system to which the present technology is applied is shown.

[0033] Figure 15 This is a functional block diagram of the second embodiment.

[0034] Figure 16 is a block diagram showing a hardware configuration example of a computer. DETAILED DESCRIPTION

[0035] Hereinafter, a mode for implementing the present technology (hereinafter referred to as an "embodiment") will be described with reference to the accompanying drawings. Note that in this specification and the drawings, components having substantially the same functional configuration will be denoted by the same reference numerals, and their repeated description will be omitted. The description will be provided in the following order.

[0036] 1. Configuration Example of First Embodiment of Image Processing System

[0037] 2. Functional block diagram of a smartphone

[0038] 3. File format of image data with tactile information

[0039] 4. Control of tactile presentation device

[0040] 5. Flowchart of haptic control processing

[0041] 6. Modify the example

[0042] 7. Configuration Example of Second Embodiment of Image Processing System

[0043] 8. Computer Configuration Example

[0044] <1. Configuration Example of First Embodiment of Image Processing System>

[0045] Figure 1 A configuration example of a first embodiment of an image processing system to which the present technology is applied is shown.

[0046] Figure 1 The illustrated image processing system 1 includes a smartphone 11 and a server device 12 , and the smartphone 11 and the server device 12 are connected via a network 13 .

[0047] The smartphone 11 is a terminal device (information processing device) operated by a user. In response to user operations, the smartphone 11 accesses the server device 12 via the network 13, acquires image data stored in the server device 12, and displays the image on its own display. The image displayed on the display may be a moving image or a still image.

[0048] The server device 12 includes a storage unit 14 and a communication unit 15. The storage unit 14 stores image data of one or more moving images and image data of one or more still images. In response to a request from the smartphone 11, the communication unit 15 transmits the image data of the moving images or still images stored in the storage unit 14 to the smartphone 11. Note that the server device 12 may store only the image data of the moving images or the image data of the still images.

[0049] The network 13 is an arbitrary communication network, and can be a communication network for wired communication or a communication network for wireless communication, or can include both a communication network for wired communication and a communication network for wireless communication. In addition, the network 13 can include a single communication network or multiple communication networks. The network 13 can include, for example, the Internet, a public telephone network, a wide area network for wireless mobile bodies such as the so-called 4G network or 5G network, a wide area network (WAN), a local area network (LAN), etc. In addition, the network 13 can include a private network, such as an Internet Protocol virtual private network (IP-VPN). In addition, the network 13 can include a communication network or a communication path of any communication standard, such as a wireless communication network that performs communication that conforms to the Bluetooth (registered trademark) standard, a communication path for short-range wireless communication such as near field communication (NFC), a communication path for infrared communication, or a communication network for wired communication that conforms to a high-definition multimedia interface (HDMI (registered trademark)), a universal serial bus (USB), or other standards.

[0050] Note, because Figure 1 The image processing system 1 has a configuration focused on a single user, so only one smartphone 11 and one server device 12 are connected via a network 13. However, the image processing system 1 may have a configuration including multiple smartphones 11. Furthermore, the server device 12 may be divided into two or more server devices depending on the type of image data to be stored, the connection device, and the like. Furthermore, the server device 12 only needs to have image data storage and communication functions and implement server functions, and may be configured as, for example, a personal computer, smartphone, or the like.

[0051] The haptic control information is embedded in the image data of moving images and still images stored in the server device 12. Hereinafter, the image data in which the haptic control information is embedded and stored in the server device 12 in a predetermined file format is referred to as "image data with haptic information."

[0052] Figure 2 An example of image data with tactile information is shown.

[0053] In the image data with tactile information provided from the server device 12, for example, Figure 2 As shown, RGB texture information (color information) and tactile data A used as tactile control information are stored for each pixel. The tactile data A represents a tactile ID (tactile identification information) for identifying a tactile control signal. For example, when the tactile data A stored in a specific pixel is 0 (A=0), this indicates that a tactile control signal with tactile ID=0 is used. In addition, for example, when the tactile data A stored in a specific pixel is 1 (A=1), this indicates that a tactile control signal with tactile ID=1 is used. The tactile control signal is, for example, a signal for driving a tactile presentation device such as a piezoelectric element and corresponds to a vibration waveform in a predetermined time period.

[0054] Figure 3 is a cross-sectional view showing a tactile presentation mechanism of the smartphone 11 .

[0055] The smartphone 11 includes a touch-sensitive display 22 (hereinafter, also simply referred to as the "display") placed on a predetermined surface of a main body (housing) 21, and a piezoelectric actuator 23 attached to the rear surface of the display 22 opposite to the user operation surface. The haptic control signal is, for example, a signal for driving the piezoelectric actuator 23, which serves as a haptic presentation device.

[0056] Smartphone 11 displays an image on display 22 based on texture information of image data having tactile information, and provides a tactile control signal corresponding to tactile data A to piezoelectric actuator 23 according to a position (pixel position) on the image touched by the user, thereby vibrating display 22.

[0057] Therefore, if Figure 4 As shown, in the case where the user touches or traces a predetermined position on the image displayed on the display 22 , the user can feel a tactile sense such as the feel of the material of the image displayed on the display 22 .

[0058] Note that the tactile sensation generating method of generating the tactile sensation may be a method of generating the tactile sensation by vibration in the above-described piezoelectric actuator 23 , or may be a method of generating the tactile sensation by electrical stimulation.

[0059] <2. Functional Block Diagram of Smartphone>

[0060] Figure 5 It is a functional block diagram of the smartphone 11 regarding haptic control for not only displaying an image on the display 22 but also causing the user to perceive the tactile sense of the image.

[0061] The smartphone 11 includes a communication unit 41, a data processing unit 42, a storage unit 43, a sensor unit 44, an image display unit 45, and a tactile presentation unit 46. The communication unit 41, the data processing unit 42, the storage unit 43, the sensor unit 44, the image display unit 45, and the tactile presentation unit 46 are connected to one another via a predetermined bus 47.

[0062] The communication unit 41 includes, for example, a network interface that can be connected to the network 13 and communicate with the server device 12 .

[0063] The communication unit 41 is connected to the server device 12 via the network 13 under the control of the data processing unit 42 and acquires (receives) image data embedded with tactile data in a predetermined file format. The acquired image data is supplied to the data processing unit 42 or the storage unit 43.

[0064] Furthermore, the communication unit 41 may also transmit the image data with tactile information stored in the storage unit 43 to the server device 12 via the network 13 under the control of the data processing unit 42 .

[0065] The user can upload image data with tactile information previously stored in the user's own smartphone 11, image data with tactile information acquired from another device (another user), and other image data to the server device 12. In addition, if the smartphone 11 has a function of creating image data with tactile information, image data with tactile information created by the smartphone itself can also be uploaded. The server device 12 receives image data with tactile information transmitted from each of the plurality of devices including the smartphone 11, and stores the image data with tactile information in the storage unit 14 ( Figure 1 )middle.

[0066] The data processing unit 42 includes, for example, an arithmetic processing unit and a data storage unit such as a central processing unit (CPU), a read-only memory (ROM), and a random access memory (RAM).

[0067] The data processing unit 42 provides a tactile control signal based on the tactile data embedded in the image data with tactile information in a predetermined file format to the tactile presentation unit 46. More specifically, the data processing unit 42 acquires the tactile control signal based on the tactile data A corresponding to the user's touch position on the image displayed based on the image data with tactile information from the storage unit 43 and provides the tactile control signal to the tactile presentation unit 46. The user's touch position on the image is provided from the sensor unit 44 as a touch position on the image display unit 45 (display 22).

[0068] The storage unit 43 includes, for example, a storage medium such as a hard disk or a nonvolatile memory.

[0069] The storage unit 43 stores the image data with tactile information acquired from the server device 12. In addition, the storage unit 43 may store not only the image data with tactile information acquired from the server device 12 but also image data with tactile information previously stored.

[0070] In addition, the storage unit 43 pre-stores a tactile control signal corresponding to the tactile ID embedded in the image data with tactile information as tactile data A. Note that the tactile control signal corresponding to the tactile data A (tactile ID) included in the image data with tactile information is stored in the server device 12, acquired when the image data with tactile information is acquired, or acquired in advance at a timing different from when the image data with tactile information is acquired, and stored in the storage unit 43. Alternatively, the tactile control signal corresponding to the tactile data A (tactile ID) may be stored in a server device other than the server device 12, or the like.

[0071] The sensor unit 44 senses a user touch position on an image displayed on the image display unit 45. The sensor unit 44 includes, for example, a touch sensor overlaid on the display 22. The sensor unit 44 senses a user touch position on the display 22 and provides the sensing result to the data processing unit 42.

[0072] The image display unit 45 includes, for example, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, etc. The image display unit 45 displays an image corresponding to the image data supplied from the data processing unit 42 .

[0073] The tactile sense presenting unit 46 includes a vibration generating device such as the piezoelectric actuator 23 including a piezoelectric element. The tactile sense presenting unit 46 is a tactile sense presenting device that presents a tactile sense to the user.

[0074] Figure 3 The touch sensing display 22 and the piezoelectric actuator 23 correspond to Figure 5The sensor unit 44, image display unit 45 and tactile presentation unit 46 are included.

[0075] <3. File Format of Image Data with Tactile Information>

[0076] Figure 6 An example of a file format of image data embedded with haptic data is shown.

[0077] The image data with tactile information may be transmitted by using, for example, the Portable Network Graphics (PNG) file format.

[0078] In the PNG file format, a parameter called an alpha channel that specifies transparency can be stored for each pixel. This alpha channel area is used as a parameter not for storing transparency but for storing tactile data A. Transparency is a parameter that is not necessarily used, and therefore, tactile data A can be transmitted by using this parameter.

[0079] Specifically, if Figure 6 As shown in FIG. 6A , a PNG format file includes a header 61 and data 62, and the data 62 stores RGB texture information (color information) and tactile data A in pixel units. The tactile data A is stored in the α channel area. The α channel is not limited to binary values ​​"0" and "1" and can be defined by 8 bits (256 gray levels). By embedding the tactile data A in each pixel as tactile control information for controlling the tactile rendering device, a fine tactile feeling can be reproduced.

[0080] The header 61 may store a tactile data flag HAP_FLG as metadata describing information about the data. This tactile data flag HAP_FLG indicates whether the data stored in the alpha channel area is transparency or tactile data. For example, HAP_FLG = 1 indicates that the data stored in the alpha channel area is tactile data, while HAP_FLG = 0 indicates that the data stored in the alpha channel area is transparency. Therefore, a reproduction-side application (program) that has acquired the file can determine whether to process the alpha channel as transparency or as tactile data.

[0081] In addition, if Figure 6 As shown in FIG. 1B , the header 61 may include a haptic use flag AUSE_FLG that specifies whether to use the data stored in the α channel area. Therefore, if a reproduction-side application that has acquired a file does not support control for using haptic data, the haptic data stored in the α channel may be prevented from being used based on the haptic use flag AUSE_FLG.

[0082] In addition, if Figure 6As shown in FIG. 3C , the header 61 may store both a haptic data flag HAP_FLG indicating transparency or haptic data and a haptic use flag AUSE_FLG specifying whether to use data stored in the α channel area.

[0083] In the above description, the example of PNG is described as a file format having an alpha channel. However, the alpha channel area can also be similarly applied as an area for storing tactile data in file formats having an alpha channel other than PNG (for example, Audio Video Interleave (AVI) and QuickTime). An existing file format having an alpha channel is adopted as a file format for transmitting image data having tactile information, and thus tactile information can be presented by using the existing data format without preparing a special data format or developing a new data format. The mechanism of using the existing file format facilitates data transmission and reception between devices, such as the distribution of data from the server device 12.

[0084] Note that the present technology is not limited to a file format having an α channel as a file format for image data having tactile information. Figure 6 As shown in D of FIG, even if the file format has an alpha channel, the tactile data A is not stored in the alpha channel area, but the tactile data (HAP_DATA) 64 for all pixels in the data 62 may be stored in a manner such that the tactile data 64 is added to the end of the pixel data 63 stored in the existing format. Alternatively, the tactile data 64 may be placed before the pixel data 63 stored in the data 62 in the existing format, or may be placed before the header 61. In addition, the tactile data may be stored in an area (free description area) in which the application can freely describe data, such as the application extension area of ​​the header 61. Note that, needless to say, referring to Figure 6 The method of storing tactile data described in D can also be applied to files in a file format that does not have an alpha channel.

[0085] In the above example, the tactile data A is described as being stored in pixel units. However, instead of storing the tactile data A in one pixel unit, the tactile data A may be stored in multiple pixel units (for each group of multiple pixels) in both the horizontal and vertical directions. When the user touches a pixel without tactile data A, the data processing unit 42 can provide a tactile control signal to the tactile presentation unit 46 by using the tactile data A of one or more pixels having tactile data A around the touch position.

[0086] Furthermore, when the image data having tactile information is image data of a dynamic image, tactile data A may be stored in units of one frame or multiple frames. In this case, tactile data A of an adjacent image may be used for tactile data A of an image in which tactile data A is not stored.

[0087] Furthermore, the haptic data A may be stored in units of a plurality of frames, and the haptic data A may also be stored in units of a plurality of pixels in an image in which the haptic data A is stored.

[0088] In the above example, the haptic ID for identifying the haptic control signal is embedded in the α channel of each pixel. However, the haptic control signal itself may be embedded therein. In addition, the haptic control signal embedded in the α channel may not be as Figure 2 The waveform with a time width shown is not a waveform with a time width, but data such as an instantaneous value, for example, a tactile stimulus value obtained by quantizing the intensity of the tactile stimulus. In addition, the tactile ID can be embedded in the α channel of each pixel, and the tactile control signal can be embedded in a channel such as Figure 6 The head 61 in D or another position of the tactile data 64 after the pixel data 63 .

[0089] The number of tactile data A (tactile ID) embedded in the α channel of each pixel is not limited to one, and multiple pieces of tactile data A (tactile ID) may be embedded therein. For example, control may be performed so that three pieces of tactile data A1 to A3 corresponding to three vibration patterns of strong, medium, and weak are embedded in the α channel, and a tactile control signal of one of the multiple pieces of tactile data A1 to A3 corresponding to the vibration pattern set by the user is acquired and provided to the tactile presentation device.

[0090] <4. Control of Tactile Presentation Device>

[0091] Will refer to Figures 7 to 9 Control of a tactile presentation device based on tactile data A is described.

[0092] Figure 7 and Figure 8 An example is shown in which the data processing unit 42 controls the tactile sense presentation device in a case where the user performs a tracing (sliding) operation on an image displayed on the display 22 .

[0093] Figure 7 A shows a state in which the user performs a drawing operation on the image displayed on the display 22 and the tactile data A (tactile ID) of the pixel touched by the user changes from “0” to “1”.

[0094] like Figure 7 As shown in B, when the tactile data A (tactile ID) of the pixel touched by the user changes from "0" to "1", as the most basic control, the data processing unit 42 can perform control to switch the tactile control signal corresponding to the tactile ID at the moment the tactile ID changes.

[0095] In addition, for example, Figure 7As shown in Figure C, the data processing unit 42 can perform control to switch the tactile control signal corresponding to the tactile ID by controlling the starting output level (amplitude) of the next tactile control signal (of the next tactile ID) according to the movement speed of the finger at the switching moment. Specifically, when the tactile data A (tactile ID) changes from "0" to "1" when the movement speed of the finger changes rapidly, the data processing unit 42 increases the starting output level of the tactile control signal, and when the tactile data A (tactile ID) changes from "0" to "1" when the movement speed of the finger changes slowly, the data processing unit 42 decreases the starting output level of the tactile control signal. Figure 7 C is a graph showing an example of greatly changing output levels.

[0096] Note that when the finger's moving speed is high, the time for touching the pixel becomes shorter, and therefore, the pitch (reproduction speed) of the output level of the tactile control signal can be controlled according to the moving speed. Specifically, when the finger's moving speed is high, the data processing unit 42 increases the pitch (reproduction speed) of the output level of the tactile control signal. Meanwhile, when the finger's moving speed is low, the data processing unit 42 decreases the pitch (reproduction speed) of the output level of the tactile control signal. This will be referred to later. Figure 8 B describes the control of pitch (reproduction speed).

[0097] When the finger moves at a high speed and the output level (amplitude) of the tactile control signal decreases according to the movement speed, the output level may become lower than the user's sensed level. Therefore, a sufficient tactile sensation cannot be provided. Therefore, the output level of the tactile control signal may have a lower limit value.

[0098] In addition, for example, Figure 7 As shown in D of FIG. 8 , the data processing unit 42 may perform control to switch the haptic control signal by fading out the haptic control signal of the haptic data that has not changed from “0” to “1” and fading in the changed haptic control signal.

[0099] Figure 8 A shows a state in which the user performs a drawing operation on the image displayed on the display 22 and the tactile data A (tactile ID) of the pixel touched by the user remains “1”.

[0100] In this case, for example, the data processing unit 42 can perform control to switch the tactile control signal by controlling the output level (amplitude) and pitch (reproduction speed) of the start of the next tactile control signal (of the next tactile ID) according to the movement speed of the finger when crossing pixels.

[0101] For example, Figure 8As shown in B, the operation of detecting the drawing of five pixels with the tactile data A (tactile ID) of "1" is performed in order, and the speed when crossing pixels is in the following order: V1, V2, V3, V2, and V1 (V1 < V2 < V3).

[0102] When the moving speed of the finger when crossing pixels is high, the data processing unit 42 increases the output level (amplitude) and pitch (reproduction speed) of the tactile control signal. At the same time, when the moving speed of the finger when crossing pixels is low, the data processing unit 42 decreases the output level (amplitude) and pitch (reproduction speed) of the tactile control signal.

[0103] In Figure 8 In the example of the tactile control signal in B, the sections of the respective tactile control signals corresponding to the pitch are T1, T2, T3, T2, and T1 (T3 < T2 < T1), which respectively correspond to the speeds V1, V2, V3, V2, and V1. In addition, the output level (amplitude) is also the speeds AMP1, AMP2, AMP3, AMP2, and AMP1 (AMP1 < AMP2 < AMP3), which respectively correspond to the speeds V1, V2, V3, V2, and V1.

[0104] Figure 7 The operation example shown is an example of changing the tactile data A (tactile ID) of pixels by the operation of the user drawing an image displayed on the display 22 (i.e., the active operation of the user). However, the tactile data A (tactile ID) of pixels can be changed passively. Specifically, when the image data with tactile information is a dynamic image, even if the user touches the same pixel position without moving the finger, the image can be changed, and the tactile data A (tactile ID) stored in the pixel at the touch position can be changed.

[0105] Figure 9 A of

[0106] In Figure 7 A of Figure 8 A of Figure 9 In A of

[0107] As <00002As shown in B, when the tactile data A (tactile ID) stored in the pixel at the touch position changes from "0" to "1" due to the change of the image, as the most basic control, the data processing unit 42 can perform control to switch the tactile control signal corresponding to the tactile ID at the moment the tactile ID changes.

[0108] Alternatively, if Figure 9 As shown in C, the data processing unit 42 may perform control to switch the haptic control signal by fading out the haptic control signal of the haptic data that has not changed from “0” to “1” and fading in the changed haptic control signal.

[0109] Figure 10 There is shown a process of the tactile data A (tactile ID) that is performed when the user performs, for example, a pinch-out operation on an image displayed on the display 22 to enlarge the image displayed on the display 22 .

[0110] When the image is magnified, standard image magnification processing of a drawing application can be performed on the tactile data A as is, as in the case of the α channel, to generate tactile data A for each magnified pixel. When a new pixel is generated by interpolation between a pixel where tactile data A = "0" and a pixel where tactile data A = "1" due to image magnification, tactile data A for the pixel generated by interpolation is generated as, for example, tactile data A = "0.5" by interpolation using tactile data A = "0" and tactile data A = "1."

[0111] In the case where the user touches the pixel with tactile data A = "0.5", the data processing unit 42 can generate a tactile control signal obtained by superimposing the tactile control signal for tactile ID = "0" and the tactile control signal for tactile ID = "1" as a tactile control signal for the pixel with tactile data A = "0.5", and provide the tactile control signal to the tactile rendering device.

[0112] Furthermore, when the user performs a pinch-in operation or the like to reduce the image, the standard image reduction processing of the drawing application can be performed on the tactile data A as it is, as in the case of the α channel, to generate tactile data A for each reduced pixel. For example, when reducing multiple pixels to one pixel, the pixels to be reduced can be omitted, or the average value of the tactile data A of the multiple pixels to be aggregated can be set as the tactile data A of the aggregated pixel.

[0113] When the tactile data A of a pixel is changed to third tactile data A3 between the first tactile data A1 and the second tactile data A2 according to the enlargement or reduction of the image, the data processing unit 42 can generate a signal obtained by superimposing a tactile control signal corresponding to the first tactile data A1 and a tactile control signal corresponding to the second tactile data A2, and provide the signal to the tactile presentation device.

[0114] Since the α channel of the pixel is used for the tactile data A controlling the tactile presentation device, processing can be performed as it is by using the standard image enlargement processing of the drawing application without requiring special processing in the enlargement or reduction processing of the image, which is easy to apply.

[0115] <5. Flowchart of Haptic Control Processing>

[0116] Will refer to Figure 11 The flowchart of FIG describes a tactile control process in which the smartphone 11 causes the user to perceive tactile information according to the touch position on the image. For example, this process starts when the user instructs the smartphone 11 to perform an operation to obtain image data with tactile information stored in the server device 12.

[0117] Note that in Figure 11 Before the processing of is started, a tactile control signal corresponding to the tactile data A (tactile ID) that may be stored in the image is acquired and stored in the storage unit 43 in advance.

[0118] First, in step S1, the communication unit 41, under the control of the data processing unit 42, requests image data with tactile information from the server device 12, and acquires (receives) the image data with tactile information provided by the server device 12. The acquired image data with tactile information is provided to the data processing unit 42. The acquired image data with tactile information is specified by a user operation. Note that if the user specifies image data with tactile information stored in the storage unit 43 as a target to be displayed, the image data with tactile information is not acquired from the server device 12, but the image data with tactile information stored in the storage unit 43 is acquired in step S1.

[0119] In step S2, the data processing unit 42 analyzes metadata of the header 61 of the image data with tactile information. Specifically, the data processing unit 42 refers to the tactile data flag HAP_FLG stored in the metadata and determines whether tactile data A is stored in the acquired image data with tactile information.

[0120] In step S3, the data processing unit 42 supplies an image signal to the display 22 based on the texture information of the image data including tactile information, and causes the display 22 to display an image. The display 22 displays the image based on the image signal supplied from the data processing unit 42. The image may be a dynamic image or a still image. If the image to be displayed is a dynamic image, after the processing in step S3 is started, one or more images forming the dynamic image are sequentially displayed on the display 22 at a predetermined frame rate.

[0121] In step S4 , the data processing unit 42 determines whether the tactile data A is included in the image data with tactile information of the image displayed on the display 22 based on the analysis result of the metadata in step S2 .

[0122] If it is determined in step S4 that the tactile data A is not included in the image data having tactile information of the image displayed on the display 22, the process ends. Figure 11 Tactile control processing.

[0123] Meanwhile, in a case where it is determined in step S4 that the tactile data A is included in the image data with tactile information of the image displayed on the display 22 , the process proceeds to step S5 .

[0124] In step S5 , the data processing unit 42 determines whether a touch of the display 22 by the user has been detected based on the sensing result from the sensor unit 44 (touch sensor), and repeats the processing in step S5 until it is determined that a touch is detected.

[0125] Then, in a case where it is determined in step S5 that the user touch has been detected, the processing proceeds to step S6, and the data processing unit 42 identifies the tactile data A stored in the α channel of the pixel at the user touch position, and obtains the tactile control signal corresponding to the tactile ID indicated by the tactile data A from the storage unit 43.

[0126] In step S7, the data processing unit 42 modulates the tactile control signal corresponding to a single or multiple tactile IDs based on the user's touch operation (such as the operation of drawing an image on the display 22 or the operation of enlarging or reducing an image), and provides the modulated tactile control signal to the tactile presentation unit 46 (tactile presentation device).

[0127] In step S8, the tactile sense presentation unit 46 performs tactile sense presentation based on the tactile sense control signal supplied from the data processing unit 42. Specifically, the piezoelectric actuator 23 serving as tactile sense presentation means vibrates the surface of the display 22 touched by the user.

[0128] Actually, the processing in steps S6 to S8 is partially performed in parallel.

[0129] In step S9, the data processing unit 42 determines whether to terminate the haptic control process. For example, the data processing unit 42 determines to terminate the haptic control process when an instruction to terminate the application executing the haptic control process is issued, or when an operation to terminate the display of an image displayed on the display 22 is performed.

[0130] In the case where it is determined in step S9 that the haptic control process is not to be ended, the data processing unit 42 returns the process to step S5 and repeatedly executes the above-described steps S5 to S9 .

[0131] Meanwhile, in the case where it is determined in step S9 that the haptic control process is to be terminated, Figure 11 The tactile control process ends.

[0132] The haptic control process of the data processing unit 42 of the smartphone 11 is performed as described above.

[0133] Note that in the above-described haptic control process, a haptic control signal corresponding to the haptic data A (haptic ID) stored in the α channel of each pixel of the image displayed on the display 22 is acquired and stored in the storage unit 43 in advance before the image is displayed.

[0134] However, in the processing of step S1 of obtaining image data with tactile information specified by the user from the server device 12, the image data with tactile information and the tactile control signal corresponding to the tactile data A (tactile ID) included in the image data with tactile information can be simultaneously obtained from the server device 12 and stored in the storage unit 43.

[0135] Alternatively, for example, in a case where there is sufficient margin in the communication frequency band of the network 13 and high-speed communication can be performed between the smart phone 11 and the server device 12, the tactile control signal is not acquired in advance, but the tactile control signal is acquired when the pixel at the touch position is specified, and the tactile control signal corresponding to the tactile ID of the pixel at the touch position can be acquired by accessing the server device 12.

[0136] Specifically, the following method can be adopted: the URL (for example, "http: / / haptic.com / ?id=") as the access destination of the server device 12 is stored in the metadata of the header 61, and when the tactile data A (tactile ID) stored in the alpha channel of the pixel touched by the user is "2", the tactile control signal corresponding to the tactile ID is obtained by accessing the URL "http: / / haptic.com / ?id="2".

[0137] When the user performs a drawing operation, the data processing unit 42 may also perform control to predict (pre-read) the movement destination of the drawing operation and acquire a haptic control signal corresponding to the haptic ID of the predicted pixel from the storage unit 43 or the server device 12 .

[0138] When a haptic control signal corresponding to a haptic ID cannot be acquired in real time due to limitations of communication speed, communication cost (communication time), etc., a haptic control signal previously acquired and stored in the storage unit 43 or cache may be used.

[0139] Not only the tactile data A (tactile ID) for controlling the tactile control device, but also the sound ID (sound control identification information) for controlling the audio device that causes sound output can be embedded in the alpha channel of each pixel. For example, 8-bit alpha channel data can be embedded by assigning 0 to 127 to the tactile ID and 128 to 255 to the sound ID. Alternatively, a value corresponding to a combination of the tactile ID and the sound ID can be embedded. For example, data corresponding to a predefined combination can be embedded as follows: alpha channel data of "1" indicates tactile ID = "1" and sound ID = "1"; and alpha channel data of "5" indicates tactile ID = "4" and sound ID = "1".

[0140] <6. Modification Example>

[0141] In the above-described first embodiment, the following modification examples can be performed.

[0142] <Configuration Example of Providing Tactile Presentation Means for Each Pixel>

[0143] In the first embodiment described above, Figure 3 As shown, a single piezoelectric actuator 23 serving as a tactile presentation device is provided to the display 22 and is controlled to vibrate the display 22 to give a tactile sensation to the user by providing different or the same tactile control signals to the piezoelectric actuator 23 according to the position (pixel position) on the image touched by the user.

[0144] At the same time, if Figure 12 As shown, a device configuration in which a piezoelectric actuator 23P generating vibration is provided in pixel units of the display 22 may also be employed. In this case, for each of the multiple pixels including the touch location, the data processing unit 42 may independently provide a haptic control signal corresponding to the haptic ID of each pixel to the piezoelectric actuator 23P, thereby causing the piezoelectric actuator 23P to vibrate. Of course, the piezoelectric actuator 23P may be provided not in a single pixel unit but in a plurality of pixel units.

[0145] <Configuration Example of Providing Tactile Presentation Means Other than Display>

[0146] like Figure 13 As shown, the smartphone 11 may include another piezoelectric actuator 71 in addition to the piezoelectric actuator 23 attached to the rear surface of the display 22. The piezoelectric actuator 71 is attached to the main body (casing) 21 of the smartphone 11, for example.

[0147] The user generally holds and grips the main body 21 of the smartphone 11 with one hand and performs a touch operation on the display 22 with the other hand. Therefore, with the piezoelectric actuator 71 attached to the main body 21, the data processing unit 42 can perform a tactile presentation on the hand holding the main body 21 that is different from the tactile presentation in response to the touch operation on the display 22.

[0148] For example, when the image displayed on the display 22 is a moving image, the piezoelectric actuator 71 of the main body 21 can be caused to perform tactile presentation or the like based on sound data (sound data) reproduced together with the moving image.

[0149] As described above, tactile data for tactile presentation based on the touched position of the image displayed on the display 22 is embedded in the alpha channel of each pixel in the data 62 of the image data of the dynamic image, the free description area of ​​the header 61 thereof, etc. At the same time, tactile data for tactile presentation based on the sound data (audio data) reproduced together with the dynamic image can be embedded in the file for the sound data.

[0150] <Tactile presentation function on / off>

[0151] The data processing unit 42 can turn the tactile presentation function on or off based on the haptic control information embedded in the alpha channel, according to setting conditions set by a setting unit (not shown). The tactile presentation function can be turned on or off in response to a user's designation. Furthermore, the data processing unit 42 can include an automatic save function that automatically turns off the tactile presentation function when, for example, the communication speed of the communication unit 41 via the network 13 or the remaining battery charge of the smartphone 11 falls below a specified reference value. When the tactile presentation function is turned off, the processing of acquiring the tactile control signal corresponding to the tactile ID from the server device 12, providing the tactile control signal to the tactile presentation device, and analyzing metadata of the image data containing tactile information are stopped.

[0152] <7. Configuration Example of Second Embodiment of Image Processing System>

[0153] In the above-mentioned first embodiment, all sensor units 44 for sensing the user's touch position on the image, an image display unit 45 for displaying an image of image data with tactile information, and a tactile presentation unit 46 for presenting a tactile sense to the user are provided in the smart phone 11 as a single information processing device.

[0154] However, the sensor unit 44 , the image display unit 45 , and the tactile presentation unit 46 are not necessarily integrated, and at least one of them may be configured as a plurality of separate devices.

[0155] Figure 14 A configuration example of a second embodiment of an image processing system to which the present technology is applied is shown.

[0156] In the second embodiment, if Figure 14 As shown, the devices corresponding to the smartphone 11 in the first embodiment are divided into three devices, ie, an information processing device 81 , a head mounted display 82 , and a glove 83 .

[0157] The information processing device 81 is configured as, for example, a personal computer, a smartphone, or a dedicated data processing device. The information processing device 81 includes the aforementioned data processing unit 42 and acquires image data containing tactile information in a predetermined file format to analyze metadata. The information processing device 81 then provides tactile control signals to the glove 83 based on the user's hand movements transmitted from the head-mounted display 82.

[0158] The head mounted display 82 includes an image display unit 45 ( Figure 14 ) and the sensor unit 44.

[0159] The image display unit 45 includes a liquid crystal display, an OLED display, or the like, and displays and presents the image 84 supplied from the information processing device 81 to the user. Figure 14 The image 84 is an image corresponding to image data having tactile information, and is an image diagram displayed on the image display unit 45 of the head mounted display 82 .

[0160] The sensor unit 44 includes, for example, an image sensor that images a front subject, a distance measurement sensor (ToF sensor) that measures the distance to the front subject, etc. The sensor unit 44 senses movement of the user's hand wearing the glove 83 and provides the sensing result to the information processing device 81.

[0161] The glove 83 includes a tactile presentation unit 46 , and is a tactile presentation device that presents a tactile sensation to the user based on a tactile control signal supplied from the information processing device 81 .

[0162] The information processing device 81 communicates with the server device 12 and receives image data containing tactile information and a tactile control signal corresponding to a tactile ID. The information processing device 81 transmits an image signal corresponding to an image 84 containing the image data containing tactile information to the head-mounted display 82. The head-mounted display 82 causes the image display unit 45 to display the image 84 based on the received image signal. When the user moves their hand wearing the glove 83 relative to the image 84 displayed on the head-mounted display 82, the movement is detected by the sensor unit 44 and transmitted to the information processing device 81. The information processing device 81 transmits a tactile control signal to the glove 83 corresponding to the tactile data A (tactile ID) of the pixel corresponding to the position of the user's hand on the image 84. The glove 83 presents a tactile sensation to the user based on the tactile control signal transmitted from the information processing device 81.

[0163] The image display unit 45 may be a 3D display that displays an image for the left eye and an image for the right eye so that the user can stereoscopically perceive the image using parallax of the two images. The head mounted display 82 realizes a world called virtual reality (VR), augmented reality (AR), or the like.

[0164] Examples of image data formats for 3D objects include: a first format, in which two images for the left eye and the right eye and a depth image indicating the depth direction are sent; a second format, in which the three-dimensional position of an object is represented by a set of points (point cloud), and the color information of the object is saved corresponding to each point; and a third format, in which the three-dimensional position of an object is represented by connections between vertices called polygon meshes, and the color information of the object is saved as a texture image of a UV coordinate system corresponding to each polygon mesh.

[0165] For example, in the first format, haptic control information (eg, haptic data A) for controlling the haptic presentation device only needs to be embedded in the alpha channel of each pixel for either the left-eye image or the right-eye image, as in the case of a two-dimensional image.

[0166] In the second format or the third format, haptic control information (eg, haptic data A) for controlling the haptic presentation device may be embedded corresponding to points or polygonal meshes indicating a three-dimensional position of an object.

[0167] Figure 15 Shown Figure 14 The information processing device 81, the head mounted display 82 and the gloves 83 are Figure 5 The correspondence between the functional blocks.

[0168] like Figure 15As shown, the sensor unit 44 and the image display unit 45 are included in a single device (head-mounted display 82), but the sensor unit 44 and the image display unit 45 may be included in separate devices. For example, the sensor unit 44 may be an imaging device such as a stereo camera that images the user wearing the glove 83 and the head-mounted display 82 from different viewpoints.

[0169] Alternatively, the sensor unit 44 may be integrated with the glove 83 including the tactile presentation unit 46. Specifically, the sensor unit 44 may include an acceleration sensor, a gyro sensor, etc. that estimates the posture of the glove 83 itself and is configured as a part of the glove 83.

[0170] The predetermined bus 47 connecting the information processing device 81, the head mounted display 82, and the gloves 83 includes a network. The information processing device 81, the head mounted display 82, and the gloves 83 can transmit and receive sensing data, tactile control signals, image signals, etc. through wireless communication such as Bluetooth (registered trademark) or Wi-Fi (registered trademark). Therefore, the user can feel a more realistic sensation because not only visual information but also tactile information is increased.

[0171] In the case where the image display unit 45 is included in a device different from the device including the sensor unit 44 or the tactile presentation unit 46 and only needs to have a function of simply displaying an image, the image display unit 45 can be, for example, a display of a television receiver, AR glasses, etc.

[0172] <8. Computer Configuration Example>

[0173] The above series of processes can be performed by hardware or software. In the case of performing a series of processes by software, the program forming the software is installed in a computer. In this article, a computer includes, for example, a microcomputer built into dedicated hardware, a general-purpose personal computer capable of performing various functions by installing various programs, etc.

[0174] Figure 16 8 is a block diagram showing a hardware configuration example of a computer in a case where the information processing apparatus 81 is configured as a computer.

[0175] A central processing unit (CPU) 101 , a read only memory (ROM) 102 , and a random access memory (RAM) 103 are connected to one another via a bus 104 in the computer.

[0176] The bus 104 is also connected to an input / output interface 105. The input / output interface 105 is connected to an input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110.

[0177] Input unit 106 includes a keyboard, a mouse, a microphone, a touch screen, input terminals, etc. Output unit 107 includes a display, a speaker, output terminals, etc. Storage unit 108 includes a hard disk, a RAM disk, a nonvolatile memory, etc. Communication unit 109 includes a network interface, etc. Drive 110 drives removable recording medium 111 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0178] In the computer configured as described above, the above series of processes are performed by, for example, CPU 101 loading a program stored in storage unit 108 into RAM 103 via input / output interface 105 and bus 104 and executing the program. RAM 103 also appropriately stores data and the like required for CPU 101 to execute various processes.

[0179] The program executed by the computer (CPU 101) can be provided by, for example, recording the program on the removable recording medium 111 serving as a package medium, etc. Furthermore, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0180] In the computer, by attaching the removable recording medium 111 to the drive 110, the program can be installed in the storage unit 108 via the input / output interface 105. In addition, the program can be received by the communication unit 109 via a wired or wireless transmission medium and installed in the storage unit 108. In addition, the program can also be installed in the ROM 102 or the storage unit 108 in advance.

[0181] Note that the program executed by the computer may be a program that performs processing in time series in the order described in this specification, or may be a program that performs processing in parallel or at necessary timing (such as when a call is made).

[0182] Notice, Figure 1 The server device 12 in the embodiment may also be configured to Figure 16 The hardware is configured in the same way as in the example.

[0183] The tactile presentation technology of the present disclosure using image data with tactile information is not limited to the above-mentioned embodiments and can be applied to all terminal devices including displays that display images and allow users to perform touch operations. For example, the present disclosure can also be applied to information terminals installed in stores such as convenience stores and bank automated teller machines (ATMs).

[0184] The embodiment of the present technology is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present technology.

[0185] For example, a mode in which all or part of the above-described embodiments are combined may be adopted.

[0186] For example, the present technology may have a configuration of cloud computing in which a single function is shared by a plurality of devices via a network and jointly processed.

[0187] Of course, the steps shown in the flowchart can be performed in time series in the order described, but the steps may not necessarily be processed in time series and may be performed in parallel or at necessary timing (such as when a call is made).

[0188] Furthermore, each of the steps described in the above flowcharts may be performed by a single device, or may be performed by being shared by a plurality of devices.

[0189] Furthermore, in the case where a single step includes a plurality of processes, the plurality of processes included in the single step may be executed by a single device, or may be executed by being shared by a plurality of devices.

[0190] Note that in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), and it does not matter whether all components are included in the same housing. Therefore, multiple devices included in separate housings and connected via a network and a single device including multiple modules in a single housing are both systems.

[0191] Note that the effects described in this specification are merely illustrative and non-limiting. Furthermore, effects other than those described in this specification can be obtained.

[0192] Note that the present technology can have the following configurations. (1)

[0194] An information processing device, comprising:

[0195] A data processing unit is configured to provide a haptic control signal to a haptic presentation device based on haptic control information embedded in the image data in a predetermined file format. (2)

[0197] The information processing device according to (1), wherein

[0198] The data processing unit provides the tactile control signal to the tactile presentation device based on the tactile control information corresponding to a touch position of a user on an image displayed based on the image data. (3)

[0200] The information processing device according to (2), wherein

[0201] When the haptic control information corresponding to the touch position changes due to a change in the image or a change in the touch position, the data processing unit performs a fade-out / fade-in process of the haptic control signal. (4)

[0203] The information processing device according to (2) or (3), wherein

[0204] The data processing unit controls at least one of an output level or a pitch of the haptic control signal according to a moving speed of the touch position. (5)

[0206] The information processing device according to any one of (1) to (4), wherein

[0207] The haptic control information is haptic recognition information for recognizing the haptic control signal. (6)

[0209] The information processing device according to (5), wherein

[0210] The predetermined file format is a file format having an alpha channel, and

[0211] The tactile recognition information is stored in the alpha channel. (7)

[0213] The information processing device according to (5) or (6), further comprising:

[0214] A storage unit is configured to store the haptic control signal corresponding to the haptic recognition information. (8)

[0216] The information processing device according to any one of (5) to (7), further comprising:

[0217] a communication unit configured to communicate with another device, wherein

[0218] The data processing unit acquires a haptic control signal corresponding to the haptic recognition information from the other device via the communication unit. (9)

[0220] The information processing device according to any one of (1) to (8), wherein

[0221] The haptic control information is stored in pixel units of the image data. (10)

[0223] The information processing device according to (9), wherein

[0224] In a case where the tactile control information of the pixel has a third value between a first value and a second value in response to enlargement or reduction of an image displayed based on the image data, the data processing unit provides a signal obtained by superimposing a tactile control signal corresponding to the first value and a tactile control signal corresponding to the second value to the tactile presentation device. (11)

[0226] The information processing device according to any one of (1) to (10), wherein

[0227] In a case where the image data in the predetermined file format is image data of a dynamic image, other haptic control information is further embedded in the sound data of the dynamic image. (12)

[0229] The information processing device according to any one of (1) to (11), wherein

[0230] The haptic control information is stored in one or more frame units of the image data. (13)

[0232] The information processing device according to any one of (1) to (12), wherein

[0233] The haptic control information is stored in two or more pixel units of the image data. (14)

[0235] The information processing device according to any one of (1) to (13), wherein

[0236] The tactile control information is a tactile stimulation value obtained by quantifying the intensity of the tactile stimulation, and

[0237] The data processing unit provides the tactile control signal corresponding to the tactile stimulation value to the tactile presentation device. (15)

[0239] The information processing device according to any one of (2) to (14), further comprising:

[0240] a sensor unit configured to sense a touch position of the user;

[0241] an image display unit configured to display the image based on the image data; and

[0242] The tactile presentation device. (16)

[0244] A server device, comprising:

[0245] a storage unit configured to store image data in a predetermined file format in which haptic control information is embedded; and

[0246] A communication unit is configured to transmit the image data to a predetermined information processing device in response to a request from the predetermined information processing device. (17)

[0248] The server device according to (16), wherein

[0249] The tactile control information is tactile identification information for identifying a tactile control signal to be provided to a tactile presentation device.

[0250] The storage unit further stores the tactile control signal corresponding to the tactile recognition information, and

[0251] The communication unit transmits the haptic control signal to the predetermined information processing device in response to a request from the predetermined information processing device. (18)

[0253] The server device according to (16) or (17), wherein

[0254] The communication unit receives the image data in the predetermined file format transmitted from another information processing apparatus, and

[0255] The storage unit stores the received image data in the predetermined file format. (19)

[0257] An information processing method, comprising:

[0258] Enable the information processing device to:

[0259] A haptic control signal is provided to a haptic presentation device based on haptic control information embedded in image data in a predetermined file format. (20)

[0261] A program that causes a computer to:

[0262] A data processing unit is configured to provide a haptic control signal to a haptic presentation device based on haptic control information embedded in the image data in a predetermined file format.

[0263] Reference Mark List

[0264] 1 Image Processing System

[0265] 11 Smartphone

[0266] 12 Server Devices

[0267] 13 Network

[0268] 14 storage units

[0269] 15 Communication Unit

[0270] 21 Main body (shell)

[0271] 22 Display

[0272] 23 Piezoelectric actuator

[0273] 41 Communication Unit

[0274] 42 Data Processing Unit

[0275] 43 storage units

[0276] 44 sensor units

[0277] 45 Image display unit

[0278] 46 Tactile presentation unit

[0279] 61 Head

[0280] 62 data

[0281] 63 pixel data

[0282] 64 tactile data

[0283] 71 Piezoelectric Actuator

[0284] 81 Information processing device

[0285] 82 Head-mounted display

[0286] 83 gloves

[0287] 101 CPU

[0288] 102 ROM

[0289] 103 RAM

[0290] 106 Input Units

[0291] 107 Output Unit

[0292] 108 storage units

[0293] 109 Communication Unit

[0294] 110 Driver

Claims

1. An information processing device, comprising: a data processing unit configured to provide a haptic control signal to the haptic presentation device based on haptic control information embedded in the image data in a predetermined file format, The tactile control information is tactile recognition information used to identify the tactile control signal. The predetermined file format is a file format having an alpha channel, storing the tactile recognition information in the alpha channel, without storing transparency of pixels of the image data in the alpha channel, The file in the predetermined file format includes a tactile data flag indicating whether the data stored in the alpha channel is the transparency or the tactile recognition information.

2. The information processing device according to claim 1, wherein The data processing unit provides the tactile control signal to the tactile presentation device based on the tactile control information corresponding to a touch position of a user on an image displayed based on the image data.

3. The information processing device according to claim 2, wherein: When the haptic control information corresponding to the touch position changes due to a change in the image or a change in the touch position, the data processing unit performs a fade-out / fade-in process of the haptic control signal.

4. The information processing device according to claim 2, wherein: The data processing unit controls at least one of an output level or a pitch of the haptic control signal according to a moving speed of the touch position.

5. The information processing apparatus according to claim 1, further comprising: A storage unit is configured to store the haptic control signal corresponding to the haptic recognition information.

6. The information processing apparatus according to claim 1, further comprising: a communication unit configured to communicate with another device, wherein The data processing unit acquires the haptic control signal corresponding to the haptic recognition information from the other device via the communication unit.

7. The information processing apparatus according to claim 1, wherein: The haptic control information is stored in pixel units of the image data.

8. The information processing apparatus according to claim 7, wherein: In a case where the tactile control information of a pixel has a third value between a first value and a second value in response to enlargement or reduction of an image displayed based on the image data, the data processing unit provides the tactile presentation device with a signal obtained by superimposing a tactile control signal corresponding to the first value and a tactile control signal corresponding to the second value.

9. The information processing apparatus according to claim 1, wherein: In a case where the image data in the predetermined file format is image data of a dynamic image, other haptic control information is further embedded in the sound data of the dynamic image.

10. The information processing apparatus according to claim 1, wherein: The haptic control information is stored in one or more frame units of the image data.

11. The information processing apparatus according to claim 1, wherein: The haptic control information is stored in two or more pixel units of the image data.

12. The information processing apparatus according to claim 1, wherein: The tactile control information is a tactile stimulation value obtained by quantifying the intensity of the tactile stimulation, and The data processing unit provides the tactile control signal corresponding to the tactile stimulation value to the tactile presentation device.

13. The information processing apparatus according to claim 2, further comprising: a sensor unit configured to sense a touch position of the user; an image display unit configured to display the image based on the image data; as well as The tactile presentation device.

14. A server device comprising: a storage unit configured to store image data in a predetermined file format in which haptic control information is embedded; as well as a communication unit configured to transmit the image data to a predetermined information processing device in response to a request from the predetermined information processing device, The tactile control information is tactile recognition information used to identify a tactile control signal to be provided to a tactile presentation device. The predetermined file format is a file format having an alpha channel, storing the tactile recognition information in the alpha channel, without storing transparency of pixels of the image data in the alpha channel, The file in the predetermined file format includes a tactile data flag indicating whether the data stored in the alpha channel is the transparency or the tactile recognition information.

15. The server device according to claim 14, wherein: The storage unit further stores the tactile control signal corresponding to the tactile recognition information, and The communication unit transmits the haptic control signal to the predetermined information processing device in response to a request from the predetermined information processing device.

16. The server device according to claim 14, wherein: The communication unit receives the image data in the predetermined file format transmitted from another information processing apparatus, and The storage unit stores the received image data in the predetermined file format.

17. An information processing method, comprising: Enable the information processing device to: providing a tactile control signal to a tactile presentation device based on tactile control information embedded in image data in a predetermined file format, The tactile control information is tactile recognition information used to identify the tactile control signal. The predetermined file format is a file format having an alpha channel, storing the tactile recognition information in the alpha channel, without storing transparency of pixels of the image data in the alpha channel, The file in the predetermined file format includes a tactile data flag indicating whether the data stored in the alpha channel is the transparency or the tactile recognition information.

18. A computer-readable medium having a program recorded thereon, which, when executed by a computer, causes the computer to function as: a data processing unit configured to provide a haptic control signal to the haptic presentation device based on haptic control information embedded in the image data in a predetermined file format, in, The tactile control information is tactile recognition information for identifying the tactile control signal. The predetermined file format is a file format having an alpha channel, storing the tactile recognition information in the alpha channel, without storing transparency of pixels of the image data in the alpha channel, The file in the predetermined file format includes a tactile data flag indicating whether the data stored in the alpha channel is the transparency or the tactile recognition information.

Images