Information processing apparatus, information processing method, program, and information processing system

Abstract

An information processing apparatus (300) is provided that includes a first acquisition unit (308) that acquires, in response to an input from a first user, a control command that includes presentation unit information that indicates a presentation unit that presents a haptic stimulus by means of a haptic presentation apparatus and form information that indicates a form of the haptic stimulus, a generation unit (310) that generates, in response to the control command, a haptic control signal for presenting the haptic stimulus to the presentation unit, and a first distribution unit (302) that distributes the haptic control signal to the haptic presentation apparatus that is worn on a body of a second user.

Description

Technical Field

[0001] This disclosure relates to information processing apparatus, information processing methods and procedures, and information processing systems. Background Technology

[0002] In recent years, consumer spending has shifted from simple "goods consumption" of purchasing products to "service consumption" of paying for experiences with high added value. For example, in entertainment fields such as music and animation, consumers not only strongly demand one-way experiences such as watching live performances by artists (distributors), but also strongly demand real-time interactive experiences with higher added value, such as interacting with artists or enthusiasts.

[0003] For example, as a case study of such an experience, there exists a "coin-operated" system where viewers of content send data such as images or text, or send money along with the data, to artists distributing content on the Internet. By facilitating communication between artists and viewers through this "coin-operated" system, viewers can experience greater added value. This further enhances viewers' satisfaction with the content and increases their intention to purchase such a "service."

[0004] Citation List

[0005] Patent documents

[0006] Patent Document 1: WO 2018 / 008217 A Summary of the Invention

[0007] Technical issues

[0008] Conventionally, devices for presenting tactile stimuli such as vibrations to users have been proposed. For example, as an example, a jacket-type tactile presentation device is described in Patent Document 1. This tactile presentation device is installed on users in cinemas, theme park attractions, etc., and is controlled to be synchronized with the reproduced content viewed by the user, thereby further amplifying the presence of the reproduced content provided.

[0009] Therefore, this disclosure proposes information processing apparatus, information processing method, program, and information processing system capable of providing viewers with a high-value-added real-time interactive experience through the use of such tactile presentation device.

[0010] Solution to the problem

[0011] According to this disclosure, an information processing apparatus is provided, comprising: a first acquisition unit that acquires each of the control commands including presentation unit information and form information based on input from a first user, wherein the presentation unit information specifies a presentation unit for presenting a tactile stimulus by a tactile presentation device, and the form information specifies the form of the tactile stimulus; a generation unit that generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit based on each of the control commands; and a first distribution unit that distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user. When input from a plurality of first users satisfies predetermined conditions, the first acquisition unit acquires a new control command that is different from each of the control commands corresponding to the input from the plurality of first users.

[0012] Furthermore, according to this disclosure, an information processing apparatus is provided, comprising: a first acquisition unit that acquires, based on input from a first user, each of the identification information specifying presentation unit information and form information, wherein the presentation unit information specifies a presentation unit for presenting a tactile stimulus by a tactile presentation device, and the form information specifies the form of the tactile stimulus; a generation unit that generates, based on each of the identification information, each of the tactile control signals for presenting the tactile stimulus to the presentation unit; and a first distribution unit that distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user. When input from a plurality of first users satisfies predetermined conditions, the first acquisition unit acquires presentation unit information and form information that are different from the presentation unit information and form information specified by each of the identification information corresponding to each of the inputs from the plurality of first users.

[0013] Furthermore, according to this disclosure, an information processing method is provided, comprising the following processing performed by an information processing device: acquiring each of the control commands, including presentation unit information and form information, based on input from a first user, wherein the presentation unit information specifies a presentation unit for presenting a tactile stimulus by a tactile presentation device, and the form information specifies the form of the tactile stimulus; generating each of the tactile control signals for presenting the tactile stimulus to the presentation unit based on each of the control commands; and distributing each of the tactile control signals to the tactile presentation device worn on the body of a second user. If input from a plurality of first users satisfies predetermined conditions, acquiring a new control command different from each of the control commands corresponding to the input from the plurality of first users.

[0014] Furthermore, according to this disclosure, a program is provided for enabling a computer to perform the following functions: acquiring each of a control command including presentation unit information and form information based on input from a first user, wherein the presentation unit information specifies a presentation unit for presenting a tactile stimulus by a tactile presentation device, and the form information specifies the form of the tactile stimulus; generating each of a tactile control signal for presenting the tactile stimulus to the presentation unit based on each of the control commands; and distributing each of the tactile control signals to the tactile presentation device worn on the body of a second user. If input from a plurality of first users satisfies predetermined conditions, acquiring a new control command different from each of the control commands corresponding to the input from the plurality of first users.

[0015] Furthermore, according to this disclosure, an information processing system is provided, comprising an information processing apparatus and a distribution apparatus. In the information processing system, the information processing apparatus includes: a first acquisition unit that acquires each of a control command including presentation unit information and form information based on input from a first user, wherein the presentation unit information specifies a presentation unit for presenting a tactile stimulus by a tactile presentation device, and the form information specifies the form of the tactile stimulus; a generation unit that generates each of a tactile control signal for presenting the tactile stimulus to the presentation unit based on each of the control commands; and a first distribution unit that distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user. When input from a plurality of first users satisfies predetermined conditions, the first acquisition unit acquires a new control command different from each of the control commands corresponding to the input from the plurality of first users. In the information processing system, the distribution apparatus includes: an image generation unit that overlays a predetermined image generated based on each of the inputs onto an image in real space distributed to each of the first users. Attached Figure Description

[0016] Figure 1 This is an explanatory diagram (part 1) used to describe an outline of embodiments of the present disclosure.

[0017] Figure 2 This is an explanatory diagram (part 2) used to describe the outline of a second embodiment of the present disclosure.

[0018] Figure 3 This is a system diagram illustrating a schematic configuration example of an information processing system 10 according to an embodiment of the present disclosure.

[0019] Figure 4 This is a diagram illustrating an example of the appearance configuration of a tactile presentation device 100 according to an embodiment of the present disclosure.

[0020] Figure 5 This is a diagram illustrating an example of the functional configuration of a tactile presentation device 100 according to an embodiment of the present disclosure.

[0021] Figure 6 This is a diagram illustrating an example of the functional configuration of a tactile server 300 according to an embodiment of the present disclosure.

[0022] Figure 7 This is a diagram illustrating an example of the functional configuration of a distribution data editing server 400 according to an embodiment of the present disclosure.

[0023] Figure 8 This is a diagram illustrating an example of the functional configuration of a live distribution server 500 according to an embodiment of the present disclosure.

[0024] Figure 9 This is a diagram illustrating an example of the functional configuration of a user terminal 700 according to an embodiment of the present disclosure.

[0025] Figure 10 This is an explanatory diagram (part 1) used to describe a display example according to a first embodiment of the present disclosure.

[0026] Figure 11 This is an explanatory diagram (part 1) used to describe an example of tactile stimulus presentation according to a first embodiment of the present disclosure.

[0027] Figure 12 This is an explanatory diagram (part 2) used to describe a display example according to a first embodiment of the present disclosure.

[0028] Figure 13 This is an explanatory diagram (part 2) used to describe an example of tactile stimulus presentation according to a first embodiment of the present disclosure.

[0029] Figure 14 This is an explanatory diagram (part 3) used to describe an example of tactile stimulus presentation according to a first embodiment of the present disclosure.

[0030] Figure 15 This is an explanatory diagram (part 3) used to describe a display example according to a first embodiment of the present disclosure.

[0031] Figure 16 This is an explanatory diagram (part 4) used to describe a display example according to a first embodiment of the present disclosure.

[0032] Figure 17 This is an explanatory diagram (part 5) used to describe a display example according to a first embodiment of the present disclosure.

[0033] Figure 18 This is an explanatory diagram (part 6) used to describe a display example according to a first embodiment of the present disclosure.

[0034] Figure 19 This is an explanatory diagram used to describe a second embodiment of the present disclosure.

[0035] Figure 20 This is an explanatory diagram used to describe a display example according to a second embodiment of the present disclosure.

[0036] Figure 21 This is a flowchart (part 1) illustrating an example of an information processing method according to a second embodiment of the present disclosure.

[0037] Figure 22 This is a flowchart (part 2) illustrating an example of an information processing method according to a second embodiment of the present disclosure.

[0038] Figure 23 This is an explanatory diagram (part 1) for describing an input example according to a third embodiment of the present disclosure.

[0039] Figure 24 This is a flowchart (part 1) illustrating an example of an information processing method according to a third embodiment of the present disclosure.

[0040] Figure 25 This is an explanatory diagram (part 2) for describing an input example according to a third embodiment of the present disclosure.

[0041] Figure 26 This is a flowchart (part 2) illustrating an example of an information processing method according to a third embodiment of the present disclosure.

[0042] Figure 27 This is an explanatory diagram (part 3) for describing an input example according to a third embodiment of the present disclosure.

[0043] Figure 28 This is an explanatory diagram used to describe an input example according to a fourth embodiment of the present disclosure.

[0044] Figure 29 This is a flowchart illustrating an example of an information processing method according to a fourth embodiment of the present disclosure.

[0045] Figure 30 This is an explanatory diagram (part 1) for describing a display example according to a fifth embodiment of the present disclosure.

[0046] Figure 31 This is an explanatory diagram (part 2) for describing a display example according to the fifth embodiment of the present disclosure.

[0047] Figure 32 This is a flowchart illustrating an example of an information processing method according to a fifth embodiment of the present disclosure.

[0048] Figure 33This is an explanatory diagram (part 1) for describing a display example according to a sixth embodiment of the present disclosure.

[0049] Figure 34 This is an explanatory diagram (part 2) for describing a display example according to the sixth embodiment of the present disclosure.

[0050] Figure 35 This is an explanatory diagram (part 3) for describing a display example according to the sixth embodiment of the present disclosure.

[0051] Figure 36 This is an explanatory diagram (part 4) for describing a display example according to the sixth embodiment of the present disclosure.

[0052] Figure 37 This is an explanatory diagram (part 5) for describing a display example according to the sixth embodiment of the present disclosure.

[0053] Figure 38 This is a flowchart illustrating an example of an information processing method according to a sixth embodiment of the present disclosure.

[0054] Figure 39 This is an explanatory diagram (part 1) for describing a display example according to the seventh embodiment of the present disclosure.

[0055] Figure 40 This is an explanatory diagram (part 2) for describing a display example according to the seventh embodiment of the present disclosure.

[0056] Figure 41 This is an explanatory diagram (part 3) for describing a display example according to the seventh embodiment of the present disclosure.

[0057] Figure 42 This is a flowchart illustrating an example of an information processing method according to a seventh embodiment of the present disclosure.

[0058] Figure 43 This is a system diagram (part 1) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0059] Figure 44 This is a system diagram (part 2) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0060] Figure 45 This is a system diagram (part 3) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0061] Figure 46 This is a system diagram (part 4) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0062] Figure 47 This is a system diagram (part 5) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0063] Figure 48 This is a system diagram (part 6) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0064] Figure 49 This is a system diagram (part 7) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0065] Figure 50 This is a system diagram (part 8) illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0066] Figure 51 This is a system diagram (part 1) illustrating a schematic configuration example of an information processing system 10 according to a second modified example of an embodiment of the present disclosure.

[0067] Figure 52 This is a system diagram (part 2) illustrating a schematic configuration example of an information processing system 10 according to a second modified example of an embodiment of the present disclosure.

[0068] Figure 53 This is a system diagram (part 3) illustrating a schematic configuration example of an information processing system 10 according to a second modified example of an embodiment of the present disclosure.

[0069] Figure 54 This is a system diagram (part 4) illustrating a schematic configuration example of an information processing system 10 according to a second modified example of an embodiment of the present disclosure.

[0070] Figure 55 This is an illustrative diagram for describing a method of presenting tactile stimuli according to embodiments of the present disclosure.

[0071] Figure 56 These are explanatory diagrams illustrating examples of modifications to embodiments according to this disclosure.

[0072] Figure 57 This is a hardware configuration diagram illustrating an example of a computer that implements the functions of the haptic server 300. Detailed Implementation

[0073] In the following, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the same reference numerals are assigned to components having substantially the same functional configuration, and repetitive descriptions are omitted in this specification and the drawings. Furthermore, in this specification and the drawings, similar components of different embodiments can be distinguished by assigning different letters after the same reference numerals. However, in cases where there is no particular need to distinguish multiple similar components from each other, only the same reference numerals are assigned.

[0074] Note that the descriptions will be presented in the following order.

[0075] 1. Overview of the embodiments of this disclosure

[0076] 2. Overview of the Information Processing System 10 of this Disclosure

[0077] 2.1 Overview of Information Processing System 10

[0078] 2.2 Detailed configuration of the tactile presentation device 100

[0079] 2.3 Detailed Configuration of Haptic Server 300

[0080] 2.4 Detailed Configuration of Data Distribution and Editing Server 400

[0081] Detailed configuration of the 2.5 Live Distribution Server 500

[0082] 2.6 Detailed Configuration of User Terminal 700

[0083] 3. First Embodiment

[0084] 4. Second Embodiment

[0085] 5. Third embodiment

[0086] 6. Fourth Embodiment

[0087] 7. Fifth Embodiment

[0088] 8. Sixth Embodiment

[0089] 9. Seventh Embodiment

[0090] 10. Eighth Embodiment

[0091] 11. Ninth Embodiment

[0092] 12. Summary

[0093] 13. Example of a first modification to the information processing system 10 of this disclosure

[0094] 14. Example of a second modification to the information processing system 10 disclosed herein

[0095] 15. Methods of delivering tactile stimulation

[0096] 16. Example of editing the stamp display

[0097] 17. Hardware Configuration

[0098] 18. Supplementary Explanation

[0099] <<1. Overview of Embodiments of this Disclosure>>

[0100] First, before describing the details of the embodiments of this disclosure, reference will be made to... Figure 1 and Figure 2 An overview describing embodiments of this disclosure created by the inventors. Figure 1 and Figure 2 This is an illustrative diagram used to describe an overview of embodiments of the present disclosure.

[0101] As mentioned above, in recent years, consumer spending has shifted from "goods consumption" to "service consumption." Specifically, in the entertainment sector, consumers not only strongly demand one-way experiences such as watching live performances by artists, but also strongly demand real-time interactive experiences with higher added value, such as interacting with artists.

[0102] Therefore, considering this situation, the inventors have conducted in-depth research into whether it is possible to provide viewers with an experience of higher added value, and have envisioned the use of a tactile presentation device (tactile device) that presents tactile stimulation such as vibration to the wearer. The inventors have considered that viewers can obtain an experience of higher added value by using such a tactile presentation device.

[0103] In embodiments of this disclosure created based on this concept, a distributor 800, which enables a performance or content to be viewed or its distribution to be performed, wears, for example, Figure 1 The vest-style tactile presentation device 100 is shown. The tactile presentation device 100 includes multiple tactile stimulation units (e.g., actuators). Furthermore, upon receiving a predetermined signal, each tactile stimulation unit can present tactile stimulation to a distributor 800, who is acting as a wearer. Then, as... Figure 2 As shown, the viewer 900 selects a tactilely stimulating stamp 850 from a plurality of tactilely stimulating stamps 850 displayed on the display unit 702 of the user terminal 700, and sends the selected tactilely stimulating stamp 850. Then, by sending the selected tactilely stimulating stamp 850, a predetermined tactile control signal corresponding to the tactile stimulation given to the stamp 850 is sent to the tactile stimulation unit (performing a so-called "coin insertion" with tactile stimulation). Furthermore, the tactile stimulation unit presents the wearer with the tactile stimulation corresponding to the selected tactilely stimulating stamp 850 based on the received predetermined tactile control signal.

[0104] Therefore, when the distributor 800 perceives the presented tactile stimulus and takes action, the viewer 900 can examine in real time the action caused by the tactile stimulus presented by the stamp 850 sent by the viewer himself. Then, when the action caused by the tactile stimulus related to the stamp 850 sent by the viewer himself can be examined in real time, the viewer 900 can feel that he has interacted directly with the distributor 800, that is, he can obtain an experience with higher added value.

[0105] In this way, in the embodiments of this disclosure created by the inventors, not only can visual information such as illustrations, animations, and text, and auditory information such as music, be sent from the viewer 900 to the distributor 800, but tactile information can also be sent. Therefore, according to the embodiments of this disclosure, a real-time interactive experience with high added value can be provided to the viewer 900, further enhancing the viewer 900's satisfaction with performance or content, or increasing their intention to purchase such a "service". Hereinafter, details of the embodiments of this disclosure created by the inventors will be described sequentially.

[0106] <<2. Overview of the Information Processing System 10 of this Disclosure>>

[0107] <2.1 Overview of Information Processing System 10>

[0108] First, refer to Figure 3 An overview of an information processing system according to embodiments of the present disclosure is provided. Figure 3 This is a system diagram illustrating a schematic configuration example of an information processing system 10 according to an embodiment of the present disclosure. In the following description, it is assumed that the distributor 800 and the viewer 900 exist in different spaces or in the same space. That is, for example, in the information processing system 10, the viewer 900 can directly view the appearance of the distributor 800, or can view the distributed video of the distributor 800.

[0109] Specifically, such as Figure 3As shown, in the information processing system 10 according to this embodiment, for example, a haptic presentation device 100, a driver amplifier / interface 200, a speaker 202, a monitor 204, a microphone (hereinafter referred to as a microphone) 206, and a camera device 208 are arranged on the distributor 800 side. Furthermore, in the information processing system 10, for example, a haptic server (information processing device) 300, a distribution data editing server 400, and a live distribution server 500 (another information processing device) are arranged between the distributor 800 side and the viewer 900 side. Additionally, in the information processing system 10, a smartphone or tablet computer, as an example of a user terminal 700, is arranged on the viewer 900 side. Devices included in the information processing system 10 can perform transmission and reception with each other via various communication networks such as wired / wireless local area networks (LAN), Wi-Fi, Bluetooth, mobile communication networks (LTE, 5G, etc.). Note that the number of devices included in the information processing system 10 is not limited to this. Figure 3 The number of devices shown can be increased, and may also be larger. Furthermore, the information processing system 10 may include... Figure 3 Devices not shown. For example, information processing system 10 may include a general-purpose personal computer (PC), a game console, a mobile phone, a portable media player, a speaker, a projector, a display (such as digital signage), wearable devices such as headphones, smart glasses, or a smartwatch, etc.

[0110] Note that in Figure 3 In the information processing system 10 shown, for example, the haptic server 300 that manages the presentation of haptic stimuli, the distribution data editing server 400 with a built-in application for editing video and sound to be distributed to viewers 900, and the live distribution server 500 that manages the distribution to viewers 900 can be operated by different service operators. That is, in this embodiment, there is no specific limitation on the service operators that manage and operate each server, and all the service operators operating the various servers can be different, or some or all of these servers can be operated by a common service operator. Hereinafter, an outline of each device included in the information processing system 10 according to this embodiment will be described.

[0111] (Haptic presentation device 100)

[0112] The tactile presentation device 100 includes, for example, a device that can be worn on the body. In this embodiment, it is assumed that the tactile presentation device 100 is, for example, a vest-type (sleeveless outer garment) device worn by the distributor 800. As described above, the vest-type tactile presentation device 100 includes a plurality of tactile stimulation units (not shown). For example, a predetermined number (e.g., 6) of tactile stimulation units can be arranged on both the front and rear sides of the distributor 800 within the tactile presentation device 100. As an example, the tactile stimulation units arranged on the front side and the tactile stimulation units arranged on the rear side are arranged in a positional relationship facing each other.

[0113] Note that in this embodiment, the shape of the tactile presentation device 100 is not limited to a vest shape, but can also be an outer garment shape with sleeves. In this case, one or more tactile stimulation units can be arranged not only on the chest and abdomen of the distributor 800, but also at positions corresponding to the arms of the distributor 800. Furthermore, in this embodiment, the tactile presentation device 100 is not limited to having an outer garment shape, but can have the following shapes: trousers, shoes, belt, hat, gloves, or mask, etc.

[0114] Furthermore, a microphone 206 can be arranged on each of the right and left shoulders of the haptic presentation device 100, or on one of the right and left sides, or three or more microphones 206 can be arranged. Additionally, the microphones 206 can be arranged as separate devices from the haptic presentation device 100 around the distributor 800. Furthermore, the haptic presentation device 100 can incorporate the following: a wear status detection sensor (e.g., fastener-type sensor, pressure sensor, etc.) (not shown) for detecting the wear status of the haptic presentation device 100; an inertial measurement unit (IMU) (not shown) for detecting the movement and posture of the distributor 800; and a bio-information sensor (e.g., a sensor for sensing heart rate, pulse, brain waves, respiration, sweating, electromyography, skin temperature, skin resistance, eye movement, pupil diameter, etc.) (not shown). Note that a detailed configuration of the haptic presentation device 100 will be described later.

[0115] (Driver Amplifier / Interface 200)

[0116] The driver amplifier / interface 200 is an interface for sending and receiving tactile control signals between the tactile presentation device 100 and the tactile server 300. For example, the driver amplifier / interface 200 can obtain configuration information (e.g., function information) of the tactile presentation device 100, convert and amplify the tactile control signals generated by the tactile server 300, and send them to the tactile presentation device 100.

[0117] (Monitor 204)

[0118] For example, monitor 204 can display video of distributor 800 captured by camera device 208 (described later) to distributor 800, and monitor 204 can overlay text, icons, animations, etc. on the image of distributor 800. For example, monitor 204 is implemented by liquid crystal display (LCD) device, organic light-emitting diode (OLED) device, etc. Furthermore, in this embodiment, the display unit (not shown) of monitor 204 can be set as a unit integrated with input unit (not shown). In this case, for example, the input unit is implemented by a touch panel superimposed on the display unit. Furthermore, in this embodiment, a speaker 202 for outputting sound to distributor 800 can be provided in monitor 204.

[0119] (Camera device 208)

[0120] The imaging device 208 is one or more visible light imaging devices that image the distributor 800 from one or more viewpoints, and the video captured by the imaging device 208 is transmitted to the user terminal 700 on the viewer 900 side via the tactile server 300, the distribution data editing server 400, and the live distribution server 500. Note that the imaging device 208 can capture images of real objects, etc., existing around or near the distributor 800. Specifically, the imaging device 208 includes a lens system and a driving system. The lens system includes an imaging lens, an aperture, a zoom lens, a focusing lens, etc., and the driving system enables the lens system to perform focusing and zooming operations. Furthermore, the imaging device 208 includes a solid-state imaging element array, etc., that performs photoelectric conversion on the imaging light acquired by the lens system and generates an imaging signal. Note that the solid-state imaging element array can be implemented using, for example, a charge-coupled device (CCD) sensor array, a complementary metal-oxide-semiconductor (CMOS) sensor array, etc.

[0121] (Haptic Server 300)

[0122] The haptic server 300 can receive stamps (control commands) 850 with haptic stimulation effects input from the viewer 900 via the live distribution server 500, generate haptic control signals based on the stamps 850, and send the generated haptic control signals to the haptic presentation device 100. Each stamp 850 with haptic stimulation effects is associated with each predetermined control command, and each control command includes: information specifying the perceptual location of the vibration stimulus (location information) (specifically, such as information specifying the haptic stimulation unit that presents the haptic stimulus), information specifying the waveform type, intensity, etc. of the vibration stimulus (form information), etc. In addition, the control command may include identification information (ID) for specifying the haptic stimulation unit (not shown) disposed in the haptic presentation device 100, and form information. Specifically, the tactile server 300 generates tactile control signals (waveform data) to be input to each tactile stimulation unit disposed in the tactile presentation device 100, so as to present vibrational stimulation with a specified waveform at a specified sensing position and a specified intensity according to the control command, and the tactile server 300 sends the tactile control signals to the tactile presentation device 100. Furthermore, the control command associated with each stamp 850 having a tactile stimulation effect may only include the identification information (ID) of the stamp 850. In this case, the tactile server 300 can refer to the received identification information of the stamp 850 and generate tactile control signals (waveform data) corresponding to the stamp 850 based on pre-stored data associated with the identification information. Note that in this specification, "sensing position" includes the movement path of the sensing position and the sensing range of a predetermined size. Furthermore, the detailed configuration of the tactile server 300 will be described later.

[0123] (Distribution data editing server 400)

[0124] The distribution data editing server 400 can edit video received from the camera device 208 via the haptic server 300, and can also edit sound received from the microphone 206 via the haptic server 300. Furthermore, the distribution data editing server 400 can send the edited video and sound data to the user terminal 700 via the live distribution server 500, and can output it to the speaker 202 and monitor 204 via the haptic server 300. For example, the distribution data editing server 400 can generate video data for distribution by overlaying an image of a stamp 850 input from a viewer 900 or a video effect associated with the stamp 850 onto an image of the distributor 800 captured by the camera device 208. Note that the detailed configuration of the distribution data editing server 400 will be described later.

[0125] (Live distribution server 500)

[0126] The live streaming server 500 can distribute images such as those from distributors like 800, and images for selecting haptic-stimulating stamps like 850, to user terminals like 700. For example, the live streaming server 500 can perform authentication via a Web Application Programming Interface (API) and monitor haptic-stimulating stamps like 850 sent from viewers like 900. Note that a detailed configuration of the live streaming server 500 will be described later.

[0127] Furthermore, in this embodiment, the haptic server 300, the data distribution and editing server 400, and the live distribution server 500 can be implemented by a single device or by multiple devices, and there are no specific limitations. Details will be described later.

[0128] (User Terminal 700)

[0129] User terminal 700 is used by or installed near viewer 900 and is a terminal for viewer 900 to input, for example, a stamp 850 with tactile stimulation effects. User terminal 700 then receives the stamp (control command) 850 with tactile stimulation effects input from viewer 900 and sends the received stamp 850 to tactile server 300 via live distribution server 500. Furthermore, for example, user terminal 700 can receive and display video from distributor 800 via live distribution server 500, wherein video effects associated with the received stamp 850 are applied to the video, and tactile stimulation associated with the stamp 850 is presented. In this case, user terminal 700 can receive the identification information (ID) of stamp 850, read the video effect information associated with the identification information from its own storage unit (not shown), and perform processing itself, or it can receive video with video effects already applied. For example, user terminal 700 can be a wearable device such as a head-mounted display (HMD) or smartphone, tablet PC, mobile phone, or laptop PC. Alternatively, user terminal 700 can be a dedicated device installed in a room provided by a business operator, such as a karaoke room. Note that the detailed configuration of user terminal 700 will be described later.

[0130] <2.2 Detailed Configuration of the Haptic Presentation Device 100>

[0131] Next, we will refer to Figure 4 and Figure 5 Describe the detailed configuration of the haptic presentation device 100. Figure 4 This is a diagram showing an example of the appearance configuration of the tactile presentation device 100 according to this embodiment, and Figure 5This is a diagram illustrating an example of the functional configuration of the tactile presentation device 100 according to this embodiment. As described above, the tactile presentation device 100 is a device worn on part of the body of a distributor 800 and, for example, provides tactile stimulation to the distributor 800 by vibration according to a stamp (control command) 850.

[0132] like Figure 4 As shown, for example, the vest-style tactile presentation device 100, as previously described, internally includes a plurality of tactile stimulation units 106. Each tactile stimulation unit 106 includes, for example, an actuator that generates vibrations driven by tactile control signals generated by the tactile server 300, and presents the vibrations as tactile stimuli. For example, an eccentric motor, a linear vibrator, a piezoelectric element, etc., can be used as the actuator.

[0133] In addition, such as Figure 5 As shown, the tactile presentation device 100 includes a communication unit 102, a control unit 104, the aforementioned tactile stimulation unit 106, and an operation unit 108. The functional blocks of the tactile presentation device 100 will be described sequentially below.

[0134] (Communication Unit 102)

[0135] The communication unit 102 is wirelessly connected to the haptic server 300 via the driver amplifier / interface 200, and can send information to and receive information from the haptic server 300.

[0136] (Control Unit 104)

[0137] The control unit 104 is a controller and can drive the tactile stimulation unit 106 based on the tactile control signals input via the aforementioned communication unit 102. The control unit 104 is implemented, for example, by executing various programs stored in a read-only memory (ROM) or the like within the tactile presentation device 100, using random access memory (RAM) as the working area, via a central processing unit (CPU), microprocessor unit (MPU), or the like. Furthermore, the control unit 104 is implemented, for example, by an integrated circuit such as an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

[0138] (Operation Unit 108)

[0139] The operating unit 108 is an operating device such as a touch sensor, pressure sensor, proximity sensor, button, switch or lever operated by the distributor 800, and can be used by the distributor 800, for example, to reduce the intensity of the presented tactile stimulation or to stop presenting the tactile stimulation.

[0140] Although the detailed configuration of the tactile presentation device 100 according to this embodiment has been described above, the detailed configuration of the tactile presentation device 100 according to this embodiment is not limited to... Figure 4 and Figure 5 The example shown.

[0141] Furthermore, the haptic presentation device 100 is not limited to the vest-style wearable device described above, but can also be a wearable device that can be worn on a part of the user's body (e.g., earlobe, neck, arm, wrist, or ankle). More specifically, examples of wearable devices include various types / forms of wearable devices, such as earpieces, anklets, rings, gloves, bracelets (wristbands), collars, glasses, headwear, pads, badges, and clothing. Additionally, the haptic presentation device 100 can be configured as a handheld type mounted on a device held in the hand of the distributor 800, such as a smartphone, tablet, camera device, game controller, portable music player, etc., or it can be pen-shaped, stick-shaped, or handle-shaped. Furthermore, the haptic presentation device 100 is not limited to wearable or handheld types, and can also be configured as a slate / floor type mounted on furniture such as beds, chairs, or tables, or on various facilities.

[0142] Furthermore, in embodiments of this disclosure, the presentation of tactile stimulation (vibration) to distributor 800 via tactile presentation device 100 is described. However, this is not a limitation, and wind, electrical stimulation, ultrasound, force, heat, humidity, odor, etc., may be given to distributor 800 in place of or in conjunction with tactile stimulation. Moreover, in embodiments of this disclosure, the presentation of tactile stimulation to distributor 800 is not limited. Tactile stimulation, etc., may be presented to viewer 900 who selects stamp 850 or simply to viewer 900 who enjoys the distribution by distributor 800.

[0143] <2.3 Detailed Configuration of Haptic Server 300>

[0144] Next, we will refer to Figure 6 The detailed configuration of the haptic server 300 according to embodiments of the present disclosure is described. Figure 6 This is a diagram illustrating an example of the functional configuration of a tactile server 300 according to an embodiment of the present disclosure. Figure 6 As shown, the haptic server 300 mainly includes a communication unit 302, a camera image acquisition unit 304, a microphone sound acquisition unit 306, a stamp acquisition unit 308, a haptic signal generation unit 310, a distributor status acquisition unit 312, an output image acquisition unit 314, an output sound acquisition unit 316, and a storage unit 318. The functional blocks of the haptic server 300 will be described sequentially below.

[0145] (Communication Unit 302)

[0146] The communication unit (distribution unit) 302 can send and receive information to and from the haptic presentation device 100, speaker 202, monitor 204, and camera device 208. The communication unit 302 is a communication interface with the function of sending and receiving data, and is implemented by communication devices (not shown), such as a communication antenna, transmission / reception circuitry, and ports. Specifically, the communication unit 302 can send haptic control signals to the haptic presentation device 100, send video data (including text information, for example) from the distribution data editing server 400 to the monitor 204, and send audio data (predetermined audio) from the distribution data editing server 400 to the speaker 202.

[0147] Next, the image acquisition unit 304 of the camera device, the sound acquisition unit 306 of the microphone, the stamp acquisition unit 308, the tactile signal generation unit 310, the distributor status acquisition unit 312, the output image acquisition unit 314, and the output sound acquisition unit 316 will be described. These functional units are implemented by, for example, executing various programs stored in ROM or the like in the tactile server 300 using RAM as the working area by a CPU, MPU, or the like.

[0148] (Image acquisition unit 304 of the camera device)

[0149] The image acquisition unit 304 of the camera device can acquire images of the real space on the side of the distributor 800 and images of the distributor 800 from the camera device 208, and send them to the distribution data editing server 400 via the communication unit 302.

[0150] (Microphone sound acquisition unit 306)

[0151] The microphone sound acquisition unit 306 can acquire ambient sound or the sound of the distributor 800 in the real space from the microphone 206, and send it to the distribution data editing server 400 via the communication unit 302.

[0152] (Stamp Acquisition Unit 308)

[0153] Stamp acquisition unit 308 can acquire control commands, which include location information (presentation unit information) associated with a stamp 850 with tactile stimulation effect input from viewer 900, specifying the presentation position of the tactile stimulation presented by tactile presentation device 100, and form information specifying the form of the tactile stimulation. Stamp acquisition unit 308 can output the control commands to tactile signal generation unit 310 (described later). Furthermore, stamp acquisition unit 308 can acquire control commands 850 that only include identification information (ID) associated with the stamp 850 with tactile stimulation effect and output them to tactile signal generation unit 310 (described later).

[0154] (Tactile signal generation unit 310)

[0155] The tactile signal generation unit 310 can generate tactile control signals for controlling the tactile presentation device 100 based on control commands associated with a stamp 850 having a tactile stimulation effect input from the viewer 900. Specifically, based on control commands including the perceived location of the vibration stimulus (location information), the waveform type of the vibration stimulus, and the intensity information of the vibration stimulus (form information), the tactile signal generation unit 310 generates waveform data to be input to each tactile stimulation unit 106 (specifically, vibration actuator) disposed in the tactile presentation device 100 to present a vibration stimulus with a specified waveform at a specified perceived location and a specified intensity. Note that the tactile control signals may include information indicating the timing, frequency, interval, and presentation time of the vibration stimulus based on the control commands. Furthermore, the tactile signal generation unit 310 can refer to a control command that includes only identification information (ID) associated with the stamp 850 with tactile stimulation effect input from the viewer 900, and generate a tactile control signal (including perception position, waveform type, intensity information, etc.) corresponding to the stamp 850 based on pre-stored data associated with the identification information.

[0156] Furthermore, when the frequency and intensity of the vibration stimulus specified by the control command have a wide frequency band (e.g., 50Hz to 500Hz), the tactile signal generation unit 310 can compress the vibration stimulus to a narrow frequency band (e.g., 100Hz) according to the function of the tactile presentation device 100 and generate waveform data. Additionally, the tactile signal generation unit 310 can adjust the tactile control signal according to the wearing status of the tactile presentation device 100 of the distributor 800 or the configuration file (functions, etc.) of the tactile presentation device 100.

[0157] In addition, the tactile signal generation unit 310 can send the generated tactile control signal to the tactile presentation device 100 worn on the body of the distributor 800 via the communication unit 302.

[0158] (Distributor Status Acquisition Unit 312)

[0159] For example, the distributor state acquisition unit 312 can acquire sensing data obtained by a wear state detection sensor (not shown) used to detect the wear state of the tactile presentation device 100, and output it to the aforementioned tactile signal generation unit 310.

[0160] (Output Image Acquisition Unit 314)

[0161] The output image acquisition unit 314 can acquire edited video data (predetermined image and text information) from the distribution data editing server 400 and send it to the monitor 204 via the communication unit 302.

[0162] (Output sound acquisition unit 316)

[0163] The output sound acquisition unit 316 can acquire edited sound data from the distribution data editing server 400 and send it to the speaker 202 via the communication unit 302.

[0164] (Storage unit 318)

[0165] The storage unit 318 is implemented using storage devices such as a ROM storing programs and calculation parameters for processing performed by the tactile signal generation unit 310, RAM temporarily storing appropriately changed parameters, and an HDD storing various databases (DBs). For example, the storage unit 318 stores previously generated tactile databases (e.g., perceived position and vibration waveform patterns) associated with the identification information (ID) of each stamp 850, and the aforementioned tactile signal generation unit 310 can also generate tactile control signals using the tactile database. Furthermore, the storage unit 318 can store information such as the number, position, frequency characteristics, and maximum input voltage of the tactile stimulation units 106 of the tactile presentation device 100 as configuration information for the tactile presentation device 100. The tactile signal generation unit 310 can adjust the tactile control signals by referring to this configuration information.

[0166] Although the detailed configuration of the haptic server 300 according to this embodiment has been described above, the detailed configuration of the haptic server 300 according to this embodiment is not limited to... Figure 6 The example shown.

[0167] <2.4 Detailed Configuration of Distribution Data Editing Server 400>

[0168] Next, we will refer to Figure 7 The following describes the detailed configuration of the distribution data editing server 400 according to embodiments of the present disclosure. Figure 7This is a diagram illustrating an example of the functional configuration of a distribution data editing server 400 according to an embodiment of the present disclosure. Figure 7 As shown, the data distribution editing server 400 mainly includes a communication unit 402, a camera image acquisition unit 404, an image generation unit 406, a stamp acquisition unit 408, a microphone sound acquisition unit 410, a sound generation unit 412, an output sound acquisition unit 414, and a storage unit 416. The functional blocks of the data distribution editing server 400 will be described sequentially below.

[0169] (Communication Unit 402)

[0170] The communication unit 402 can send information to and receive information from the haptic server 300 and the live distribution server 500. The communication unit 402 is a communication interface with the function of sending and receiving data, and is implemented by a communication device (not shown) such as a communication antenna, a transmitting / receiving circuit, and a port.

[0171] Next, the image acquisition unit 404, image generation unit 406, stamp acquisition unit 408, microphone sound acquisition unit 410, sound generation unit 412, and output sound acquisition unit 414 of the camera device will be described. These functional units are implemented by, for example, a CPU, MPU, or the like, executing various programs stored in ROM or the like within the distribution data editing server 400 using RAM as the working area.

[0172] (Image acquisition unit 404 of the camera device)

[0173] The image acquisition unit 404 of the camera device can acquire an image of the real space on the side of the distributor 800 or an image of the distributor 800 from the camera device 208 via the tactile server 300, and output it to the image generation unit 406 (described later).

[0174] (Image generation unit 406)

[0175] Image generation unit 406 can generate image data to be presented to viewer 900 or distributor 800. For example, image generation unit 406 can generate video data that overlays virtual objects such as icons, animations, and text onto the image of distributor 800. More specifically, the virtual object can be, for example, an animation of a bomb explosion, which is displayed simultaneously with the presentation of tactile stimulation. Furthermore, the virtual object can be an image corresponding to a stamp 850 with tactile stimulation effects input from viewer 900. For example, in the case of a heart-shaped stamp 850, image generation unit 406 can generate video data that overlays the heart-shaped stamp 850 onto the image of distributor 800. Additionally, for example, image generation unit 406 can apply video effects associated with the stamp 850 input from viewer 900 onto the image of distributor 800. Furthermore, for example, in cases where tactile stimulation cannot be presented to the distributor 800 because the tactile presentation device 100 is not worn on the body of the distributor 800, the image generation unit 406 may also generate video data to be presented to the viewer 900, etc., in place of tactile stimulation.

[0176] (Stamp Acquisition Unit 408)

[0177] The stamp acquisition unit 408 can acquire information about the stamp 850 with tactile stimulation effect input from the viewer 900 and output it to the image generation unit 406 and the sound generation unit 412.

[0178] (Microphone sound acquisition unit 410)

[0179] The microphone sound acquisition unit 410 can acquire the sound of the distributor 800 from the microphone 206 via the haptic server 300 and output it to the sound generation unit 412 (described later).

[0180] (Sound generation unit 412)

[0181] The sound generation unit 412 can generate sound data to be presented to the viewer 900 or the distributor 800. For example, the sound generation unit 412 can generate sound data indicating a sound similar to a bomb explosion, which is output simultaneously with the presentation of tactile stimulation. Furthermore, the sound generation unit 412 can generate sound data corresponding to the sound of a stamp 850 with tactile stimulation input from the viewer 900. For example, if the stamp 850 is in the form of a wild bird, the sound generation unit 412 generates sound data in which the call of the wild bird is superimposed on the singing of the distributor 800. Additionally, the sound generation unit 412 can generate sound data in which the sound of the viewer 900, acquired by the user terminal 700, is superimposed on the singing of the distributor 800. Furthermore, for example, if tactile stimulation cannot be presented to the distributor 800 because the tactile presentation device 100 is not worn on the body of the distributor 800, the sound generation unit 412 can also generate sound data to be output to the viewer 900, etc., instead of tactile stimulation.

[0182] (Output sound acquisition unit 414)

[0183] The output sound acquisition unit 414 can acquire the sound input from the viewer 900 using the user terminal 700 and output it to the sound generation unit 412.

[0184] (Storage unit 416)

[0185] The storage unit 416 is implemented using storage devices such as a ROM for storing programs and calculation parameters for processing in the image generation unit 406 and the output sound acquisition unit 414, RAM for temporarily storing appropriately changed parameters, and an HDD for storing various databases (DBs). For example, the storage unit 416 stores pre-generated image and sound databases associated with identification information (ID) for each stamp 850, and the image generation unit 406 and the output sound acquisition unit 414 generate video data and sound data using the image and sound databases.

[0186] Although the detailed configuration of the distribution data editing server 400 according to this embodiment has been described above, the detailed configuration of the distribution data editing server 400 according to this embodiment is not limited to... Figure 7 The example shown.

[0187] <Detailed Configuration of Live Distribution Server 500 (2.5)>

[0188] Next, we will refer to Figure 8 The following describes the detailed configuration of the live distribution server 500 according to embodiments of the present disclosure. Figure 8 This is a diagram illustrating an example of the functional configuration of a live distribution server 500 according to an embodiment of the present disclosure. Figure 8 As shown, the live broadcast server 500 mainly includes a communication unit 502, a GUI control unit 504, a stamp acquisition unit 506, a sound data acquisition unit 508, an image data acquisition unit 510, a tactile signal acquisition unit 512, a viewer information acquisition unit 514, a distribution control unit 516, and a storage unit 518. The functional blocks of the live broadcast server 500 will be described sequentially below.

[0189] (Communication Unit 502)

[0190] The communication unit 502 can send and receive information to the user terminal 700, the data distribution and editing server 400, and the haptic server 300. The communication unit 502 is a communication interface with the function of sending and receiving data, and is implemented by a communication device (not shown), such as a communication antenna, a transmitting / receiving circuit, and a port.

[0191] Next, the GUI control unit 504, stamp acquisition unit 506, sound data acquisition unit 508, image data acquisition unit 510, tactile signal acquisition unit 512, viewer information acquisition unit 514, and distribution control unit 516 will be described. These functional units are implemented by, for example, executing various programs stored in ROM or the like within the live distribution server 500 using RAM as the working area by a CPU, MPU, or similar device.

[0192] (GUI control unit 504)

[0193] The graphical user interface (GUI) control unit 504 can control the user terminal 700 of the viewer 900 and display a screen for inputting tactile stamps (control commands) 850. Specifically, the GUI control unit 504 causes the display unit 702 of the user terminal 700 to... Figure 2 The screen shown is configured to allow selection of a stamp 850 with tactile stimulation effects. A selection screen (stamp selection screen) displays a number of stamps 850 with tactile stimulation effects. Each of the stamps 850 with tactile stimulation effects is associated with a control command for the tactile presentation device 100, and the viewer 900 can input control commands by selecting a stamp 850 displayed on the selection screen. Note that, in this embodiment, preferably, the images of the stamps 850 with tactile stimulation effects visually evoke tactile stimuli, sensations (messages), etc., that the viewer 900 expects to send to the distributor 800. Furthermore, as described below, the GUI control unit 504 can display an image on the display unit 702 of the user terminal 700 from which, in addition to selecting stamps 850 with tactile stimulation effects, stamps without tactile stimulation effects can also be selected.

[0194] (Stamp Acquisition Unit 506)

[0195] The stamp acquisition unit 506 can acquire information (e.g., ID) of a tactilely stimulating stamp 850 input from the viewer 900 and send it to the distribution data editing server 400 and the tactile server 300 via the communication unit 502. Furthermore, the stamp acquisition unit 506 can acquire command information, such as tactile control signals or image table control signals, corresponding to the input from the user terminal 700.

[0196] (Sound data acquisition unit 508)

[0197] The sound data acquisition unit 508 can acquire sound data from the distribution data editing server 400 via the communication unit 502 and send it to the user terminal 700.

[0198] (Image data acquisition unit 510)

[0199] The image data acquisition unit 510 can acquire image data from the distribution data editing server 400 via the communication unit 502 and send it to the user terminal 700.

[0200] (Tactile signal acquisition unit 512)

[0201] The tactile signal acquisition unit 512 can acquire tactile control signals from the tactile server 300 and send them to the user terminal 700. For example, if a vibration device (not shown) is installed on the user terminal 700, the tactile stimulus corresponding to the stamp 850 selected by the viewer 900 can be reproduced by the vibration device.

[0202] (Viewer Information Acquisition Unit 514)

[0203] For example, the viewer information acquisition unit 514 can acquire the identification information (e.g., ID) of the viewer 900 sent from the user terminal 700 and perform authentication on the viewer 900.

[0204] (Distribution control unit 516)

[0205] The distribution control unit 516 can control the transmission of data from the sound data acquisition unit 508, the image data acquisition unit 510, and the tactile signal acquisition unit 512 to the user terminal 700 of the viewer 900, which is authenticated by the viewer information acquisition unit 514.

[0206] (Storage unit 518)

[0207] The storage unit 518 is implemented by a storage device such as a ROM for storing programs and calculation parameters for processing in the live broadcast server 500, RAM for temporarily storing parameters that are changed appropriately, and an HDD for storing various databases (DBs). For example, the storage unit 518 may store the identification information of the viewer 900, and may also store information about previously acquired control commands or previously used stamps (control commands) 850 of the viewer 900 in association with the identification information of the viewer 900.

[0208] Although the detailed configuration of the live distribution server 500 according to this embodiment has been described above, the detailed configuration of the live distribution server 500 according to this embodiment is not limited to... Figure 8 The example shown. For instance, the live distribution server 500 may also include a recommendation unit (not shown) that refers to information stored in the storage unit 518 to select stamps (control commands) 850 used frequently by the viewer 900 or stamps (control commands) 850 used infrequently by the viewer, and recommends the selected stamps 850 with tactile stimulation effects to the viewer 900. Furthermore, the recommendation unit may recommend that the viewer 900 input stamps 850 into the distributor 800 who has not previously acquired a predetermined number or more of the stamps 850.

[0209] <2.6 Detailed Configuration of User Terminal 700>

[0210] Next, we will refer to Figure 9 The detailed configuration of a user terminal 700 according to an embodiment of the present disclosure is described. Figure 9 This is a diagram illustrating an example of the functional configuration of a user terminal 700 according to this embodiment. For example... Figure 9 As shown, the user terminal 700 mainly includes a display unit 702, an operation input unit 704, a speaker 706, a communication unit 708, a control unit 710, a storage unit 712, and a sensor unit 720. The functional blocks of the user terminal 700 will be described sequentially below.

[0211] (Display unit 702)

[0212] The display unit 702 can display to the viewer 900, for example, a selection screen for selecting a stamp (control command) 850 with tactile stimulation effects, an image of the distributor 800, etc. Furthermore, the display unit 702 can overlay text, icons, animations, etc., onto the image of the distributor 800. The display unit 702 is implemented using a liquid crystal display device, an OLED device, or the like.

[0213] (Operation Input Unit 704)

[0214] For example, viewer 900 inputs the result of selecting a stamp 850 with tactile stimulation effect associated with a control command to operation input unit 704. This control command includes positional information specifying the presentation location of the tactile stimulation and formatal information specifying the form of the tactile stimulation. Alternatively, the control command can be directly input to operation input unit 704. For example, operation input unit 704 can be implemented as a switch, button, touch panel, or joystick. Furthermore, the content of the operation input through operation input unit 704 can be displayed through the aforementioned display unit 702. Additionally, operation input unit 704 can receive input operation information from viewer 900 on a position selection screen displayed by display unit 702, which is superimposed on display unit 702 and used to specify the presentation location (e.g., positional information).

[0215] (Speaker 706)

[0216] The speaker 706 can reproduce sound under the control of the control unit 710 (described later). Note that the speaker 706 can be located in the user terminal 700, or it can be a device such as a pair of headphone speakers (not shown) that is separate from the user terminal 700.

[0217] (Communication Unit 708)

[0218] The communication unit 708 can send and receive information from the live broadcast server 500, and specifically, it can send information about a tactilely stimulating stamp (control command) 850 input by the viewer 900 to the live broadcast server 500. Furthermore, the communication unit 708 can receive information sent from the live broadcast server 500. For example, the communication unit 708 is a communication interface with the function of sending and receiving data, and is implemented by a communication device (not shown) such as a communication antenna, a transmitting / receiving circuit, and a port.

[0219] (Control Unit 710)

[0220] The control unit 710 is the controller of the user terminal 700, and is implemented by executing various programs stored in ROM or the like in the user terminal 700, for example by a CPU, MPU or the like, with RAM as the working area.

[0221] (Storage Unit 712)

[0222] The storage unit 712 is implemented by a storage device such as a ROM that stores programs and calculation parameters for processing performed by the control unit 710 and RAM that temporarily stores parameters that are appropriately changed.

[0223] (Sensor Unit 720)

[0224] The sensor unit 720 can acquire sensing data related to actions from the viewer 900 (e.g., vibrations given to the user terminal 700). For example, as Figure 9 As shown, the sensor unit 720 mainly includes a camera device 722, a microphone 724, a gyroscope sensor 726, and an accelerometer sensor 728. Note that the above sensors are examples, and this embodiment is not limited thereto.

[0225] For example, the camera device 722 captures images of the viewer 900's movements and outputs the captured images to the control unit 710. The control unit 710 can then extract a predetermined movement of the viewer 900 from the images captured by the camera device 722 and obtain control commands related to the extracted movement. Specifically, the camera device 722 includes a lens system and a drive system. The lens system includes an imaging lens, an aperture, a zoom lens, a focusing lens, etc., and the drive system enables the lens system to perform focusing and zooming operations. Furthermore, the camera device 722 includes a solid-state imaging element array that performs photoelectric conversion on the imaging light acquired by the lens system and generates an imaging signal. Note that this solid-state imaging element array can be implemented using, for example, a CCD sensor array, a CMOS sensor array, etc. Additionally, the camera device 722 may include a time-of-flight (ToF) sensor (not shown). For example, the ToF sensor emits illumination light with a predetermined period towards an object, detects reflected light reflected by the object, and detects the phase difference or time difference between the illumination light and the reflected light, thereby obtaining depth information of the object. Here, the depth information of the object is the depth information as a distance from the ToF sensor to each point on the object's surface. Then, by aggregating the depth information of multiple points on the object's surface, shape information related to the non-uniform shape of the object's surface (i.e., the object's external shape information) can be obtained.

[0226] Microphone 724 collects the sound of viewer 900 and outputs the collected sound data to the control unit 710. Then, control unit 710 can extract the sound pattern of viewer 900 from the sound collected by microphone 724 and obtain control commands related to the extracted sound pattern (e.g., such as a stamp 850 designated by the sound of viewer 900).

[0227] The gyroscope sensor 726 is implemented, for example, a three-axis gyroscope sensor, and detects the angular velocity (rotational speed) of the user terminal 700 of the viewer 900. Furthermore, the accelerometer sensor 728 is implemented, for example, a three-axis accelerometer sensor (also called a G-sensor), and detects the acceleration of the user terminal 700 of the viewer 900. In this embodiment, operations performed by the viewer 900 on the user terminal 700 can be identified from the sensing data of these sensors, and control commands associated with the identified operations can also be obtained.

[0228] Although the detailed configuration of the user terminal 700 according to this embodiment has been described above in detail, the detailed configuration of the user terminal 700 according to this embodiment is not limited to... Figure 9 The example shown, and for example, may also include a vibrating device (vibrator) that notifies the viewer 900 via vibration. That is, although Figure 9 Although not shown, the user terminal 700 may be equipped with a vibration device that reproduces tactile stimulation, or it may be a tactile presentation device 100 worn on the body of the viewer 900.

[0229] <<3. First Embodiment>>

[0230] First, refer to Figures 10 to 18 A first embodiment of this disclosure is described. Figure 10 , Figure 12 as well as Figures 15 to 18 These are explanatory diagrams used to describe display examples according to this embodiment, and Figure 11 , Figure 13 as well as Figure 14 This is an explanatory diagram used to describe an example of tactile stimulation presentation according to this embodiment.

[0231] exist Figure 10 In the example shown, suppose viewer 900 selects a stamp 850 with multiple heart shapes that provides tactile stimulation. In this case, Figure 10 In the user terminal 700 shown, the entered stamp 850 can be displayed next to the comment 860 of the viewer 900. Then, as... Figure 11 As shown, the tactile stimulation unit 106 of the tactile presentation device 100 worn on the body of the distributor 800 vibrates at the tactile location specified by a control command associated with the selected stamp 850, thereby presenting tactile stimulation to the distributor 800.

[0232] At this time, as Figure 10As shown, the information processing system 10 can distribute an image to a viewer 900 in which an image of a stamp 850 is overlaid on an image of a distributor 800 (augmented reality (AR) display). Specifically, the location where the stamp 850 is overlaid can be a perceptual location specified by a control command associated with the stamp 850. At this time, the information processing system 10 can distribute comments 860 from viewers 900 who are viewing the same image from distributor 800 along with the image. Furthermore, in this embodiment, the information processing system 10 can automatically select the stamp 850 based on comments input by viewers 900 and present tactile stimuli associated with the automatically selected stamp 850 to the distributor 800.

[0233] Furthermore, in this embodiment, the virtual object superimposed on the image of the distributor 800 can be, for example, Figure 12 The animated image shown. Figure 12 In the example shown, the stamp 852 input by the viewer 900 is fireworks, and an animated image of the fireworks (an image in which light propagates from the center outwards) 852 is overlaid on the image of the distributor 800 based on the stamp 852. Then, in this case, as... Figure 13 As shown, according to the control command associated with the selected stamp 852, the tactile position of the tactile presentation device 100 worn on the body of the distributor 800 (i.e., the tactile stimulation unit 106 presenting the tactile stimulus) changes synchronously with the change of the animated image 852. Specifically, in synchronization with the image of light propagating from the center to the periphery of the fireworks animated image 852, the tactile stimulation unit 106 of the tactile presentation device 100 changes from the tactile stimulation unit 106 located in the center to the tactile stimulation unit 106 located on the periphery. Note that in this embodiment, the change of the animated image 852 is not limited to being synchronized with the change of tactile position, but can also be synchronized with arbitrary changes, such as the frequency, waveform, and intensity of the tactile control signal.

[0234] In addition, such as Figure 14 As shown, in the above embodiment, the following content can be presented to the viewer 900 through the indication of specific information: the tactile position of the tactile presentation device 100 worn on the body of the distributor 800 (i.e., the tactile stimulation unit 106 that presents the tactile stimulation) changes synchronously with the change of the animated image 852. For example, a display 842 indicating which part (tactile stimulation unit 106) is vibrating is displayed on the viewer 900's user terminal 700. Figure 14 On the user terminal shown. Figure 14In the example, because the tactile position changes when the animated image 852 changes, the display of display 842 also changes. Furthermore, in display 842, the color, shading, brightness, etc., of the vibrating portion can change according to the intensity of the tactile stimulus presented at each tactile position. Additionally, in Figure 14 The example also shows a specific waveform image 840 of the reproduced tactile stimulus. Note that the waveform image can be displayed in a deformed manner, and the color, shading, brightness, line thickness, etc. of the waveform can change according to the intensity of the tactile stimulus.

[0235] In addition, such as Figure 15 As shown, in this embodiment, the stamps 850 and virtual objects to be overlaid on the image of the distributor 800 are not limited to those prepared in advance, and can be configured through trajectories drawn by the viewer 900's operations, etc. Specifically, the viewer 900 can form a stamp 850 indicating a word by arranging multiple stamps 850a along a trajectory determined by the viewer themselves. Figure 15 (850) This resulted in a stamp containing the word "LOVE". Furthermore... Figure 15 The stamp 850 in the image can be an animated image in which multiple small stamps 850a appear sequentially along a trajectory drawn by the viewer 900 and create the word "LOVE".

[0236] In addition, such as Figure 16 As shown, in this embodiment, the pre-prepared stamp 850 and the virtual object can be deformed according to the shape of the real-world object superimposed upon it. For example, in Figure 16 In the example shown, the shape and size of the glasses-type stamp 850 are changed according to the shape and size of the distributor's face 800, and the stamp 850 is superimposed on the image of the distributor's face 800.

[0237] Furthermore, in this embodiment, the stamp 850 itself, coins used to purchase the stamp 850, etc., can be generated as gifts for viewers 900 based on lottery results, login bonuses (store access bonuses), subscription services, win / loss predictions, etc.

[0238] For example, in Figure 17 In the example shown, distributor 800 prepares coins as rewards, specifies the conditions for conducting a lottery (specifically, for example, entering a password or any comment), and hosts the lottery. Then, under the specified conditions, viewer 900 can obtain coins by participating in the lottery. Viewer 900 can then use the obtained coins to purchase a stamp 850 with tactile stimulation effects.

[0239] In addition, for example, in Figure 18In the example shown, when two distributors 800a and 800b play a pre-arranged game, a viewer 900 predicts the outcome. If the prediction is successful, the viewer 900 receives a stamp 850 with tactile stimulation as a gift.

[0240] Furthermore, in this embodiment, for example, viewer 900 can receive rewards by logging into a pre-selected application or site once a day. The reward could be a stamp 850 with tactile stimulation or virtual currency that can be used to purchase stamps 850. In addition, in this embodiment, viewer 900 can receive rewards not only by logging into a pre-selected application, but also by visiting a pre-selected store (detected by a location sensor installed on user terminal 700). Furthermore, through continuous logins, viewer 900 can acquire more stamps 850 or more expensive stamps (rare stamps) 850.

[0241] Furthermore, in this embodiment, the distributor 800 can provide a tactilely stimulating stamp 850 or virtual currency that can be used to purchase the stamp 850 by releasing a subscription function, as a benefit limited to subscribers of the subscription service. In this way, by subscribing to the subscription service of a favorite distributor 800, the viewer 900 can support the distributor 800 and use the aforementioned benefits limited to subscribers.

[0242] As described above, in the first embodiment, by designing a presentation method that presents to the distributor 800 a tactile stimulus corresponding to a stamp 850 with tactile stimulation effects selected by the viewer 900, or an image presented to the viewer 900 or the distributor 800 when presenting the tactile stimulus, the viewer 900 can feel that he / she is interacting directly with the distributor 800. In other words, the viewer 900 can obtain a real-time interactive experience with high added value.

[0243] <<4. Second Embodiment>>

[0244] Furthermore, viewers 900 can simultaneously enjoy distributions from multiple distributors 800. (See also...) Figure 19 and Figure 20 A second embodiment of this disclosure is described in this case. Figure 19 These are explanatory diagrams used to describe this embodiment, and Figure 20 These are explanatory diagrams used to describe display examples according to this embodiment. For example, such as... Figure 19 As shown, a viewer 900 can simultaneously enjoy distributions from multiple distributors 800a, 800b, and 800c. In this embodiment, a method for selecting which distributor 800 to which a stamp (control command) 850 with tactile stimulation effect is sent, performed by the viewer 900, and a method for selecting which distributor 800 senses the presented tactile stimulation will be described.

[0245] For example, in this embodiment, such as Figure 19 As shown, when a viewer 900 displays distribution screens from multiple distributors 800a, 800b, and 800c on the display unit 702 of the user terminal 700, the viewer 900 can simultaneously send the same stamp 850 to all or some of the distributors 800a, 800b, and 800c. Alternatively, in this embodiment, the viewer 900 can determine to which distributor 800 the stamp 850 will be sent by selecting the distribution screen of the distributor 800 to which tactile stimulation is desired, or by selecting an icon (not shown) superimposed on the distribution screen. More specifically, for example, the viewer 900 performs a touch operation on the distribution screen of the distributor 800 to which the stamp 850 is desired, and then performs a touch operation on the stamp 850, thereby the stamp 850 with tactile stimulation effect can be sent to the distributor 800.

[0246] Furthermore, in this embodiment, voice input can be used as a means of selecting the distributor 800 to which a message is to be sent. For example, the name of the distributor 800 can be called out, the location of the distribution screen can be stated (e.g., right side or bottom side), information about objects in real space included in the distribution image of the distributor 800 (e.g., chair, the color of the distributor 800's clothing, accessories worn by the distributor 800, etc.) or information about virtual objects superimposed on the image of the distributor 800 can be stated. Additionally, in this embodiment, the position of the viewer 900's gaze can be used as a means of selecting the distributor 800 to which a message is to be sent.

[0247] Furthermore, in this embodiment, preferably, for example, an icon 870 indicating whether the haptic presentation is acceptable is displayed in the upper right corner of each distribution screen, such as... Figure 20 As shown. For example, icon 870a indicates that distributor 800b can receive tactile control signals, while icon 870b indicates that distributor 800b cannot receive tactile control signals. Therefore, referring to such icon 870, viewer 900 can determine to distributor 800 that stamp 850 will be sent.

[0248] In addition, such as Figure 20As shown, viewer 900 can set whether their worn haptic presentation device 100 can receive haptic stimulation by operating icon 870 displayed next to their own comment display 860. Specifically, for example, by long-pressing icon 870b displayed next to their own comment display 860, viewer 900 can toggle and set whether haptic control signals can be received or not. Furthermore, in this embodiment, by operating icon 870 displayed next to another viewer 900's comment display 860, viewer 900 can set whether their worn haptic presentation device 100 can receive haptic stimulation based on haptic control signals input by another viewer 900.

[0249] Furthermore, in this embodiment, when the viewer 900 wears the haptic presentation device 100 or a vibration device (not shown) installed on the viewer 900's user terminal 700, the viewer 900 can feel haptic stimulation corresponding to the stamp 850 sent to the distributor 800 through the haptic presentation device 100 or the vibration device. Note that the haptic stimulation felt by the viewer 900 can be a haptic stimulation corresponding to the stamp 850 selected by the viewer 900, or it can be a haptic stimulation corresponding to the stamp 850 selected by the viewer 900 and sent from another viewer 900 to the distributor 800. In this case, by operating... Figure 20 The icon 870 in the upper right corner of each distribution screen shown allows the viewer 900 to pre-select the distributor 800 corresponding to the desired tactile stimulus.

[0250] Furthermore, in this embodiment, when the viewer 900 selects multiple distributors 800, the tactile stimuli presented to the distributors 800 can be superimposed (specifically, the waveforms of the tactile control signals are superimposed) and presented to the viewer 900. Furthermore, in this embodiment, the superposition ratio of tactile stimuli can be determined based on the degree of interest associated with each distribution by the viewer 900 (e.g., the number of stamps 850 sent, the number of comments 860 sent, or the percentage of time the gaze lingers). Furthermore, in this embodiment, the intensity, presentation time, etc., of the tactile stimuli presented to the distributors 800 can be varied based on the degree of interest associated with each distribution by the viewer 900 (e.g., the number of stamps 850 sent, the number of comments sent, or the percentage of time the gaze lingers).

[0251] Furthermore, in this embodiment, when the distributor 800 is not wearing the haptic presentation device 100, viewers 900 can send stamps 850 with haptic stimulation effects to each other. In this case, a stamp 850 selected by one viewer 900 can be sent only to another viewer 900 set by that one viewer 900. Alternatively, only stamps 850 set by another viewer 900 from one viewer 900 can be sent to the other viewer 900. Furthermore, in this embodiment, viewers 900 can be pre-set whether they can receive haptic control signals from other viewers 900. Specifically, for example, as... Figure 20 As shown, viewer 900 can toggle whether tactile control signals can be received or not by long-pressing the icon 870b displayed next to their own comment display 860. Alternatively, in this embodiment, by operating the icon 870 displayed next to another viewer 900's comment display 860, viewer 900 can set whether their own worn tactile presentation device 100 can receive tactile stimulation based on tactile control signals input by another viewer 900. Furthermore, in this embodiment, for example, as Figure 20 As shown, preferably, the number of viewers 900 who are capable of receiving tactile control signals is displayed to viewers 900 on display 880.

[0252] Next, we will refer to Figure 21 and Figure 22 An example describing the information processing method according to this embodiment is provided. Figure 21 and Figure 22 This is a flowchart illustrating an example of an information processing method according to this embodiment.

[0253] First, refer to Figure 21 Describe the information processing methods during setup. For example... Figure 21 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S101 to step S102. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0254] Based on setting information from distributor 800 and viewer 900 indicating whether tactile control signals can be received or not, information processing system 10 sets the validity / invalidity of receiving tactile control signals in the tactile presentation device 100 of each distributor 800 or viewer 900 (step S101). Then, information processing system 10 displays the setting information on the monitor 204 of distributor 800 or the user terminal 700 of viewer 900 (step S102). Note that, in the case where viewer 900 performs viewing on a browser, preferably, the setting is stored in tactile server 300 as a setting value associated with the identification information of viewer 900.

[0255] Next, we will refer to Figure 22 Describe the information processing methods used when presenting tactile stimuli. For example... Figure 22 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S201 to step S205. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0256] The haptic server 300 and the distribution data editing server 400 of the information processing system 10 receive information about the stamp 850 input by the viewer 900 (e.g., the type of the stamp 850, the viewer 900 who performed the input, and the information of the distributor 800 that performed the sending) (step S201). Note that in this embodiment, when the viewer 900 performs viewing on a browser or the like, the haptic server 300 and the distribution data editing server 400 of the information processing system 10 can simultaneously receive the video / audio / vibration data itself. Then, the distribution data editing server 400 of the information processing system 10, based on the received information about the stamp 850, overlays the video effect onto the distribution screen of the corresponding distributor 800 or reproduces the audio effect (step S202).

[0257] Then, the tactile server 300 of the information processing system 10 determines whether the tactile control signal corresponding to the stamp 850 can be received by the tactile presentation device 100 of the distributor 800 or the viewer 900 corresponding to the information of the stamp 850 (step S203). If the tactile server 300 determines that it can be received (step S203: Yes), it proceeds to step S204; if it determines that it cannot be received (step S203: No), it ends the processing.

[0258] The tactile server 300 of the information processing system 10 reads each parameter of the tactile control signal associated with the stamp 850 (step S204). Then, the tactile server 300 outputs the tactile control signal from the tactile presentation device 100 according to each read parameter (step S205).

[0259] As described above, in this embodiment, when a viewer 900 simultaneously enjoys distributions from multiple distributors 800, the distributor 800 to whom the tactile stimulation stamp 850 will be sent can be easily selected. Furthermore, in this embodiment, the viewer 900 can feel the tactile stimulation presented to one or more distributors 800, and the viewer 900 can send tactile stimulation stamps 850 to each other. In other words, according to this embodiment, the viewer 900 can obtain a real-time interactive experience with high added value.

[0260] <<5. Third Embodiment>>

[0261] Next, we will refer to Figure 23 A third embodiment of this disclosure describes a method for setting each parameter of a tactile control signal performed by a viewer 900 and for setting a stamp 850 with a tactile stimulation effect to be sent to a distributor 800. Figure 23 This is an explanatory diagram used to describe an input example according to a third embodiment of the present disclosure.

[0262] For example, in this embodiment, such as Figure 23 As shown, the viewer 900 can set the intensity or type of the tactile control signal to be presented to the distributor 800 by performing a drag operation on the icon 890 displayed on the display unit 702 of the user terminal 700 (specifically, an operation of releasing the finger after dragging the icon 890 from the starting position of the touch operation towards a relatively low part of the screen). In this embodiment, the intensity or type of the tactile control signal to be presented to the distributor 800 is determined based on the distance, time, or speed at which the viewer 900 drags the icon 890. Furthermore, at this time, the tactile stimulus can be presented to the distributor 800 at the timing when the viewer 900 releases their finger from the icon 890. Additionally, at this time, the tactile stimulus can be presented to the distributor 800 at a position associated with a vector 910, which is opposite to the vector corresponding to the trajectory of the drag operation.

[0263] Next, we will refer to Figure 24 This describes an information processing method according to this embodiment. Figure 24 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 24 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S301 to step S310. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0264] The user terminal 700 of the information processing system 10 detects the input start position (the part where the touch operation begins) of the viewer 900 on the screen of the user terminal 700 (step S301). Then, the haptic server 300 measures the distance between the current input position and the input start position (step S302).

[0265] Then, the user terminal 700 of the information processing system 10 determines whether the distance measured in step S302 is equal to or greater than a predetermined distance (step S303). If the user terminal 700 determines that the measured distance is equal to or greater than the predetermined distance (step S303: Yes), it proceeds to step S304; if it determines that the measured distance is not equal to or greater than the predetermined distance (step S303: No), it ends the processing.

[0266] Then, the user terminal 700 of the information processing system 10 switches to drag-and-drop input mode (step S304). The user terminal 700 detects the input end position (the position where the finger is released from the screen) and measures the distance between the input end position and the input start position (step S305).

[0267] Then, the user terminal 700 of the information processing system 10 determines whether the distance measured in step S305 is equal to or greater than a predetermined distance (step S306). If the user terminal 700 determines that the measured distance is equal to or greater than the predetermined distance (step S306: Yes), it proceeds to step S307; if it determines that the measured distance is not equal to or greater than the predetermined distance (step S303: No), it ends the processing.

[0268] Then, the user terminal 700 of the information processing system 10 determines the distribution screen of the distributor 800 on the vector from the input end position to the input start position (step S307). Then, the user terminal 700 sends the screen information of the distributor 800 to be targeted, the information of the stamp 850, the operation distance information, etc., to the haptic server 300, etc. (step S308). Then, the haptic server 300 determines the strength of the haptic control signal based on the operation distance information (step S309). Then, the distribution data editing server 400 displays the video effect on the distribution screen of the distributor 800 to be targeted, and the haptic server 300 outputs the haptic control signal from the haptic presentation device 100 (step S310).

[0269] Furthermore, different setting methods can be used in this embodiment. (Refer to...) Figure 25 Describe the different setup methods. Figure 25 This is an explanatory diagram used to describe an input example according to this embodiment.

[0270] like Figure 25As shown, the viewer 900 can perform a swipe operation on the icon 890 displayed on the display unit 702 of the user terminal 700 (a relatively quick swipe operation from the starting position of the finger towards the top of the screen (or the distributor's distribution screen) followed by releasing the finger). Similarly, in this case, the strength of the tactile control signal presented to the distributor 800 is determined based on the distance or speed of the swipe operation.

[0271] Next, we will refer to Figure 26 This describes an information processing method according to this embodiment. Figure 26 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 26 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S401 to step S410. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0272] When a predetermined trigger is received (e.g., input of a specific stamp 850, mode switching of distributor 800, or mode switching of viewer 900), the user terminal 700 of the information processing system 10 switches to drag input mode (step S401). Then, the user terminal 700 detects the touch screen operation of viewer 900 and begins input (step S402).

[0273] The information processing system 10 (specifically, the user terminal 700 or the data distribution and editing server 400) determines the length of the trajectory to be drawn and the number of stamps to be used for drawing based on the distance the viewer 900 moves while touching the screen, and performs the drawing (step S403).

[0274] Then, the user terminal 700 of the information processing system 10 determines whether the non-operation time has elapsed for a predetermined time or longer (step S404). If the user terminal 700 determines that the non-operation time is equal to or longer than the predetermined time (step S404: Yes), it proceeds to step S405; if it determines that the non-operation time is not equal to or longer than the predetermined time (step S404: No), it returns to the processing in step S402.

[0275] The user terminal 700 of the information processing system 10 measures the total distance of the drawn trajectory (or the number of stamps to be used) (step S405).

[0276] Then, the user terminal 700 of the information processing system 10 determines whether the distance measured in step S405 is equal to or greater than a predetermined distance (or a predetermined number) (step S406). If the user terminal 700 determines that the measured distance is equal to or greater than the predetermined distance (step S406: Yes), it proceeds to step S407; if it determines that the measured distance is not equal to or greater than the predetermined distance (step S406: No), it proceeds to the processing in step S408.

[0277] The user terminal 700 or the haptic server 300 of the information processing system 10 switches the type of haptic control signal to be presented based on the determination in step S406 (step S407). The haptic server 300 determines the haptic control signal to be presented and reads each parameter of the haptic control signal (step S408). The haptic server 300 determines the intensity of the haptic control signal based on the distance of the trajectory, the number of stamps 850 used, etc. (step S409). Then, the haptic server 300 outputs the haptic control signal from the haptic presentation device 100 (step S410).

[0278] Furthermore, in this embodiment, the viewer 900 can perform the settings by tapping the back surface of the user terminal 700 facing the display unit 702. Specifically, the viewer 900 selects the stamp 850 by tapping on the display unit 702, and the timing of presenting the tactile stimulus is determined by the tapping on the back surface. Note that the tapping on the back surface can be detected by an accelerometer 728 built into the user terminal 700. Furthermore, in this embodiment, the timing of presenting the tactile stimulus can be determined at a time when the tapping operations of multiple viewers 900 are synchronized.

[0279] Furthermore, in this embodiment, tactile stimuli are edited and set not only through operations on the display unit 702 but also by utilizing various sensors and other devices, such as those built into the user terminal 700. In this embodiment, for example, the viewer 900 can edit the waveform, intensity, etc., of the tactile stimulus by performing touch operations such as applying vibration or movement operations such as changing the holding angle on the user terminal 700. Specifically, in this embodiment, movement operations are detected by the gyroscope sensor 726 and the accelerometer sensor 728 built into the user terminal 700, and the waveform, etc., of the tactile stimulus can be determined based on the detected sensing data.

[0280] Furthermore, in this embodiment, shapes or characters (trajectories) drawn by the viewer 900 can be recognized, words can be extracted from the recognition results, and a stamp 850 or tactile control signal associated with the extracted words can be selected. At this time, not only can operations on the touch panel (not shown) of the user terminal 700 be performed, but also drawing characters or shapes in the air can be performed. In this case, for example, characters or shapes can be recognized by an IMU sensor (not shown) attached to the viewer 900's arm.

[0281] In addition, such as Figure 27 As shown, haptic control signals can also be edited via voice input. Figure 27 This is an explanatory diagram illustrating an input example according to this embodiment. For example, a viewer 900 emits a sound with a predetermined rhythm to a user terminal 700, and a microphone 724 built into the user terminal 700 detects the sound. The haptic server 300 then uses the sensing data detected by the microphone 724 and sets the frequency of the haptic control signal according to the rhythm of the sound. Furthermore, in this embodiment, for example, as... Figure 27 As shown, the user can switch to sound input mode when the viewer touches the microphone icon 892 (the sound input mode ends when the finger is released), or the user can switch the start and end of input each time the microphone icon 892 is touched.

[0282] Note that, for example, in cases where it is desired to continuously present tactile stimuli associated with multiple stamps 850 to the distributor 800 according to the rhythm of music, sound input can be considered an effective means, since the timing of the presentation can be determined by sound rather than a tapping operation. Furthermore, when a predetermined piece of music or rhythm is output to the viewer 900 and the rhythm or timing of the music matches the sound emitted by the viewer 900, the intensity of the tactile control signal can be increased or other parameters can be changed.

[0283] Furthermore, in this embodiment, when the viewer 900 utters onomatopoeic words (e.g., stuck, bored, or trembling), the name of the stamp 850 (e.g., heart or bouquet), etc., words can be extracted from the uttered sounds, and the stamp 850 or tactile stimulation associated with the extracted words can be selected. At this time, the intensity of the tactile control signal can be increased, or other parameters can be changed, depending on the sound pressure (volume) of the uttered sound.

[0284] As described above, in the embodiments of this disclosure, the viewer 900 can set the presentation timing of tactile stimuli, the distributor 800 that performs the presentation, and each parameter of the tactile control signal through various input methods. Since the viewer 900 can easily perform these settings in this manner, according to this embodiment, the viewer 900 can obtain a real-time interactive experience with high added value.

[0285] <<6. Fourth Embodiment>>

[0286] Furthermore, in this disclosure, when multiple viewers 900 select a predetermined type of stamp 850 within a predetermined time, the stamp 850 can be changed into a new stamp 850 and a new tactile stimulus based on the combination of stamps 850. (Refer to...) Figure 28 This fourth embodiment of the present disclosure is described. Figure 28 This is an explanatory diagram used to describe an input example according to this embodiment.

[0287] For example, such as Figure 28 As shown, when viewer 1 selects the bread stamp 850a, the clock starts, and the user terminal 700 displays the remaining time. Then, if viewer 2 selects the meat stamp 850b and viewer 3 selects the lettuce stamp 850c within the predetermined time, the result changes to a hamburger stamp 850d that combines stamps 850a, 850b, and 850c. The tactile stimulus associated with stamp 850d is different from the tactile stimuli associated with the other stamps 850a, 850b, and 850c. That is, in this embodiment, if multiple viewers 900 select a predetermined type of stamp 850 within a predetermined time and meet predetermined conditions, the video effect of stamp 850 changes, or the tactile stimulus presented to the distributor 800 changes.

[0288] Next, we will refer to Figure 29 An example describing the information processing method according to this embodiment. Figure 29 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 29 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S501 to step S507. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0289] The data distribution and editing server 400 of the information processing system 10 receives information (identification information of stamp 850) sent from the user terminal 700 (step S501).

[0290] Then, the distribution data editing server 400 of the information processing system 10 determines whether the selected stamp 850 corresponds to the composition (step S502). If the distribution data editing server 400 determines that the stamp 850 corresponds to the composition (step S502: Yes), it proceeds to step S503; if it determines that the stamp 850 does not correspond to the composition (step S502: No), it ends the processing.

[0291] Then, the data distribution editing server 400 reads the standby time corresponding to the selected stamp 850 and performs its distribution (step S503). At this time, the user terminal 700 receiving the distribution presents the remaining time to each viewer 900 by displaying its text, time bar, etc. based on the standby time.

[0292] Then, the data distribution and editing server 400 determines whether the stamp 850 input from another viewer 900 within a predetermined time meets the predetermined compositing conditions (step S504). If the data distribution and editing server 400 determines that the compositing conditions are met (step S504: Yes), it proceeds to step S505; if it determines that the compositing conditions are not met (step S504: No), it ends the process.

[0293] The data distribution and editing server 400 of the information processing system 10 distributes the identification information and video effects of the special stamp 850 to be displayed when the synthesis conditions are met, and causes the user terminal 700 to display the special stamp 850 (step S505). At this time, the image of the stamp 850 that was input and displayed on the user terminal 700 up to that point can be deleted. In addition, the haptic server 300 reads the haptic control signal associated with the special stamp 850 selected in step S505 (step S506). Next, the haptic server 300 outputs a haptic control signal (a signal different from the haptic control signal corresponding to the stamp 850) from the haptic presentation device 100 (step S507). Note that in this embodiment, in the above step S506, the haptic server 300 can receive the identification information associated with the special stamp 850 selected in step S505, and read the haptic control signal based on the received identification information.

[0294] As described above, in embodiments of this disclosure, new stamps 850 and new tactile stimuli can be sent to distributor 800 in collaboration with another viewer 900. Because this sending can be performed, according to this embodiment, viewer 900 can obtain a real-time interactive experience with high added value.

[0295] <<7. Fifth Embodiment>>

[0296] Incidentally, when a large number of stamps 850 are simultaneously sent to a single distributor 800, the tactile stimulation unit 106 of the tactile presentation device 100 worn on the distributor 800 may generate heat due to operation and cause operational malfunctions. Therefore, as a fifth embodiment of this disclosure, the following embodiment will be described, in which a limit is set on the simultaneous reproduction of tactile stimuli, and the burden on the tactile stimulation unit 106 of the tactile presentation device 100 can be avoided.

[0297] For example, in this embodiment, the tactile server 300 of the information processing system 10 compares the number of simultaneously reproduced tactile stimuli (stamps 850), the intensity of the tactile control signal, the presentation time, the heat of the tactile stimulation unit 106, etc., with a threshold predetermined based on the characteristics of the tactile stimulation unit 106. Then, if it is determined that the threshold is exceeded, the tactile server 300 limits the simultaneous reproduction of tactile stimuli. Furthermore, when a limit is set, the tactile server 300 may temporarily stop the presentation of tactile stimuli, or stack the tactile stimuli of each stamp 850 and resume the presentation of tactile stimuli when the parameters drop below the threshold. Note that in this embodiment, it is assumed that the temperature of the tactile stimulation unit 106 is sent from the tactile presentation device 100 to the tactile server 300.

[0298] Furthermore, when temporarily pausing, it is preferable to notify viewers of the temporary pause. For example, refer to... Figure 30 and Figure 31 Describes an example of how the notification is displayed. Figure 30 and Figure 31 This is an explanatory diagram used to describe a display example according to this embodiment.

[0299] For example, such as Figure 30 As shown, the user terminal 700 can simply stop the presentation of tactile stimulation, while maintaining the display of the stamp 852, etc. Furthermore, at this time, the user terminal 700 can display an icon 870b indicating temporary cessation and execute the display 850 indicating that a stamp is not available and can be selected by the viewer 900.

[0300] Furthermore, in situations where not only tactile stimulation is stopped but video display is also stopped, the user terminal 700 can... Figure 31 The display is performed in the manner shown. Furthermore, at this time, the user terminal 700 may display an icon 872 indicating that the status is stopped, or it may display the number of stamps 850 or tactile stimuli in the stack, indicated by reference numeral 874.

[0301] Next, we will refer to Figure 32 This describes the information processing method according to this embodiment. Figure 32 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 32 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S601 to step S607. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0302] The tactile server 300 and the data distribution and editing server 400 of the information processing system 10 receive information (e.g., ID) of the stamp 850 sent from the user terminal 700 (step S601).

[0303] Then, the tactile server 300 of the information processing system 10 determines whether the number of the stamps 850 being reproduced exceeds a threshold (step S602). If the tactile server 300 determines that the number exceeds the threshold (step S602: yes), it proceeds to step S606; if it determines that the number does not exceed the threshold (step S602: no), it proceeds to step S603.

[0304] The data distribution and editing server 400 of the information processing system 10 distributes the received stamp 850 to another viewer 900 and distributor 800 (step S603). The tactile server 300 of the information processing system 10 reads the parameters of the tactile control signal corresponding to the stamp 850 and executes its output from the tactile presentation device 100 (step S604). The data distribution and editing server 400 of the information processing system 10 reads and displays the video effect corresponding to the stamp 850 (step S605).

[0305] The tactile server 300 of the information processing system 10 includes information indicating that the tactile presentation device 100 cannot present tactile stimuli in the information to be distributed (step S606). The user terminal 700 displays an icon or text indicating that the tactile presentation device 100 cannot present tactile stimuli (step S607).

[0306] As described above, according to this embodiment, the simultaneous reproduction of tactile stimuli can be limited, and the burden on the tactile stimulation unit 106 of the tactile presentation device 100 can be avoided.

[0307] <<8. Sixth Embodiment>>

[0308] Incidentally, in this disclosure, for example, when the distributor 800 is not wearing the haptic presentation device 100, when the distributor 800 does not wish to receive haptic stimulation, or when the battery capacity of the haptic presentation device 100 is low, the vibration of the haptic stimulation can be presented by another modality such as video instead of the haptic stimulation. Therefore, reference will be made to... Figures 33 to 37 The presentation method in this case is described as the sixth embodiment of this disclosure. Figures 33 to 37 This is an explanatory diagram used to describe a display example according to this embodiment.

[0309] In this embodiment, for example, such as Figure 33 As shown, a video effect can be used where the distributed video 950, or a portion of video 950, reciprocates left and right according to the frequency of a tactile control signal. Specifically, for example, when the frequency of the tactile control signal is high, the reciprocating period of video 950 is shortened. Furthermore, in this embodiment, the area to be reciprocated by video 950 can be determined based on the frequency of the tactile control signal exceeding a threshold. For example, as... Figure 33As shown, when the frequency of the tactile control signal is low, the video reciprocates closer to the lower part of video 950.

[0310] In addition, such as Figure 34 As shown, when multiple frequencies of the tactile control signal exceed a threshold (e.g., when two frequency regions, one in a relatively low frequency region and the other in a high frequency region, exceed the threshold), the lower and upper portions of the distributed video 950 are made to reciprocate.

[0311] Furthermore, in this embodiment, when the video loops back and forth around 950 degrees, the loop can be switched to be continuous or discontinuous, or its degree can be switched. For example, as... Figure 35 As shown, when the vibration frequency component is relatively low, the video distortion is made continuous (region 960b), while when the vibration frequency component is relatively high, the video distortion is made discontinuous (region 960a). In this way, a video effect with a softer expression is applied at lower frequencies in video 950. Note that in this embodiment, not only the frequency of the video 950's back-and-forth movement, but also the intervals, waveforms, etc., can be changed according to the frequency of the haptic control signal.

[0312] More specifically, will refer to Figure 36 To describe Figure 35 Example, Figure 36 This is a graph showing the video position at each unit of time during the video warp's reflection. (Example) Figure 36 As shown, in Figure 35 In the example, the video position changes proportionally to the elapsed unit of time, and when the video position reaches the end point, the video position begins to change in the opposite direction.

[0313] exist Figure 36 In the case of relatively high frequencies shown on the left side (region 960a), the video position is determined according to the following expressions (1) and (2). First, the video position is determined according to the elapsed time t and expression (1), and when the endpoint is reached, the video position x is determined according to the elapsed time t and expression (2). Note that α in expressions (1) and (2) is an arbitrary coefficient.

[0314] X=α×t …expression(1)

[0315] X=-α×t …expression(2)

[0316] exist Figure 36 The right side (region 960b) shows the case where the frequency is relatively low. The video position x is determined based on the elapsed time t and expression (3). Note that α and β in expression (3) are arbitrary coefficients.

[0317] x=α×sin(β×t) …expression(3)

[0318] Note that in this embodiment, the determination of the video position at the foldback point of video deformation can be performed based on the frequency components and intensity of the haptic control signal, the type of video content, the type of video effect, and metadata associated with the video content or video effect.

[0319] Furthermore, in this embodiment, not only can the entire video 950 be rotated right and left, but also only a predetermined region 970 within the video 950 can be rotated right and left. For example, in Figure 37 In this case, the area 970 displaying the distributor 800 can be rotated approximately back and forth. Alternatively, in this embodiment, only the image of the stamp 850 superimposed on the image of the distributor 800 can be rotated approximately back and forth.

[0320] Furthermore, in this embodiment, when metadata associated with the video content exists, the type of video deformation can be determined based on the metadata. For example, if metadata such as "falling" is assigned to a stamp 850 that has a video effect of an object falling from above, the video 950 can move up and down instead of moving left and right.

[0321] Next, we will refer to Figure 38 This describes an information processing method according to this embodiment. Figure 38 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 38 As shown, an example of the information processing method according to this embodiment includes multiple steps from step S701 to step S706. Hereinafter, details of each step included in the example of the information processing method according to this embodiment will be described.

[0322] The user terminal 700 of the information processing system 10 sends the information of the stamp 850 to the tactile server 300 (step S701). The tactile server 300 reads the tactile control signal corresponding to the stamp 850 (step S702).

[0323] Then, the haptic server 300 of the information processing system 10 determines whether the distributor 800 or the viewer 900 has the haptic presentation device 100 (step S703). If the haptic server 300 determines that the haptic presentation device 100 is included (step S703: Yes), it proceeds to step S704; if it determines that the haptic presentation device 100 is not included (step S703: No), it proceeds to step S705.

[0324] The tactile server 300 of the information processing system 10 outputs a tactile control signal corresponding to the stamp 850 from the tactile presentation device 100 (step S704).

[0325] The tactile server 300 of the information processing system 10 analyzes the frequency components and intensities in the tactile control signals (step S705). The data distribution and editing server 400 of the information processing system 10 deforms the video 950 based on the analysis results in step S705 (step S706).

[0326] In addition, in this embodiment, besides shaking the video 950 to the right and left, the audio data to be distributed to the viewer 900 or the distributor 800 can be processed by shaking the audio image up and down using audio-visual positioning technology.

[0327] Furthermore, in this embodiment, if the distributor 800 is not wearing the tactile presentation device 100, air (e.g., warm air, cold air, etc.) can be output by a blower-type device, or the temperature of a temperature presentation device (equipped with a Peltier element, etc.) worn on the body can be changed. Additionally, in this embodiment, a fragrance can be presented by a fragrance emitter.

[0328] As described above, for example, even when the distributor 800 is not wearing the haptic presentation device 100, the vibration of haptic stimulation can be presented by another modality in this embodiment. Therefore, according to this embodiment, the viewer 900 can obtain a real-time interactive experience with high added value.

[0329] <<9. Seventh Embodiment>>

[0330] Next, we will refer to Figures 39 to 41 The seventh embodiment of this disclosure is described. Figures 39 to 41 This is an explanatory diagram used to describe a display example according to this embodiment.

[0331] In this embodiment, for example, when the tactile presentation device 100 worn by the distributor 800 includes multiple tactile stimulation units 106, each tactile stimulation unit 106 can be dedicated to a viewer 900. That is, a viewer 900 other than the dedicated viewer 900 cannot receive tactile stimulation by using the corresponding tactile stimulation unit 106. For example, to occupy a tactile stimulation unit 106, it is assumed that the viewer 900 is able to pay a predetermined amount, co-purchase, or subscribe. Furthermore, in this embodiment, the presentation of tactile stimulation units 106 located around the tactile stimulation units 106 designated by the high-priced stamp 850 can be stopped. In addition, when the viewer 900 is divided into several groups (e.g., by area or by level), the tactile stimulation unit 106 can be assigned to each group.

[0332] For example, in Figure 39In the image, the left side shows a display example of a user terminal 700 of a viewer 900 occupying a portion of the tactile stimulation unit 106, and the right side shows a display example of a user terminal 700 of a viewer 900 not occupying a portion of the tactile stimulation unit 106. In this case, the user terminal 700 of the viewer 900 not occupying a portion of the tactile stimulation unit 106 displays the following: the stamp 850 corresponding to the occupied tactile stimulation unit 106 cannot be selected.

[0333] In addition, for example, in Figure 40 In the image, the left side shows a display example of a user terminal 700 of a viewer 900 occupying a portion of the tactile stimulation unit 106, and the right side shows a display example of a user terminal 700 of a viewer 900 not occupying a portion of the tactile stimulation unit 106. In this case, the user terminal 700 of a viewer 900 not occupying a portion of the tactile stimulation unit 106 displays the following: The occupied tactile stimulation unit 106 cannot be selected.

[0334] In addition, for example, in Figure 41 In the image, the left side shows a display example of a user terminal 700 of a viewer 900 occupying all tactile stimulation units 106, and the right side shows a display example of a user terminal 700 of a viewer 900 not occupying all tactile stimulation units 106. In this case, the user terminal 700 of a viewer 900 not occupying all tactile stimulation units 106 displays the following: "Stamp 850 cannot be selected because all tactile stimulation units 106 are occupied." Alternatively, in... Figure 41 In the display example, the left side could be a display example of the user terminal 700 of a viewer 900 who paid a high amount or was at a high level (e.g., advanced course, gold level, etc.), while the right side could be a display example of the user terminal 700 of another viewer 900 when viewer 900 inputs a tactile control signal. In this case, other viewers 900 can input tactile control signals after the presentation of the tactile stimulus associated with, for example, the tactile control signal input by the viewer 900 who paid a high amount has ended. Alternatively, in this embodiment, if the viewer 900 who paid a high amount or was at a high level inputs a tactile control signal immediately after the viewer 900 who paid a low amount or was at a low level (e.g., basic course, bronze level, etc.) inputs a tactile control signal, the presentation of the tactile control signal input by the viewer 900 who paid a low amount or was at a low level can be immediately canceled.

[0335] Furthermore, in this embodiment, the tactile stimulation unit 106 capable of presenting tactile stimulation can be switched according to the category of the content being distributed. For example, in the case of makeup distribution or game commentary distribution, the tactile stimulation unit 106 corresponding to the hand or arm used for makeup or gaming is set not to present tactile stimulation. Furthermore, in the case of distribution related to flea markets (or live shopping), since the vest-style tactile presentation device 100 is removed for trying on clothes, the tactile stimulation unit 106 corresponding to the torso is set not to present tactile stimulation. In this case, when the tactile presentation device 100 is worn, stacked tactile stimuli can be presented sequentially.

[0336] Furthermore, in this embodiment, when the types of tactile presentation devices 100 worn by the distributor 800 and the viewer 900 in a battle-type distribution are different (e.g., different reproducible frequency bands or different numbers of actuators installed), tactile stimulation can be presented by using only the tactile stimulation unit 106 that has a common part (a common reproducible frequency region, a minimum value of the vibration intensity that can be output, and a common actuator part).

[0337] Specifically, in order to adjust the tactile control signals optimized for a larger number of installed tactile stimulation units 106 to tactile control signals optimized for a smaller number of installed tactile stimulation units 106, the control signals applied to each tactile stimulation unit 106 can be merged and output from a specific tactile stimulation unit 106. Specifically, tactile stimuli presented on the shoulder and arm are merged and output from a tactile stimulation unit 106 installed on the wrist. Furthermore, when tactile stimuli are merged, a priority can be preset for each body part or each tactile stimulation unit 106 to determine the mixing ratio. Specifically, for example, if the priority of the shoulder is set to 4 and the priority of the arm is set to 1 (assuming that the larger number indicates a higher priority), the intensity of the tactile control signal output from the tactile stimulation unit 106 corresponding to the wrist is the intensity of the tactile control signal applied to the shoulder × 0.8 + the intensity of the tactile control signal applied to the arm × 0.2.

[0338] Furthermore, in this embodiment, each tactile stimulation unit 106 can be pre-set with a meaning (e.g., positive system / negative system), and the tactile stimulation unit 106 having a meaning corresponding to the metadata associated with the stamp 850 can be identified as the tactile stimulation unit 106 that presents tactile stimulation by comparing it with the metadata associated with the stamp 850.

[0339] Next, we will refer to Figure 42 This describes an information processing method according to this embodiment. Figure 42 This is a flowchart illustrating an example of the information processing method according to this embodiment. For example... Figure 42As shown, an example of the information processing method according to this embodiment includes multiple steps from step S801 to step S806. Details of each step included in the example of the information processing method according to this embodiment will be described below.

[0340] The tactile server 300 of the information processing system 10 detects the category of the distribution (step S801). The tactile server 300 reads information about the tactile stimulation unit 106 that cannot perform tactile presentation for the detected category (step S802). Then, the tactile server 300 reads information about the tactile stimulation unit 106 associated with the stamp 850 (step S803).

[0341] Then, the tactile server 300 of the information processing system 10 determines whether a tactile stimulation unit 106 that cannot present tactile stimulation is included (step S804). If the tactile server 300 determines that a tactile stimulation unit 106 that cannot present tactile stimulation is included (step S804: Yes), it proceeds to step S805, and if it determines that a tactile stimulation unit 106 that cannot present tactile stimulation is not included (step S804: No), it ends the processing.

[0342] The tactile server 300 of the information processing system 10 sets the stamp 850 to an unselectable state and distributes the stamp as unselectable (step S805). The user terminal 700 of the information processing system 10 executes a change to display an indication that the stamp 850 cannot be selected (step S806).

[0343] As described above, in the embodiments of this disclosure, the viewer 900 may occupy the tactile stimulation unit 106, and the tactile stimulation unit 106 presenting the tactile stimulation may change depending on the content being distributed, or the tactile stimulation may change depending on the type of tactile presentation device 100. In this way, according to this embodiment, the viewer 900 can obtain a real-time interactive experience with high added value.

[0344] <<10. Eighth Embodiment>

[0345] In the eighth embodiment of this disclosure, by having the viewer 900 simultaneously input the stamp 850 at the same timing or rhythm, a switch to a tactile stimulus different from the tactile stimulus associated with the stamp 850 can be performed, and its presentation can be performed.

[0346] Furthermore, in this embodiment, the time range for selecting the stamp 850 (e.g., from when to when, or for how many minutes) and the number of stamps that can be sent within that time can be set. In this embodiment, for example, the number of minutes for each viewer 900 to input the stamp 850 can be determined through bidding.

[0347] <<11. Ninth Embodiment>

[0348] Furthermore, in this embodiment, in the case of distribution with a relatively small number of viewers 900 or inactive distribution of stamps 850 (the number of stamps 850 sent per unit time is less than a threshold), chat text, etc., can be used as a trigger, and tactile stimuli corresponding to the chat text can be presented to the distributor 800. In this way, the distributor 800's motivation to distribute can be increased. For example, when a viewer 900 posts a comment that includes keywords or pictorial text pre-set by the distributor 800, the comment can be detected and tactile stimuli can be presented. In addition, the type of video effect can be switched or the intensity of the presented tactile stimuli can be increased based on the number of matching keywords or matching pictorial text in the comment. In this case, keywords can be set before distribution begins, or keywords can be set appropriately during distribution (e.g., setting the correct keywords each time in a question scenario).

[0349] Furthermore, in this embodiment, tactile stimulation can be triggered by a new viewer 900 entering the distribution room of the distributor 800. Additionally, in this embodiment, tactile stimulation can be triggered by the timing of multiple viewers 900 simultaneously (within a certain time period) posting the same comment, posting comments including the same pictorial text, or posting the same stamp 850 (however, not corresponding to tactile stimulation).

[0350] <<12. Summary>>

[0351] As described above, according to each embodiment of this disclosure, viewer 900 can obtain a real-time interactive experience with high added value.

[0352] Note that the embodiments of this disclosure can be applied not only to live distribution as described above, but also to, for example, stamps 850 exchanged on social networking services (SNS). In this case, for example, the user terminal 700, instead of the haptic presentation device 100, vibrates, thereby providing haptic stimulation to the party to which the stamp 850 is sent.

[0353] <<13. Example of a first modification to the information processing system 10 of this disclosure>>

[0354] In addition, it will refer to Figures 43 to 50 A modified example of the information processing system 10 according to an embodiment of the present disclosure is described. Figures 43 to 50 This is a system diagram illustrating a schematic configuration example of an information processing system 10 according to a first modified example of an embodiment of the present disclosure.

[0355] First of all, Figure 43In the information processing system 10 shown, the haptic server 300a also has the functions of the aforementioned data distribution editing server 400 and live distribution server 500. In this case, the management of the haptic server 300a can be performed by a business operator.

[0356] In addition, Figure 44 The information processing system 10 shown may include a haptic server 600 as part of the functions of the storage unit 318 of the haptic server 300. In this case, the haptic server 600 stores a previously generated haptic database (e.g., vibration waveform patterns) associated with the identification information (ID) of each stamp 850. The haptic server 600 may, for example, store information such as the number, location, frequency characteristics, and maximum input voltage of the haptic stimulation units 106 of the haptic presentation device 100 as configuration information of the haptic presentation device 100.

[0357] In addition, Figure 45 In the information processing system 10 shown, the tactile server 300 also has the functions of the aforementioned data distribution and editing server 400. In this case, the service operator managing the presentation of tactile stimuli and the service operator managing the distribution can be different service operators.

[0358] In addition, with Figure 45 The examples are different, in Figure 46 In the information processing system 10 shown, information stored in the haptic server 600 is provided to the haptic server 300 via the live distribution server 500.

[0359] In addition, Figure 47 In the information processing system 10 shown, with Figure 45 Unlike other examples, the information stored in the haptic server 600 is provided to the haptic server 300 via the live distribution server 500 and the distribution data editing server 400.

[0360] In addition, with Figure 43 The examples shown are different, in Figure 48 The information processing system 10 shown may include a haptic server 600 as part of the functionality of the storage unit 318 of the haptic server 300.

[0361] In addition, Figure 49 In the information processing system 10 shown, the haptic server 600 can cooperate with the live distribution server 500 to perform distribution to the user terminal 700.

[0362] In addition, Figure 50In the information processing system 10 shown, the live distribution server 500 obtains information about the stamps 850 from the user terminal 700 and distributes videos, etc. Furthermore, the haptic server 300 obtains the identification information (ID) of each stamp 850 from the live distribution server 500. Additionally, the haptic server 300 generates haptic control signals associated with each stamp 850 based on the information in the haptic server 600, referencing the identification information. Note that in Figure 50 In this context, tactile data refers to the identification information of the tactile control signal (waveform data) corresponding to the stamp 850, or the tactile control signal itself.

[0363] <<14. Example of a second modification to the information processing system 10 of this disclosure>>

[0364] For example, the information processing system 10 according to embodiments of this disclosure can be applied to a system comprising multiple devices, provided it is connected to a network such as cloud computing (cloud) (or communication between devices). Therefore, reference will be made to... Figures 51 to 54 The description covers the changes in the network location (cloud side or local side) of each server in the information processing system 10 according to this embodiment. Figures 51 to 54 This is a system diagram illustrating a schematic configuration example of an information processing system 10 according to a second modified example of an embodiment of the present disclosure. Note that in these figures, the local control device 350 corresponds to the haptic server 300 in the embodiments of the present disclosure described above, and the live distribution server 500 corresponds to the live distribution server 500 and the distribution data editing server 400 in the embodiments of the present disclosure described above. Furthermore, in these figures, the haptic data is either identification information of the haptic control signal (waveform data) corresponding to stamp 850 or the haptic control signal itself.

[0365] First of all, Figure 51 In the information processing system 10 shown, a local control device 350 is installed on the distributor 800 side. On the other hand, a live distribution server 500 is located on the cloud side. Furthermore, the local control device 350 includes a PC or similar device and is equipped with a browser and software to execute this embodiment (displaying the stamp 850 and sending and receiving data to and from the live distribution server 500). Additionally, the local control device 350 is equipped with software and a database for controlling the haptic presentation device 100. Furthermore, each device and software installed on the distributor side of the information processing system 10 can be provided by the same service operator or by different service operators. Moreover, the service operator can be the same as or different from the service operator managing / operating the live distribution server 500.

[0366] Next, with Figure 51 The information processing system 10 shown is different. Figure 52The information processing system 10 shown includes a haptic server 600 deployed on the cloud side. The local control device 350 includes a PC, etc., and can obtain identification information, such as identification information of haptic control signals (waveform data) associated with the identification information (stamp information) of the stamp 850, from the haptic server 600. Note that in Figure 52 In the information processing system 10 shown, the haptic server 600 may be a local device installed on the distributor 800 side.

[0367] Next, similar to Figure 52 The information processing system 10 shown is... Figure 53 The information processing system 10 shown includes a tactile server 600 deployed on the cloud side. However, Figure 53 The information processing system 10 shown is Figure 52 The difference in the information processing system 10 shown is that the local control device 350 obtains the identification information of the tactile control signal (waveform data) associated with the identification information (stamp information) of the stamp 850 from the tactile server 600 via the live distribution server 500.

[0368] In addition, Figure 54 In the information processing system 10 shown, the local control device 350 is installed on the distributor 800 side. On the other hand, the live distribution server 500 and the haptic server 600 are arranged on the cloud side. Figure 54 The information processing system 10 shown is different from Figure 53 The information processing system 10 shown, and the local control device 350 obtains video, audio signals, etc. associated with the identification information (stamp information) of the stamp 850 from the live distribution server 500 via the haptic server 600.

[0369] <<15. Methods of Outputting Tactile Stimuli>>

[0370] In each of the above embodiments of this disclosure, the tactile server 300 refers to the received identification information of the stamp 850 and generates / outputs a tactile control signal corresponding to the stamp 850 based on pre-stored data associated with the identification information. Therefore, reference will be made to... Figure 55 Specific methods for presenting tactile stimuli are described in embodiments of this disclosure. Figure 55 This is an illustrative diagram for describing a method of presenting tactile stimuli according to embodiments of the present disclosure.

[0371] In this embodiment, for example, such as Figure 55As shown, waveform data of the tactile stimulation associated with the identification information of the stamp 850 is prepared and stored in the tactile server 300 or the tactile server 600 in a manner corresponding to the tactile stimulation unit 106 that presents the tactile stimulation. Then, the tactile server 300 or the tactile server 600 sends multiple waveform data associated with the received identification information of the stamp 850 to the driver amplifier / interface 200. Furthermore, the driver amplifier / interface 200 can present tactile stimulation by driving designated tactile stimulation units 106a to 106f based on the received waveform data.

[0372] Note that while the above description describes the preparation of waveform data in a manner corresponding to the tactile stimulation unit 106 that presents the tactile stimulus, this embodiment is not limited thereto. For example, waveform data of the tactile stimulus associated with the identification information of the stamp 850 may be prepared and stored in the tactile server 300 or tactile server 600, without being associated with the tactile stimulation unit 106 that presents the tactile stimulus. Furthermore, it is assumed that the tactile server 300, tactile server 600, or driver amplifier / interface 200 obtains information about the specifications of the tactile presentation device 100 (e.g., the number and location of the tactile stimulation units 106, and the maximum vibration intensity to be applied) from the tactile presentation device 100, or pre-stores this information.

[0373] Then, haptic server 300 or haptic server 600 associates (matches) each of the multiple waveform data associated with the identification information of the received stamp 850 with each haptic stimulation unit 106 according to the specifications of haptic presentation device 100. In this way, for example, if the number of pre-prepared waveform data is not the same as the number of haptic stimulation units 106, haptic server 300 or haptic server 600 can send only the waveform data that matches the specifications of haptic presentation device 100. Then, haptic server 300 or haptic server 600 sends the waveform data associated with each haptic stimulation unit 106 to drive amplifier / interface 200, and drive amplifier / interface 200 can present haptic stimulation by driving each haptic stimulation unit 106 based on the received waveform data.

[0374] <<16. Example of modifying the stamp display>>

[0375] In addition, it will refer to Figure 56 A display example illustrating modifications to embodiments of the present disclosure. Figure 56These are explanatory diagrams illustrating examples of modifications to embodiments according to the present disclosure. In each embodiment of the present disclosure described above, it has been depicted that a viewer 900 selects a stamp 850 with a tactile stimulating effect. However, this is not a limitation of the present disclosure, and the viewer 900 may be able to select both stamps without a tactile stimulating effect and stamps 850 with a tactile stimulating effect.

[0376] For example, in Figure 56 The image shows a display example of a user terminal 700 for viewer 900, in which stamps 854a and 854b without tactile stimulation are displayed together with stamp 856 with tactile stimulation. In this modified example, by performing an operation on such a display, viewer 900 can select between stamp 850 with tactile stimulation and stamp 854 without tactile stimulation.

[0377] <<17. Hardware Configuration>>

[0378] Information processing apparatuses such as haptic server 300 according to each of the above embodiments are provided with, for example, a haptic server 300. Figure 57 The computer 1000 is implemented in the manner shown. Hereinafter, a tactile server 300 according to each embodiment of this disclosure will be described as an example. Figure 57 This is a hardware configuration diagram illustrating an example of a computer implementing the functions of a haptic server 300. The computer 1000 includes a CPU 1100, RAM 1200, read-only memory (ROM) 1300, hard disk drive (HDD) 1400, communication interface 1500, and input / output interface 1600. Each unit of the computer 1000 is connected via a bus 1050.

[0379] The CPU 1100 operates based on programs stored in ROM 1300 or HDD 1400 and controls each unit. For example, the CPU 1100 expands programs stored in ROM 1300 or HDD 1400 in RAM 1200 and executes processing corresponding to various programs.

[0380] ROM 1300 stores boot programs such as the Basic Input / Output System (BIOS) executed by CPU 1100 during the startup of computer 1000, and programs that depend on the hardware of computer 1000.

[0381] HDD 1400 is a computer-readable recording medium that non-transitorily records programs executed by CPU 1100, data used by the programs, etc. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, the program being an example of program data 1450.

[0382] Communication interface 1500 is an interface for connecting computer 1000 to an external network 1550 (such as the Internet). For example, CPU 1100 receives data from another device or sends data generated by CPU 1100 to another device via communication interface 1500.

[0383] Input / output interface 1600 is an interface connecting input / output device 1650 and computer 1000. For example, CPU 1100 receives data from input devices such as keyboards or mice via input / output interface 1600. Additionally, CPU 1100 sends data to output devices such as displays or printers via input / output interface 1600. Furthermore, input / output interface 1600 can be used as a media interface for reading programs recorded on a predetermined recording medium. This medium may be, for example, optical recording media such as digital multifunction discs (DVDs) or phase-change rewritable discs (PDs), magneto-optical recording media such as magneto-optical discs (MOs), magnetic tape media, magnetic recording media, semiconductor memory, etc.

[0384] For example, when computer 1000 is used as a tactile server 300 according to an embodiment of the present disclosure, the CPU 1100 of computer 1000 executes an information processing program loaded onto RAM 1200 and performs functions such as generating tactile control signals. Furthermore, HDD 1400 stores the information processing program according to an embodiment of the present disclosure. Note that CPU 1100 reads program data 1450 from HDD 1400 and executes it, but in another example, these programs may be obtained from another device via an external network 1550.

[0385] Furthermore, the information processing apparatus according to this embodiment can be applied to a system comprising multiple devices, provided it is connected to a network such as cloud computing (or communication between devices). That is, the information processing apparatus according to this embodiment can also be implemented, for example, as an information processing system in which multiple devices perform processes related to the information processing method according to this embodiment.

[0386] <<18. Supplementary Explanation>>

[0387] Furthermore, each of the above embodiments may, for example, include a program for enabling a computer to function as an information processing apparatus according to this embodiment, and a non-transitory tangible medium on which the program is recorded. Additionally, the program may be distributed via communication lines such as the Internet (including wireless communication).

[0388] Furthermore, the steps in the processing of each of the above embodiments do not necessarily have to be processed in the described order. For example, the steps can be processed in a suitably modified order. Additionally, these steps can be processed in partial parallelism or individually, rather than in chronological order. Moreover, the processing method of the steps does not necessarily have to follow the described method, and can, for example, be processed by different functional blocks using different methods.

[0389] Preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings. However, the scope of the present disclosure is not limited to these examples. It will be apparent to those skilled in the art that various alternatives or modifications can be conceived within the scope of the technical concept described in the claims, and it should be understood that such alternatives or modifications naturally fall within the scope of the present disclosure.

[0390] Furthermore, the effects described in this specification are illustrative or exemplary only, and not restrictive. That is, in addition to or in lieu of the effects described above, the technology according to this disclosure can exhibit effects that are clearly different to those skilled in the art compared with those described in this specification.

[0391] Note that this technology can also have the following configurations.

[0392] (1) An information processing device, comprising:

[0393] The first acquisition unit acquires each of the control commands, including presentation unit information and form information, based on input from the first user. The presentation unit information specifies the presentation unit that presents the tactile stimulus by the tactile presentation device, and the form information specifies the form of the tactile stimulus.

[0394] The generation unit generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit, according to each of the control commands; and

[0395] A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein...

[0396] When the inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires a new control command that is different from each of the control commands corresponding to the inputs from the multiple first users.

[0397] (2) The information processing apparatus according to (1), wherein,

[0398] Each of the control commands is pre-associated with a stamp displayed on the stamp selection screen, and

[0399] Each of the first users performs input by selecting a stamp displayed on the stamp selection screen.

[0400] (3) The information processing apparatus according to (2), wherein each of the first users sets the timing for presenting the tactile stimulus by performing a tapping operation on the device displaying the stamp selection screen.

[0401] (4) The information processing device according to (3), wherein the tactile stimulation is presented based on the timing of the tapping operations of the plurality of first users.

[0402] (5) The information processing apparatus according to (1), wherein the intensity or presentation time of the tactile stimulus corresponding to the new control command is changed according to the number of inputs from the plurality of first users.

[0403] (6) The information processing apparatus according to (1), wherein,

[0404] If the parameter of each of the haptic control signals generated within a predetermined time exceeds a threshold previously determined based on the characteristics of the presentation unit, the first distribution unit temporarily stops distributing each of the haptic control signals.

[0405] (7) The information processing apparatus according to (6) further includes a notification unit, wherein, in the event that the distribution of each of the tactile control signals is temporarily suspended, the notification unit provides a notification to the plurality of first users.

[0406] (8) The information processing apparatus according to (1), wherein each of the tactile control signals specifies at least one parameter among the presentation timing, frequency, interval, waveform, presentation time and intensity of the tactile stimulus.

[0407] (9) The information processing apparatus according to (8) further includes:

[0408] The second distribution unit distributes the predetermined image to a display device that displays the image to the second user, wherein...

[0409] When the tactile presentation device is not worn on the body of the second user, the second distribution unit distributes the predetermined image, which performs image processing according to the frequency to vibrate at least a portion of the predetermined image in a predetermined direction.

[0410] (10) The information processing apparatus according to (9), wherein, in the image processing, the region in the predetermined image to be vibrated is determined according to the frequency.

[0411] (11) The information processing apparatus according to (9) or (10), wherein, in the image processing, the frequency, interval and waveform of the vibration of the predetermined image are changed according to the parameters of the tactile stimulus.

[0412] (12) The information processing apparatus according to (8) further includes:

[0413] A sound distribution unit that distributes a predetermined sound to a sound output device that outputs the predetermined sound to the second user.

[0414] When the tactile presentation device is not worn on the body of the second user, the sound distribution unit distributes the predetermined sound, which performs sound processing of the sound image of the predetermined sound in a predetermined direction according to the frequency.

[0415] (13) The information processing apparatus according to (1), wherein the generating unit selects the presentation unit for presenting the tactile stimulus according to the state of the second user.

[0416] (14) The information processing apparatus according to (2), wherein,

[0417] The stamp selection screen is distributed from a separate information processing device capable of communicating with the display device that displays images to each of the first users to the display device.

[0418] (15) The information processing apparatus according to (14), wherein,

[0419] The additional information processing device acquires command information corresponding to the input of each of the first users.

[0420] (16) The information processing apparatus according to (1) further includes:

[0421] The second acquisition unit acquires a predetermined image based on input from each of the first users; and

[0422] The third distribution unit distributes the predetermined image to the display device that displays the image to each of the first users.

[0423] (17) An information processing apparatus, comprising:

[0424] The first acquisition unit acquires each of the identification information for specifying presentation unit information and form information based on input from the first user, wherein the presentation unit information specifies the presentation unit for presenting tactile stimuli by the tactile presentation device, and the form information specifies the form of the tactile stimulus;

[0425] The generation unit generates, based on each of the identification information, each of the tactile control signals for presenting the tactile stimulus to the presentation unit; and

[0426] A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein...

[0427] When inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires presentation unit information and format information that are different from the presentation unit information and format information specified by each of the identification information corresponding to each of the inputs from the multiple first users.

[0428] (18) An information processing method, comprising:

[0429] Each of the control commands, including presentation unit information and form information, is obtained based on input from a first user. The presentation unit information specifies the presentation unit by which the tactile presentation device presents the tactile stimulus, and the form information specifies the form of the tactile stimulus.

[0430] Generate each of the tactile control signals for presenting the tactile stimulus to the presentation unit according to each of the control commands; and

[0431] Each of the tactile control signals is distributed to the tactile presentation device worn on the body of a second user.

[0432] The acquisition, generation, and distribution are performed by an information processing device, wherein...

[0433] If the input from multiple first users meets predetermined conditions, obtain a new control command that is different from each of the control commands corresponding to the input from the multiple first users.

[0434] (19) A program that enables a computer to perform the following functions:

[0435] Each of the control commands, including presentation unit information and form information, is obtained based on input from a first user. The presentation unit information specifies the presentation unit by which the tactile presentation device presents the tactile stimulus, and the form information specifies the form of the tactile stimulus.

[0436] Generate each of the tactile control signals for presenting the tactile stimulus to the presentation unit according to each of the control commands; and

[0437] Each of the tactile control signals is distributed to the tactile presentation device worn on the body of a second user, wherein...

[0438] If the input from multiple first users meets predetermined conditions, obtain a new control command that is different from each of the control commands corresponding to the input from the multiple first users.

[0439] (20) An information processing system, comprising: an information processing device; and a distribution device, wherein...

[0440] The information processing device includes:

[0441] The first acquisition unit acquires each of the control commands, including presentation unit information and form information, based on input from the first user. The presentation unit information specifies the presentation unit that presents the tactile stimulus by the tactile presentation device, and the form information specifies the form of the tactile stimulus.

[0442] The generation unit generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit, according to each of the control commands; and

[0443] A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein...

[0444] When inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires a new control command that is different from each of the control commands corresponding to the inputs from the multiple first users, and

[0445] The distribution device includes:

[0446] An image generation unit superimposes a predetermined image generated based on each of the inputs onto an image in real space distributed to each of the first users.

[0447] (21) The information processing system according to (20), wherein the distribution device includes a device on the cloud.

[0448] List of reference numerals

[0449] 10. Information Processing System

[0450] 100 tactile presentation devices

[0451] Communication units 102, 302, 402, 502, and 708

[0452] 104, 710 Control Units

[0453] Tactile stimulation units 106, 106a, 106b, 106c, 106d, 106e, 106f

[0454] 108 operating units

[0455] 200 Driver Amplifier / Interface

[0456] 202, 706 speakers

[0457] 204 monitor

[0458] 206, 724 microphones

[0459] 208, 722 camera devices

[0460] 300, 300a haptic servers

[0461] Image acquisition unit of 304 and 404 camera devices

[0462] 306, 410 Microphone Sound Acquisition Unit

[0463] Units for obtaining stamps 308, 408, and 506

[0464] 310 Tactile Signal Generation Unit

[0465] 312 Distributor Status Acquisition Unit

[0466] 314 Output Image Acquisition Unit

[0467] 316, 414 Output sound acquisition unit

[0468] 318, 416, 518, 712 memory cells

[0469] 350 Local side control device

[0470] 400 Distribution Data Editing Server

[0471] 406 Image Generation Units

[0472] 412 Sound Generation Unit

[0473] 500 Live Distribution Server

[0474] 504 GUI Control Unit

[0475] 508 Sound Data Acquisition Unit

[0476] 510 Image Data Acquisition Unit

[0477] 512 Tactile Signal Acquisition Unit

[0478] 514 Viewer Information Acquisition Unit

[0479] 516 Distribution Control Unit

[0480] 600 haptic servers

[0481] 700 User Terminal

[0482] 702 Display Unit

[0483] 704 Operation Input Unit

[0484] 720 sensor unit

[0485] 726 Gyroscope Sensor

[0486] 728 Accelerometer

[0487] Distributors of 800, 800a, 800b, and 800c

[0488] 840 waveform image

[0489] Displays 842, 872, 874, 880, and 980

[0490] Stamps for 850, 850a, 850b, 850c, 850d, 852, 854, 854a, 854b, and 856

[0491] 860 comments

[0492] Icons 870a, 870b, 890, and 892

[0493] 900 viewers

[0494] 910 Vector

[0495] 950 Display Image

[0496] Areas 960a, 960b, and 970

Claims

1. An information processing apparatus, comprising: The first acquisition unit acquires each of the control commands, including presentation unit information and form information, based on input from the first user. The presentation unit information specifies the presentation unit that presents the tactile stimulus by the tactile presentation device, and the form information specifies the form of the tactile stimulus. A generation unit that generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit, based on each of the control commands. as well as A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein... When the inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires a new control command that is different from each of the control commands corresponding to the inputs from the multiple first users.

2. The information processing apparatus according to claim 1, wherein, Each of the control commands is pre-associated with a stamp displayed on the stamp selection screen, and Each of the first users performs input by selecting a stamp displayed on the stamp selection screen.

3. The information processing apparatus according to claim 2, wherein, Each of the first users sets the timing for presenting the tactile stimulus by performing a tapping operation on the device displaying the stamp selection screen.

4. The information processing apparatus according to claim 3, wherein, The tactile stimulation is presented based on the timing of the synchronized tapping operations of the multiple first users.

5. The information processing apparatus according to claim 1, wherein, The intensity or presentation time of the tactile stimulus corresponding to the new control command is changed according to the number of inputs from the plurality of first users.

6. The information processing apparatus according to claim 1, wherein, If the parameter of each of the haptic control signals generated within a predetermined time exceeds a threshold previously determined based on the characteristics of the presentation unit, the first distribution unit temporarily stops distributing each of the haptic control signals.

7. The information processing apparatus according to claim 6 further includes a notification unit, wherein, In the event that the distribution of each of the tactile control signals is temporarily suspended, the notification unit provides a notification to the plurality of first users.

8. The information processing apparatus according to claim 1, wherein, Each of the tactile control signals specifies at least one parameter among the presentation timing, frequency, interval, waveform, presentation time, and intensity of the tactile stimulus.

9. The information processing apparatus according to claim 8, further comprising: The second distribution unit distributes the predetermined image to a display device that displays the image to the second user, wherein... When the tactile presentation device is not worn on the body of the second user, the second distribution unit distributes the predetermined image, which performs image processing according to the frequency to vibrate at least a portion of the predetermined image in a predetermined direction.

10. The information processing apparatus according to claim 9, wherein, In the image processing, the region in the predetermined image to be vibrated is determined according to the frequency.

11. The information processing apparatus according to claim 9, wherein, In the image processing, the frequency, interval, and waveform of the vibration of the predetermined image are changed according to the parameters of the tactile stimulus.

12. The information processing apparatus according to claim 8, further comprising: A sound distribution unit that distributes a predetermined sound to a sound output device that outputs the predetermined sound to the second user. When the tactile presentation device is not worn on the body of the second user, the sound distribution unit distributes the predetermined sound, which performs sound processing of the sound image of the predetermined sound in a predetermined direction according to the frequency.

13. The information processing apparatus according to claim 1, wherein, The generation unit selects the presentation unit to present the tactile stimulus based on the state of the second user.

14. The information processing apparatus according to claim 2, wherein, The stamp selection screen is distributed from a separate information processing device capable of communicating with the display device that displays images to each of the first users to the display device.

15. The information processing apparatus according to claim 14, wherein, The additional information processing device acquires command information corresponding to the input of each of the first users.

16. The information processing apparatus according to claim 1, further comprising: The second acquisition unit acquires a predetermined image based on input from each of the first users; as well as The third distribution unit distributes the predetermined image to the display device that displays the image to each of the first users.

17. An information processing apparatus, comprising: The first acquisition unit acquires each of the identification information for specifying presentation unit information and form information based on input from the first user, wherein the presentation unit information specifies the presentation unit for presenting tactile stimuli by the tactile presentation device, and the form information specifies the form of the tactile stimulus; A generation unit generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit based on each of the identification information; as well as A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein... When inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires presentation unit information and format information that are different from the presentation unit information and format information specified by each of the identification information corresponding to each of the inputs from the multiple first users.

18. An information processing method, comprising: Each of the control commands, including presentation unit information and form information, is obtained based on input from a first user. The presentation unit information specifies the presentation unit by which the tactile presentation device presents the tactile stimulus, and the form information specifies the form of the tactile stimulus. Each of the control commands is used to generate a tactile control signal for presenting the tactile stimulus to the presentation unit; as well as Each of the tactile control signals is distributed to the tactile presentation device worn on the body of a second user. The acquisition, generation, and distribution are performed by an information processing device, wherein... If the input from multiple first users meets predetermined conditions, obtain a new control command that is different from each of the control commands corresponding to the input from the multiple first users.

19. A computer-readable recording medium storing a program for enabling a computer to perform the following functions: Each of the control commands, including presentation unit information and form information, is obtained based on input from a first user. The presentation unit information specifies the presentation unit by which the tactile presentation device presents the tactile stimulus, and the form information specifies the form of the tactile stimulus. Each of the control commands is used to generate a tactile control signal for presenting the tactile stimulus to the presentation unit; as well as Each of the tactile control signals is distributed to the tactile presentation device worn on the body of a second user, wherein... If the input from multiple first users meets predetermined conditions, obtain a new control command that is different from each of the control commands corresponding to the input from the multiple first users.

20. An information processing system, comprising: Information processing device; and a dispensing device, wherein, The information processing device includes: The first acquisition unit acquires each of the control commands, including presentation unit information and form information, based on input from the first user. The presentation unit information specifies the presentation unit that presents the tactile stimulus by the tactile presentation device, and the form information specifies the form of the tactile stimulus. The generation unit generates each of the tactile control signals for presenting the tactile stimulus to the presentation unit, according to each of the control commands; and A first distribution unit distributes each of the tactile control signals to the tactile presentation device worn on the body of a second user, wherein... When inputs from multiple first users meet predetermined conditions, the first acquisition unit acquires a new control command that is different from each of the control commands corresponding to the inputs from the multiple first users, and The distribution device includes: An image generation unit superimposes a predetermined image generated based on each of the inputs onto an image in real space distributed to each of the first users.

21. The information processing system according to claim 20, wherein, The distribution device includes devices in the cloud.

Images