Information processing apparatus, information processing terminal, and program

Abstract

An information processing apparatus is provided that includes: a first acquisition unit (214) configured to acquire a control command that is input by a first user and that corresponds to presentation unit information for specifying a presentation unit for presenting a haptic stimulus by a haptic presentation apparatus and form information for specifying a form of the haptic stimulus; a generation unit (218) configured to generate a haptic control signal for presenting the haptic stimulus to the presentation unit in accordance with the control command; and a first distribution unit (222) configured to distribute the haptic control signal to a haptic presentation apparatus worn on a body of a second user.

Description

Technical Field

[0001] This disclosure relates to information processing equipment, information processing terminals, and programs. Background Technology

[0002] In recent years, consumer spending has shifted from "goods consumption"—the simple purchase of goods—to "experience consumption," where consumers pay for added-value experiences. For example, in entertainment fields such as music and animation, in addition to one-way experiences like watching live performances by artists, consumers are demanding interactive, real-time, and higher-value experiences, such as interactions between artists and fans.

[0003] Examples of this experience include transmitting data such as graphics and text from content viewers to artists distributing that content on the internet, and "social coin tossing" where money is sent along with the data transmission. Artists and viewers interact with each other through such "social coin tossing," providing viewers with a higher-value experience. This increases viewer satisfaction with the content and their desire to purchase such an "experience."

[0004] Citation List

[0005] Patent documents

[0006] Patent Document 1: WO 2018 / 008217 A Summary of the Invention

[0007] Technical issues

[0008] Meanwhile, devices for presenting tactile stimuli such as vibrations to users have been conventionally proposed. Examples of such devices include the jacket-type tactile presentation device described in Patent Document 1 above. Users wear such tactile presentation devices in cinemas, theme park attractions, etc., and the tactile presentation device is controlled to synchronize with the reproduced content viewed by the user, which increases the realism of the reproduced content provided.

[0009] Therefore, this disclosure proposes information processing devices, information processing terminals, and programs that use such haptic presentation devices to provide viewers with a real-time, interactive, and value-added experience.

[0010] Solution to the problem

[0011] According to this disclosure, an information processing device is provided, comprising: a first acquisition unit configured to acquire a control command input by a first user, the control command corresponding to presentation unit information for specifying a presentation unit for presenting tactile stimuli via a tactile presentation device and form information for specifying the form of the tactile stimuli; a generation unit configured to generate a tactile control signal for presenting tactile stimuli to the presentation unit according to the control command; and a first distribution unit configured to distribute the tactile control signal to a tactile presentation device worn on the body of a second user.

[0012] Furthermore, according to this disclosure, an information processing terminal is provided, comprising: an input unit configured to receive input of a control command, the control command including presentation unit information for specifying a presentation unit for presenting tactile stimuli through a tactile presentation device and form information for specifying the form of the tactile stimulus; and a sending unit configured to send the input control command to the information processing device, the information processing device generating a tactile control signal according to the control command and distributing the tactile control signal to the tactile presentation device.

[0013] Furthermore, according to this disclosure, a program is provided for using an information processing device as a control unit, and the program causes the control unit to perform processing including: acquiring a control command input by a first user; receiving a live image from a second user; displaying the received live image from the second user on a display unit; and sending the acquired control command to a server via a communication unit; wherein, a tactile control signal is generated according to the control command, the tactile control signal is distributed to a tactile presentation device worn on the body of the second user, and tactile presentation is performed via the tactile presentation device based on presentation unit information for specifying a tactile stimulus for presenting the tactile presentation device corresponding to the control command and form information for specifying the form of the tactile stimulus.

[0014] Furthermore, according to this disclosure, an information processing device is provided, comprising: a control unit configured to: receive a control command input by a first user and receive a live image from a second user; wherein, based on the control command, a tactile control signal is generated, the tactile control signal is distributed to a tactile presentation device worn on the body of the second user, and tactile presentation is performed via the tactile presentation device based on presentation unit information corresponding to the control command for specifying a presentation unit for presenting tactile stimuli for the tactile presentation device and form information for specifying the form of the tactile stimuli. Attached Figure Description

[0015] Figure 1 This is an explanatory diagram (1) used to illustrate an outline of embodiments of the present disclosure.

[0016] Figure 2 This is an explanatory diagram (2) used to illustrate an outline of embodiments of the present disclosure.

[0017] Figure 3 This is a system diagram illustrating an example of a schematic configuration of an information processing system 10 according to a first embodiment of the present disclosure.

[0018] Figure 4 This is a diagram illustrating an example of the appearance configuration of a tactile presentation device 100 according to a first embodiment of the present disclosure.

[0019] Figure 5 This is a diagram illustrating an example of the functional configuration of a tactile presentation device 100 according to a first embodiment of the present disclosure.

[0020] Figure 6 This is a diagram illustrating an example of the functional configuration of a server 200 according to a first embodiment of the present disclosure.

[0021] Figure 7 This is a diagram illustrating an example of the functional configuration of a user terminal 300 according to a first embodiment of the present disclosure.

[0022] Figure 8 This is a flowchart depicting an example of an information processing method according to a first embodiment of the present disclosure.

[0023] Figure 9 This is an explanatory diagram (1) used to illustrate a display example according to a first embodiment of the present disclosure.

[0024] Figure 10 This is an explanatory diagram (2) used to illustrate a display example according to a first embodiment of the present disclosure.

[0025] Figure 11 This is an explanatory diagram (3) used to illustrate a display example according to the first embodiment of the present disclosure.

[0026] Figure 12 This is an explanatory diagram (4) used to illustrate a display example according to the first embodiment of the present disclosure.

[0027] Figure 13 This is an explanatory diagram (1) used to illustrate a display example according to a second embodiment of the present disclosure.

[0028] Figure 14 This is an explanatory diagram (2) used to illustrate a display example according to a second embodiment of the present disclosure.

[0029] Figure 15 This is an explanatory diagram (1) used to illustrate a third embodiment of the present disclosure.

[0030] Figure 16 This is an explanatory diagram used to illustrate a display example according to a third embodiment of the present disclosure.

[0031] Figure 17 This is an explanatory diagram (2) used to illustrate the third embodiment of this disclosure.

[0032] Figure 18 This is an explanatory diagram (3) used to illustrate the third embodiment of this disclosure.

[0033] Figure 19 This is an explanatory diagram (4) used to illustrate the third embodiment of this disclosure.

[0034] Figure 20 This is an explanatory diagram (5) used to illustrate the third embodiment of this disclosure.

[0035] Figure 21 This is a diagram illustrating an example of the functional configuration of a server 200a according to a fourth embodiment of the present disclosure.

[0036] Figure 22 This is a flowchart depicting an example of an information processing method according to a fourth embodiment of the present disclosure.

[0037] Figure 23 This is an explanatory diagram (1) used to illustrate an example of a fourth embodiment according to the present disclosure.

[0038] Figure 24 This is an explanatory diagram (2) used to illustrate an example of a fourth embodiment according to the present disclosure.

[0039] Figure 25 This is an explanatory diagram (3) used to illustrate an example of a fourth embodiment according to the present disclosure.

[0040] Figure 26 This is a diagram illustrating an example of the functional configuration of server 200b according to a sixth embodiment of the present disclosure.

[0041] Figure 27 This is an explanatory diagram (1) used to illustrate a display example according to the sixth embodiment of the present disclosure.

[0042] Figure 28 This is an explanatory diagram (2) used to illustrate a display example according to the sixth embodiment of the present disclosure.

[0043] Figure 29 This is a diagram illustrating an example of the functional configuration of a server 200c according to a modified example of the sixth embodiment of this disclosure.

[0044] Figure 30 This is a flowchart illustrating an example of an information processing method according to a modified example of a sixth embodiment of the present disclosure.

[0045] Figure 31 This is an explanatory diagram (1) used to illustrate a modified example according to the sixth embodiment of the present disclosure.

[0046] Figure 32 This is an explanatory diagram (2) used to illustrate a modified example according to the sixth embodiment of the present disclosure.

[0047] Figure 33 This is a system diagram (1) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0048] Figure 34 This is a system diagram (2) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0049] Figure 35 This is a system diagram (3) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0050] Figure 36 This is a system diagram (4) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0051] Figure 37 This is a system diagram (5) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0052] Figure 38 This is a system diagram (6) illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0053] Figure 39 This is a hardware configuration diagram illustrating an example of a computer that implements the functions of server 200. Detailed Implementation

[0054] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Furthermore, in this specification and the drawings, structural elements having substantially the same function and structure are indicated by the same reference numerals, and repeated descriptions of these structural elements are omitted. Additionally, in this specification and the drawings, different letters are sometimes added after the same reference numerals to distinguish similar constituent elements in different embodiments. However, where it is not necessary to specifically distinguish similar constituent elements from each other, only the same reference numerals are given.

[0055] The descriptions are given in the following order.

[0056] 1. Summary of the embodiments of this disclosure

[0057] 2. First Embodiment

[0058] 2.1 Overview of Information Processing System 10

[0059] 2.2 Detailed Configuration of the Haptic Presentation Device 100

[0060] 2.3 Detailed configuration of server 200

[0061] 2.4 Detailed Configuration of User Terminal 300

[0062] 2.5 Information Processing Methods

[0063] 2.6 Modified Example

[0064] 3. Second Embodiment

[0065] 4. Third embodiment

[0066] 5. Fourth Embodiment

[0067] 5.1 Detailed configuration of Server 200a

[0068] 5.2 Information Processing Methods

[0069] 5.3 Example

[0070] 6. Fifth Embodiment

[0071] 7. Sixth Embodiment

[0072] 7.1 Detailed configuration of Server 200b

[0073] 7.2 Examples

[0074] 7.3 Modify Example 1

[0075] 7.4 Modify Example 2

[0076] 7.5 Modify Example 3

[0077] 8. Examples of modifications to the information processing system 10 disclosed herein

[0078] 9. Summary

[0079] 10. Regarding hardware configuration

[0080] 11. Supplement

[0081] <<1. Summary of Embodiments of this Disclosure>>

[0082] First, before detailing the embodiments of this disclosure, refer to Figure 1 and Figure 2 This is to describe a summary of the embodiments of the present disclosure created by the inventors. Figure 1 and Figure 2 These are explanatory diagrams used to illustrate a summary of embodiments of the present disclosure.

[0083] As described above, consumer spending has recently shifted from "goods consumption" to "experience consumption." In particular, in the entertainment sector, in addition to one-way experiences such as watching live performances by artists, consumers are demanding more value-added experiences such as interactive, real-time, and engaging interactions with artists.

[0084] Therefore, in view of this situation, the inventors have diligently explored the possibility of providing viewers with a higher value-added experience, and conceived the idea of ​​using a haptic presentation device (haptic device) that presents tactile stimuli such as vibrations to the wearer. According to the inventors' considerations, the use of a haptic presentation device enables viewers to obtain a higher value-added experience.

[0085] In embodiments of this disclosure created based on such a concept, such as Figure 1 As shown, the artist 602, whose performance or content will be viewed or distributed, wears a tactile presentation device 100, such as a vest. This tactile presentation device 100 includes multiple tactile stimulation units (e.g., actuators, etc.). Furthermore, based on received predetermined signals, the tactile stimulation units can present tactile stimulation to the wearer. Moreover, as... Figure 2 As shown, the viewer 600 selects a tactilely stimulating stamp 700 from the tactilely stimulating stamps 700 displayed on the display unit 302 of the user terminal 300, and sends the selected tactilely stimulating stamp 700; thereby, a predetermined tactile control signal corresponding to the tactile stimulation applied to the stamp 700 is sent to the tactile stimulation unit (performing a so-called tactilely stimulating "social coin toss"). Furthermore, based on the received predetermined tactile control signal, the tactile stimulation unit presents the tactile stimulation corresponding to the selected tactilely stimulating stamp 700 to the wearer. Therefore, if the artist 602 perceives the presented tactile stimulation and takes action, the viewer 600 can confirm in real time the action caused by the tactile stimulation presented by the stamp 700 sent by the viewer 600. Therefore, if viewer 600 can confirm in real time the action caused by the tactile stimulation related to the stamp 700 that he / she has sent, then viewer 600 can feel as if he / she is interacting directly with artist 602, that is, viewer 600 can obtain a higher value-added experience.

[0086] As described above, in the embodiments of this disclosure created by the inventors, the viewer 600 can send not only visual information such as illustrations, animations, and text, and auditory information such as music, to the artist 602, but also tactile information. Therefore, according to the embodiments of this disclosure, a real-time, interactive, and value-added experience can be provided to the viewer 600, which increases his / her satisfaction with the performance and content, and enhances his / her desire to purchase such an "experience." The details of the embodiments of this disclosure created by the inventors are described below.

[0087] <<2. First Embodiment>

[0088] <2.1 Overview of Information Processing System 10>

[0089] First, refer to Figure 3 An outline of an information processing system 10 according to a first embodiment of the present disclosure is described. Figure 3 This is a system diagram illustrating an example of a schematic configuration of an information processing system 10 according to a first embodiment of the present disclosure. In the following description, it is assumed that the artist (second user) 602 and the viewer (first user) 600 exist in different spaces or in the same space. Specifically, in the information processing system 10, the viewer 600 can, for example, directly watch the artist 602, or watch a distributed video of the artist 602.

[0090] Specifically, such as Figure 3 As shown, the information processing system 10 according to an embodiment may include, for example, a haptic presentation device 100, a monitor 110, a camera device 120, a server (information processing device) 200, and a smartphone 300a and a tablet terminal 300b as examples of user terminals (information processing terminals) 300. The server 200 and other devices can send and receive data via various communication networks such as wired / wireless local area networks (LANs), Wi-Fi, Bluetooth, and mobile communication networks (LTE and 5G). Note that the number of devices included in the information processing system 10 is not limited. Figure 3 The number shown is not limited to, and can be even greater. Furthermore, the information processing system 10 may also include... Figure 3 Devices not shown in the diagram. For example, information processing system 10 may include a general-purpose personal computer (PC), a game console, a cellular phone, a portable media player, a speaker, a projector, a display (digital signage, etc.), and wearable devices such as headphones, smart glasses, or smartwatches. Hereinafter, an outline of the various devices included in information processing system 10 according to an embodiment is described.

[0091] (Haptic presentation device 100)

[0092] The tactile presentation device 100 is implemented, for example, by a device that can be worn on the body. In an embodiment, for example, it is assumed that the tactile presentation device 100 is a vest-type (sleeveless jacket shape) worn by artist 602. As described above, the vest-type tactile presentation device 100 includes a plurality of tactile stimulation units. For example, a predetermined number (e.g., 6) of tactile stimulation units may be arranged inside the tactile presentation device 100, on each of the front and back sides of artist 602. As an example, the tactile stimulation units arranged on the front side and the tactile stimulation units arranged on the back side are arranged in a facing position relationship.

[0093] In this embodiment, the shape of the tactile presentation device 100 is not limited to a vest shape, but can also be a jacket shape with sleeves. In this case, one or more tactile stimulation units can be placed not only on the chest and abdomen of the artist 602, but also at positions corresponding to the artist 602's arms. Furthermore, in this embodiment, the tactile presentation device 100 is not limited to a jacket shape, but can be trousers, shoes, belts, hats, gloves, masks, etc.

[0094] Furthermore, a microphone (hereinafter referred to as a microphone) (not shown) may be provided on each side of the shoulder portion of the haptic presentation device 100, or a microphone may be provided on one of the left and right sides of the shoulder portion, or three or more microphones may be provided. Additionally, the microphones may be provided as separate devices from the haptic presentation device 100 around the artist 602. Furthermore, the haptic presentation device 100 may include a wear status detection sensor (e.g., a button-type sensor, pressure sensor, etc.) (not shown) for detecting the wear status of the haptic presentation device 100, an inertial sensor (inertial measurement unit (IMU)) (not shown) for detecting the artist 602's movements and postures, and a bio-information sensor (e.g., a sensor for sensing heart rate, pulse, brain waves, respiration, sweating, electromyography, skin temperature, skin resistance, eye movement, or pupil diameter, etc.) (not shown). A detailed configuration of the haptic presentation device 100 will be described later.

[0095] (Monitor 110)

[0096] Monitor 110 can display an image of artist 602, for example, captured by camera device 120 described later, to artist 602, and monitor 110 can also overlay text, icons, or animations onto the image of artist 602. For example, monitor 110 is implemented using a liquid crystal display (LCD) device and an organic light-emitting diode (OLED) device. Furthermore, in an embodiment, the display unit (not shown) of monitor 110 can be configured as a unit integrated with an input unit (not shown), and in this case, the input unit is implemented using a touch panel superimposed on the display unit. Additionally, in an embodiment, monitor 110 may be provided with a speaker (not shown) for outputting sound to artist 602.

[0097] (Camera device 120)

[0098] The imaging device 120 is one or more visible light imaging devices that capture images of artist 602 from one or more viewpoints, and the captured images are transmitted via server 200 to user terminal 300 or monitor 110 of viewer 600. The imaging device 120 can capture images of the environment surrounding artist 602 or real objects existing around artist 602. Specifically, the imaging device 120 includes a lens system having an image pickup lens, an aperture, a zoom lens, and a focusing lens, and a drive system that enables the lens system to perform focusing and zooming operations. The imaging device 120 also includes a solid-state imaging element array that photoelectrically converts the imaging light captured by the lens system to generate an imaging signal. The solid-state imaging element array can be implemented, for example, by a charge-coupled device (CCD) sensor array or a complementary metal-oxide-semiconductor (CMOS) sensor array.

[0099] (Server 200)

[0100] Server 200 can receive a stamp (control command) 700 with tactile stimulation effect input by viewer 600, generate a tactile control signal based on the stamp 700, and send the generated tactile control signal to tactile presentation device 100. Each stamp 700 with tactile stimulation effect is associated with each predetermined control command, and each control command includes information (position information) for specifying the sensing location to be presented with vibration stimulation, and information (form information) for specifying, for example, the waveform type and intensity of the vibration stimulation. Furthermore, the control command may include identification information (ID) for specifying the tactile stimulation unit of tactile presentation device 100 and the aforementioned form information. Specifically, server 200 generates a tactile control signal (waveform data) for each tactile stimulation unit to be input to tactile presentation device 100 to present vibration stimulation at the sensing location specified by the control command with the intensity and waveform specified by the control command, and sends the tactile control signal to tactile presentation device 100. Note that in this specification, "sensing location" includes the movement path of the sensing location and the sensing range with a predetermined size.

[0101] Furthermore, in this embodiment, server 200 may be provided by, for example Figure 3 The implementation shown may be a single device or a combination of multiple devices, and this disclosure is not particularly limited to this example. For example, server 200 may be implemented using a dedicated server (not shown) for the haptic presentation device 100 and a distribution server (not shown) for distributing content. In this case, the dedicated server for the haptic presentation device 100 is authenticated via a web application programming interface (web API), monitors the haptic stimulation effect of stamps 700, etc., sent by the viewer 600, and controls the haptic presentation device 100. On the other hand, the distribution server distributes images of artists 602, etc., and images for selecting haptic stimulation effect stamps 700, etc., to the user terminal 300. Furthermore, server 200 may, for example, include a settlement server (not shown) that performs payments for the use of this information processing system 10. The detailed configuration of server 200 will be described later.

[0102] (User Terminal 300)

[0103] User terminal 300 is a terminal used by viewer 600 or installed near viewer 600, and is used by viewer 600 to input tactilely stimulating stamps 700, etc. User terminal 300 receives the tactilely stimulating stamps (control commands) 700 input by viewer 600 and sends the received stamps 700 to server 200. For example, user terminal 300 can be a smartphone 300a, a tablet PC 300b, a cellular phone, a laptop PC, or a wearable device such as a head-mounted display (HMD). Detailed configuration of user terminal 300 will be described later.

[0104] <2.2 Detailed Configuration of the Haptic Presentation Device 100>

[0105] Next, refer to Figure 4 as well as Figure 5 To describe the detailed configuration of the haptic presentation device 100. Figure 4 This is a diagram illustrating an example of the appearance configuration of the haptic presentation device 100 according to an embodiment, and Figure 5 This is a diagram illustrating an example of the functional configuration of the tactile presentation device 100 according to an embodiment. As described above, the tactile presentation device 100 is a device attached to part of the body of an artist 602 and vibrates according to control commands to provide tactile stimulation to the artist 602.

[0106] like Figure 4 As shown, for example, a vest-type tactile presentation device 100, as described above, includes a plurality of tactile stimulation units 106. Each tactile stimulation unit 106 includes, for example, an actuator that is driven by a tactile control signal generated by the server 200 to generate vibrations, and presents such vibrations as tactile stimuli. Examples of actuators include eccentric motors, linear vibrators, piezoelectric elements, etc.

[0107] like Figure 5 As shown, the haptic presentation device 100 includes a communication unit 102, a control unit 104, and a haptic stimulation unit 106. The communication unit 102 is connected to the server 200 via a wired or wireless connection and sends / receives information to / from the server 200. The control unit 104 is a controller that drives the haptic stimulation unit 106 based on haptic control signals input via the communication unit 102. The control unit 104 may be implemented, for example, in response to various programs stored in the read-only memory (ROM) of the haptic presentation device 100, executed by a central processing unit (CPU), microprocessor unit (MPU), or similar device using random access memory (RAM) as its working area. Alternatively, the control unit 104 may be implemented, for example, by an integrated circuit such as an application-specific integrated circuit (ASIC) or a field-programmable gate array (FPGA).

[0108] Although the detailed configuration of the haptic presentation device 100 according to the embodiments has been described above, the detailed configuration of the haptic presentation device 100 according to the embodiments is not limited to... Figure 4 as well as Figure 5 The example shown.

[0109] Furthermore, the haptic presentation device 100 is not limited to the aforementioned wearable devices, but can also be configured as a handheld device mounted on a device held by the artist 602, such as a smartphone, game controller, or portable music player. Alternatively, the haptic presentation device 100 is not limited to wearable and handheld devices, but can also be configured as a slab / floor-standing device mounted on furniture such as a bed or chair, or on various installations.

[0110] <2.3 Detailed Configuration of Server 200>

[0111] Next, refer to Figure 6 The following describes the detailed configuration of server 200 according to embodiments of the present disclosure. Figure 6 This is a diagram illustrating an example of the functional configuration of server 200 according to an embodiment. (See diagram for example.) Figure 6 As shown, server 200 mainly includes a communication unit 202, a control unit 210, and a storage unit 240. The functional blocks of server 200 are described below in sequence.

[0112] (Communication Unit 202)

[0113] The communication unit 202 can send and receive information to and from the haptic presentation device 100, the monitor 110, the camera device 120, and the user terminal (information processing terminal) 300. The communication unit 202 is a communication interface with the function of sending and receiving data, and is implemented by communication devices (not shown), such as communication antennas, transmission / reception circuits, and ports.

[0114] (Control Unit 210)

[0115] The control unit 210 is a controller, and is implemented, for example, in response to various programs stored in the ROM of the server 200, executed by a CPU, MPU, etc., using RAM as its working area. Specifically, such as Figure 6 As shown, the control unit 210 may include a GUI control unit 212, a viewer-side input unit (first acquisition unit) 214, a distributor-side input unit 216, a generation unit 218, a determination unit 220, and an output control unit (first distribution unit) 222.

[0116] The graphical user interface (GUI) control unit 212 controls the user terminal 300 of the viewer 600 to display a screen for inputting tactilely stimulating stamps (control commands) 700. Specifically, the GUI control unit 212 causes the display unit 302 of the user terminal 300 to display, for example... Figure 2The screen shown serves as a selection screen for stamps 700 with tactile stimulating effects. This selection screen (stamp selection screen) displays a variety of stamps 700 with tactile stimulating effects. Each stamp 700 with tactile stimulating effects is associated with a control command for the tactile presentation device 100, and the viewer 600 can select a stamp 700 displayed on the selection screen to input a control command. In an embodiment, preferably, the images of the stamps 700 with tactile stimulating effects visually evoke tactile stimuli, thoughts (messages), etc., that the viewer 600 wishes to send to the artist 602.

[0117] The viewer-side input unit 214 acquires a control command associated with the stamp 700 with tactile stimulation effect input by the viewer 600, and outputs the control command to the generation unit 218, which will be described later. The control command includes: position information for specifying the presentation position of the tactile stimulation presented by the tactile presentation device 100 and form information for specifying the form of the tactile stimulation.

[0118] The distributor-side input unit 216 acquires, for example, sensing data obtained by a wearing state detection sensor (not shown) used to detect the wearing state of the haptic presentation device 100, and outputs the sensing data to the generation unit 218, which will be described later.

[0119] The generation unit 218 generates tactile control signals for controlling the tactile presentation device 100 based on control commands associated with the stamp 700 with tactile stimulation effects input by the viewer 600, and outputs the tactile control signals to the determination unit 220, described later. Specifically, the generation unit 218 generates waveform data for each tactile stimulation unit to be input to the tactile presentation device 100 to present vibrational stimulation at the perceived location specified by the control command, with the intensity and waveform specified by the control command, based on control commands including the perceived location of the vibrational stimulation (location information), the waveform type of the vibrational stimulation, and information about the intensity of the vibrational stimulation (form information). Note that the tactile control signals may include information for giving commands to present vibrational stimulation with presentation timing, frequency, interval, and presentation time of the tactile stimulation based on the control commands. If the frequency and intensity of the vibrational stimulation specified by the control commands have a wide bandwidth (e.g., 50Hz to 500Hz), the generation unit 218 can compress it to a narrow bandwidth (e.g., 100Hz) according to the functionality of the tactile presentation device 100 and generate waveform data.

[0120] The generation unit 218 can also adjust the tactile control signal based on the wearing status of the tactile presentation device 100 on the artist 602. For example, the generation unit 218 adjusts the tactile control signal based on the contact rate between the tactile presentation device 100 and the artist 602's body. More specifically, the generation unit 218 adjusts the tactile control signal so that the tactile stimulation unit 106 does not present tactile vibrations at locations with low contact rates. The generation unit 218 can also adjust the tactile control signal based on the artist 602's attribute information (e.g., age, gender, height, weight, physique, etc.) and biometric information. For example, the generation unit 218 can adjust the perceived location, intensity, etc., based on the artist 602's age. More specifically, if the artist 602 is 6 years old, the generation unit 218 can adjust the tactile control signal so that the intensity of the tactile stimulus to be presented is half the intensity if the artist 602 is an adult.

[0121] Furthermore, the generation unit 218 can generate, together with the tactile control signal, a presentation control signal (e.g., a control signal when not wearing the device) for presenting a predetermined image or sound to the viewer 600 or artist 602. For example, the predetermined image can be a virtual object such as an icon, animation, or text superimposed on an image of artist 602 or an image of the real space surrounding artist 602, or projected onto artist 602; more specifically, the predetermined image can be the trajectory of a social coin moving from viewer 600 to artist 602, an animation resembling a bomb explosion displayed simultaneously with the presentation of tactile stimulation, or an icon corresponding to a tactilely stimulated stamp 700 input by viewer 600. Furthermore, in cases where tactile stimulation cannot be presented to artist 602 because the tactile presentation device 100 is not worn on artist 602's body, the predetermined image or sound can be, for example, an image or sound output to viewer 600 in place of tactile stimulation.

[0122] The determining unit 220 determines whether to send a tactile control signal to the tactile presentation device 100 based on the content of the control command and tactile control signal, and attribute information of the viewer 600 or artist 602. For example, if a control command input by the viewer 600 specifies a presentation position and intensity pre-defined by the artist 602, the determining unit 220 determines not to send a tactile control signal generated based on that control command to the tactile presentation device 100. Furthermore, if different viewers 600 consecutively specify the same presentation position, or if the same viewer 600 consecutively inputs control commands, the determining unit 220 may determine not to send the generated tactile control signal to the tactile presentation device 100. In addition, in this case, the generating unit 218 may change the presentation position of the tactile stimulus.

[0123] The output control unit 222 sends the generated tactile control signal to the tactile presentation device 100 worn on the body of the artist 602 via the communication unit 202.

[0124] (Storage unit 240)

[0125] The storage unit 240 is implemented by a storage device such as a ROM that stores programs and calculation parameters for processing by the control unit 210, RAM that temporarily stores appropriately changing parameters, and a hard disk drive (HDD) that stores various databases (DBs). For example, such as Figure 6 As shown, the storage unit 240 may include a viewer profile 242, a distributor profile 244, and a distribution data DB 246. The viewer profile 242 and distributor profile 244 store attribute information for the viewer 600 and artist 602, respectively. Furthermore, the viewer profile 242 may store information about control commands previously acquired or used by the viewer 600, associated with the viewer 600's identification information, and the distributor profile 244 may store information about control commands previously received by the artist 602, associated with the artist 602's identification information. Additionally, the distribution data DB 246 stores a pre-generated tactile database (vibration waveform patterns, etc.) associated with the identification information of each stamp 700, and the generation unit 218 uses the tactile database to generate tactile control signals. Furthermore, the distribution data DB 246 may store, for example, information such as the number, location, frequency characteristics, and maximum input voltage of the tactile stimulation units 106 of the tactile presentation device 100, as profile information of the tactile presentation device 100. The generation unit 218 can adjust the tactile control signal by referring to the configuration file information.

[0126] Although the detailed configuration of server 200 according to the embodiments has been described above, the detailed configuration of server 200 according to the embodiments is not limited to... Figure 6 The example shown. For example, server 200 may also include a recommendation unit (not shown) that references viewer profile 242 and distributor profile 244 to select control commands frequently used by viewer 600 or artist 602, or conversely, to select control commands less frequently used by viewer 600 or artist 602, and recommends to viewer 600 a tactilely stimulating stamp 700 associated with the selected control commands. Furthermore, the recommendation unit may recommend to viewer 600 tactilely stimulating stamps 700 recommended by artist 602.

[0127] <2.4 Detailed Configuration of User Terminal 300>

[0128] Next, refer to Figure 7The detailed configuration of a user terminal 300 according to an embodiment of the present disclosure is described. Figure 7 This is a diagram illustrating an example of the functional configuration of a user terminal 300 according to an embodiment. For example... Figure 7 As shown, the user terminal 300 mainly includes a display unit 302, an operation input unit 304, a speaker 306, a communication unit (transmission unit) (price acquisition unit) 308, a control unit 310, a storage unit 312, and a sensor unit 320. The functional blocks of the user terminal 300 are described in sequence below.

[0129] (Display unit 302)

[0130] Display unit 302 can, for example, display a selection screen for selecting a stamp (control command) 700 with tactile stimulation effect, an image of artist 602, etc., to viewer 600. Display unit 302 can also overlay text, icons, or animations on the image of artist 602. Display unit 302 is implemented by liquid crystal display device, OLED device, etc.

[0131] (Operation Input Unit 304)

[0132] The operation input unit 304 receives from the viewer 600 the selection result of a stamp 700 with tactile stimulation effect associated with a control command, which includes: position information for specifying the presentation location of the tactile stimulation, and form information for specifying the form of the tactile stimulation. Alternatively, the operation input unit 304 may directly receive input of the control command. For example, the operation input unit 304 may be implemented by a switch, button, touch panel, or handle. Furthermore, the content of the operation input by the operation input unit 304 may be displayed on the display unit 302. In addition, the operation input unit 304 may receive information (e.g., position information) about the input operation entered by the viewer 600 on a position selection screen, which is set to be superimposed on the display unit 302 and used to specify the presentation location displayed on the display unit 302.

[0133] (Speaker 306)

[0134] The speaker 306 reproduces audio signals, etc., under the control of the control unit 310, which will be described later. Note that the speaker 306 may be located in the user terminal 300, or it may be a device such as a pair of headphone speakers (not shown) that is separate from the user terminal 300.

[0135] (Communication Unit 308)

[0136] The communication unit 308 can send and receive information to and from the server 200, and specifically, it can send information to the server 200 regarding the tactilely stimulating stamp (control command) 700 input by the viewer 600. Furthermore, the communication unit 308 can receive information sent from the server 200 (e.g., information such as the price of the tactilely stimulating stamp (control command) 700). For example, the communication unit 308 is a communication interface with the function of sending and receiving data, and is implemented by a communication device (not shown) such as a communication antenna, transmitting and receiving circuits, and ports.

[0137] (Control Unit 310)

[0138] The control unit 310 is the controller of the user terminal 300, and is implemented, for example, in response to various programs stored in the ROM of the user terminal 300, which are executed by the CPU, MPU, etc. using RAM as the working area.

[0139] (Storage unit 312)

[0140] The storage unit 312 is implemented by a storage device such as a ROM that stores programs and operating parameters for processing the control unit 310, and a RAM that temporarily stores parameters that are changed appropriately.

[0141] (Sensor Unit 320)

[0142] The sensor unit 320 can acquire sensing data about actions taken by the viewer 600 (such as vibrations given to the user terminal). For example, such as Figure 7 As shown, the sensor unit 320 mainly includes a camera device 322, a microphone 324, a gyroscope sensor 326, and an accelerometer sensor 328. Note that these sensors are examples, and the embodiments are not limited thereto.

[0143] For example, the camera device 322 captures images of the movement of the viewer 600, and outputs the captured images to the control unit 310. Furthermore, the control unit 310 can extract a predetermined movement of the viewer 600 from the images captured by the camera device 322 and obtain control commands related to the extracted movement. Specifically, the camera device 322 includes a lens system having an image pickup lens, an aperture, a zoom lens, and a focusing lens, and a drive system for performing focusing and zooming operations on the lens system. The camera device 322 also includes a solid-state imaging element array that performs photoelectric conversion on the imaging light captured by the lens system to generate an imaging signal. Note that this solid-state imaging element array can be implemented, for example, by a CCD sensor array or a CMOS sensor array. In addition, the camera device 322 may include a time-of-flight (ToF) sensor (not shown). The ToF sensor, for example, illuminates an object with illumination light having a predetermined period, detects reflected light reflected from the object, and detects the phase difference and time difference between the illumination light and the reflected light, thereby obtaining depth information of the object. Here, the depth information of the object is one of the depth information provided by the distance from the ToF sensor to each point on the object's surface. Moreover, by aggregating the depth information about multiple points on the object's surface, shape information about the surface unevenness of the object can be obtained, i.e., the object's external shape information.

[0144] Microphone 324 collects the sound of viewer 600 and outputs the collected sound information to control unit 310. Then, control unit 310 can extract a predetermined sound pattern of viewer 600 from the sound collected by microphone 324 and obtain control commands related to the extracted sound pattern.

[0145] The gyroscope sensor 326 is implemented, for example, a three-axis gyroscope sensor, and detects the angular velocity (rotational speed) of the movement of the user terminal 300 by the viewer 600. Furthermore, the accelerometer sensor 328 is implemented, for example, a three-axis accelerometer sensor (also called a G-sensor), and detects the acceleration of the movement of the user terminal 300 by the viewer 600. In embodiments, the sensing data from these sensors can be used to identify operations performed by the viewer 600 on the user terminal 300, thereby triggering the acquisition of control commands related to the identified operations.

[0146] Although the detailed configuration of the user terminal 300 according to the embodiments has been described above in detail, the detailed configuration of the user terminal 300 according to the embodiments is not limited to... Figure 7 The example shown may also include, for example, a vibration device (not shown) for notifying the viewer 600 by vibration.

[0147] <2.5 Information Processing Methods>

[0148] The various devices of the information processing system 10 according to the embodiment have been described in detail above. Next, referring to... Figures 8 to 12 Examples of information processing methods according to embodiments are described below. Figure 8 This is a flowchart depicting an example of an information processing method according to an embodiment. Figures 9 to 12 These are explanatory diagrams used to illustrate display examples according to embodiments. For example... Figure 8 As shown, an example of an information processing method according to an embodiment includes multiple steps from step S101 to step S106. Details of each step included in the example of the information processing method according to an embodiment are described below.

[0149] First, the viewer 600 selects a tactilely stimulating stamp 700 from the stamps 700 displayed on the display unit 302 of the user terminal 300, and sends the selected stamp 700 to the server 200. In an embodiment, before sending, the viewer 600 may, for example, tap the displayed stamp 700 to reproduce the tactile stimulation corresponding to the control command associated with the stamp 700, and in this case, for example, the user terminal 300 vibrates to correspond to the tactile stimulation.

[0150] Then, the server 200 obtains information about a tactilely stimulating stamp 700 sent from the user terminal 300, selected by the viewer 600, associated with a control command, and having a tactile stimulation effect (step S101).

[0151] Next, the server 200 refers to the distribution data DB 246, etc., to obtain the location information included in the control command associated with the obtained stamp 700, which is used to specify the presentation position of the tactile stimulus (step S102).

[0152] In addition, the server 200 refers to the distribution data DB 246, etc., and obtains the form information included in the control command associated with the obtained stamp 700, which is used to specify the form of tactile stimulation (step S103).

[0153] Then, based on the position information and form information obtained in steps S102 and S103, the server 200 generates waveform data as a tactile control signal for controlling the tactile presentation device 100 (step S104).

[0154] Next, the server 200 determines, for example, whether to send the generated haptic control signal to the haptic presentation device 100 based on the attribute information of the artist 602 (NG determination) (step S105).

[0155] If it is determined in step S105 that a tactile control signal should be sent to the tactile presentation device 100, the server 200 sends the generated tactile control signal to the tactile presentation device 100 worn on the body of the artist 602 (step S106), and the process ends. On the other hand, if it is determined in step S105 that a tactile control signal should not be sent to the tactile presentation device 100, the server 200 may notify the viewer 600 via the user terminal 300 that no tactile control signal should be sent.

[0156] Then, artist 602 perceives the tactile stimuli presented via tactile presentation device 100 and takes action. Viewer 600 can examine in real time the actions of artist 602 caused by the tactile stimuli presented by the stamp 700 sent by viewer 600. If viewer 600 can confirm in real time the actions caused by the tactile stimuli related to the stamp 700 sent by him / her, then viewer 600 can feel as if he / she is in direct contact with artist 602 and can feel a sense of oneness with artist 602.

[0157] Note that in this embodiment, tactile stimulation is presented not only by the tactile presentation device 100 worn on the body of artist 602, but also, for example, as Figure 9 As shown, a display 800 or similar device can also be overlaid on the image of the artist 602 on the display unit 302 of the user terminal 300. In this case, it is preferable to overlay the display 800 on the location where the tactile stimulus is presented. Furthermore, in an embodiment, the display 800 may have a design corresponding to the design of the stamp 700 with a tactile stimulus effect selected by the viewer 600. For example, if the stamp 700 is designed as an arrow passing through a heart, the display 800 may also be designed as an arrow passing through a heart. Furthermore, in an embodiment, when a tactile stimulus is presented, the image displayed on the display unit 302 of the user terminal 300 can move up, down, left, and right according to the tactile stimulus. Furthermore, in an embodiment, when a tactile stimulus is presented by the tactile presentation device 100 worn on the body of the artist 602, the user terminal 300 of the viewer 600 sending the corresponding tactile stimulus may vibrate, or the user terminals 300 of other viewers 600 present around the artist 602 or the viewer 600 may vibrate.

[0158] Furthermore, in the embodiment, when sending the generated tactile control signal to the tactile presentation device 100, such as Figure 10As shown, an icon (predetermined icon) 806, such as a coin, and a trajectory 808 of the icon 806 moving from the viewer 600 side to the artist 602 can be displayed on the display unit 302 of the user terminal 300, the display unit (not shown) of the monitor 110, etc. Displaying such a trajectory 808 allows the viewer 600 to be aware that a stamp 700 sent by himself / herself is being sent to the artist 602.

[0159] Furthermore, in the embodiments, such as Figure 11 As shown, an artist 602 who has perceived tactile stimulation can, for example, display comments 810 entered via a distributor terminal (not shown) on a display unit 302 of a user terminal 300.

[0160] Furthermore, in this embodiment, if artist 602 is not wearing the haptic presentation device 100, server 200 can stop sending haptic control signals. In this case, server 200 can also send haptic control signals upon newly detecting the attachment of the haptic presentation device 100 worn by artist 602. Furthermore, in the case where the transmission of haptic control signals has been stopped, such as... Figure 12 As shown, the notification 804 indicating a stop can be displayed on, for example, the display unit 302 of the user terminal 300, or the user terminal 300 can be vibrated to make the notification.

[0161] Furthermore, in the embodiment, when artist 602 is not wearing haptic presentation device 100, such as Figure 12 As shown, an animation can also be displayed on the display unit 302 of the user terminal 300, etc., via a control signal during wear. This animation shows the presentation of tactile stimulation to an avatar 802, which is an alternative to the artist 602. In this case, it is preferable to overlay the display 800 on the avatar 802 at the position corresponding to the position where the tactile stimulation is presented.

[0162] As described above, according to the embodiment, a tactile stimulus corresponding to a stamp 700 selected by the viewer 600 that has a tactile effect can be presented to the artist 602. Therefore, in the embodiment, if the artist 602 perceives the presented tactile stimulus and takes action, the viewer 600 can confirm in real time the action caused by the tactile stimulus presented by the stamp 700 sent by the viewer 600. Thus, according to the embodiment, if the viewer 600 can confirm in real time the action caused by the tactile stimulus related to the stamp 700 he / she has sent, the viewer can feel as if he / she is directly interacting with the artist 602; that is, the viewer 600 can obtain a real-time, interactive, and value-added experience.

[0163] <2.6 Modification Example>

[0164] Furthermore, in an embodiment, when the viewer 600 wears the tactile presentation device 100, a "return" performed by the artist 602 can be presented to the viewer 600; in other words, a tactile stimulus corresponding to a stamp 700 selected by the artist 602 that has a tactile stimulating effect. According to a modified example, when the tactile stimulus presented by the stamp 700 sent by the viewer 600 serves as a starting point, and the artist 602 returns the tactile stimulus to the viewer 600, the viewer 600 can feel as if he / she is communicating directly with the artist 602.

[0165] In the modified example, for instance, as in the first embodiment, when artist 602 selects and sends a stamp 700 with tactile stimulation effects, the tactile presentation device 100 of viewer 600 also presents tactile stimulation to viewer 600. Specifically, in the modified example, server 200 acquires the stamp 700 with tactile stimulation effects input by artist 602, generates a tactile control signal according to the control command associated with the acquired stamp 700, and sends the generated tactile control signal to the tactile presentation device 100 worn on the body of viewer 600.

[0166] Furthermore, in the modified example, if the viewer 600 is not wearing the haptic presentation device 100 during the “return” performed by artist 602, the user terminal 300 can be used instead of the haptic presentation device 100.

[0167] In the modified example, for instance, server 200 controls user terminal 300 to output sound, vibration, or flashing, etc., based on control commands associated with a tactilely stimulating stamp 700 input by artist 602. Specifically, in this modified example, server 200 acquires the tactilely stimulating stamp 700 input by artist 602, generates control signals for user terminal 300 based on the control commands associated with the acquired stamp 700 and the functional information (attribute information) of user terminal 300, and sends the generated control signals for user terminal 300.

[0168] <<3. Second Embodiment>>

[0169] In the first embodiment, the viewer 600 inputs a control command by selecting a stamp 700 associated with a predetermined control command; however, embodiments of this disclosure are not limited to this form, and for example, the viewer 600 can freely edit the tactile stimulus (control command) itself. In this way, if the viewer 600 can freely edit the tactile stimulus, then, for example, the viewer 600 can confirm in real time the actions of the artist 602 caused by the tactile stimulus edited by the viewer 600, and can feel as if he / she is in direct contact with the artist 602. In view of this, reference is made below. Figure 13 as well as Figure 14 An embodiment based on such an editing method is described as a second embodiment. Figure 13 as well as Figure 14 This is an explanatory diagram used to illustrate a display example according to a second embodiment of the present disclosure.

[0170] First, 600 viewers can... Figure 13 The operation shown is performed on the position selection screen displayed on the display unit 302 of the user terminal 300 to input position information for specifying the perceptual position for presenting tactile stimulation. Specifically, as... Figure 13 As shown, a human model display 812 is displayed in the location selection screen, and further, multiple regions 814 are displayed on the human model display 812 at positions corresponding to the tactile stimulation unit 106 of the tactile presentation device 100. The viewer 600 can move a marker 816 over the region 814 corresponding to the desired sensory position to set and input the sensory position. Note that the embodiment is not limited to precisely locating and setting and inputting the sensory position; for example, the movement path of the sensory position can be set and input by tracking the human model display 812, or a sensory range with a predetermined size can be set and input. Then, the viewer-side input unit 214 of the server 200 acquires the position information input on the location selection screen.

[0171] In this embodiment, even if the installation location and number of the tactile stimulation units 106 are limited, tactile stimulation can be presented at the desired perception location for the viewer 600 based on the following principle. Specifically, an illusion known medically as hallucination is an illusion in which, when stimulation is presented simultaneously at different locations on the skin, a person perceives only one stimulus between the presented stimulus locations. Therefore, in this embodiment, by using such an illusion, for example, when tactile stimulation is presented simultaneously to two tactile stimulation units 106, the perceived location of the tactile stimulation can be a location between the two tactile stimulation units 106. Furthermore, in this embodiment, by changing the output intensity of the multiple tactile stimulation units 106, the range of tactile stimulation that can be presented by the multiple tactile stimulation units 106 can be expanded without changing the arrangement spacing between the tactile stimulation units 106.

[0172] Furthermore, the embodiments are not limited to such Figure 13The settings and inputs shown on the position selection screen are as follows. For example, if a vest-type sensor (first sensor) similar to the haptic presentation device 100 is worn on the body of the viewer 600 and this sensor can detect touch operations performed by the viewer 600, the viewer 600 can perform operations on the sensor to set and input the perceived position. The viewer-side input unit 214 of the server 200 acquires the position information input to the sensor. Furthermore, the sensor is not limited to being worn on the body of the viewer 600, and can be worn, for example, on a doll (not shown).

[0173] Furthermore, in the embodiments, the waveform type, intensity, presentation timing, frequency, interval, and presentation time of the vibration stimulus can also be edited and set. For example, this can be achieved by... Figure 14 The operation shown is performed on the editing screen (form selection screen) on the display unit 302 of the user terminal 300 to edit the waveform type, intensity, presentation timing, frequency, interval, and presentation time of the tactile stimulus. Specifically, as shown... Figure 14 As shown, waveform 826 is displayed on the timeline in the editing screen, and the viewer 600 can edit waveform 826 by performing operations on it. Furthermore, a cursor is displayed in the editing screen, and the viewer 600 can set the intensity, frequency, etc. of the tactile stimulation by moving the cursor 824. Figure 14 For example, an editing screen is shown where the speed and frequency of the tactile stimulation of the stamp 700 being thrown can be set. The viewer-side input unit 214 of the server 200 acquires the form information input into the form selection screen.

[0174] In this embodiment, the range of values ​​that the viewer 600 can edit can be preset based on the attribute information of the artist 602. For example, for male artist 602, the intensity can be set with a wide range of values, and for female artist 602, the intensity can be set with a narrow range of values.

[0175] Furthermore, perceptual sensitivity varies depending on body position, and also varies between individuals. Therefore, in this embodiment, data (e.g., sensitivity coefficients) indicating the perceptual sensitivity of each position on the artist 602's body are stored as a distributor profile 244, and the generation unit 218 refers to information about the distributor profile 244 and appropriately adjusts the intensity, etc., set by the viewer 600 for the artist 602 as appropriate. In this way, discomfort to the artist 602 due to tactile stimulation edited by the viewer 600 can be avoided.

[0176] Furthermore, in this embodiment, the viewer 600 can also configure the control command to present tactile stimulation when predetermined conditions are met. For example, when predetermined conditions are met, such as reaching a predetermined time specified by the control command, the artist 602 uttering a predetermined keyword specified by the control command (e.g., the artist 602's words are detected by the microphone of the tactile presentation device 100), or the artist 602 performing a predetermined operation specified by the control command (e.g., the artist 602's movement is detected by the camera device 120), the server 200 can distribute tactile control signals related to the control command to the tactile presentation device 100. For example, the predetermined conditions can be set by the viewer 600. Furthermore, in this embodiment, the viewer 600 can also configure the form, size, display speed, animation display speed, etc., of the virtual object displayed when presenting tactile stimulation.

[0177] Furthermore, in the embodiments, tactile stimuli can be edited and set not only through operations such as the location selection screen and editing screen described above, but also, for example, various sensors (second sensors) or other devices built into the user terminal 300 can be used.

[0178] In one embodiment, for example, a viewer 600 can edit the waveform, intensity variation, etc., of the tactile stimulus by performing a touch operation such as vibrating the user terminal 300 or a motion operation such as changing the holding angle of the user terminal 300. Specifically, in this embodiment, a gyroscope sensor 326 and an accelerometer sensor 328 built into the user terminal 300 detect the motion operation, and the viewer-side input unit 214 of the server 200 acquires the detected sensing data. Furthermore, the generation unit 218 of the server 200 generates waveforms, etc., based on the acquired sensing data.

[0179] More specifically, for example, viewer 600 uses a gyroscope sensor 326 and an accelerometer sensor 328 built into user terminal 300 to detect motion with a predetermined rhythm. Then, server 200 sets the frequency of the tactile stimulation based on the rhythm extracted from the sensing data detected by the gyroscope sensor 326 and accelerometer sensor 328. Furthermore, for example, viewer 600 speaks a speech with a predetermined rhythm to user terminal 300 and uses a microphone (sound sensor) 324 built into user terminal 300 to detect the speech. Then, server 200 uses the sensing data detected by microphone 324 to set the frequency of the tactile stimulation. Additionally, for example, viewer 600 uses a camera device (imaging device) 322 built into user terminal 300 to capture images of his / her motion. Server 200 can analyze the images captured by camera device 322, extract predetermined actions, and generate waveform data for tactile stimulation using the extracted actions.

[0180] Furthermore, in this embodiment, the camera device 322, built into the user terminal 300, captures an image of a part of the body, and the server 200 can set a sensing position based on the location contained in the captured image. In this case, the body's position can be identified based on external shape information obtained through a ToF sensor (not shown) included in the camera device 322. Additionally, the intensity of the tactile stimulation can be set according to the viewing angle of the captured image. For example, the intensity is set high for a narrow viewing angle and low for a wide viewing angle. Furthermore, if, for example, the camera device 322 captures an image of the viewer 600's hand moving on a part of the viewer 600's body (e.g., an arm), the arm can be set as the sensing position.

[0181] Furthermore, in this embodiment, the terminal used for setting up is not limited to the user terminal 300, and the terminal used for setting up can be, for example, an electronic musical instrument with a Musical Instrument Digital Interface (MIDI), a turntable, a game interface (stick, etc.).

[0182] In cases where multiple viewers 600 intend to edit and input simultaneously, server 200 can restrict the multiple viewers 600 to perform editing and input sequentially, or it can restrict the multiple viewers 600 to perform editing and input sequentially according to the order in which viewers 600 have started editing or the order in which viewers 600 have paid. Furthermore, server 200 can notify viewers 600 waiting for their turn to perform editing and input how long it will take for their turn (see [link to documentation]). Figure 16 ).

[0183] Furthermore, if the server 200, referring to the information in the distributor configuration file 244, determines that the tactile stimulus edited by the viewer 600 is a tactile stimulus rejected by the artist 602 or a similar tactile stimulus (NG determined), the server 200 may stop sending tactile control signals. In this case, the server 200 may notify the corresponding viewer 600, the operator of this information processing system 10, etc., that the tactile stimulus edited by the viewer 600 corresponds to a tactile stimulus rejected by the artist 602, or may return money to the corresponding viewer 600. Alternatively, in this case, the server 200 may adjust the perceived position, intensity, etc., so that the tactile stimulus edited by the viewer 600 no longer corresponds to a tactile stimulus rejected by the artist 602.

[0184] Furthermore, in an embodiment, if a viewer 600 wishes to examine a tactile stimulus edited by himself / herself, the viewer 600 can examine the tactile stimulus before sending it to the tactile presentation device 100 worn by the artist 602.

[0185] For example, when the viewer 600 wears the haptic presentation device 100, the server 200 sends a haptic control signal to the haptic presentation device 100 that is the same as the haptic control signal associated with the edited haptic stimulus. This allows the viewer 600 to examine the haptic stimulus he / she edited via the haptic presentation device 100 worn by the viewer 600. Furthermore, when the viewer 600 is not wearing the haptic presentation device 100, the user terminal 300 can be used for this examination. In this case, the server 200 generates a control signal (user terminal control signal) corresponding to the haptic control signal associated with the edited haptic stimulus based on the functional information (attribute information) of the user terminal 300, and sends this control signal to the user terminal 300. The user terminal 300 can then output sound from the speaker (sound output device) 306, cause light to flash in the display unit (flickering device) 302, or cause a vibration device (not shown) to vibrate according to the received control signal, allowing the viewer 600 to perform the examination.

[0186] Furthermore, in the embodiments, tactile stimuli edited by viewer 600 can be exchanged among multiple viewer 600 as stamps 700 with tactile stimulating effects.

[0187] <<4. Third Embodiment>>

[0188] Meanwhile, as illustrated in the explanatory diagrams used to illustrate the third embodiment of this disclosure... Figure 15 As shown, sometimes multiple viewers 600 simultaneously send stamps 700 with tactile stimuli to an artist 602. In this case, with multiple tactile stimuli presented to the artist 602 simultaneously based on the simultaneously sent stamps 700, the artist 602 may experience discomfort due to the multiple tactile stimuli. Furthermore, if tactile stimuli are given simultaneously, the artist 602 cannot perceive the tactile stimuli individually and cannot take action in response to each tactile stimuli. This makes it difficult for viewers 600 to feel as if they are directly interacting with the artist 602 through the tactile stimuli caused by the stamps 700 sent by viewers 600.

[0189] Therefore, in the third embodiment of this disclosure, to avoid discomfort and the inability to perceive individual tactile stimuli, when multiple viewers 600 simultaneously send multiple stamps 700 with tactile stimuli, the processing described below is performed. (Refer to...) Figures 16 to 20 The process according to the embodiments is described. Figure 16 These are explanatory diagrams used to illustrate a display example according to a third embodiment of the present disclosure, and Figures 17 to 20 This is an explanatory diagram used to illustrate a third embodiment according to the present disclosure.

[0190] For example, in an embodiment, such as Figure 17 As shown, when multiple viewers 600 send multiple control commands 702 (or stamps 700), the server 200 temporarily stores the control commands 702, processes them sequentially according to the order in which they are input (a predetermined rule), generates tactile control signals, and sends the tactile control signals to the tactile presentation device 100. In an embodiment, when multiple viewers 600 send multiple control commands 702, the server 200 may temporarily stop acquiring multiple control commands 702 and acquire them sequentially according to the order in which they are input. In this case, as... Figure 16 As shown, server 200 can display a display 818 via display unit 302 of user terminal 300 to the viewer 600 who is waiting for his / her turn, to notify the viewer 600 how long it will take for his / her turn to be reached.

[0191] As described above, in the embodiment, since the tactile stimuli are presented to the artist 602 sequentially, the artist 602 can avoid experiencing discomfort, and since the tactile stimuli can be perceived individually, an action can be taken for each tactile stimulus.

[0192] Furthermore, in the embodiments, such as Figure 18 As shown, when multiple control commands 702 (or stamps 700) are acquired within a predetermined time, the server 200 can adjust, for example, the intensity of tactile stimulation based on the number of acquired control commands 702, generate a tactile control signal as a tactile stimulus, and send the tactile control signal to the tactile presentation device 100. For example, the server 200 increases the intensity of the tactile stimulus as the number of identical control commands 702 acquired (e.g., the same perception location and waveform type) increases. Besides simply increasing the intensity based on the number of acquired control commands 702, the server 200 can also consider factors such as the workload of the artist 602, setting an upper limit for the intensity or processing the intensity through subtraction.

[0193] Furthermore, in this embodiment, depending on the number of acquired control commands 702, the server 200 can change the waveform of the tactile stimulus, adjust the presentation time, or adjust the perception position, and this disclosure is not particularly limited to this example. Additionally, in this embodiment, for example, based on the perception positions specified by the continuously acquired control commands 702, the perception position can be adjusted to a single perception position, and a tactile control signal as a tactile stimulus can be generated. More specifically, when the continuously acquired control commands 702 specify the right shoulder and left shoulder as perception positions, the server 200 sets the neckline between the right and left shoulders as the perception position in the generated tactile control signal.

[0194] Furthermore, in the embodiments, such as Figure 19 As shown, server 200 can execute processing according to a predetermined rule (based on the order in which viewer 600 pays when inputting control command 702 (or stamp 700)). For example, server 200 prioritizes processing control commands 702 with higher payment amounts. That is, because viewer 600 has a higher priority in purchasing interactions with artist 602, viewer 600 who intends to interact with artist 602 earlier will pay more money. In other words, this processing order can encourage viewer 600 to pay more money.

[0195] Furthermore, in the embodiments, such as Figure 20 As shown, when multiple identical control commands 702 (or stamps 700) are received within a predetermined time, the server 200 can, for example, sequentially increase the intensity of the tactile stimulation based on the order of the received control commands 702. In this way, collaboration or interaction among multiple viewers 600 can be encouraged, thereby leading to a more valuable experience.

[0196] Furthermore, in an embodiment, the server 200 can adjust the tactile stimulation based on the synchronicity of the transmission of multiple control commands 702 (or stamps 700) from multiple viewers 600. More specifically, in the case where control commands 702 with the same content are synchronously transmitted from different viewers 600 (so-called "tasks" performed by multiple viewers 600), the server 200 can adjust the intensity of the tactile stimulation based on the degree of synchronicity. Additionally, in an embodiment, the server 200 can generate and transmit a tactile control signal only if the number of control commands 702 with the same content received from different viewers 600 exceeds a predetermined number (a predetermined condition). Alternatively, the server 200 can generate and transmit a tactile control signal only if the types of the multiple control commands 702 received from different viewers 600 are of a predetermined type.

[0197] Furthermore, in an embodiment, if control commands 702 (or stamps 700) specifying multiple identical perceptual locations are continuously acquired within a predetermined time period, and these control commands 702 are presented directly to the artist 602 as multiple tactile stimuli, the artist 602 may experience discomfort due to the multiple tactile stimuli. Therefore, in an embodiment, the server 200 (specifically, the viewer-side input unit 214) may only receive and process control commands 702 specifying perceptual locations separated from the immediately preceding perceptual locations by a predetermined distance.

[0198] Furthermore, in embodiments, for example, when multiple viewers 600 send multiple control commands 702 (or stamps 700), the server 200 acquires the control commands 702 substantially in the order they are entered; however, if the amount of the next acquired control command 702 (the amount paid when the control command 702 is entered) is equal to or greater than a predetermined amount, the server 200 may stop processing the previously acquired control command 702 midway and prioritize processing the next control command 702 that is equal to or greater than the predetermined amount. Alternatively, in embodiments, when multiple viewers 600 send multiple control commands 702 (or stamps 700), the server 200 acquires the control commands 702 substantially in the order they are entered; however, the server 200 may compare the amount of the previous control command 702 with the amount of the next control command 702, and if the amount of the next control command 702 is equal to or less than the amount of the previous control command 702, the server 200 may process the previous control command 702.

[0199] Furthermore, in an embodiment, if the amount of the next control command 702 is higher than that of the previous control command 702, the server 200 may stop processing the previously obtained control command 702 midway and prioritize processing the next control command 702. Additionally, in an embodiment, if a control command 702 of higher cost (a control command 702 following the next control command 702) is sent during the processing of the next control command 702, the server 200 may stop processing the next control command 702 midway and prioritize processing the control commands 702 following the next control command 702.

[0200] <<5. Fourth Embodiment>>

[0201] Furthermore, in the fourth embodiment of this disclosure, the price of the stamp 700 with tactile stimulation effect can be dynamically determined based on factors such as the contact rate between the tactile presentation device 100 and the artist 602's body, the perceived location, and attribute information of the viewer 600 or the artist 602. In this embodiment, since the price of the stamp 700 is determined based on such conditions, and based on the value of the experience felt by the viewer 600, it is possible to persuade the viewer 600 to purchase the stamp 700 and to satisfy the viewer's purchase of the stamp 700.

[0202] <5.1 Detailed Configuration of Server 200a>

[0203] First, refer to Figure 21 An example describing the detailed configuration of server 200a according to an embodiment. Figure 21This is a diagram illustrating an example of the functional configuration of server 200a according to an embodiment. (See diagram for example.) Figure 21 As shown, server 200a mainly includes a communication unit 202, a control unit 210a, and a storage unit 240a, as in the first embodiment. Hereinafter, the various functional blocks of server 200a will be described sequentially; however, since the communication unit 202 is common to the communication unit 202 in the first embodiment, its description is omitted here.

[0204] (Control Unit 210a)

[0205] Control unit 210a is a controller, and as Figure 21 As shown, the control unit 210a includes a GUI control unit 212, a viewer-side input unit 214, and a distributor-side input unit 216, as in the first embodiment. Figure 21 The system includes a generation unit 218 and an output control unit (first distribution unit) 222 (not shown in the diagram), and further includes a price determination unit 224 and a settlement unit 226. Note that since the GUI control unit 212, viewer-side input unit 214, distributor-side input unit 216, generation unit 218, and output control unit 222 are common to those units in the first embodiment, their descriptions are omitted here, and only the price determination unit 224 and the settlement unit 226 are described.

[0206] Price Determination Unit 224

[0207] Price determination unit 224, based on the location and format information included in the control command 702 associated with the acquired stamp 700, inputs from distributor-side unit 216 (in... Figure 21 The price of the stamp 700 (or, for the input of the control command 702) is determined by the contact rate between the haptic presentation device 100 and the artist 602's body (not shown in the image) or by the attribute information of the viewer 600 or artist 602 obtained from the storage unit 240a. At this time, the price determination unit 224 can refer to the information in the price data DB 248 stored in the storage unit 240a, which will be described later, to determine the price.

[0208] Settlement Unit 226

[0209] For example, when the settlement unit 226 receives a settlement command from the user terminal 300 via the communication unit 202, the settlement unit 226 performs settlement related to the purchase of the stamp 700 (or, for the input of the control command 702) based on the price determined by the price determination unit 224.

[0210] (Storage unit 240a)

[0211] like Figure 21As shown, storage unit 240a includes viewer profile 242, distributor profile 244 and distribution data DB 246 as in the first embodiment, and further includes price data DB 248 for storing information for determining the price of stamp 700 (or, for input to control command 702).

[0212] Although examples of detailed configurations of server 200a according to embodiments have been specifically described above, the detailed configurations of server 200a according to embodiments are not limited to those described above. Figure 21 The example shown, and for example, server 200a may further include determining unit 220 as in the first embodiment.

[0213] <5.2 Information Processing Methods>

[0214] The server 200a according to an embodiment has been described above. Next, referring to... Figure 22 Examples of information processing methods according to embodiments are described below. Figure 22 This is a flowchart illustrating an example of an information processing method according to an embodiment. For example... Figure 22 As shown, the information processing method according to the embodiment includes multiple steps from step S201 to step S208. Hereinafter, details of each step included in the information processing method according to the embodiment are described.

[0215] First, the viewer 600 selects a tactilely stimulating stamp 700 from the tactilely stimulating stamps 700 displayed on the display unit 302 of the user terminal 300, and sends the selected stamp 700 to the server 200a. Then, as in step S101 of the first embodiment, the server 200a obtains the information sent from the user terminal 300 about the tactilely stimulating stamp 700 selected by the viewer 600 and associated with the control command 702 (step S201).

[0216] Next, server 200a refers to the information in price data DB 248 and determines the price of stamp 700 based on the location and form information included in the acquired control command 702, the contact rate between the haptic presentation device 100 and the artist 602's body, or the attribute information of viewer 600 or artist 602 (step S202). The details of price determination will be described later as an example.

[0217] Then, upon receiving a settlement command from the user terminal 300, the server 200a performs settlement related to the purchase of the stamp 700 based on the price determined in step S202 (step S203). At this time, the server 200a preferably notifies the viewer 600 of the availability of settlement processing.

[0218] Next, server 200a executes the processing from steps S204 to S208, which is related to... Figure 8 Steps S102 to S106 in the first embodiment shown are the same, and therefore their description is omitted here. Note that in the embodiment, steps S102 to S106 may only be performed when... Figure 22 If step S207 (NG determined) is completed and it is determined that the generated haptic control signal is sent to the haptic presentation device 100, the settlement process in step S203 is executed; that is, it is also possible to skip this step. Figure 22 Perform the steps in the order shown.

[0219] <5.3 Example>

[0220] The embodiments have been described above. Next, reference will be made to examples showing specific cases. Figures 23 to 25 Examples of embodiments will be described in more detail below. Figures 23 to 25 These are explanatory diagrams used to illustrate display examples of embodiments according to the embodiments. Note that the following examples are merely examples of embodiments, and the embodiments are not limited to the following examples.

[0221] (Example 1)

[0222] Meanwhile, depending on the artist 602's body size, the contact between the tactile stimulation unit 106 of the tactile presentation device 100 and the artist 602's body may be poor, and the tactile stimulation may not be presented as the viewer 600 expects. Moreover, setting both expected and unexpected tactile stimulation at a uniform price may cause a sense of unfairness for the viewer 600. In view of this, in the example, to avoid such unfairness, the expected and unexpected tactile stimulation are set at different prices. Specifically, in the example, the server 200a determines the price of the stamp 700 (or, for the input of the control command 702) based on the sensing data of the tactile presentation device 100's wearing status detection sensor (e.g., a button-type sensor, a pressure sensor, etc.) (not shown) used to detect the wearing status. For example, if the control command 702 associated with the selected stamp 700 includes a command to use the tactile stimulation unit 106 having a high contact rate with the artist 602's body, the server 200a sets the price of the stamp 700 to be higher. Conversely, if the control command 702 includes a command to use the tactile stimulation unit 106 having a low contact rate with the artist 602's body, the server 200a sets the price of the stamp 700 to be lower. Assuming in this example, sensing data from the wear status detection sensor can be imported into the server 200a, for example, upon triggering the detection that the artist 602 is wearing the tactile presentation device 100.

[0223] (Example 2)

[0224] In the example, since each artist 602 has perceptual locations with high and low sensitivity to tactile stimuli, the server 200a determines the price of the stamp 700 for the tactile stimulus presented at each perceptual location based on the difference in perceptual sensitivity at each location. For example, if the control command 702 associated with the selected stamp 700 includes a command to use the tactile stimulus unit 106 present at the perceptual location with high sensitivity, the server 200a sets the price of that stamp 700 to be higher. On the other hand, if the control command 702 includes a command to use the tactile stimulus unit 106 present at the perceptual location with low sensitivity, the server 200a sets the price of that stamp 700 to be lower. Therefore, in the example, the server 200a stores indicators such as those indices showing the perceptual sensitivity of each perceptual location of the artist 602 as a distributor profile 244, and determines the price of the stamp 700 (or, for the input of the control command 702) based on the stored indicators. Furthermore, the example is not limited to determining the price based on perceptual sensitivity, and for example, the price can be determined based on the popularity of the stamp 700 or tactile stimulus (waveform, perceptual location, etc.) among the viewer 600 or artist 602 (which can be estimated based on the frequency of selection, etc.), and this disclosure is not particularly limited to this example.

[0225] (Example 3)

[0226] In the example, server 200a determines the price of stamp 700 (or, for input to control command 702) based on viewer 600's attribute information (e.g., purchase history, membership level, membership courses, etc.). For example, in this example, server 200a stores the amount of money viewer 600 has paid so far for stamp 700 in a viewer profile 242 associated with viewer 600's identification information, and determines the price of a new stamp 700 (or, for input to control command 702) purchased by viewer 600 based on the stored total amount. In this example, the more money viewer 600 has paid so far, the lower the purchase price of stamp 700 can be set by server 200a, for example, or alternatively, the more money viewer 600 has paid so far, the higher the purchase price of stamp 700 can be set by server 200a. Furthermore, the example is not limited to determining the price based on the amount purchased so far, and for example, the price could be determined based on a membership level set based on the amount purchased so far or on a membership course (e.g., a trial course, a new member course, a premium course, etc.) subscribed to by viewer 600 before purchasing the stamp, and this disclosure is not particularly limited to this example. At this time, server 200a can display, as shown on display unit 302 of user terminal 300... Figure 23 The screen shown serves as the selection screen for stamp 700. This screen displays, for example, the price of stamp 700, the membership level of viewer 600, and the purchase points awarded to viewer 600 based on their purchase history.

[0227] Furthermore, in the example, the range of waveform types, intensities, and sensory locations of tactile stimuli that viewer 600 can choose can be determined not only based on price but also based on viewer 600's attribute information (e.g., purchase history, membership level, membership courses, etc.). For example, the more money viewer 600 has paid so far, the higher the upper limit of the tactile stimuli that can be chosen will be set by server 200a. Additionally, in the example, server 200a can be configured to prioritize the order in which stamps 700 can be sent, not only based on the range of choices but also based on viewer 600's attribute information. For example, the greater the amount viewer 600 has paid so far, the higher the priority given by server 200a in the order in which stamps 700 can be sent. At this time, server 200a can display on the display unit 302 of user terminal 300 the following... Figure 24 The screen shown serves as the selection screen for stamp 700. This screen displays, for example, buttons for upgrading position and order, and the screen changes as follows, for example, when viewer 600 operates the button for upgrading position. Figure 25 The location selection screen is shown. On the location selection screen, a mannequin display 812 is shown, and on this mannequin display 812, an area 814 corresponding to the tactile stimulation unit 106 that the viewer 600 can select is shown, along with its price. The viewer 600 can select the desired tactile location by performing an operation on area 814 while checking the price on the location selection screen. In the example described above, for example, a mechanism could be provided to prioritize viewers 600 who have purchased a large number of stamps 700 or paid a large sum of money, which could further incentivize viewers 600 to purchase stamps 700.

[0228] <<6. Fifth Embodiment>>

[0229] Furthermore, in the embodiments, the stamps 700 with tactile stimulation effects can be exchanged among multiple viewers 600 or collected by viewers 600, which can further incentivize viewers 600 to purchase the stamps 700.

[0230] Specifically, in an embodiment, for example, during the streaming of an artist 602's performance video, a selection screen of a tactilely stimulating stamp 700, or the stamp 700 itself, is automatically distributed to the viewer 600's user terminal 300. This encourages the viewer 600 to send the stamp 700 to the artist 602 during the streaming. Furthermore, valuable tactilely stimulating stamps 700 that are not normally distributed (so-called "rare stamps") can be distributed to the viewer 600, where "not normally distributed" means limiting the location, date, and time of distribution (e.g., limiting it to the date and time of the artist's live concert performance). In this way, the viewer 600 visits the live concert, for example, to obtain the rare and valuable stamp 700, which enhances the live concert's ability to attract consumers. Note that the viewer 600 may be able to automatically acquire rare stamps via a communication connection only during streaming, or may be able to acquire rare stamps by performing a process such as a purchase process, and this disclosure is not particularly limited to this example.

[0231] Furthermore, multiple viewers 600 can exchange tactilely stimulating stamps 700 obtained through such a stamp selection screen via a social networking service (SNS), or the number and type of collected stamps 700 can be made public as a ranking. For example, in an embodiment, the server 200 stores information about the stamps 700 obtained by the viewer 600 so far in a viewer profile 242 in association with the viewer 600's identification information. Furthermore, in an embodiment, when a predetermined type of tactilely stimulating stamp 700 can be collected (under predetermined conditions), the server 200 can grant the viewer 600 a new tactilely stimulating stamp 700 (e.g., a "rare stamp"). In this way, the viewer 600 collects and purchases predetermined types of stamps to obtain valuable stamps 700, which can further incentivize the viewer 600 to purchase stamps 700.

[0232] <<7. Sixth Embodiment>>

[0233] Furthermore, in this embodiment, viewers 600 can be further incentivized to purchase stamps 700 with tactile stimulation effects by adding game elements.

[0234] <7.1 Detailed Configuration of Server 200b>

[0235] First, refer to Figure 26 The detailed configuration of server 200b according to the embodiment is described below. Figure 26 This is a diagram illustrating an example of the functional configuration of server 200b according to an embodiment. Figure 26As shown, server 200b mainly includes a communication unit 202, a control unit 210b, and a storage unit 240a, as in the first and fourth embodiments. Hereinafter, the various functional blocks of server 200b will be described sequentially; however, since the communication unit 202 and storage unit 240a are common to those units in the first and fourth embodiments, their descriptions are omitted here.

[0236] (Control Unit 210b)

[0237] Control unit 210b is a controller, and as... Figure 26 As shown, the control unit 210b includes a GUI control unit 212, a viewer-side input unit 214, a distributor-side input unit 216, a generation unit 218, and an output control unit (first distribution unit) 222, as in the first embodiment, and further includes an integration assignment unit 228. Note that since the GUI control unit 212, viewer-side input unit 214, distributor-side input unit 216, generation unit 218, and output control unit 222 are common to the units in the first embodiment, their description is omitted, and only the integration assignment unit 228 will be described below.

[0238] Integral assignment unit 228

[0239] The scoring unit 228 acquires the evaluation of the tactile stimulus input by the artist 602 who has perceived the tactile stimulus via the distributor-side input unit 216, and assigns points to the viewer 600 based on the acquired evaluation. Note that the assigned points are stored in the viewer profile 242 of the storage unit 240a in association with the viewer 600's identification information.

[0240] <7.2 Example>

[0241] The server 200b according to an embodiment has been described above. Next, referring to... Figure 27 as well as Figure 28 Describe the implementation examples. Figure 27 as well as Figure 28 This is an explanatory diagram used to illustrate a display example according to an embodiment.

[0242] Here, for example, suppose the following game is played, in which two viewers 600 throw (send) stamps 700 with tactile stimulating effects at an artist 602, and compete against each other for evaluation. First, artist 602 evaluates the tactile stimulation caused by the thrown stamps 700, and server 200b assigns points to each viewer 600 based on the evaluation. Then, server 200b determines the winner between the two viewers 600 based on the number of points assigned, and displays the result on the display unit 302 of user terminal 300. Figure 27The image shown serves as an indication of the outcome of the match. Furthermore, as... Figure 28 As shown, after a series of such matches, server 200b can display a ranking based on the total number of points awarded to each viewer, which is 600.

[0243] Furthermore, in this embodiment, the evaluation performed by artist 602 is not limited to evaluations manually entered by artist 602, and can be, for example, based on sensing data from a bio-information sensor (not shown) attached to artist 602's body. For example, the greater the increase in artist 602's heart rate caused by tactile stimulation, the higher the evaluation. Note that, in this embodiment, the sensing data obtained from artist 602's bio-information sensor can, for example, be displayed on user terminal 300.

[0244] As described above, in this embodiment, the purchase of the stamp 700 with tactile stimulation effect can be further incentivized by adding game elements.

[0245] <7.3 Modified Example 1>

[0246] Furthermore, in an embodiment, the game involving artist 602 can be configured such that not only does the viewer 600 throw a stamp 700 with tactile stimulation, but artist 602 also performs a predetermined operation in response to the thrown stamp 700, in which case no tactile stimulation related to the stamp 700 is presented. Examples of modifications related to such a game are described below.

[0247] (Detailed configuration of server 200c)

[0248] First, refer to Figure 29 This describes the detailed configuration of Server 200c based on the modified example. Figure 29 This is a diagram illustrating an example of the functional configuration of a server 200c based on a modified example. (See diagram for example.) Figure 29 As shown, the server 200c mainly includes a communication unit 202, a control unit 210c, and a storage unit 240, as in the first embodiment. Hereinafter, the various functional blocks of the server 200c will be described in sequence; however, since the communication unit 202 and the storage unit 240 are common to the units in the first embodiment, their descriptions will be omitted, and only the control unit 210c will be described.

[0249] The control unit 210c is a controller, and as... Figure 29As shown, the control unit 210c, as in the first embodiment, includes a GUI control unit 212, a viewer-side input unit 214, a distributor-side input unit 216, a generation unit 218, a determination unit 220, and an output control unit (first distribution unit) 222. Furthermore, in a modified example, the distributor-side input unit 216 acquires, for example, sensing data from various sensors of the haptic presentation device 100, and outputs the sensing data to the determination unit 220.

[0250] (Information Processing Methods)

[0251] The above describes server 200c based on the modified example. Next, refer to... Figure 30 as well as Figure 31 Describe the information processing method based on the modified example. Figure 30 This is a flowchart illustrating an example of an information processing method modified according to an embodiment, and Figure 31 These are explanatory diagrams used to illustrate modified examples according to embodiments. For example... Figure 30 As shown, the information processing method according to the modified example includes multiple steps from step S301 to step S308. The details of each step included in the information processing method according to the modified example are described below.

[0252] First, server 200c executes the processing from steps S301 to S304, which is related to... Figure 8 Steps S101 to S104 in the first embodiment shown are similar, and therefore their description is omitted here.

[0253] Next, server 200c displays, for example, augmented reality (AR) on display unit 302 of user terminal 300 and display unit (not shown) of monitor 110, such as... Figure 31 The icon of the coin shown and the trajectory 808 of the icon moving from the viewer's side 600 to the artist's side 602 (step S305). Note that in the modified example, the viewer 600 can set the trajectory 808 and the speed of displaying the trajectory 808 before throwing the stamp 700 with tactile stimulation effect, or can modify the trajectory 808 and the speed of displaying the trajectory 808 after display. Furthermore, in the modified example, a predetermined sound can be output from the user terminal 300 or the speaker (not shown) of the monitor 110, etc., during the AR display.

[0254] Then, artist 602 visually recognizes the trajectory 808 displayed on the display unit (not shown) of monitor 110, and performs an action in response (e.g., escaping from the falling position of an icon estimated based on trajectory 808, performing a touch operation on a predetermined terminal (e.g., monitor 110), uttering a keyword, etc.). Next, server 200c acquires sensing data about the actions of artist 602 (step S306). For example, artist 602's escape action can be detected by camera device 120, touch operation can be detected by touch panel (not shown) of monitor 110, and artist 602's words can be detected by microphone (not shown) of haptic presentation device 100.

[0255] Next, server 200c determines whether to present tactile stimulation in tactile presentation device 100 based on the sensing data acquired in step S306 (step S307). For example, this could occur if artist 602 performs an escape operation at a predetermined time, if the timing of artist 602's touch operation is a predetermined time, or if artist 602's utterance is a predetermined keyword (e.g., such as...). Figure 31 In the case of the disappearance of the tactile stimulus, server 200c determines that no tactile stimulus is presented. Furthermore, in the modified example, tactile stimulus can be presented even when a predetermined number or more stamps 700 (or control commands 702) are sent simultaneously, or even when a predetermined movement of artist 602 is detected. Additionally, in the modified example, when viewer 600 throws a stamp 700 with a tactile stimulus effect, a desired keyword can be entered or selected, and this keyword can be displayed on monitor 110. In this case, if artist 602 correctly utters the keyword displayed on monitor 110, server 200c can determine whether to present or not tactile stimulus. In this way, according to the modified example, viewer 600 can not only have a one-way experience such as watching artist 602's performance, but also a more real-time, interactive, and higher-value experience such as interacting with artist 602.

[0256] Then, server 200c executes the processing in step S308, which is related to... Figure 8 Step S106 in the first embodiment shown is similar, and therefore its description is omitted here.

[0257] In the modified example, not only viewer 600 but also artist 602 can play a virtual game, such as a dodgeball game, throwing stamps 700 at each other and dodging the thrown stamps 700. As a result, viewer 600 can feel as if he / she is interacting directly with artist 602 in an exciting way and can obtain a more valuable experience.

[0258] Note that the modified example is not limited to not presenting tactile stimulation when the predetermined movement of artist 602 is detected, but also allows for changing the intensity of the tactile stimulation when the predetermined movement of artist 602 is detected. Furthermore, in the absence of tactile stimulation, a predetermined sound (e.g., a fading sound) can be output via user terminal 300, or user terminal 300 can vibrate. Additionally, in the modified example, server 200c can determine whether to present tactile stimulation based on a combination of the type of stamp 700, the attribute information of artist 602, the attribute information of viewer 600, etc.

[0259] <7.4 Modified Example 2>

[0260] Furthermore, the game elements can be further enhanced with the following configuration, in which the content of the stamp 700 to be thrown by the viewer 600, which has a tactile stimulation effect, can be determined by taking into account both chance and skill. (See reference...) Figure 32 Describe an example of such a modification. Figure 32 This is an explanatory diagram used to illustrate a modified example according to the embodiment.

[0261] In the modified example, for instance, it is assumed that the intensity of the tactile stimulus is determined based on the value of a level gauge when a stamp 700 with a tactile stimulating effect is thrown. Specifically, as... Figure 32 As shown, an animation of a cursor 820, used to specify the intensity of a tactile stimulus, is displayed on the display unit 302 of the user terminal 300. In this animation, it is assumed that the cursor 820 always moves left and right. Furthermore, icons 822, such as a bow and arrow, are displayed on the display unit 302. The viewer 600 can throw a stamp 700 by sliding their finger across the icon 822 and releasing their fingertip from the screen. Then, the viewer-side input unit 214 of the server 200c obtains the intensity corresponding to the position of the cursor 820 at the time of the release operation as the intensity of the tactile stimulus associated with the thrown stamp 700.

[0262] In the modified example, because the cursor 820 always moves left and right, the intensity to be set is determined by chance. Furthermore, to set the intensity to the desired level, the viewer 600 needs to carefully perform operations on the icon 822 based on the movement of the cursor 820, which requires skill. Therefore, if the viewer 600 cannot set the intensity to the desired level, for example, the viewer 600 may repeatedly throw the stamp 700 until the desired level can be set. That is, because the modified example provides a game that combines skill and chance, it offers a more entertaining experience for the viewer 600.

[0263] Note that the modified example is not limited to the operation of icon 822, and for example, the intensity of the tactile stimulation can be set according to the speed of the movement operation performed by the viewer 600 to change the holding angle of the user terminal 300, and this disclosure is not particularly limited to this example. Furthermore, in the modified example, cursor 820 is not limited to animation, and can be a cursor 820 that can move in response to an operation performed by the viewer 600. In this case, the viewer-side input unit 214 of server 200c acquires the intensity corresponding to the position to which cursor 820 moves in response to the viewer 600's operation as the intensity of the tactile stimulation related to the thrown stamp 700.

[0264] <7.5 Modified Example 3>

[0265] In embodiments and modifications of this disclosure, noise sometimes exists in the microphone (not shown) disposed on the shoulder portion of the haptic presentation device 100 due to vibration of the haptic stimulation unit 106 of the haptic presentation device 100. Therefore, a modified example for eliminating noise in the microphone caused by vibration of the haptic stimulation unit 106 is described below.

[0266] Specifically, server 200 predicts noise based on the waveform applied to tactile stimulation unit 106. For example, server 200 can predict noise by referring to a database (DB) (not shown) obtained by pre-applying various waveforms to tactile stimulation unit 106 and performing machine learning on the generated noise. Thus, server 200 can avoid sound degradation due to noise by eliminating the predicted noise from the sound collected by a microphone (not shown) disposed on the shoulder portion of tactile presentation device 100.

[0267] Note that in the modified example, server 200 can adjust the waveform to be eliminated based on the distance between a microphone (not shown) positioned on the shoulder portion of haptic presentation device 100 and haptic stimulation unit 106. Furthermore, for example, in the case of artist 602 performing in a studio, the microphone can collect noise reflected from the studio walls. In this case, server 200 can adjust the waveform to be eliminated based on the distance between the microphone positioned on the shoulder portion of haptic presentation device 100 and the wall.

[0268] Furthermore, in the modified example, as a means of eliminating noise caused by the vibration of the tactile stimulation unit 106, the microphone (not shown) can be made directional so that the microphone can collect the sound of the artist 602 in a focused manner, or the frequency range in which the microphone can collect sound can be limited to avoid collecting noise caused by the vibration of the tactile stimulation unit 106.

[0269] <<8. Examples of modifications to the information processing system 10 disclosed herein>>

[0270] In addition, refer to Figures 33 to 38 A modified example of the information processing system 10 according to an embodiment of the present disclosure is described. Figures 33 to 38 This is a system diagram illustrating an example of a schematic configuration of an information processing system 10 according to a modified example of an embodiment of the present disclosure.

[0271] First of all, Figure 33 In the information processing system 10 shown, Figure 3 The server 200 shown is implemented through a haptic server 250a, a data distribution and editing server 250b, a live streaming server 250c, and a haptic server 250d.

[0272] Specifically, such as Figure 33 As shown, in the information processing system 10 according to the embodiment, for example, a tactile presentation device (tactile vest) 100, a driver amplifier / interface 140, a speaker 116, a monitor 110, a microphone 124, and a camera device 120 are arranged on the artist 602 side. Furthermore, in the information processing system 10, for example, a tactile server (information processing device) 250a, a data distribution and editing server 250b, a live streaming server (another information processing device) 250c, and a tactile server 250d are arranged between the artist 602 side and the viewer 600 side. Additionally, in the information processing system 10, a smartphone or tablet terminal, as an example of a user terminal 300, is provided on the viewer 600 side. The various devices included in the information processing system 10 can send and receive data via various communication networks such as wired / wireless local area networks (LAN), Wi-Fi, Bluetooth, and mobile communication networks (LTE and 5G). Note that the number of devices included in the information processing system 10 is not limited to... Figure 33 The number shown is not limited to, and can be even greater. Furthermore, the information processing system 10 may also include... Figure 33 Devices not shown. For example, information processing system 10 may include a general-purpose personal computer (PC), a game console, a cellular phone, a portable media player, a speaker, a projector, a display (digital signage, etc.), and wearable devices such as headphones, smart glasses, or a smartwatch.

[0273] Note that in Figure 33In the information processing system 10 shown, for example, the haptic server 250a, which manages the presentation of haptic stimuli, can be operated by a different service operator than the service operators of the distribution data editing server 250b and the live streaming server 250c. The distribution data editing server 250b has a built-in application for editing video and sound to be distributed to viewer 600, and the live streaming server 250c manages the distribution to viewer 600. The following is a brief description of the driver amplifier / interface 140, monitor 110, camera device 120, haptic server 250a, distribution data editing server 250b, live streaming server 250c, and haptic server 250d included in the information processing system 10 according to the embodiment.

[0274] (Driver amplifier / interface 140)

[0275] The driver amplifier / interface 140 is an interface for sending and receiving tactile control signals between the tactile presentation device 100 and the tactile server 250a. For example, the driver amplifier / interface 140 obtains configuration file information (functional information, etc.) of the tactile presentation device 100 from the tactile presentation device 100, or converts and amplifies the tactile control signals generated by the tactile server 250a, and sends the signals to the tactile presentation device 100.

[0276] (Monitor 110)

[0277] Monitor 110 can, for example, display video of artist 602 captured by camera device 120 (described later), and monitor 110 can also overlay text, icons, or animations onto the image of artist 602. For example, monitor 110 is implemented using a liquid crystal display (LCD) device and an organic light-emitting diode (OLED) device. Furthermore, in embodiments, the display unit (not shown) of monitor 110 can be configured as a unit integrated with an input unit (not shown), and in this case, the input unit is implemented using a touch panel superimposed on the display unit. Additionally, in embodiments, monitor 110 may be provided with a speaker 116 for outputting sound to artist 602.

[0278] (Camera device 120)

[0279] The imaging device 120 is one or more visible light imaging devices that capture images of artist 602 from one or more viewpoints, and transmits the video captured by the imaging device 120 to the user terminal 300 of viewer 600 via a tactile server 250a, a data distribution and editing server 250b, and a live streaming server 250c. The imaging device 120 can capture images of the environment surrounding artist 602 or real objects existing around artist 602. Specifically, the imaging device 120 includes a lens system having an image pickup lens, an aperture, a zoom lens, and a focusing lens, and a drive system that enables the lens system to perform focusing and zooming operations. The imaging device 120 also includes a solid-state imaging element array that photoelectrically converts the imaging light captured by the lens system to generate an imaging signal. The solid-state imaging element array can be implemented, for example, by a charge-coupled device (CCD) sensor array or a complementary metal-oxide-semiconductor (CMOS) sensor array.

[0280] (Haptic Server 250a)

[0281] The haptic server 250a can receive a stamp (control command) 700 with haptic stimulation effect input by the viewer 600 via the live streaming server 250c, generate a haptic control signal based on the stamp 700, and send the generated haptic control signal to the haptic presentation device 100. Each stamp 700 with haptic stimulation effect is associated with each predetermined control command 702, and each control command 702 includes information for specifying the perceptual location of the presented vibration stimulus (location information), and information for specifying the vibration stimulus, such as waveform type and intensity (form information). In addition, the control command 702 may include identification information (ID) for specifying the haptic stimulation unit (not shown) of the haptic presentation device 100 and the aforementioned form information. Specifically, the tactile server 250a generates tactile control signals (waveform data) for each tactile stimulation unit 106 to be input to the tactile presentation device 100 to present vibration stimulation at the sensing position specified by the control command 702 with the intensity and waveform specified by the control command, and sends the tactile control signals to the tactile presentation device 100.

[0282] (Distribution data editing server 250b)

[0283] The distribution data editing server 250b can edit the video received by the camera device 120 via the haptic server 250a, and can also edit the sound received by the microphone 124 via the haptic server 250a. The distribution data editing server 250b can further send the edited video and sound data to the user terminal 300 via the live streaming server 250c, and can output the edited video and sound data to the speaker 116 and monitor 110 via the haptic server 250a. For example, the distribution data editing server 250b can generate video data for distribution by overlaying an image of a stamp 700 input by the viewer 600 or a video effect associated with the stamp 700 onto an image of the artist 602 captured by the camera device 120.

[0284] (Live streaming server 250c)

[0285] The live streaming server 250c can distribute images such as those of artist 602 and images for selecting tactile stimulation effects, such as stamps 700, to user terminals 300. For example, the live streaming server 250c can authenticate via a web application programming interface (web API) and monitor tactile stimulation effects such as stamps 700 sent by viewers 600.

[0286] (Haptic Server 250d)

[0287] The haptic server 250d stores a pre-generated haptic database (vibration waveform patterns, etc.) associated with the identification information (ID) of each stamp 700. In addition, the haptic server 250d may store, for example, information such as the number, location, frequency characteristics, and maximum input voltage of the haptic stimulation units 106 of the haptic presentation device 100 as configuration information of the haptic presentation device 100.

[0288] Furthermore, in the embodiments, the haptic server 250a, the data distribution and editing server 250b, the live streaming server 250c, and the haptic server 250d can be implemented by a single device or multiple devices, and this disclosure is not particularly limited to this example. Details will be described later.

[0289] In addition, Figure 34 In the information processing system 10 shown, the tactile server 250a also has the functions of the aforementioned data distribution and editing server 250b. In this case, the service operator managing the presentation of tactile stimuli can be different from the service operator managing the distribution.

[0290] In addition, Figure 35 In the information processing system 10 shown, with Figure 34Unlike the example, the information stored in the haptic server 250d is provided to the haptic server 250a via the live streaming server 250c.

[0291] In addition, Figure 36 In the information processing system 10 shown, information stored in the haptic server 250d is provided to the haptic server 250a via the live streaming server 250c and the data distribution and editing server 250b.

[0292] In addition, Figure 37 In the information processing system 10 shown, the tactile server 250a, which serves as the server 200, has a tactile server 250d externally installed as part of the function of the storage unit 240.

[0293] In addition, Figure 38 In the information processing system 10 shown, the haptic server 250d can cooperate with the live streaming server 250c to distribute to the user terminal 300.

[0294] <<9. Summary>>

[0295] As described above, in the embodiments of this disclosure, a tactile stimulus corresponding to a stamp 700 selected by viewer 600 that has a tactile effect can be presented to artist 602. Therefore, in the embodiments, if artist 602 perceives the presented tactile stimulus and takes action, viewer 600 can confirm in real time the action caused by the tactile stimulus presented by the stamp 700 sent by viewer 600. Thus, according to the embodiments, if viewer 600 can confirm in real time the action caused by the tactile stimulus related to the stamp 700 sent by him / her, the viewer can feel as if he / she is directly interacting with artist 602; that is, viewer 600 can obtain a real-time, interactive, and value-added experience.

[0296] The embodiments disclosed herein can be applied not only to live streaming, but also, for example, to stamps 700 exchanged on social networking sites. In this case, for example, instead of the haptic presentation device 100, the user terminal 300 can vibrate to provide haptic stimulation to the person who has sent the stamp 700.

[0297] <<10. About Hardware Configuration>>

[0298] Information processing equipment such as server 200 according to the above embodiments, for example, comprises... Figure 39 The computer 1000 with the configuration shown is implemented. An example of a server 200 according to an embodiment of this disclosure is described below. Figure 39This is a diagram illustrating the hardware configuration of an example computer that implements the functions of server 200. Computer 1000 includes a CPU 1100, RAM 1200, read-only memory (ROM) 1300, hard disk drive (HDD) 1400, communication interface 1500, and input / output interface 1600. The various units of computer 1000 are interconnected via bus 1050.

[0299] The CPU 1100 operates based on programs stored in ROM 1300 or HDD 1400 to control the various units. For example, the CPU 1100 expands programs stored in ROM 1300 or HDD 1400 into RAM 1200 and executes processing corresponding to various programs.

[0300] ROM 1300 stores boot programs such as the Basic Input / Output System (BIOS) program executed by CPU 1100 when computer 1000 starts up, and programs that depend on the hardware of computer 1000.

[0301] HDD 1400 is a computer-readable recording medium that non-transitorily records programs executed by CPU 1100, data used by the programs, etc. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, exemplified as program data 1450.

[0302] Communication interface 1500 is an interface for computer 1000 to connect to external network 1550 (e.g., the Internet). For example, CPU 1100 receives data from another device or sends data generated by CPU 1100 to another device via communication interface 1500.

[0303] Input / output interface 1600 is an interface for connecting input / output device 1650 to computer 1000. For example, CPU 1100 receives data from input devices such as keyboard and mouse via input / output interface 1600. CPU 1100 also sends data to output devices such as monitor or printer via input / output interface 1600. Furthermore, input / output interface 1600 can be used as a media interface for reading programs recorded on a predetermined recording medium (media). For example, the medium is an optical recording medium such as digital multifunction optical disc (DVD) or phase-change rewritable disc (PD), a magneto-optical recording medium such as magneto-optical disc (MO), magnetic tape, magnetic recording medium, semiconductor memory, etc.

[0304] For example, when computer 1000 is used as server 200 according to an embodiment of the present disclosure, the CPU 1100 of computer 1000 executes an information processing program loaded onto RAM 1200 to perform functions such as generating tactile control signals. Furthermore, HDD 1400 stores information processing programs according to embodiments of the present disclosure. Note that CPU 1100 reads program data 1450 from HDD 1400 for execution; however, as another example, the program can be obtained from another device via external network 1550.

[0305] Furthermore, the information processing apparatus according to the embodiments can be applied to systems including multiple devices connected to a network (or communication between devices), such as cloud computing. That is, the information processing apparatus according to the above embodiments can also be implemented as an information processing system that performs processes related to the information processing method according to the embodiments through multiple devices.

[0306] <<11. Supplement>>

[0307] Furthermore, the above embodiments may include, for example, a program for enabling a computer to function as an information processing device according to the embodiments, and a non-transitory tangible medium on which the program is recorded. Additionally, the program may be distributed via communication lines such as the Internet (including wireless communication).

[0308] Furthermore, the steps in the embodiment do not necessarily have to be processed in the described order. For example, the steps can be processed in a different order as appropriate. Additionally, the steps can be processed partially in parallel or individually, instead of in chronological order. Furthermore, the processing method for each step does not have to conform to the described method, and can be processed in other ways, for example, through other functional blocks.

[0309] Although preferred embodiments of the present disclosure have been described above with reference to the accompanying drawings, the scope of the present disclosure is not limited to the examples described above. It will be apparent to those skilled in the art that various changes and modifications will be discovered within the scope of the appended claims, and it should be understood that such changes and modifications will naturally fall within the scope of the present disclosure.

[0310] Furthermore, the effects described in this specification are merely illustrative or exemplary and are not restrictive. That is, other effects that are readily apparent to those skilled in the art from this specification can be achieved, in conjunction with or in lieu of the aforementioned effects, according to the technology disclosed herein.

[0311] In addition, this technology can also be configured as follows. (1)

[0313] An information processing device, comprising:

[0314] The first acquisition unit is configured to acquire a control command input by a first user, the control command corresponding to presentation unit information for specifying a presentation unit for presenting tactile stimuli through a tactile presentation device and form information for specifying the form of the tactile stimuli;

[0315] A generation unit configured to generate, according to the control command, a tactile control signal for presenting the tactile stimulus to the presentation unit; and

[0316] A first distribution unit is configured to distribute the tactile control signal to the tactile presentation device worn on the body of a second user. (2)

[0318] According to the information processing device described in (1), wherein,

[0319] The control commands are pre-associated with the stamps displayed in the stamp selection screen, and

[0320] The first user selects a stamp displayed in the stamp selection screen to input the control command. (3)

[0322] The information processing apparatus according to (1) or (2) further includes: a price determination unit configured to determine the price of the input to the control command based on at least one of the presentation unit information and the form information. (4)

[0324] The information processing apparatus according to any one of (1) to (3) further includes: a storage unit configured to store the control command obtained by the first user in association with the identification information of the first user. (5)

[0326] According to the information processing device described in (4), a new control command is issued when a plurality of control commands obtained by the first user meet predetermined conditions. (6)

[0328] According to the information processing device described in (4), wherein,

[0329] The storage unit acquires an evaluation of the tactile stimulus input by the second user who perceives the tactile stimulus, and stores the information about the evaluation in association with the identification information of the first user who input the control command corresponding to the tactile stimulus. (7)

[0331] The information processing apparatus according to any one of (1) to (6) further includes:

[0332] A determining unit is configured to determine whether to present the tactile stimulus in the tactile presentation device based on the actions of the second user. (8)

[0334] According to the information processing device described in (7), wherein,

[0335] The action is detected by at least one of the following: an imaging device for capturing an image of the second user; a motion sensor for acquiring motion data about the second user; and a sound sensor for collecting the voice of the second user. (9)

[0337] According to the information processing device described in (7), the determining unit determines not to present the tactile stimulus when the second user performs a predetermined action, or alternatively when the second user utters a predetermined keyword. (10)

[0339] The information processing apparatus according to any one of (1) to (9), wherein,

[0340] The first acquisition unit displays a cursor for specifying the intensity of the tactile stimulus, and receives the specification of the intensity through the first user's operation on the cursor. (11)

[0342] According to the information processing device described in (10), wherein,

[0343] The first acquisition unit displays the animation of the cursor movement and receives the specification of the intensity by the first user's operation based on the cursor position when the operation of the first user is received. (12)

[0345] An information processing terminal, comprising:

[0346] An input unit configured to receive input of control commands, the control commands including presentation unit information for specifying a presentation unit for presenting tactile stimuli via a tactile presentation device and form information for specifying the form of the tactile stimulus; and

[0347] A sending unit is configured to send the input control command to an information processing device, which generates a tactile control signal based on the control command and distributes the tactile control signal to the tactile presentation device. (13)

[0349] According to the information processing device described in (1), the tactile presentation device includes a tactile stimulation unit, and

[0350] The presentation unit information includes the ID information of the tactile stimulation unit. (14)

[0352] According to the information processing device described in (1), wherein,

[0353] The tactile control signal is a tactile control ID corresponding to the control command, and

[0354] The tactile presentation device performs tactile presentation based on the presentation unit information and the form information corresponding to the tactile control ID. (15)

[0356] According to the information processing device of (1), the tactile control signal corresponds to a predetermined image generated based on the input and superimposed on an image of a real space distributed to the first user. (16)

[0358] According to the information processing device described in (15), wherein,

[0359] The predetermined image and the image of the real space are distributed from other information processing devices capable of communicating with the display device that displays the image to the first user to the display device. (17)

[0361] According to the information processing device described in (16), wherein,

[0362] The other information processing device acquires the control command corresponding to the input of the first user. (18)

[0364] According to the information processing device described in (1),

[0365] Also includes:

[0366] The second acquisition unit is configured to acquire, based on input from the first user, a predetermined image superimposed on an image in real space in sync with the presentation of the tactile stimulus;

[0367] The third acquisition unit is configured to acquire an image of the real space; and

[0368] The second distribution unit is configured to distribute the predetermined image and the image of the real space to a display device that displays the image to the first user. (19)

[0370] A program for enabling an information processing device to function as a control unit.

[0371] The program causes the control unit to perform a process that includes the following operations:

[0372] Obtain the control commands input by the first user;

[0373] Receive live video feed from a second user;

[0374] The received live stream image from the second user is displayed on the display unit; and

[0375] The acquired control commands are sent to the server via the communication unit;

[0376] in,

[0377] The tactile control signal is generated according to the control command.

[0378] The tactile control signal is distributed to the tactile presentation device worn on the body of the second user, and

[0379] Tactile presentation is performed via the tactile presentation device based on presentation unit information for specifying the presentation unit for presenting tactile stimuli of the tactile presentation device, which corresponds to the control command, and form information for specifying the form of the tactile stimuli. (20)

[0381] An information processing device, comprising:

[0382] The control unit is configured to:

[0383] Receive control commands input by the first user, and

[0384] Receive the live stream image from the second user; where,

[0385] The tactile control signal is generated according to the control command.

[0386] The tactile control signal is distributed to the tactile presentation device worn on the body of the second user, and

[0387] Tactile presentation is performed via the tactile presentation device based on presentation unit information for specifying the presentation unit for presenting tactile stimuli of the tactile presentation device, which corresponds to the control command, and form information for specifying the form of the tactile stimuli.

[0388] List of reference numerals

[0389] 10. Information Processing System

[0390] 100 haptic presentation devices

[0391] Communication units 102, 202, and 308

[0392] 104, 210, 210a, 210b, 210c, 310 Control Units

[0393] 106 tactile stimulation units

[0394] 110 surveillance camera

[0395] 116, 306 speakers

[0396] 120, 322 camera devices

[0397] 124, 324 microphones

[0398] 140 Driver Amplifier / Interface

[0399] Servers 200, 200a, 200b, 200c, 250a, 250b, 250c, 250d

[0400] 212 GUI Control Unit

[0401] 214 Viewer-side input units

[0402] 216 Distributor-side input unit

[0403] 218 Generating Units

[0404] 220 Determining Unit

[0405] 222 Output Control Unit

[0406] 224 Price Determination Unit

[0407] Settlement Unit 226

[0408] 228 Integral Assignment Unit

[0409] 240, 240a, 312 memory cells

[0410] 242 Viewer Profiles

[0411] 244 Distributor Profile

[0412] 246 Distribute Data DB

[0413] 248 Price Data DB

[0414] 300 User Terminal

[0415] 300a Smart Phone

[0416] 300b tablet terminal

[0417] 302 Display Unit

[0418] 304 Operation Input Unit

[0419] 320 sensor unit

[0420] 326 Gyroscope Sensor

[0421] 328 Accelerometer

[0422] 600 viewers

[0423] 602 Artists

[0424] 700 stamps

[0425] 702 Control Command 800 Display

[0426] 802 Incarnation

[0427] 804 Notice

[0428] Icons 806 and 822

[0429] 808 trajectory

[0430] 810 comments

[0431] Model 812 shows

[0432] Area 814

[0433] 816 mark

[0434] 820, 824 cursors

[0435] 826 waveform

Claims

1. An information processing device, comprising: The first acquisition unit is configured to acquire a control command input by a first user, the control command corresponding to tactile presentation device information for specifying a tactile presentation device for presenting tactile stimuli and form information for specifying the form of the tactile stimuli; A generation unit is configured to generate, according to the control command, a tactile control signal for presenting the tactile stimulus to the tactile presentation device; as well as A first distribution unit is configured to distribute the tactile control signal to the tactile presentation device worn on the body of a second user. The tactile control signal is adjusted based on the contact rate between the tactile presentation device and the second user's body. The contact rate reflects the amount of contact between the haptic presentation device and the second user's body compared to at least one threshold contact amount. The contact rate is determined based on sensing data from a wear status detection sensor, including a pressure sensor. The first acquisition unit, the generation unit, and the first distribution unit are all implemented by at least one processor.

2. The information processing device according to claim 1, in, The control commands are pre-associated with the stamps displayed in the stamp selection screen, and The first user selects a stamp displayed in the stamp selection screen to input the control command.

3. The information processing device according to claim 1, further comprising: A price determination unit is configured to determine the price of the input to the control command based on at least one of the haptic presentation device information and the form information. The price confirmation unit is implemented by at least one processor.

4. The information processing device according to claim 1, further comprising: A storage unit configured to store the control commands acquired by the first user in association with the first user's identification information. The storage unit is implemented using at least one non-transitory computer-readable storage medium.

5. The information processing device according to claim 4, wherein, If a plurality of control commands obtained by the first user meet predetermined conditions, a new control command is issued.

6. The information processing device according to claim 4, in, The storage unit is further configured as follows: Obtain an evaluation of the tactile stimulus from the second user who has perceived the tactile stimulus, and Information about the evaluation is stored in association with the identification information of the first user who input the control command corresponding to the tactile stimulus.

7. The information processing device according to claim 1, further comprising: A determining unit is configured to determine, based on the actions of the second user, whether to present the tactile stimulus in the tactile presentation device. The determining unit is implemented by at least one processor.

8. The information processing device according to claim 7, in, The action is detected by at least one of the following: an imaging device for capturing an image of the second user; a motion sensor for acquiring motion data about the second user; and a sound sensor for collecting the voice of the second user.

9. The information processing device according to claim 7, wherein, If the second user performs a predetermined action, or alternatively if the second user utters a predetermined keyword, the determining unit determines not to present the tactile stimulus.

10. The information processing device according to claim 1, wherein, The first acquisition unit displays a cursor for specifying the intensity of the tactile stimulus, and receives the specification of the intensity through the first user's operation on the cursor.

11. The information processing device according to claim 1, wherein, The wearing status detection sensor is configured to be worn by the second user.

12. The information processing device according to claim 1, wherein, The tactile presentation device includes a tactile stimulation unit, and The tactile presentation device information includes the ID information of the tactile stimulation unit.

13. The information processing device according to claim 1, in, The tactile control signal is a tactile control ID corresponding to the control command, and The tactile presentation device performs tactile presentation based on the tactile presentation device information corresponding to the tactile control ID and the form information.

14. The information processing device according to claim 1, wherein, The tactile control signal corresponds to a predetermined image generated based on the input and superimposed on an image of the real space distributed to the first user.

15. The information processing device according to claim 14, wherein, The predetermined image and the image of the real space are distributed from a different information processing device to the display device, which is capable of communicating with the display device that displays the image to the first user.

16. The information processing device according to claim 15, wherein, The different information processing devices acquire the control commands corresponding to the input of the first user.

17. The information processing device according to claim 1, Also includes: The second acquisition unit is configured to acquire, based on input from the first user, a predetermined image superimposed on an image in real space in sync with the presentation of the tactile stimulus; The third acquisition unit is configured to acquire an image of the real space; as well as The second distribution unit is configured to distribute the predetermined image and the image of the real space to a display device that displays the image to the first user.

18. An information processing terminal, comprising: An input unit is configured to receive input of control commands, the control commands including tactile presentation device information for specifying a tactile presentation device for presenting tactile stimuli and form information for specifying the form of the tactile stimulus; as well as A sending unit is configured to send the input control command to an information processing device, which generates a tactile control signal based on the control command and distributes the tactile control signal to the tactile presentation device. The tactile control signal is adjusted based on the contact rate between the tactile presentation device and the second user's body. The contact rate reflects the amount of contact between the haptic presentation device and the second user's body compared to at least one threshold contact amount. The contact rate is determined based on sensing data from a wear status detection sensor, including a pressure sensor. Both the input unit and the sending unit are implemented by at least one processor.

19. A non-transitory computer-readable storage medium having a program stored thereon, said program, when executed by an information processing device of a computer, causing the computer to perform a method, said method comprising: Obtain the control commands input by the first user; Receive live video feed from a second user; The received live image from the second user is displayed on the monitor; as well as The acquired control commands are sent to the server via the communication unit; Specifically, tactile control signals are generated based on the control commands. Specifically, the tactile control signal is distributed to a tactile presentation device worn on the body of the second user. Specifically, tactile presentation is performed based on tactile presentation information corresponding to the control command, which specifies the tactile presentation device, and form information, which specifies the form of the tactile stimulus. The tactile control signal is adjusted based on the contact rate between the tactile presentation device and the second user's body. The contact rate reflects the amount of contact between the haptic presentation device and the second user's body compared to at least one threshold contact amount. The contact rate is determined based on sensing data from a wear status detection sensor, which includes a pressure sensor.

20. An information processing device, comprising: The circuit is configured as follows: Receive control commands input by the first user, and Receive live video feed from a second user; Specifically, tactile control signals are generated based on the control commands. Specifically, the tactile control signal is distributed to a tactile presentation device worn on the body of the second user. Tactile presentation is performed based on tactile presentation information corresponding to the control command, which specifies the tactile presentation device for presenting tactile stimuli, and form information, which specifies the form of the tactile stimulus. The tactile control signal is adjusted based on the contact rate between the tactile presentation device and the second user's body. The contact rate reflects the amount of contact between the haptic presentation device and the second user's body compared to at least one threshold contact amount. The contact rate is determined based on sensing data from a wear status detection sensor, which includes a pressure sensor.

Images