Information processing device
The system provides real-time, interactive tactile experiences through a tactile presentation device, allowing viewers to feel as if they are directly engaging with artists, thereby increasing satisfaction and purchase intent.
Patent Information
- Application Number
- JP2021571278
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-09-23
- Filing Date
- 2021-01-15
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-01-15
AI Technical Summary
Existing technologies lack the ability to provide real-time, interactive, and high-value-added experiences through tactile stimulation, such as vibration, to enhance viewer engagement in entertainment settings.
An information processing device and terminal system that includes a tactile presentation device worn by users, a server, and user terminals, which allow for the generation and transmission of tactile control signals based on user inputs to synchronize tactile stimuli with live content, enabling real-time interaction and enhanced experience.
Enables viewers to feel a sense of direct interaction with artists by receiving tactile stimuli in real-time, enhancing viewer satisfaction and increasing the desire to purchase related content.
Smart Images

Figure 0007593335000001 
Figure 0007593335000002 
Figure 0007593335000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing device, an information processing terminal, and a program. [Background technology]
[0002] In recent years, consumer activity has been shifting from "mono consumption," the simple purchase of goods, to "koto consumption," in which people pay for experiences with high added value. For example, even in the entertainment field, such as music and animation, consumers are increasingly seeking not only one-way experiences such as watching live performances by artists, but also real-time, interactive experiences with higher added value, such as interactions between artists and fans.
[0003] For example, one example of such an experience is "tipping," in which a viewer of content sends illustrations, text, and other data, and also transfers money, to an artist who distributes the content on the Internet. By communicating between the artist and the viewer through such "tipping," the viewer can obtain an experience with higher added value. As a result, the viewer's satisfaction with the content increases, and their willingness to purchase such "things" increases. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2018 / 008217 Summary of the Invention [Problem to be solved by the invention]
[0005] Incidentally, devices for presenting tactile stimuli such as vibrations to a user have been proposed in the past. For example, a jacket-type tactile presentation device described in the above-mentioned Patent Document 1 can be given as an example. Such a tactile presentation device is worn by a user in a movie theater, a theme park attraction, or the like, and is controlled to be synchronized with the playback content being viewed by the user, thereby amplifying the sense of realism of the playback content being provided.
[0006] Therefore, the present disclosure proposes an information processing device, an information processing terminal, and a program that can provide viewers with a real-time, interactive, and high-added-value experience by utilizing such a tactile presentation device. [Means for solving the problem]
[0007] According to the present disclosure, an information processing device is provided, comprising: a first acquisition unit that acquires control commands corresponding to presentation unit information input by a first user, the presentation unit specifying a presentation unit that presents a tactile stimulus by a tactile presentation device, and form information specifying a form of the tactile stimulus; a generation unit that generates a tactile control signal for presenting the tactile stimulus on the presentation unit in response to the control command; and a first distribution unit that distributes the tactile control signal to the tactile presentation device worn on the body of a second user.
[0008] In addition, according to the present disclosure, there is provided an information processing terminal comprising: an input unit to which a control command including presentation unit information specifying a presentation unit that presents a tactile stimulus by a tactile presentation device and form information specifying the form of the tactile stimulus is input; and a transmission unit that generates a tactile control signal corresponding to the input control command and transmits the control command to an information processing device that distributes it to the tactile presentation device.
[0009] In addition, according to the present disclosure, there is provided a program that causes an information processing device to function as a control unit that acquires a control command input from a first user, receives an image of a live stream of a second user, displays the received image of the live stream on a display unit, and transmits the acquired control command to a server via a communication unit, wherein a tactile control signal is generated in response to the control command, the tactile control signal is delivered to a tactile presentation device worn on the body of the second user, and tactile presentation is performed via the tactile presentation device based on presentation unit information that specifies a presentation unit that presents a tactile stimulation of the tactile presentation device corresponding to the control command and form information that specifies the form of the tactile stimulation.
[0010] Furthermore, according to the present disclosure, there is provided an information processing device that includes a control unit that receives a control command input from a first user and receives an image of a live stream of a second user, generates a tactile control signal in response to the control command, distributes the tactile control signal to a tactile presentation device worn on the body of the second user, and presents a tactile sensation via the tactile presentation device based on presentation unit information that specifies a presentation unit that presents a tactile stimulus of the tactile presentation device corresponding to the control command and form information that specifies the form of the tactile stimulus. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is an explanatory diagram (part 1) for explaining an overview of an embodiment of the present disclosure. [Diagram 2] FIG. 2 is an explanatory diagram (part 2) for explaining an overview of the embodiment of the present disclosure. [Diagram 3] FIG. 1 is a system diagram showing a schematic configuration example of an information processing system 10 according to a first embodiment of the present disclosure. [Figure 4] 1 is a diagram illustrating an example of the external configuration of a tactile presentation device 100 according to a first embodiment of the present disclosure. [Diagram 5] 2 is a diagram illustrating an example of a functional configuration of the tactile presentation device 100 according to the first embodiment of the present disclosure. [Figure 6]2 is a diagram illustrating an example of a functional configuration of a server 200 according to a first embodiment of the present disclosure. [Figure 7] 2 is a diagram illustrating an example of a functional configuration of a user terminal 300 according to the first embodiment of the present disclosure. FIG. [Figure 8] FIG. 2 is a flowchart illustrating an example of an information processing method according to the first embodiment of the present disclosure. [Figure 9] FIG. 1 is an explanatory diagram (part 1) for explaining a display example according to the first embodiment of the present disclosure. [Figure 10] FIG. 2 is an explanatory diagram (part 2) for explaining a display example according to the first embodiment of the present disclosure. [Figure 11] FIG. 11 is an explanatory diagram (part 3) for explaining a display example according to the first embodiment of the present disclosure. [Figure 12] FIG. 11 is an explanatory diagram (part 4) for explaining a display example according to the first embodiment of the present disclosure. [Figure 13] FIG. 11 is an explanatory diagram (part 1) for explaining a display example according to a second embodiment of the present disclosure. [Figure 14] FIG. 11 is an explanatory diagram (part 2) for explaining a display example according to the second embodiment of the present disclosure. [Figure 15] FIG. 11 is an explanatory diagram (part 1) for explaining a third embodiment of the present disclosure. [Figure 16] FIG. 13 is an explanatory diagram for explaining a display example according to a third embodiment of the present disclosure. [Figure 17] FIG. 2 is an explanatory diagram (part 2) for explaining the third embodiment of the present disclosure. [Figure 18] FIG. 11 is an explanatory diagram (part 3) for explaining the third embodiment of the present disclosure. [Figure 19] FIG. 11 is an explanatory diagram (part 4) for explaining the third embodiment of the present disclosure. [Figure 20] FIG. 5 is an explanatory diagram (part 5) for explaining the third embodiment of the present disclosure. [Figure 21] FIG. 13 is a diagram illustrating an example of a functional configuration of a server 200a according to a fourth embodiment of the present disclosure. [Figure 22]FIG. 13 is a flowchart illustrating an example of an information processing method according to a fourth embodiment of the present disclosure. [Diagram 23] FIG. 13 is an explanatory diagram (part 1) for explaining a display example according to an example of the fourth embodiment of the present disclosure. [Figure 24] FIG. 13 is an explanatory diagram (part 2) for explaining a display example according to an example of the fourth embodiment of the present disclosure. [Diagram 25] FIG. 13 is an explanatory diagram (part 3) for explaining a display example according to an example of the fourth embodiment of the present disclosure. [Figure 26] FIG. 13 is a diagram illustrating an example of a functional configuration of a server 200b according to a sixth embodiment of the present disclosure. [Figure 27] FIG. 23 is an explanatory diagram (part 1) for explaining a display example according to a sixth embodiment of the present disclosure. [Figure 28] FIG. 23 is an explanatory diagram (part 2) for explaining a display example according to the sixth embodiment of the present disclosure. [Figure 29] FIG. 23 is a diagram illustrating an example of a functional configuration of a server 200c according to a modified example of the sixth embodiment of the present disclosure. [Diagram 30] FIG. 23 is a flowchart illustrating an example of an information processing method according to a modified example of the sixth embodiment of the present disclosure. [Diagram 31] FIG. 23 is an explanatory diagram (part 1) for explaining a display example according to a modified example of the sixth embodiment of the present disclosure. [Diagram 32] FIG. 23 is an explanatory diagram (part 2) for explaining a display example according to a modified example of the sixth embodiment of the present disclosure. [Diagram 33] FIG. 1 is a system diagram (part 1) illustrating a schematic configuration example of an information processing system 10 according to a modified example of an embodiment of the present disclosure. [Diagram 34] FIG. 2 is a system diagram (part 2) illustrating a schematic configuration example of an information processing system 10 according to a modified example of the embodiment of the present disclosure. [Diagram 35] FIG. 11 is a system diagram (part 3) illustrating a schematic configuration example of an information processing system 10 according to a modified example of the embodiment of the present disclosure. [Diagram 36] FIG. 4 is a system diagram (part 4) illustrating a schematic configuration example of an information processing system 10 according to a modified example of the embodiment of the present disclosure. [Figure 37] FIG. 5 is a system diagram (part 5) illustrating a schematic configuration example of an information processing system 10 according to a modified example of the embodiment of the present disclosure. [Figure 38] FIG. 6 is a system diagram (part 6) illustrating a schematic configuration example of an information processing system 10 according to a modified example of the embodiment of the present disclosure. [Figure 39] FIG. 2 is a hardware configuration diagram showing an example of a computer that realizes the functions of the server 200. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] A preferred embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are given the same reference numerals to avoid repeated explanation. In this specification and the drawings, similar components in different embodiments may be distinguished by adding different alphabets after the same reference numerals. However, when there is no particular need to distinguish between similar components, only the same reference numerals are given.
[0013] The explanation will be given in the following order. 1. Overview of the embodiments of the present disclosure 2. First embodiment 2.1 Overview of Information Processing System 10 2.2 Detailed configuration of the tactile presentation device 100 2.3 Detailed configuration of server 200 2.4 Detailed configuration of the user terminal 300 2.5 Data Processing Method 2.6 Variations 3. Second embodiment 4. Third embodiment 5. Fourth embodiment 5.1 Detailed configuration of server 200a 5.2 Information Processing Method 5.3 Example 6. Fifth embodiment 7. Sixth embodiment 7.1 Detailed configuration of server 200b 7.2 Implementation 7.3 Variation 1 7.4 Variation 2 7.5 Variation 3 8. Modifications of the Information Processing System 10 of the Present Disclosure 9. Summary 10. Hardware Configuration 11. Supplementary Information
[0014] <<1. Overview of the embodiments of the present disclosure>> Before describing the details of the embodiment of the present disclosure, an outline of the embodiment of the present disclosure created by the present inventors will be described with reference to Figures 1 and 2. Figures 1 and 2 are explanatory diagrams for explaining the outline of the embodiment of the present disclosure.
[0015] As explained above, in recent years, consumer activities have been shifting from "consumption of things" to "consumption of experiences." Particularly in the entertainment field, consumers are now strongly seeking not only one-way experiences such as watching live performances by artists, but also real-time, interactive, and higher-value-added experiences such as interacting with artists.
[0016] In light of this situation, the inventors have been working hard to find a way to provide viewers with an experience with higher added value, and came up with the idea of using a haptic device that presents tactile stimuli such as vibrations to the wearer. The inventors believed that by using such a haptic device, viewers would be able to obtain an experience with higher added value.
[0017] In an embodiment of the present disclosure created based on such an idea, as shown in FIG. 1, an artist 602 who allows a performance or content to be viewed or distributed is asked to wear, for example, a vest-type tactile presentation device 100. The tactile presentation device 100 has a plurality of tactile stimulating units (e.g., actuators, etc.) inside. Furthermore, the tactile stimulating unit can present a tactile stimulus to a wearer upon receiving a predetermined signal. Then, as shown in FIG. 2, a viewer 600 selects one stamp 700 with tactile stimulating effect from a plurality of stamps 700 with tactile stimulating effect displayed on the display unit 302 of the user terminal 300, and transmits the selected stamp 700 with tactile stimulating effect, whereby a predetermined tactile control signal corresponding to the tactile stimulus given to the stamp 700 is transmitted to the tactile stimulating unit (so-called "tipping" with tactile stimulating effect is performed). Furthermore, the tactile stimulating unit presents a tactile stimulus corresponding to the selected stamp 700 with tactile stimulating effect to a wearer based on the received predetermined tactile control signal. If the artist 602 perceives the presented tactile stimulus and takes an action, the viewer 600 can confirm in real time the action induced by the tactile stimulus presented by the stamp 700 that the viewer 600 sent. If the viewer 600 can confirm in real time the action induced by the tactile stimulus related to the stamp 700 that the viewer sent, the viewer 600 can feel as if he or she is directly interacting with the artist 602, that is, the viewer can obtain an experience with higher added value.
[0018] Thus, in the embodiment of the present disclosure created by the present inventors, not only visual information such as illustrations, animations, and text, and auditory information such as music, but also tactile information can be sent from the viewer 600 to the artist 602. Therefore, according to the embodiment of the present disclosure, a real-time, interactive, high-value-added experience can be provided to the viewer 600, which increases the viewer's satisfaction with the performance and content, and increases their willingness to purchase such "experiences." Details of the embodiment of the present disclosure created by the present inventors will be described below in order.
[0019] <<2. First embodiment>> <2.1 Overview of the information processing system 10> First, an overview of the information processing system 10 according to the first embodiment of the present disclosure will be described with reference to Fig. 3. Fig. 3 is a system diagram showing a schematic configuration example of the information processing system 10 according to the first embodiment of the present disclosure. In the following description, it is assumed that an artist (second user) 602 and a viewer (first user) 600 exist in different spaces or in the same space. That is, in the information processing system 10, the viewer 600 may, for example, directly view the artist 602 or may view a distributed video of the artist 602.
[0020] In detail, as shown in FIG. 3, the information processing system 10 according to the present embodiment may include, for example, a tactile presentation device 100, a monitor 110, a camera 120, a server (information processing device) 200, and a smartphone 300a and a tablet 300b as examples of a user terminal (information processing terminal) 300. The server 200 and other devices may transmit and receive data to and from each other via various communication networks such as a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 5G (fifth generation mobile communication method)), etc. The number of devices included in the information processing system 10 is not limited to the number shown in FIG. 3, and may be greater. The information processing system 10 may also include devices not shown in FIG. 3. For example, the information processing system 10 may include a general-purpose PC (Personal Computer), a game machine, a mobile phone, a portable media player, a speaker, a projector, a display (digital signage, etc.), headphones, and wearable devices such as smart glasses and a smart watch. An outline of each device included in the information processing system 10 according to this embodiment will be described below.
[0021] (Tactile presentation device 100) The tactile presentation device 100 is configured, for example, by a device that can be worn on the body. In this embodiment, for example, a vest type (sleeveless jacket shape) worn by the artist 602 is assumed. As described above, the vest type tactile presentation device 100 has a plurality of tactile stimulation units inside. For example, a predetermined number (for example, six) of tactile stimulation units can be arranged on the front side and the back side of the artist 602 inside the tactile presentation device 100. As an example, each tactile stimulation unit arranged on the front side and each tactile stimulation unit arranged on the back side are arranged in a positional relationship facing each other.
[0022] In this embodiment, the shape of the tactile presentation device 100 is not limited to a vest type, and may be a jacket shape with sleeves. In this case, one or more tactile stimulation units may be arranged not only on the chest and abdomen of the artist 602, but also at positions corresponding to both arms of the artist 602. In this embodiment, the tactile presentation device 100 is not limited to a jacket shape, and may be pants, shoes, a belt, a hat, gloves, a mask, or the like.
[0023] Furthermore, a microphone (hereinafter referred to as a microphone) (not shown) may be arranged on each of the left and right shoulders of the tactile presentation device 100, or one microphone may be arranged on either the left or right shoulder, or three or more microphones may be arranged. Furthermore, the microphones may be arranged around the artist 602 as other devices independent of the tactile presentation device 100. Furthermore, the tactile presentation device 100 may incorporate a wearing state detection sensor (e.g., a fastener-type sensor, a pressure sensor, etc.) (not shown) for detecting the wearing state of the tactile presentation device 100, an inertial sensor (Inertial Measurement Unit: IMU) (not shown) for detecting the movement and posture of the artist 602, a bioinformation sensor (e.g., a sensor for sensing heart rate, pulse, brain wave, respiration, sweat, myoelectric potential, skin temperature, skin electrical resistance, eye movement, or pupil diameter, etc.) (not shown), and the like for detecting bioinformation of the artist 602. The detailed configuration of the tactile presentation device 100 will be described later.
[0024] (Monitor 110) The monitor 110 can display, for example, an image of the artist 602 captured by a camera 120 (described later) toward the artist 602, and further, the monitor 110 can superimpose text, icons, animations, and the like on the image of the artist 602. For example, the monitor 110 is realized by a liquid crystal display (LCD) device or an organic light emitting diode (OLED) device. In addition, in this embodiment, the display unit (not shown) of the monitor 110 may be provided as an integrated unit with an input unit (not shown), and in this case, the input unit is realized by, for example, a touch panel superimposed on the display unit. Furthermore, in this embodiment, the monitor 110 may be provided with a speaker (not shown) that outputs sound to the artist 602.
[0025] (Camera 120) The camera 120 is one or more visible light cameras that capture the artist 602 from one or multiple viewpoints, and the captured images are transmitted to the user terminal 300 or monitor 110 of the viewer 600 via the server 200. The camera 120 may capture real objects around the artist 602 or around the viewer 600. In detail, the camera 120 has a lens system composed of an imaging lens, an aperture, a zoom lens, a focus lens, and the like, and a drive system that causes the lens system to perform a focus operation or a zoom operation. The camera 120 further has a solid-state imaging element array that photoelectrically converts the imaging light obtained by the lens system to generate an imaging signal. The solid-state imaging element array may be realized by, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
[0026] (Server 200) The server 200 can receive a stamp (control command) 700 with a tactile stimulation effect input from the viewer 600, generate a tactile control signal according to the stamp 700, and transmit the generated tactile control signal to the tactile presentation device 100. Each stamp 700 with a tactile stimulation effect is linked to a predetermined control command, and each control command includes information (position information) specifying a perception position at which a vibration stimulation is to be presented, and information (form information) specifying a waveform type and intensity of the vibration stimulation. The control command can also include identification information (ID) specifying a tactile stimulation unit provided in the tactile presentation device 100 and the form information. In detail, the server 200 generates a tactile control signal (waveform data) to be input to each tactile stimulation unit provided in the tactile presentation device 100 so that a vibration stimulation with a specified waveform is presented at a specified perception position by the control command, and transmits the generated tactile control signal to the tactile presentation device 100. In this specification, the "perception position" includes a movement path of the perception position and a perception range having a specified width.
[0027] Furthermore, in this embodiment, the server 200 may be realized by a single device as shown in FIG. 3, or may be realized by a plurality of devices, and is not particularly limited. For example, the server 200 may be realized by a dedicated server (not shown) for the tactile presentation device 100 and a distribution server (not shown) that distributes content. In this case, the dedicated server for the tactile presentation device 100 performs authentication via a Web API (Application Programming Interface), monitors the stamps 700 with tactile stimulation effects transmitted from the viewer 600, and controls the tactile presentation device 100. On the other hand, the distribution server distributes images of the artists 602 and images for selecting the stamps 700 with tactile stimulation effects to the user terminal 300. Furthermore, the server 200 may include, for example, a payment server (not shown) that performs payment for the use of the information processing system 10. The detailed configuration of the server 200 will be described later.
[0028] (User terminal 300) The user terminal 300 is used by the viewer 600 or installed near the viewer 600, and is a terminal through which the viewer 600 inputs the above-mentioned stamp with tactile stimulus effect 700 and the like. The user terminal 300 receives the stamp with tactile stimulus effect (control command) 700 input from the viewer 600, and transmits the received stamp 700 to the server 200. For example, the user terminal 300 can be a smartphone 300a, a tablet PC (Personal Computer) 300b, a mobile phone, a laptop PC, a wearable device such as an HMD (Head Mounted Display), etc. The detailed configuration of the user terminal 300 will be described later.
[0029] <2.2 Detailed configuration of the tactile presentation device 100> Next, a detailed configuration of the tactile presentation device 100 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a diagram showing an example of the external configuration of the tactile presentation device 100 according to this embodiment, and Fig. 5 is a diagram showing an example of the functional configuration of the tactile presentation device 100 according to this embodiment. As described above, the tactile presentation device 100 is a device that is attached to a part of the body of the artist 602 and provides tactile stimulation to the artist 602 by vibrating or the like according to a control command.
[0030] 4, for example, a vest-type tactile presentation device 100 has multiple tactile stimulators 106 therein, as described above. The tactile stimulators 106 are composed of actuators, for example, and are driven by tactile control signals generated by the server 200 to generate vibrations, which are presented as tactile stimuli. As the actuators, for example, eccentric motors, linear vibrators, piezoelectric elements, etc. can be used.
[0031] Further, as shown in FIG. 5, the tactile presentation device 100 has a communication unit 102, a control unit 104, and the above-mentioned tactile stimulation unit 106. The communication unit 102 is connected to the server 200 by wire or wirelessly, and transmits and receives information to and from the server 200. The control unit 104 is a controller, and drives the tactile stimulation unit 106 based on a tactile control signal input via the above-mentioned communication unit 102. The control unit 104 is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a ROM (Read Only Memory) or the like inside the tactile presentation device 100 using a RAM (Random Access Memory) as a working area. The control unit 104 can also be realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0032] Although the detailed configuration of the tactile presentation device 100 according to this embodiment has been specifically described above, the detailed configuration of the tactile presentation device 100 according to this embodiment is not limited to the examples shown in FIGS.
[0033] The tactile presentation device 100 is not limited to the wearable type as described above, but may be configured as an on-hand type mounted on a device held by the artist 602, such as a smartphone, a game controller, a portable music player, etc. The tactile presentation device 100 is not limited to the wearable type or on-hand type, but may be configured as a slate / floor type mounted on furniture such as a bed or a chair, or various facilities.
[0034] <2.3 Detailed configuration of server 200> Next, a detailed configuration of the server 200 according to the embodiment of the present disclosure will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of a functional configuration of the server 200 according to the embodiment. As shown in Fig. 6, the server 200 mainly includes a communication unit 202, a control unit 210, and a storage unit 240. Each functional block of the server 200 will be described below in order.
[0035] (Communication unit 202) The communication unit 202 can transmit and receive information between the tactile presentation device 100, the monitor 110, the camera 120, and the user terminal (information processing terminal) 300. The communication unit 202 is a communication interface having a function of transmitting and receiving data, and is realized by communication devices (not shown) such as a communication antenna, a transmission / reception circuit, and a port.
[0036] (Control unit 210) The control unit 210 is a controller, and is realized, for example, by a CPU, an MPU, or the like executing various programs stored in a ROM or the like inside the server 200 using a RAM as a working area. In detail, as shown in Fig. 6, the control unit 210 can include a GUI control unit 212, a viewer side input unit (first acquisition unit) 214, a distributor side input unit 216, a generation unit 218, a determination unit 220, and an output control unit (first distribution unit) 222, etc.
[0037] The GUI (Graphical User Interface) control unit 212 controls the user terminal 300 of the viewer 600 to display a screen for inputting a stamp with tactile stimulation effect (control command) 700. In detail, the GUI control unit 212 displays a screen as shown in FIG. 2 on the display unit 302 of the user terminal 300 as a screen for selecting the stamp with tactile stimulation effect 700. A large number of stamps with tactile stimulation effect 700 are displayed on the selection screen (stamp selection screen). Each stamp with tactile stimulation effect 700 is associated with a control command for the tactile presentation device 100, and the viewer 600 can input a control command by selecting a stamp 700 displayed on the selection screen. In this embodiment, it is preferable that the image of the stamp with tactile stimulation effect 700 intuitively evokes a tactile stimulation or a thought (message) that the viewer 600 wants to send to the artist 602.
[0038] The viewer-side input unit 214 acquires a control command linked to the stamp 700 with tactile stimulation effect input by the viewer 600, the control command including position information specifying the presentation position at which the tactile stimulation is presented by the tactile presentation device 100 and form information specifying the form of the tactile stimulation, and outputs the control command to the generation unit 218 described later.
[0039] The distributor side input unit 216 acquires, for example, sensing data acquired by a wearing state detection sensor (not shown) for detecting the wearing state of the tactile presentation device 100, and outputs it to the generation unit 218 described later.
[0040] The generating unit 218 generates a haptic control signal for controlling the haptic presentation device 100 based on a control command linked to the stamp 700 with haptic stimulation effect input from the viewer 600, and outputs the signal to the determining unit 220 described later. Specifically, based on a control command including a perceived position (position information) of the vibration stimulation, a waveform type of the vibration stimulation, and intensity information (form information) of the vibration stimulation, the generating unit 218 generates waveform data to be input to each haptic stimulation unit provided in the haptic presentation device 100 so as to present a vibration stimulation with a specified waveform at a perceived position specified by the control command, with a specified intensity. Note that the haptic control signal may include information instructing to present a vibration stimulation at the presentation timing, frequency, interval, and presentation time of the haptic stimulation based on the control command. Furthermore, if the frequency or intensity of the vibration stimulus specified in the control command has a wide band (e.g., 50 to 500 Hz), the generation unit 218 may compress it to a narrow band (e.g., 100 Hz) depending on the function of the tactile presentation device 100 to generate waveform data.
[0041] Furthermore, the generating unit 218 may adjust the haptic control signal according to the wearing state of the haptic presentation device 100 by the artist 602. For example, the generating unit 218 adjusts the haptic control signal according to the contact rate between the haptic presentation device 100 and the body of the artist 602. More specifically, the generating unit 218 adjusts the haptic stimulation unit 106 located at a position with a low contact rate so as not to present the haptic vibration. The generating unit 218 may also adjust the haptic control signal according to the attribute information (e.g., age, sex, height, weight, build, etc.) and biological information of the artist 602. For example, the generating unit 218 may adjust the perception position, intensity, etc. according to the age of the artist 602. More specifically, when the artist 602 is 6 years old, the generating unit 218 may adjust the intensity of the haptic stimulation to be presented so as to be half the intensity when the artist 602 is an adult.
[0042] Furthermore, the generating unit 218 may generate a presentation control signal (for example, a non-wearing control signal, etc.) for presenting a predetermined image or a predetermined sound to the viewer 600 or the artist 602 together with the haptic control signal. For example, the predetermined image may be a virtual object such as an icon, animation, text, etc., which is superimposed on an image of the artist 602 or an image of the real space around the artist 602, or projected onto the artist 602. More specifically, it may be a trajectory of a tip moving from the viewer 600 to the artist 602, an animation of a bomb exploding that is displayed at the same time as a haptic stimulus is presented, an icon corresponding to the stamp 700 with a haptic stimulus effect input from the viewer 600, etc. The predetermined image or predetermined sound may be, for example, an image or sound output to the viewer 600 instead of a haptic stimulus when a haptic stimulus cannot be presented to the artist 602 because the haptic presentation device 100 is not worn on the body of the artist 602.
[0043] The determination unit 220 determines whether or not to transmit the haptic control signal to the haptic presentation device 100 based on the contents of the control command or the haptic control signal, attribute information of the viewer 600 or the artist 602, and the like. For example, when a presentation position or intensity that is restricted in advance by the artist 602 is specified by a control command input from the viewer 600, the determination unit 220 determines not to transmit the haptic control signal generated based on the control command to the haptic presentation device 100. In addition, when the same presentation position is continuously specified by different viewers 600 or when continuous control commands are input from the same viewer 600, the determination unit 220 may determine not to transmit the generated haptic control signal to the haptic presentation device 100. Furthermore, in such a case, the generation unit 218 may change the presentation position of the tactile stimulation.
[0044] The output control unit 222 transmits the generated haptic control signal via the communication unit 202 to the haptic presentation device 100 worn on the body of the artist 602 .
[0045] (Storage unit 240) The storage unit 240 is realized by a storage device such as a ROM for storing programs and calculation parameters used in the processing of the control unit 210, a RAM for temporarily storing parameters that change as appropriate, and an HDD (Hard Disk Drive) for storing various databases (DB). For example, the storage unit 240 may include a viewer profile 242, a distributor profile 244, and a distribution data DB 246, as shown in FIG. 6. The viewer profile 242 and the distributor profile 244 store attribute information of the viewer 600 and the artist 602, respectively. Furthermore, the viewer profile 242 may store information on control commands previously acquired or used by the viewer 600 in association with identification information of the viewer 600, and the distributor profile 244 may store information on control commands previously transmitted by the artist 602 in association with identification information of the artist 602. The distribution data DB 246 also stores a pre-generated tactile data library (such as vibration waveform patterns) linked to the identification information of each stamp 700, and the above-mentioned generation unit 218 uses this to generate a tactile control signal. Furthermore, the distribution data DB 246 may store information such as the number of tactile stimulation units 106 of the tactile presentation device 100, their positions, frequency characteristics, maximum input voltage, etc. as profile information of the tactile presentation device 100. The generation unit 218 can adjust the tactile control signal by referring to such profile information.
[0046] Although the detailed configuration of the server 200 according to the present embodiment has been specifically described above, the detailed configuration of the server 200 according to the present embodiment is not limited to the example shown in Fig. 6. For example, the server 200 may further include a recommendation unit (not shown) that refers to the viewer profile 242 and the distributor profile 244, selects a control command that is used frequently by the viewer 600 or the artist 602, or conversely, a control command that is used less frequently, and recommends to the viewer 600 a stamp with tactile stimulating effect 700 linked to the selected control command. The recommendation unit may also recommend to the viewer 600 the stamp with tactile stimulating effect 700 recommended by the artist 602.
[0047] <2.4 Detailed configuration of the user terminal 300> Next, a detailed configuration of the user terminal 300 according to an embodiment of the present disclosure will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of a functional configuration of the user terminal 300 according to the present embodiment. As shown in Fig. 7, the user terminal 300 mainly includes a display unit 302, an operation input unit 304, a speaker 306, a communication unit (transmission unit) (price acquisition unit) 308, a control unit 310, a storage unit 312, and a sensor unit 320. Each functional block of the user terminal 300 will be described below in order.
[0048] (Display section 302) The display unit 302 can display, for example, a selection screen for selecting a stamp with tactile stimulating effect (control command) 700, an image of the artist 602, and the like, toward the viewer 600. Furthermore, the display unit 302 can superimpose text, icons, animations, and the like on the image of the artist 602. The display unit 302 is realized by a liquid crystal display device, an OLED device, or the like.
[0049] (Operation input unit 304) The operation input unit 304 receives an input of a selection result of the stamp with tactile stimulation effect 700 linked to a control command including position information specifying a presentation position at which the tactile stimulation is to be presented and form information specifying a form of the tactile stimulation by the viewer 600. Alternatively, the operation input unit 304 may directly input a control command. For example, the operation input unit 304 is realized by a switch, a button, a touch panel, a lever, or the like. Furthermore, the content of the operation input by the operation input unit 304 may be displayed by the above-mentioned display unit 302. Furthermore, the operation input unit 304 is provided so as to be superimposed on the above-mentioned display unit 302, and can receive information (e.g., position information) of an input operation from the viewer 600 on a position selection screen for specifying a presentation position displayed by the display unit 304.
[0050] (Speaker 306) The speaker 306 reproduces audio signals and the like under the control of the control unit 310, which will be described later. The speaker 306 may be provided in the user terminal 300, or may be a device separate from the user terminal 300, such as a pair of earphone speakers (not shown).
[0051] (Communication unit 308) The communication unit 308 can transmit and receive information to and from the server 200, and in particular can transmit information on the stamp with tactile stimulus effect (control command) 700 input by the viewer 600 to the server 200. The communication unit 308 can also receive information transmitted from the server 200 (e.g., information such as the price of the stamp with tactile stimulus effect (control command) 700). For example, the communication unit 308 is a communication interface having a function of transmitting and receiving data, and is realized by communication devices (not shown) such as a communication antenna, a transmission / reception circuit, and a port.
[0052] (Control unit 310) The control unit 310 is a controller of the user terminal 300, and is realized, for example, by a CPU, an MPU, or the like executing various programs stored in a ROM or the like inside the user terminal 300, using a RAM as a working area.
[0053] (Storage unit 312) The storage unit 312 is realized by a storage device such as a ROM that stores programs and calculation parameters used in the processing of the control unit 310 described above, and a RAM that temporarily stores parameters that change appropriately.
[0054] (Sensor unit 320) The sensor unit 320 can acquire sensing data related to operations (such as vibrations applied to the user terminal) from the viewer 600. For example, as shown in Fig. 7, the sensor unit 320 mainly includes a camera 322, a microphone 324, a gyro sensor 326, and an acceleration sensor 328. Note that the above-mentioned sensors are merely examples, and the present embodiment is not limited to these.
[0055] The camera 322 captures, for example, the actions of the viewer 600 and outputs the captured image to the control unit 310. The control unit 310 can extract a predetermined action by the viewer 600 from the image captured by the camera 322 and obtain a control command related to the extracted action. In detail, the camera 322 has a lens system composed of an imaging lens, an aperture, a zoom lens, a focus lens, and the like, and a drive system for performing a focus operation and a zoom operation on the lens system. The camera 322 further has a solid-state image sensor array that photoelectrically converts the imaging light obtained by the lens system to generate an imaging signal. The solid-state image sensor array may be realized by, for example, a CCD sensor array or a CMOS sensor array. The camera 322 may also include a ToF (Time of Flight) sensor (not shown). The ToF sensor can obtain depth information of the subject by, for example, irradiating an object with irradiation light having a predetermined period, detecting the reflected light reflected by the object, and detecting the phase difference or time difference between the irradiation light and the reflected light. Here, the depth information of the subject is depth information, which is one of the pieces of information on the distance from the ToF sensor to each point on the surface of the subject. By aggregating the depth information of multiple points on the surface of the subject, shape information on the uneven shape of the surface of the subject, i.e., outer shape information of the subject, can be obtained.
[0056] The microphone 324 collects the voice of the viewer 600 and outputs the collected voice information to the above-mentioned control unit 310. Then, the control unit 310 can extract a predetermined voice pattern of the viewer 600 from the voice collected by the microphone 324 and obtain a control command related to the extracted voice pattern.
[0057] The gyro sensor 326 is realized, for example, by a three-axis gyro sensor, and detects the angular velocity (rotational speed) of the movement of the user terminal 300 by the viewer 600. The acceleration sensor 328 is realized, for example, by a three-axis acceleration sensor (also called a G sensor), and detects the acceleration of the movement of the user terminal 300 by the viewer 600. In this embodiment, the sensing data from these sensors makes it possible to recognize the action performed by the viewer 600 on the user terminal 300, and further to obtain a control command related to the recognized action.
[0058] The above describes in detail the configuration of the user terminal 300 according to this embodiment. However, the detailed configuration of the user terminal 300 according to this embodiment is not limited to the example shown in FIG. 7, and may further include, for example, a vibration device (not shown) that notifies the viewer 600 by vibrating.
[0059] <2.5 Information processing method> Above, each device of the information processing system 10 according to this embodiment has been described in detail. Next, an example of the information processing method according to this embodiment will be described with reference to Figs. 8 to 12. Fig. 8 is a flow chart diagram of an example of the information processing method according to this embodiment. Also, Figs. 9 to 12 are explanatory diagrams for explaining display examples according to this embodiment. As shown in Fig. 8, the example of the information processing method according to this embodiment includes a plurality of steps from step S101 to step S106. Below, the details of each step included in the example of the information processing method according to this embodiment will be described.
[0060] First, the viewer 600 selects one stamp with tactile stimulation effect 700 from the stamps with tactile stimulation effect 700 displayed on the display unit 302 of the user terminal 300, and transmits the selected stamp 700 to the server 200. Note that in this embodiment, before transmission, the viewer 600 may tap the displayed stamp 700, for example, to reproduce a tactile stimulation corresponding to a control command linked to the stamp 700. In this case, for example, the user terminal 300 vibrates in response to the tactile stimulation.
[0061] Then, the server 200 acquires information on the tactile stimulus effect-added stamp 700 associated with the control command selected by the viewer 600 and transmitted from the user terminal 300 (step S101).
[0062] Next, the server 200 refers to the distribution data DB 246 and the like to acquire position information that is included in the control command linked to the acquired stamp 700 and that specifies the presentation position at which the tactile stimulus is to be presented (step S102).
[0063] Furthermore, the server 200 refers to the distribution data DB 246 and the like to acquire form information that specifies the form of the tactile stimulation, which is included in the control command linked to the acquired stamp 700 (step S103).
[0064] Then, the server 200 generates waveform data as a haptic control signal for controlling the haptic presentation device 100 based on the position information and shape information acquired in the above-mentioned steps S102 and S103 (step S104).
[0065] Next, the server 200 determines whether or not to transmit the generated haptic control signal to the haptic presentation device 100 based on, for example, attribute information of the artist 602 (NG determination) (step S105).
[0066] Then, if the server 200 determines in the above-mentioned step S105 to transmit the haptic control signal to the haptic presentation device 100, it transmits the generated haptic control signal to the haptic presentation device 100 worn on the body of the artist 602 (step S106), and ends the process. On the other hand, if the server 200 determines in the above-mentioned step S105 not to transmit the haptic control signal to the haptic presentation device 100, it may notify the viewer 600 via the user terminal 300 that the signal will not be transmitted.
[0067] The artist 602 then perceives the tactile stimulus presented via the tactile presentation device 100 and takes action. The viewer 600 can confirm in real time the action of the artist 602 induced by the tactile stimulus presented by the stamp 700 that the viewer 600 sent. If the viewer 600 can confirm in real time the action induced by the tactile stimulus related to the stamp 700 that the viewer sent, the viewer 600 can feel as if he or she is in direct contact with the artist 602 and can obtain a sense of unity with the artist 602.
[0068] In this embodiment, the tactile stimulus is not only presented by the tactile presentation device 100 attached to the body of the artist 602, but also, for example, as shown in FIG. 9, the display 800 may be displayed on the display unit 302 of the user terminal 300 in a superimposed manner on the image of the artist 602. In this case, it is preferable that the display 800 is displayed in a superimposed manner at the position where the tactile stimulus is presented. In addition, in this embodiment, the display 800 may have a design corresponding to the design of the stamp 700 with tactile stimulus effect selected by the viewer 600. For example, if the stamp 700 has a design of punching a heart, the display 800 may also have a design of punching a heart. Furthermore, in this embodiment, when the tactile stimulus is presented, the displayed image may be swayed up and down and left and right in accordance with the tactile stimulus on the display unit 302 of the user terminal 300. Furthermore, in this embodiment, when a tactile stimulus is presented by the tactile presentation device 100 worn on the body of the artist 602, the user terminal 300 of the viewer 600 who sent the corresponding tactile stimulus may be vibrated, or the user terminals 300 of the artist 602 and other viewers 600 present around the viewer 600 may also be vibrated.
[0069] Furthermore, in this embodiment, when the generated haptic control signal is transmitted to the haptic presentation device 100, an icon (predetermined icon) 806 such as a coin and a trajectory 808 of the icon 806 moving from the viewer 600 to the artist 602 may be displayed on the display unit 302 of the user terminal 300 or on the display unit (not shown) of the monitor 110, as shown in Fig. 10. By displaying such a trajectory 808, the viewer 600 can realize that the stamp 700 that he or she sent is being transmitted to the artist 602.
[0070] In addition, in this embodiment, as shown in FIG. 11, a comment 810 input by the artist 602 who perceived the above-mentioned tactile stimulation, for example, via a broadcaster terminal (not shown), may be displayed on the display unit 302 of the user terminal 300, etc.
[0071] Furthermore, in this embodiment, if the artist 602 is not wearing the tactile presentation device 100, the server 200 may stop transmitting the tactile control signal, and in this case, may transmit the tactile control signal when it is newly detected that the artist 602 is wearing the tactile presentation device 100. If the transmission of the tactile control signal is stopped, a notification 804 indicating the stoppage may be displayed on the display unit 302 of the user terminal 300, for example, as shown in Fig. 12, or the user terminal 300 may be vibrated to notify the user.
[0072] In this embodiment, when the artist 602 is not wearing the tactile presentation device 100, an animation that gives the impression that a tactile stimulus has been presented to an avatar 802 that replaces the artist 602 in response to the above-mentioned worn-time control signal may be displayed on the display unit 302 of the user terminal 300, as shown in Fig. 12. In this case, it is preferable that the display 800 is superimposed on the position on the avatar 802 that corresponds to the position where the tactile stimulus is presented.
[0073] As described above, according to this embodiment, the tactile stimulus corresponding to the stamp 700 with tactile stimulus effect selected by the viewer 600 can be presented to the artist 602. In this embodiment, if the artist 602 perceives the presented tactile stimulus and takes an action, the viewer 600 can confirm in real time the action induced by the tactile stimulus presented by the stamp 700 that the viewer 600 sent. According to this embodiment, if the viewer 600 can confirm in real time the action induced by the tactile stimulus related to the stamp 700 that the viewer sent, the viewer 600 can feel as if he or she is directly interacting with the artist 602, that is, a real-time, interactive, and highly value-added experience can be obtained.
[0074] <2.6 Modifications> Furthermore, in this embodiment, if the viewer 600 is wearing the haptic presentation device 100, the artist 602 may "throw it back," that is, may present the viewer 600 with a haptic stimulus corresponding to the stamp 700 with haptic stimulus effect selected by the artist 602. According to this modification, when the haptic stimulus presented by the stamp 700 sent by the viewer 600 is used as a starting point and the artist 602 returns the haptic stimulus to the viewer 600, the viewer 600 can feel as if he or she is directly communicating with the artist 602.
[0075] In this modification, for example, similarly to the above-described first embodiment, when the artist 602 selects and transmits the stamp 700 with tactile stimulation effect, the tactile stimulation is also presented to the viewer 600 by the tactile presentation device 100 of the viewer 600. In detail, in this modification, the server 200 acquires the stamp 700 with tactile stimulation effect input from the artist 602, generates a tactile control signal in response to a control command linked to the acquired stamp 700, and transmits the generated tactile control signal to the tactile presentation device 100 worn on the body of the viewer 600.
[0076] In addition, in this modified example, when the artist 602 "throws back," if the viewer 600 is not wearing the haptic presentation device 100 on his or her body, the user terminal 300 may be used instead of the haptic presentation device 100 .
[0077] In this modification, for example, the server 200 controls the user terminal 300 to output sound, vibrate, blink, or the like in response to a control command linked to the stamp 700 with tactile stimulation effect input from the artist 602. In detail, in this case, in this modification, the server 200 acquires the stamp 700 with tactile stimulation effect input from the artist 602, generates a control signal for the user terminal based on the control command linked to the acquired stamp 700 and function information (attribute information) of the user terminal 300, and transmits the generated control signal for the user terminal to the user terminal 300.
[0078] <<3. Second embodiment>> In the above-described first embodiment, the viewer 600 inputs a control command by selecting the stamp 700 associated with a predetermined control command, but the embodiment of the present disclosure is not limited to such a form. For example, the viewer 600 can freely edit the tactile stimulus (control command) itself. In this way, if the viewer 600 can freely edit the tactile stimulus, for example, the viewer 600 can check in real time the action of the artist 602 induced by the tactile stimulus edited by the viewer 600, and can feel as if he or she is in direct contact with the artist 602. Therefore, an embodiment of such an editing method will be described below as a second embodiment with reference to Figs. 13 and 14. Figs. 13 and 14 are explanatory diagrams for explaining a display example according to the second embodiment of the present disclosure.
[0079] First, the viewer 600 can input position information specifying a perception position where a tactile stimulus is to be presented by performing an operation on a position selection screen displayed on the display unit 302 of the user terminal 300 as shown in FIG. 13. In detail, as shown in FIG. 13, a human body model display 812 is displayed on the position selection screen, and a plurality of areas 814 are displayed at a position corresponding to the tactile stimulus unit 106 of the tactile presentation device 100 on the human body model display 812. The viewer 600 can set and input a perception position by aligning a marker 816 with the area 814 of a perception position to be selected. Note that in this embodiment, the present invention is not limited to setting and inputting a perception position by pinpointing, and for example, a movement path of the perception position may be set and input by tracing the human body model display 812, or a perception range having a predetermined width may be set and input. Then, the viewer-side input unit 214 of the server 200 acquires the position information inputted on the position selection screen.
[0080] In this embodiment, even if the installation locations and number of the tactile stimulation units 106 are limited, the tactile stimulation can be presented at the desired perception position of the viewer 600 by the following principle. In detail, an illusion phenomenon called phantom sensation is medically known. Phantom sensation is an illusion phenomenon in which, when stimuli are simultaneously presented to different positions on the skin, a human being perceives only one stimulus between the presented stimulation positions. Therefore, in this embodiment, by utilizing such phantom sensation, for example, when two tactile stimulation units 106 are caused to simultaneously present a tactile stimulation, the position of the perceived tactile stimulation can be the position between the two tactile stimulation units 106. In addition, in this embodiment, by changing the output intensity of the multiple tactile stimulation units 106, the range of tactile stimulation that can be presented by the multiple tactile stimulation units 106 can be expanded without changing the arrangement interval of the individual tactile stimulation units 106.
[0081] In addition, in this embodiment, the setting input is not limited to the position selection screen as shown in Fig. 13. For example, if a vest-type sensor (first sensor) similar to the tactile presentation device 100 is attached to the body of the viewer 600 and the sensor can detect a touch operation by the viewer 600, the viewer 600 may input the setting of the perceived position by operating the sensor. Then, the viewer-side input unit 214 of the server 200 acquires the position information input to the sensor. In addition, the sensor is not limited to being attached to the body of the viewer 600, and may be attached to, for example, a doll (not shown).
[0082] Furthermore, in this embodiment, the waveform type, intensity, presentation timing, frequency, interval, presentation time, etc. of the vibration stimulation can also be edited and set. For example, by performing an operation on an editing screen (form selection screen) displayed on the display unit 302 of the user terminal 300 as shown in FIG. 14, the waveform type, intensity, presentation timing, frequency, interval, presentation time, etc. of the tactile stimulation can be edited. In detail, as shown in FIG. 14, a waveform 826 is displayed on the time axis on the editing screen, and the viewer 600 can edit the waveform 826 by performing an operation on the waveform 826. Furthermore, a cursor, etc. is displayed on the editing screen, and the viewer 600 can set the intensity, frequency, etc. of the tactile stimulation by moving the cursor 824 (FIG. 14 shows an editing screen where, for example, the speed at which the stamp 700 with tactile stimulation effect is thrown and the frequency of the tactile stimulation can be set). Then, the viewer-side input unit 214 of the server 200 acquires the form information inputted on the form selection screen.
[0083] In this embodiment, the range of values that can be edited by the viewer 600 may be set in advance based on the attribute information of the artist 602. For example, a wide range of values may be set for the intensity for a male artist 602, whereas a narrow range of values may be set for the intensity for a female artist 602.
[0084] Furthermore, the perception sensitivity differs depending on the position on the body, and also differs for each individual. Therefore, in this embodiment, data (e.g., sensitivity coefficient) indicating the perception sensitivity for each position on the body of the artist 602 is stored as the distributor profile 244, and the generation unit 218 refers to the information in the distributor profile 244 and appropriately adjusts the intensity set by the viewer 600 according to the artist 602. In this way, it is possible to prevent the tactile stimulation edited by the viewer 600 from causing discomfort to the artist 602.
[0085] In addition, in this embodiment, the viewer 600 can set a control command so that a haptic stimulus is presented when a predetermined condition is satisfied. For example, when a predetermined time specified in the control command is reached, when the artist 602 utters a predetermined keyword (for example, the utterance of the artist 602 is detected by a microphone provided in the haptic presentation device 100), when the artist 602 performs a predetermined action (for example, the action of the artist 602 is detected by the camera 120), etc., the server 200 may distribute a haptic control signal related to the control command to the haptic presentation device 100. The above-mentioned predetermined condition can be set, for example, by the viewer 600. Furthermore, in this embodiment, the viewer 600 can also set the shape, size, display speed, animation display speed, etc. of a virtual object displayed when a haptic stimulus is presented.
[0086] In addition, in this embodiment, tactile stimuli can be edited and set not only by operating the position selection screen, editing screen, etc. as described above, but also by using, for example, various sensors (second sensors) or other devices built into the user terminal 300.
[0087] In this embodiment, for example, the viewer 600 may edit the waveform, intensity change, etc. of the tactile stimulation by performing a touch operation such as applying vibration to the user terminal 300, or a motion operation such as changing the holding angle. In detail, in this embodiment, the motion operation is detected by the gyro sensor 326 and the acceleration sensor 328 built into the user terminal 300, and the detected sensing data is acquired by the viewer-side input unit 214 of the server 200. Furthermore, the generation unit 218 of the server 200 generates a waveform, etc. based on the acquired sensing data.
[0088] More specifically, for example, the viewer 600 causes the gyro sensor 326 and the acceleration sensor 328 built in the user terminal 300 to detect a motion with a predetermined rhythm. The server 200 then sets the frequency of the tactile stimulation based on the rhythm extracted from the sensing data detected by the gyro sensor 326 and the acceleration sensor 328. Also, for example, the viewer 600 utters a voice with a predetermined rhythm to the user terminal 300, and causes the microphone (sound sensor) 324 built in the user terminal 300 to detect the utterance. The server 200 then sets the frequency of the tactile stimulation using the sensing data detected by the microphone 324. Also, for example, the viewer 600 causes the camera (imaging device) 322 built in the user terminal 300 to capture his / her own motion. The server 200 may then analyze the captured image obtained by the camera 322 to extract a predetermined motion, and generate waveform data of the tactile stimulation by using the extracted motion.
[0089] In this embodiment, a part of the body may be captured by the camera 322 built into the user terminal 300, and the server 200 may set the perceived position according to the position included in the captured image. In this case, the location on the body may be identified based on external shape information from a ToF sensor (not shown) included in the camera 322. Furthermore, at this time, the intensity of the tactile stimulation may be set according to the angle of view of the captured image. For example, if the angle of view is narrow, the intensity is set high, and if the angle of view is wide, the intensity is set low. Furthermore, if the camera 322 captures the hand of the viewer 600 moving on a part of the viewer 600's body (for example, the arm), the perceived position may be set to the arm.
[0090] In addition, in this embodiment, the setting terminal is not limited to the user terminal 300, but may also be an electronic musical instrument having a MIDI (Musical Instrument Digital Interface), a turntable, a game interface (stick type, etc.), etc.
[0091] When multiple viewers 600 are attempting to edit or input data at the same time, the server 200 may restrict the viewers 600 to edit or input data sequentially, or may restrict the viewers 600 to edit or input data sequentially according to the order in which the viewers 600 started editing or the order in which they paid. The server 200 may also notify the viewers 600 who are waiting their turn to edit or input data of the time remaining until their turn (see FIG. 16).
[0092] Furthermore, the server 200 may refer to the information in the distributor profile 244 and, when it is determined (NG determination) that the haptic stimulus edited by the viewer 600 is a haptic stimulus that the artist 602 refuses to receive or is similar thereto, stop transmitting the haptic control signal. In this case, the server 200 may notify the relevant viewer 600 or an administrator of the information processing system 10, etc., that the haptic stimulus edited by the viewer 600 corresponds to a haptic stimulus that the artist 602 refuses to receive, or may refund the relevant viewer 600. Alternatively, in such a case, the server 200 may adjust the perceived position, intensity, etc. so that the haptic stimulus edited by the viewer 600 does not correspond to a haptic stimulus that the artist 602 refuses to receive.
[0093] In addition, in this embodiment, if the viewer 600 wishes to check the tactile stimulus that he or she has edited, the viewer 600 may check it himself or herself before transmitting it to the tactile presentation device 100 worn by the artist 602 .
[0094] For example, when the tactile presentation device 100 is attached to the body of the viewer 600, the server 200 transmits to the tactile presentation device 100 the same tactile control signal as the tactile control signal related to the edited tactile stimulus, so that the viewer 600 can confirm the tactile stimulus via the tactile presentation device 100 attached to the viewer 600. When the tactile presentation device 100 is not attached to the body of the viewer 600, the viewer 600 may confirm the tactile stimulus using the user terminal 300. In this case, the server 200 generates a control signal (user terminal control signal) corresponding to the tactile control signal related to the edited tactile stimulus based on the function information (attribute information) of the user terminal 300, and transmits the control signal to the user terminal 300. Then, the user terminal 300 can output sound from the speaker (sound output device) 306, blink light on the display unit (blinking device) 302, or vibrate a vibration device (not shown) in response to the transmitted control signal, so that the viewer 600 can confirm the tactile stimulus.
[0095] Furthermore, in this embodiment, the tactile stimulation edited by the viewer 600 may be exchanged between a plurality of viewers 600 as a stamp 700 with a tactile stimulation effect.
[0096] <<4. Third embodiment>> Incidentally, as shown in FIG. 15, which is an explanatory diagram for explaining the third embodiment of the present disclosure, there are cases where stamps 700 with tactile stimulating effects are sent from multiple viewers 600 to one artist 602 at the same time. In such a case, if multiple tactile stimuli are presented to the artist 602 at the same time in response to the stamps 700 sent at the same time, the artist 602 will feel uncomfortable due to the multiple tactile stimuli. Furthermore, if tactile stimuli are given at the same time, the artist 602 cannot perceive them individually and cannot take action for each tactile stimuli. As a result, it becomes difficult for the viewer 600 to feel as if he or she is directly interacting with the artist 602 through the tactile stimuli from the stamps 700 sent by the viewer 600.
[0097] Therefore, in the third embodiment of the present disclosure, in order to avoid the above-mentioned discomfort and the situation where individual tactile stimuli cannot be perceived, when a plurality of stamps 700 with tactile stimulus effect are simultaneously transmitted from a plurality of viewers 600, the processing according to this embodiment will be described with reference to Figs. 16 to 20. Fig. 16 is an explanatory diagram for explaining a display example according to the third embodiment of the present disclosure, and Figs. 17 to 20 are explanatory diagrams for explaining the third embodiment of the present disclosure.
[0098] For example, in this embodiment, as shown in FIG. 17, when a plurality of control commands 702 (or stamps 700) are transmitted from a plurality of viewers 600, the server 200 temporarily stores these control commands 702, sequentially processes the control commands 702 in the input order (predetermined rule), generates a haptic control signal, and transmits it to the haptic presentation device 100. Note that in this embodiment, when a plurality of control commands 702 are transmitted from a plurality of viewers 600, the server 200 may temporarily stop acquiring the plurality of control commands 702, and acquire the control commands 702 in the input order. In such a case, as shown in FIG. 16, the server 200 may display a display 818 notifying the viewer 600 who is waiting his / her turn of the time remaining until his / her turn via the display unit 302 of the user terminal 300.
[0099] In this manner, in this embodiment, tactile stimuli are presented to artist 602 in sequence, which prevents artist 602 from feeling uncomfortable, and since artist 602 can perceive the tactile stimuli individually, he or she can take action in response to each tactile stimuli.
[0100] Furthermore, in this embodiment, as shown in FIG. 18, when the server 200 acquires a plurality of control commands 702 (or stamps 700) within a predetermined time, the server 200 may adjust, for example, the intensity of the tactile stimulus according to the number of acquired control commands 702, generate a tactile control signal as one tactile stimulus, and transmit it to the tactile provision device 100. For example, the server 200 increases the intensity of the tactile stimulus as the number of acquired identical control commands 702 (e.g., the same perceived position and waveform type) increases. Furthermore, rather than simply increasing the intensity according to the number of acquired control commands 702, an upper limit on the intensity may be set or the intensity may be subtracted in consideration of the burden on the artist 602, etc.
[0101] In addition, in this embodiment, the server 200 may change the waveform of the tactile stimulation, adjust the presentation time, or adjust the perceived position according to the number of acquired control commands 702, and is not particularly limited. Furthermore, in this embodiment, for example, the server 200 may adjust to one perceived position based on the perceived positions specified in the successively acquired control commands 702, and generate a tactile control signal as one tactile stimulation. More specifically, when the right shoulder and the left shoulder are specified as the perceived positions in the successively acquired control commands 702, the server 200 sets the neck between the right shoulder and the left shoulder as the perceived position in the generated tactile control signal.
[0102] In this embodiment, as shown in FIG. 19, the server 200 may process the control commands 702 (or stamps 700) in an order (predetermined rule) according to the amount paid by the viewer 600 when the control commands 702 (or stamps 700) are input. For example, the server 200 processes the control commands 702 with a higher amount paid when the control commands 702 are input. In other words, since this is like buying priority for the viewer 600 in interacting with the artist 602, the viewer 600 who wants to interact with the artist 602 quickly will pay a larger amount. In other words, by setting such an order of processing, the viewer 600 can be motivated to pay a higher amount.
[0103] 20, in this embodiment, when the server 200 acquires a plurality of identical control commands 702 (or stamps 700) within a predetermined time, the server 200 may, for example, sequentially increase the intensity of the presented tactile stimulus according to the order of the acquired control commands 702. In this way, cooperation, i.e., interaction, between a plurality of viewers 600 can be promoted, and an experience with higher added value can be obtained.
[0104] In addition, in this embodiment, the server 200 may adjust the haptic stimulation according to the synchronicity of the transmission of the multiple control commands 702 (or stamps 700) from the multiple viewers 600. More specifically, when the control commands 702 with the same content are transmitted synchronously from the multiple different viewers 600 (so-called execution of a "mission" by the multiple viewers 600), the server 200 may adjust the intensity of the haptic stimulation according to the degree of synchronicity. Furthermore, in this embodiment, the server 200 may generate and transmit a haptic control signal only when the number of the control commands 702 with the same content acquired from the multiple different viewers 600 exceeds a predetermined number (predetermined condition). Alternatively, the server 200 may generate and transmit a haptic control signal only when the types of the multiple control commands 702 acquired from the multiple different viewers 600 are a predetermined type.
[0105] Furthermore, in this embodiment, if control commands 702 (or stamps 700) specifying a plurality of identical perception positions are continuously acquired within a predetermined time period, and are presented as a plurality of tactile stimuli to the artist 602, the artist 602 will feel discomfort due to the plurality of tactile stimuli. Therefore, in this embodiment, the server 200 (more specifically, the viewer-side input unit 214) may be configured to accept and process only control commands 702 specifying perception positions that are a predetermined distance away from the perception position presented immediately before.
[0106] In addition, in this embodiment, for example, when a plurality of control commands 702 (or stamps 700) are transmitted from a plurality of viewers 600, the server 200 basically acquires the control commands 702 in the order of input, but if the amount of the next control command 702 to be acquired (the amount paid when the control command 702 is input) is equal to or greater than a predetermined amount, the server 200 may interrupt the processing of the previously acquired control command 702 and prioritize the processing of the next control command 702 that is equal to or greater than the predetermined amount. Alternatively, in this embodiment, when a plurality of control commands 702 (or stamps 700) are transmitted from a plurality of viewers 600, the server 200 basically acquires the control commands 702 in the order of input, but may compare the amount of the previous control command 702 with the amount of the next control command 702, and if the amount of the next control command 702 is equal to or lower than the previous control command 702, proceed with the processing of the previous control command 702.
[0107] Furthermore, in this embodiment, if the amount of the next control command 702 is higher than that of the previous control command 702, the server 200 may interrupt the processing of the previously acquired control command 702 and give priority to processing the next control command 702. In addition, in this embodiment, if a control command 702 (the next control command 702) that is more expensive than the next control command 702 is transmitted during processing of the next control command 702, the server 200 may interrupt the processing of the next control command 702 and give priority to processing the next control command 702.
[0108] <<5. Fourth embodiment>> Furthermore, in the fourth embodiment of the present disclosure, the price of the stamp 700 with tactile stimulation effect may be dynamically determined according to the contact rate between the tactile presentation device 100 and the body of the artist 602, the perception position, attribute information of the viewer 600 or the artist 602, etc. In this embodiment, by determining the price of the stamp 700 according to such conditions, the price of the stamp 700 is determined according to the value of the experience felt by the viewer 600, and therefore, the viewer 600 can feel a sense of satisfaction and satisfaction regarding the purchase of the stamp 700.
[0109] <5.1 Detailed configuration of server 200a> First, a detailed configuration example of the server 200a according to this embodiment will be described with reference to Fig. 21. Fig. 21 is a diagram showing a functional configuration example of the server 200a according to this embodiment. As shown in Fig. 21, the server 200a mainly includes a communication unit 202, a control unit 210a, and a storage unit 240a, similar to the first embodiment described above. Below, each functional block of the server 200a will be described in order, but since the communication unit 202 is common to the first embodiment, its description will be omitted here.
[0110] (Control unit 210a) The control unit 210a is a controller, and as shown in Fig. 21, similar to the first embodiment, includes a GUI control unit 212, a viewer side input unit 214, a distributor side input unit 216 (not shown in Fig. 21), a generation unit 218, an output control unit (first distribution unit) 222, and further includes a price determination unit 224 and a settlement unit 226. Note that the GUI control unit 212, the viewer side input unit 214, the distributor side input unit 216, the generation unit 218, and the output control unit 222 are common to the first embodiment, so their explanations are omitted here, and only the price determination unit 224 and the settlement unit 226 will be explained.
[0111] ~Price Determination Department 224~ The price determination unit 224 determines the price of the stamp 700 (or the input of the control command 702) based on the position information and form information included in the control command 702 linked to the acquired stamp 700, the contact rate between the tactile presentation device 100 and the body of the artist 602 acquired from the distributor side input unit 216 (not shown in FIG. 21), or attribute information of the viewer 600 or the artist 602 acquired from the storage unit 240a. At this time, the price determination unit 224 may determine the price by referring to information in a price data DB 248 stored in the storage unit 240a, which will be described later.
[0112] ~Payment Department 226~ For example, when the settlement unit 226 receives a settlement instruction from the user terminal 300 via the communication unit 202, it performs settlement for the purchase of the stamp 700 (or for the input of the control command 702) based on the price determined by the price determination unit 224.
[0113] (Storage unit 240a) As shown in FIG. 21, similar to the first embodiment, the memory unit 240a includes a viewer profile 242, a distributor profile 244, and a distribution data DB 246, and further includes a price DB 248 that stores information used to determine the price of the stamp 700 (or in response to input of the control command 702).
[0114] The above describes a specific example of the detailed configuration of the server 200a according to this embodiment. However, the detailed configuration of the server 200a according to this embodiment is not limited to the example shown in FIG. 21. For example, the server 200a may further include a determination unit 220, as in the first embodiment.
[0115] <5.2 Information processing method> The server 200a according to this embodiment has been described above. Next, an example of an information processing method according to this embodiment will be described with reference to FIG. 22. FIG. 22 is a flow chart of an example of the information processing method according to this embodiment. As shown in FIG. 22, the information processing method according to this embodiment includes a plurality of steps from step S201 to step S208. Each step included in the information processing method according to this embodiment will be described in detail below.
[0116] First, the viewer 600 selects one stamp with tactile stimulation effect 700 from the stamps with tactile stimulation effect 700 displayed on the display unit 302 of the user terminal 300, and transmits the selected stamp 700 to the server 200a. Then, the server 200a acquires information on the stamp with tactile stimulation effect 700 associated with the control command 702 selected by the viewer 600 and transmitted from the user terminal 300, similar to step S101 in the first embodiment (step S201).
[0117] Next, the server 200a refers to the information in the price data DB 248 and determines the price of the stamp 700 according to the position information and form information included in the acquired control command 702, the contact rate between the haptic presentation device 100 and the body of the artist 602, or attribute information of the viewer 600 or the artist 602 (step S202). Details of price determination will be described later as an embodiment.
[0118] Then, when the server 200a receives a payment instruction from the user terminal 300, the server 200a performs payment for the purchase of the stamp 700 based on the price determined in the above-mentioned step S202 (step S203). At this time, it is preferable that the server 200a notifies the viewer 600 as to whether or not the payment process is successful.
[0119] Next, the server 200a performs the processes from step S204 to step S208, which are similar to steps S102 to S106 in the first embodiment shown in Fig. 8, and therefore will not be described here. Note that in this embodiment, the payment process in step S203 may be performed only when it is determined that the generated tactile control signal is to be transmitted to the tactile presentation device 100 after performing step S207 (NG judgment) in Fig. 22, i.e., the steps do not have to be performed in the order shown in Fig. 22.
[0120] <5.3 Example> This embodiment has been described above. Next, with reference to Figs. 23 to 25, examples of this embodiment will be described in more detail while showing specific examples. Figs. 23 to 25 are explanatory diagrams for explaining display examples according to the examples of this embodiment. Note that the examples shown below are merely examples of this embodiment, and this embodiment is not limited to the following examples.
[0121] Example 1 However, depending on the body type of the artist 602, the contact between the tactile stimuli unit 106 of the tactile presentation device 100 and the body of the artist 602 may be poor, and the tactile stimuli may not be presented as intended by the viewer 600. If the tactile stimuli presented as intended and the tactile stimuli not presented as intended are set at the same price, it is considered that the viewer 600 may feel a sense of unfairness. Therefore, in this embodiment, in order to avoid such a sense of unfairness, the tactile stimuli presented as intended and the tactile stimuli not presented as intended are set at different prices. In detail, in this embodiment, the server 200a determines the price of the stamp 700 (or the price for the input of the control command 702) based on the sensing data of a wearing state detection sensor (e.g., a fastener-type sensor, a pressure sensor, etc.) (not shown) for detecting the wearing state provided in the tactile presentation device 100. For example, when the control command 702 linked to the selected stamp 700 includes an instruction to use the tactile stimulation unit 106 that has a high contact rate with the body of the artist 602, the server 200a sets a high price for the stamp 700. On the other hand, when the control command 702 includes an instruction to use the tactile stimulation unit 106 that has a low contact rate with the body of the artist 602, the server 200a sets a low price for the stamp 700. Note that in this embodiment, the sensing data of the wearing state detection sensor can be taken into the server 200a, for example, when it is triggered by detection that the artist 602 has worn the tactile provision device 100.
[0122] Example 2 In this embodiment, the server 200a determines the price of the stamp 700 related to the tactile stimulus presented at each perception position according to the difference in perception sensitivity for each perception position, since there are perception positions with high perception sensitivity for the tactile stimulus and perception positions with low perception sensitivity for each artist 602. For example, when the control command 702 linked to the selected stamp 700 includes an instruction to use the tactile stimulus unit 106 at the perception position with high perception sensitivity, the server 200a sets the price of the stamp 700 high. On the other hand, when the control command 702 includes an instruction to use the tactile stimulus unit 106 at the perception position with low perception sensitivity, the server 200a sets the price of the stamp 700 low. Therefore, in this embodiment, the server 200a stores an index or the like indicating the perception sensitivity for each perception position of the artist 602 as the distributor profile 244, and determines the price of the stamp 700 (or the price for the input of the control command 702) based on the stored index. Furthermore, in this embodiment, the price is not limited to being determined according to the perception sensitivity, but may be determined according to, for example, the popularity (which can be estimated from the frequency of selection, etc.) of the stamp 700 or tactile stimulus (waveform, perception position, etc.) among the viewers 600 and the artist 602, and is not particularly limited.
[0123] Example 3 In this embodiment, the server 200a determines the price of the stamp 700 (or the input of the control command 702) according to the attribute information of the viewer 600 (for example, purchase history, membership rank, membership course, etc.). For example, in this embodiment, the server 200a associates the amounts paid by the viewer 600 when purchasing the stamp 700 with the identification information of the viewer 600 and stores them as the viewer profile 242, and determines the price of the stamp 700 (or the input of the control command 702) to be newly purchased by the viewer 600 based on the total amount stored. In this embodiment, the server 200a may set the purchase price of the stamp 700 lower the more the viewer 600 has paid up to now, or conversely, may set the purchase price of the stamp 700 higher. In this embodiment, the price is not limited to being determined according to the amount of purchases made to date, and may be determined according to, for example, a membership rank set according to the amount of purchases made to date or a membership course (for example, a trial course, a new membership course, an advanced course, etc.) to which the viewer 600 joins before purchasing the stamp, and is not particularly limited. At this time, the server 200a may cause the display unit 302 of the user terminal 300 to display a screen as shown in Fig. 23 as a selection screen for the stamp 700. For example, the screen displays the price of the stamp 700, the membership rank of the viewer 600, and purchase points to be given to the viewer 600 according to his or her purchase history.
[0124] In addition, in this embodiment, the range of the waveform type, intensity, perceived position, etc. of the tactile stimulus that the viewer 600 can select may be determined not only according to the price but also according to the attribute information of the viewer 600 (e.g., purchase history, membership rank, membership course, etc.). For example, the server 200a sets the upper limit of the selectable tactile stimulus to be higher as the amount of money paid by the viewer 600 so far increases. Furthermore, in this embodiment, the server 200a may set the order in which the stamp 700 can be transmitted to be prioritized not only according to the selectable range but also according to the attribute information of the viewer 600. For example, the server 200a may set the order in which the stamp 700 can be transmitted to be prioritized as the amount of money paid by the viewer 600 so far increases. At this time, the server 200a may display a screen as shown in FIG. 24 on the display unit 302 of the user terminal 300 as a selection screen for the stamp 700. In the screen, for example, a button for upgrading the position or order is displayed, and when the viewer 600 operates the button for upgrading the position, the screen transitions to a position selection screen as shown in FIG. 25. In the position selection screen, a human body model display 812 is displayed, and an area 814 corresponding to the tactile stimulation unit 106 that the viewer 600 can select is displayed on the human body model display 812, and the price is also displayed. The viewer 600 can select a desired tactile position by operating the area 814 while checking the price. As described above, in the above-mentioned embodiment, for example, a mechanism can be provided that gives preferential treatment to the viewer 600 who has purchased many stamps 700 or paid a large amount, and therefore the willingness to purchase the stamps 700 can be further promoted.
[0125] <<6. Fifth embodiment>> Furthermore, in this embodiment, the stamps 700 with tactile stimulating effects can be exchanged between a plurality of viewers 600 and can be collected, thereby further increasing the desire to purchase the stamps 700.
[0126] In detail, in this embodiment, for example, during the distribution of the performance video of the artist 602, the selection screen of the stamp 700 with the tactile stimulating effect and the stamp 700 itself are automatically distributed to the user terminal 300 of the viewer 600. Then, the viewer 600 is prompted to send the stamp 700 to the artist 602 during the distribution. In addition, the stamp 700 with the tactile stimulating effect that is scarce and not normally distributed (so-called "rare stamp") may be distributed to the viewer 600 by limiting the place and date (for example, limiting the date and time when the artist is performing at a live venue). In this way, the viewer 600 will visit the live venue, for example, in order to obtain the rare stamp 700, and the live venue's ability to attract customers can be improved. Note that the rare stamp may be automatically acquired by the viewer 600 by connecting to the communication network during the distribution, or may be acquired by carrying out a process such as a purchase procedure, and is not particularly limited.
[0127] Furthermore, the stamps 700 with tactile stimulating effects acquired through such a stamp selection screen may be exchanged among a plurality of viewers 600 through a social networking service (SNS), or the number and types of stamps 700 collected may be made public as rankings. For example, in this embodiment, the server 200 stores information on the stamps 700 acquired by the viewer 600 so far as a viewer profile 242, linking them to the identification information of the viewer 600. Also, in this embodiment, when the server 200 has collected a predetermined type of stamps 700 with tactile stimulating effects (when a predetermined condition is satisfied), the server 200 may give the viewer 600 a new stamp 700 with tactile stimulating effects (for example, a "rare stamp"). In this way, the viewer 600 will collect and purchase a predetermined type of stamps because he or she wants a rare stamp 700, and this can further increase the viewer's desire to purchase the stamps 700.
[0128] <<7. Sixth embodiment>> Furthermore, in this embodiment, by providing a game-like element, it is possible to further increase the desire to purchase the stamp 700 with the tactile stimulus effect.
[0129] <7.1 Detailed configuration of server 200b> First, a detailed configuration of the server 200b according to this embodiment will be described with reference to FIG. 26. FIG. 26 is a diagram showing an example of a functional configuration of the server 200b according to this embodiment. As shown in FIG. 26, the server 200b mainly includes a communication unit 202, a control unit 210b, and a storage unit 240a, similar to the first and fourth embodiments described above. Below, each functional block of the server 200b will be described in order, but since the communication unit 202 and the storage unit 240a are common to the first and fourth embodiments, their description will be omitted here.
[0130] (Control unit 210b) 26, the control unit 210b is a controller, and similarly to the first embodiment, includes a GUI control unit 212, a viewer side input unit 214, a distributor side input unit 216, a generation unit 218, and an output control unit (first distribution unit) 222, and further includes a point giving unit 228. Note that the GUI control unit 212, the viewer side input unit 214, the distributor side input unit 216, the generation unit 218, and the output control unit 222 are common to the first embodiment, so their explanations are omitted, and only the point giving unit 228 will be explained below.
[0131] ~Points Assignment Department 228~ The point allocating unit 228 acquires an evaluation of the tactile stimulus input by the artist 602 who perceived the tactile stimulus via the distributor side input unit 216, and awards points to the viewer 600 in accordance with the acquired evaluation. The awarded points are linked to the identification information of the viewer 600 and stored in the viewer profile 242 in the storage unit 240a.
[0132] <7.2 Implementation form> The server 200b according to this embodiment has been described above. Next, this embodiment will be described with reference to Fig. 27 and Fig. 28. Fig. 27 and Fig. 28 are explanatory diagrams for explaining a display example according to this embodiment.
[0133] Here, for example, a game is assumed in which two viewers 600 throw (send) stamps 700 with tactile stimulating effects at one artist 602 and compete for their evaluation. First, the artist 602 evaluates the tactile stimulation caused by the thrown stamps 700, and the server 200b grants points to each viewer 600 according to the evaluation. Furthermore, the server 200b may determine whether the two viewers 600 win or lose according to the number of points granted, and may display a screen such as that shown in FIG. 27 on the display unit 302 of the user terminal 300 as a screen showing the result of the battle. Furthermore, the server 200b may display a ranking based on the total number of points granted to each viewer 600 after multiple such battles, as shown in FIG. 28.
[0134] Furthermore, in this embodiment, the evaluation by the artist 602 is not limited to being manually input by the artist 602, but may be, for example, an evaluation based on sensing data from a bio-information sensor (not shown) attached to the body of the artist 602. For example, the greater the increase in the heart rate of the artist 602 caused by the tactile stimulation, the higher the evaluation given. Note that, in this embodiment, the sensing data from the bio-information sensor of the artist 602 may be displayed on the user terminal 300, for example.
[0135] In this manner, in this embodiment, by providing a game-like element, it is possible to further increase the desire to purchase the stamp 700 with tactile stimulation effect.
[0136] <7.3 Variation 1> In addition, in this embodiment, the viewer 600 not only throws the stamp 700 with the tactile stimulating effect, but also the artist 602 may be involved in the game, for example, if the artist 602 performs a predetermined action on the thrown stamp 700, the tactile stimulus related to the stamp 700 is not presented. Below, a modified example of such a game will be described.
[0137] (Detailed configuration of server 200c) First, a detailed configuration of the server 200c according to this modification will be described with reference to FIG. 29. FIG. 29 is a diagram showing an example of a functional configuration of the server 200c according to this modification. As shown in FIG. 29, the server 200c mainly includes a communication unit 202, a control unit 210c, and a storage unit 240, similar to the first embodiment described above. Below, each functional block of the server 200c will be described in order, but since the communication unit 202 and the storage unit 240 are common to the first embodiment, their description will be omitted here, and only the control unit 210c will be described.
[0138] 29, similarly to the first embodiment, the control unit 210c is a controller, and includes a GUI control unit 212, a viewer side input unit 214, a distributor side input unit 216, a generation unit 218, a determination unit 220, and an output control unit (first distribution unit) 222. Furthermore, in this modification, the distributor side input unit 216 acquires, for example, sensing data of various sensors provided in the tactile presentation device 100, and outputs the data to the determination unit 220.
[0139] (Information processing method) The server 200c according to this modification has been described above. Next, an information processing method according to this modification will be described with reference to Figs. 30 and 31. Fig. 30 is a flow chart of an example of an information processing method according to a modification of this embodiment, and Fig. 31 is an explanatory diagram for explaining a display example according to the modification of this embodiment. As shown in Fig. 30, the information processing method according to this modification includes a plurality of steps from step S301 to step S308. Each step included in the information processing method according to this modification will be described in detail below.
[0140] First, the server 200c performs the processes from step S301 to step S304. However, since these are similar to steps S101 to S104 in the first embodiment shown in FIG. 8, the description of the processes in these steps will be omitted here.
[0141] Next, the server 200c displays, for example, in AR (Augmented Reality) on the display unit 302 of the user terminal 300 and the display unit (not shown) of the monitor 110, an icon such as a coin and a trajectory 808 along which the icon moves from the viewer 600 to the artist 602, as shown in FIG. 31 (step S305). In this modification, the trajectory 808 and the speed at which the trajectory 808 is displayed can be set by the viewer 600 before throwing the stamp 700 with tactile stimulation effect, or can be modified after it is displayed. Furthermore, in this modification, a predetermined sound may be output from a speaker (not shown) of the user terminal 300 or the monitor 110 during AR display.
[0142] The artist 602 then visually checks the trajectory 808 displayed on the display unit (not shown) of the monitor 110 and acts in response thereto (for example, running away from the drop position of the icon estimated from the trajectory 808, performing a touch operation on a specific terminal (for example, the monitor 110), speaking a keyword, etc.). Next, the server 200c acquires sensing data related to the actions of the artist 602 (step S306). For example, the running away action of the artist 602 can be detected by the camera 120, the touch operation can be detected by a touch panel (not shown) provided on the monitor 110, and the speech of the artist 602 can be detected by a microphone (not shown) provided on the haptic presentation device 100.
[0143] Next, the server 200c determines whether or not to present the tactile stimulus in the tactile provision device 100 based on the sensing data acquired in step S306 described above (step S307). For example, the server 200c determines not to present the tactile stimulus when the artist 602 moves away at a predetermined timing, when the artist 602 performs a touch operation at a predetermined timing, or when the artist 602 speaks a predetermined keyword (for example, "disappear" as shown in FIG. 31). In addition, in this modification, when a predetermined number or more of stamps 700 (or control commands 702) are sent simultaneously, the tactile stimulus may be presented even if a predetermined action of the artist 602 is detected. In addition, in this modification, the viewer 600 can input or select a desired keyword when throwing the stamp 700 with tactile stimulus effect, and the keyword may be displayed on the monitor 110. In this case, the server 200c may determine not to present a tactile stimulus or to present a tactile stimulus when it is detected that the artist 602 has correctly uttered the keyword displayed on the monitor 110. In this manner, according to this modification, the viewer 600 can not only have a one-way experience of watching the performance of the artist 602, but also have a real-time, interactive, and more value-added experience of interacting with the artist 602.
[0144] Then, the server 200c performs the process of step S308, which is similar to step S106 in the first embodiment shown in FIG. 8, and therefore will not be described here.
[0145] In this modified example, a kind of virtual dodgeball-like game can be played between not only the viewer 600 but also the artist 602, in which the viewer throws stamps 700 at each other and avoids the stamps 700 thrown at him / her. As a result, the viewer 600 feels as if he / she is directly interacting with the artist 602 in a thrilling manner, and can obtain an experience with higher added value.
[0146] In this modification, the present invention is not limited to not presenting a tactile stimulus when a predetermined action of the artist 602 is detected, and the intensity of the tactile stimulus may be changed when a predetermined action of the artist 602 is detected. In addition, when a tactile stimulus is not presented, a predetermined sound (e.g., a disappearance sound, etc.) may be output via the user terminal 300, or the user terminal 300 may be vibrated. Furthermore, in this modification, the server 200c may determine whether or not to present a tactile stimulus depending on a combination of the type of the stamp 700, the attribute information of the artist 602, the attribute information of the viewer 600, etc.
[0147] <7.4 Variation 2> Furthermore, when the viewer 600 throws the stamp 700 with tactile stimulating effect, the content of the stamp 700 to be thrown may be determined taking into account chance and skill, thereby enhancing the fun of the game. Such a modified example will be described with reference to Fig. 32. Fig. 32 is an explanatory diagram for explaining a display example according to a modified example of this embodiment.
[0148] In this modification, for example, the intensity of the tactile stimulus is determined by the value of a level meter when the stamp 700 with tactile stimulus effect is thrown. In detail, as shown in FIG. 32, an animation of a cursor 820 for specifying the intensity of the tactile stimulus is displayed on the display unit 302 of the user terminal 300. In the animation, the cursor 820 is always moving left and right. Furthermore, an icon 822 resembling, for example, a bow and arrow is displayed on the display unit 302. The viewer 600 can throw the stamp 700 by swiping on the icon 822 and releasing the fingertip from the screen. Then, the viewer-side input unit 214 of the server 200c acquires the intensity corresponding to the position of the cursor 820 at the time of the releasing action as the intensity of the tactile stimulus related to the thrown stamp 700.
[0149] In this modification, the cursor 820 is constantly moving left and right, so the intensity that is set is determined by chance. In addition, in order to set a desired intensity, the viewer 600 must carefully operate the icon 822 in consideration of the movement of the cursor 820, which requires skill. Thus, for example, if the viewer 600 is unable to set the desired intensity, he or she will repeatedly throw the stamp 700 until it is set. In other words, this modification provides a game that is both skilled and random, so that it is possible to provide the viewer 600 with a more entertaining experience.
[0150] Note that this modification is not limited to an operation on the icon 822, and for example, the intensity of the tactile stimulus may be set according to the speed of a motion operation, such as changing the angle at which the viewer 600 holds the user terminal 300, and is not particularly limited. Also, in this modification, the cursor 820 is not limited to being animated, and may be a cursor 820 that can be moved by the operation of the viewer 600. In this case, the viewer-side input unit 214 of the server 200c acquires the intensity corresponding to the position to which the cursor 820 has been moved by the operation of the viewer 600 as the intensity of the tactile stimulus related to the thrown stamp 700.
[0151] <7.5 Variation 3> In the embodiments and modifications of the present disclosure, noise caused by vibrations of the tactile stimulation unit 106 provided in the tactile presentation device 100 may be picked up by a microphone (not shown) provided on the shoulder of the tactile presentation device 100. Therefore, a modification for canceling noise caused by vibrations of the tactile stimulation unit 106 in the microphone will be described below.
[0152] In detail, the server 200 predicts noise according to the waveform given to the tactile stimulation unit 106. For example, the server 200 can predict noise by giving various waveforms to the tactile stimulation unit 106 in advance and referring to a database (DB) (not shown) obtained by machine learning of the generated noise. The server 200 can then cancel the predicted noise from the voice collected by a microphone (not shown) provided on the shoulder of the tactile presentation device 100, thereby preventing the voice from being deteriorated by noise.
[0153] In this modification, the server 200 may adjust the waveform to be cancelled depending on the distance between a microphone (not shown) provided on the shoulder of the tactile presentation device 100 and the tactile stimulation unit 106. For example, when the artist 602 is performing in a studio, the microphone may pick up noise caused by reflection on the studio wall. In such a case, the server 200 may adjust the waveform to be cancelled depending on the distance between the microphone provided on the shoulder of the tactile presentation device 100 and the wall.
[0154] In addition, in this modified example, as a means for canceling noise caused by vibration of the tactile stimulation unit 106, the above-mentioned microphone (not shown) may be made directional so that the microphone concentrates on picking up the voice of the artist 602, or the frequency range that the microphone can pick up may be limited so as to avoid picking up noise caused by vibration of the tactile stimulation unit 106.
[0155] <<8. Modifications of the Information Processing System 10 of the Present Disclosure>> Furthermore, modified examples of the information processing system 10 according to the embodiment of the present disclosure will be described with reference to Fig. 33 to Fig. 38. Fig. 33 to Fig. 38 are system diagrams showing schematic configuration examples of the information processing system 10 according to the modified examples of the embodiment of the present disclosure.
[0156] First, in the information processing system 10 shown in FIG. 33, the server 200 shown in FIG. 3 is realized by a haptics server 250a, a distribution data editing server 250b, a live distribution server 250c, and a haptics server 250d.
[0157] 33, in the information processing system 10 according to the present embodiment, for example, a haptic presentation device (haptic vest) 100, a driving amplifier / interface 140, a speaker 116, a monitor 110, a microphone 124, and a camera 120 are arranged on the artist 602 side. In addition, in the information processing system 10, for example, a haptics server (information processing device) 250a, a distribution data editing server 250b, a live distribution server (another information processing device) 250c, and a haptics server 250d are arranged between the artist 602 side and the viewer 600 side. Furthermore, in the information processing system 10, a smartphone or a tablet as an example of a user terminal 300 is arranged on the viewer 600 side. Each device included in the information processing system 10 can transmit and receive data to and from each other via various communication networks, such as a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 5G (fifth generation mobile communication method)), etc. The number of devices included in the information processing system 10 is not limited to the number illustrated in FIG. 33 and may be greater. The information processing system 10 may also include devices not illustrated in FIG. 33. For example, the information processing system 10 may include a general-purpose PC (Personal Computer), a game console, a mobile phone, a portable media player, a speaker, a projector, a display (digital signage, etc.), headphones, smart glasses, wearable devices such as a smart watch, etc.
[0158] 33, for example, the haptics server 250a that manages the presentation of tactile stimuli, the distribution data editing server 250b that has an application built in for editing video and audio to be distributed to the viewer 600, and the live streaming server 250c that manages distribution to the viewer 600 may be operated by different operators. Below, an overview of the driving amplifier / interface 140, the monitor 110, the camera 120, the haptics server 250a, the distribution data editing server 250b, the live streaming server 250c, and the haptics server 250d included in the information processing system 10 according to this embodiment will be described.
[0159] (Drive amplifier / interface 140) The driving amplifier / interface 140 is an interface that transmits and receives haptic control signals between the haptic presentation device 100 and the haptics server 250a. For example, the driving amplifier / interface 140 acquires profile information (functional information, etc.) of the haptic presentation device 100 from the haptic presentation device 100, converts and amplifies haptic control signals generated by the haptics server 250a, and transmits them to the haptic presentation device 100.
[0160] (Monitor 110) The monitor 110 can display, for example, a video of the artist 602 captured by a camera 120 (described later) toward the artist 602, and furthermore, the monitor 110 can superimpose text, icons, animations, and the like on the image of the artist 602. For example, the monitor 110 is realized by a liquid crystal display (LCD) device or an organic light emitting diode (OLED) device. In addition, in this embodiment, the display unit (not shown) of the monitor 110 may be provided as an integrated unit with an input unit (not shown), and in this case, the input unit is realized by, for example, a touch panel superimposed on the display unit. Furthermore, in this embodiment, the monitor 110 may be provided with a speaker 116 that outputs sound to the artist 602.
[0161] (Camera 120) The camera 120 is one or more visible light cameras that capture the artist 602 from one or multiple viewpoints, and the images captured by the camera 120 are transmitted to the user terminal 300 of the viewer 600 via the haptics server 250a, the distribution data editing server 250b, and the live distribution server 250c. The camera 120 may capture real objects around the artist 602 or around the viewer 600. In detail, the camera 120 has a lens system composed of an imaging lens, an aperture, a zoom lens, a focus lens, and the like, and a drive system that causes the lens system to perform a focus operation and a zoom operation. Furthermore, the camera 120 has a solid-state imaging element array that photoelectrically converts the imaging light obtained by the lens system to generate an imaging signal. The solid-state imaging element array may be realized by, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
[0162] (Haptics Server 250a) The haptics server 250a can receive a stamp (control command) 700 with a tactile stimulation effect input from the viewer 600 via the live distribution server 250c, generate a tactile control signal according to the stamp 700, and transmit the generated tactile control signal to the tactile presentation device 100. Each stamp with a tactile stimulation effect 700 is linked to a respective predetermined control command 702, and each control command 702 includes information (position information) specifying a perceived position at which a vibration stimulation is to be presented, information (shape information) specifying a waveform type and intensity of the vibration stimulation, and the like. The control command 702 can also include identification information (ID) specifying a tactile stimulation unit (not shown) provided in the tactile presentation device 100 and the above-mentioned shape information. In detail, the haptics server 250a generates a tactile control signal (waveform data) to be input to each tactile stimulation unit 106 provided in the tactile presentation device 100 so as to present a vibration stimulation with a specified waveform at a specified perception position with a specified intensity in response to the control command 702, and transmits the signal to the tactile presentation device 100.
[0163] (Distribution data editing server 250b) The distribution data editing server 250b can edit the video from the camera 120 received via the haptics server 250a, and edit the audio from the microphone 124 received via the haptics server 250a. Furthermore, the distribution data editing server 250b can transmit the edited video and audio data to the user terminal 300 via the live distribution server 250c, and output the edited video and audio data to the speaker 116 and the monitor 110 via the haptics server 250a. For example, the distribution data editing server 250a can superimpose an image of the stamp 700 input by the viewer 600 and a video effect linked to the stamp 700 on an image of the artist 602 captured by the camera 120, to generate video data for distribution.
[0164] (Live streaming server 250c) The live distribution server 250c can distribute images of the artists 602 and images for selecting the stamps 700 with tactile stimulation effects to the user terminal 300. For example, the live distribution server 250c can perform authentication via a Web API (Application Programming Interface) and monitor the stamps 700 with tactile stimulation effects transmitted from the viewers 600.
[0165] (Haptics Server 250d) The haptics server 250d stores a pre-generated tactile data library (such as vibration waveform patterns) linked to the identification information (ID) of each stamp 700. The haptics server 250d may also store information such as the number of tactile stimulation units 106 of the tactile presentation device 100, their positions, frequency characteristics, maximum input voltage, etc. as profile information of the tactile presentation device 100.
[0166] Furthermore, in this embodiment, the haptics server 250a, the delivery data editing server 250b, the live delivery server 250c, and the haptics server 250d may be realized by a single device or by multiple devices, and are not particularly limited. The details will be described later.
[0167] 34, the haptics server 250a also functions as the distribution data editing server 250b described above. In this case, the operator who manages the presentation of tactile stimuli and the operator who manages the distribution can be different operators.
[0168] Also, in the information processing system 10 shown in FIG. 35, unlike the example in FIG. 34, the information stored in the haptics server 250d is provided to the haptics server 250a via the live distribution server 250c.
[0169] In the information processing system 10 shown in FIG. 36, the information stored in the haptics server 250d is provided to the haptics server 250a via the live distribution server 250c and the distribution data editing server 250b.
[0170] In the information processing system 10 shown in FIG. 37, the haptics server 250a serving as the server 200 has an external haptics server 250d that assumes part of the functions of the storage unit 240.
[0171] In the information processing system 10 shown in FIG. 38, the haptics server 250d may cooperate with the live distribution server 250c to distribute to the user terminal 300.
[0172] <<9. Summary>> As described above, in the embodiment of the present disclosure, the tactile stimulus corresponding to the stamp 700 with tactile stimulus effect selected by the viewer 600 can be presented to the artist 602. In this embodiment, if the artist 602 perceives the presented tactile stimulus and takes an action, the viewer 600 can confirm in real time the action induced by the tactile stimulus presented by the stamp 700 sent by the viewer 600. According to this embodiment, if the viewer 600 can confirm in real time the action induced by the tactile stimulus related to the stamp 700 sent by the viewer 600, the viewer 600 can feel as if he or she is directly interacting with the artist 602, that is, a real-time, interactive, and highly value-added experience can be obtained.
[0173] The embodiment of the present disclosure can be applied not only to the above-mentioned live distribution, but also to, for example, the stamp 700 exchanged on SNS. In that case, for example, the user terminal 300 can vibrate instead of the haptic presentation device 100 to provide a haptic stimulus to the person to whom the stamp 700 was sent.
[0174] <<10. Hardware Configuration>> An information processing device such as the server 200 according to each embodiment described above is realized by a computer 1000 having a configuration as shown in FIG. 39, for example. The server 200 according to each embodiment of the present disclosure will be described below as an example. FIG. 39 is a hardware configuration diagram showing an example of a computer that realizes the functions of the server 200. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. Each unit of the computer 1000 is connected by a bus 1050.
[0175] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processes corresponding to the various programs.
[0176] The ROM 1300 stores boot programs such as a basic input output system (BIOS) executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000.
[0177] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records an information processing program according to the present disclosure, which is an example of program data 1450.
[0178] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.
[0179] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading a program or the like recorded on a predetermined recording medium. The medium may be, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0180] For example, when the computer 1000 functions as the server 200 according to an embodiment of the present disclosure, the CPU 1100 of the computer 1000 executes an information processing program loaded on the RAM 1200 to realize functions such as generating a haptic control signal. The information processing program according to an embodiment of the present disclosure is stored in the HDD 1400. The CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, the CPU 1100 may obtain these programs from other devices via an external network 1550.
[0181] Furthermore, the information processing device according to the present embodiment may be applied to a system consisting of a plurality of devices, which is premised on connection to a network (or communication between devices), such as cloud computing, etc. In other words, the information processing device according to the present embodiment described above can also be realized as an information processing system in which a plurality of devices perform processing related to the information processing method according to the present embodiment.
[0182] <<11. Supplementary Information>> The above-described embodiment may include, for example, a program for causing a computer to function as the information processing device according to the embodiment, and a non-transitory tangible medium on which the program is recorded. The program may also be distributed via a communication line (including wireless communication) such as the Internet.
[0183] Furthermore, each step in the process of each of the above-mentioned embodiments does not necessarily have to be processed in the order described. For example, each step may be processed in a different order as appropriate. Also, each step may be partially processed in parallel or individually instead of being processed in chronological order. Furthermore, each step does not necessarily have to be processed in the manner described, and may be processed in another manner by another functional block, for example.
[0184] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.
[0185] In addition, the effects described in this specification are merely explanatory or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.
[0186] The present technology can be configured as follows. (1) a first acquisition unit that acquires a control command corresponding to presentation unit information that designates a presentation unit that presents a tactile stimulus by a tactile presentation device and form information that designates a form of the tactile stimulus, both input by a first user; a generation unit that generates a haptic control signal for presenting the haptic stimulus to the presentation unit in response to the control command; a first delivery unit that delivers the haptic control signal to the haptic presentation device worn on a body of a second user; An information processing device comprising: (2) The control command is pre-associated with a stamp displayed on the stamp selection screen, the first user inputs the control command by selecting the stamp displayed on a stamp selection screen; The information processing device according to (1) above. (3) The information processing device according to (1) or (2) above, further comprising a price determination unit that determines a price for input of the control command based on at least one of the presentation unit information and the form information. (4) The information processing device according to any one of (1) to (3) above, further comprising a storage unit that stores the control command acquired by the first user in association with identification information of the first user. (5) The information processing device according to (4) above, wherein a new control command is issued when the plurality of control commands acquired by the first user satisfy a predetermined condition. (6) the storage unit acquires an evaluation of the tactile stimulus input from the second user who perceived the tactile stimulus, and stores information of the evaluation in association with identification information of the first user who input the control command corresponding to the tactile stimulus. The information processing device according to (4) above. (7) a determination unit that determines whether or not to present the tactile stimulus in the tactile presentation device based on a motion of the second user, The information processing device according to any one of (1) to (6) above. (8) The motion is detected from at least one of an imaging device that images the second user, a motion sensor that acquires motion data of the second user, and a sound sensor that collects a speech sound of the second user. The information processing device according to (7) above. (9) The information processing device described in (7) above, wherein the judgment unit determines not to present the tactile stimulation when the second user performs a predetermined action or when the second user utters a predetermined keyword. (10) The first acquisition unit displays a cursor for designating an intensity of the tactile stimulation, and accepts designation of the intensity by an operation of the first user on the cursor. The information processing device according to any one of (1) to (9) above. (11) the first acquisition unit displays an animation of the cursor moving, and accepts the designation of the strength by the operation of the first user according to a position of the cursor at the time the operation of the first user is accepted; The information processing device according to (10) above. (12) an input unit to which a control command including presentation unit information for specifying a presentation unit that presents a tactile stimulus by a tactile presentation device and form information for specifying a form of the tactile stimulus is input; a transmission unit that generates a haptic control signal corresponding to the input control command and transmits the generated haptic control signal to an information processing device that distributes the haptic control signal to the haptic presentation device; An information processing terminal comprising: (13) The tactile presentation device includes a tactile stimulation unit, The information processing device according to (1) above, wherein the presentation unit information includes ID information of the tactile stimulation unit. (14) the haptic control signal is a haptic control ID corresponding to the control command; the haptic presentation device performs haptic presentation based on the presentation unit information and the form information corresponding to the haptic control ID. The information processing device according to (1) above. (15) The information processing device described in (1) above, wherein the haptic control signal is superimposed on an image of real space delivered to the first user and corresponds to a predetermined image generated based on the input. (16) The predetermined image and the image of the real space are delivered to the display device from another information processing device capable of communicating with the display device that displays images to the first user. The information processing device according to (15) above. (17) the other information processing device acquires the control command corresponding to the input of the first user. The information processing device according to (16) above. (18) a second acquisition unit that acquires a predetermined image to be superimposed on an image of a real space in synchronization with the presentation of the tactile stimulus in response to an input from the first user; A third acquisition unit that acquires an image of the real space; a second distribution unit that distributes the predetermined image and the image of the real space to a display device that displays images toward the first user; Further comprising: The information processing device according to (1) above. (19) An information processing device, Obtaining a control command input from a first user; receiving an image of a live stream from a second user; Displaying the received live streaming image on a display unit; transmitting the acquired control command to a server via a communication unit; A program that functions as a control unit, a haptic control signal is generated in response to the control command; the haptic control signal is delivered to a haptic presentation device worn on the body of the second user; performing tactile presentation via the tactile presentation device based on presentation unit information that specifies a presentation unit that presents a tactile stimulus of the tactile presentation device corresponding to the control command and form information that specifies a form of the tactile stimulus; program. (20) receiving a control command input from a first user; receiving an image of a live broadcast of a second user; A control unit is provided, generating a haptic control signal in response to the control command; delivering the haptic control signal to a haptic presentation device worn on the second user's body; performing tactile presentation via the tactile presentation device based on presentation unit information that specifies a presentation unit that presents a tactile stimulus of the tactile presentation device corresponding to the control command and form information that specifies a form of the tactile stimulus; Information processing device. [Explanation of symbols]
[0187] 10. Information Processing Systems 100 Tactile presentation device 102, 202, 308 Communications Department 104, 210, 210a, 210b, 210c, 310 control unit 106 Tactile stimulation section 110 Monitor 116, 306 Speaker 120, 322 Camera 124, 324 Mike 140 Driving amplifier / interface 200, 200a, 200b, 200c, 250a, 250b, 250c, 250d servers 212 GUI control section 214 Viewer side input section 216 Distributor side input section 218 Generation part 220 Judgment section 222 Output control section 224 Pricing Department 226 Payment Department 228 Points Granting Department 240, 240a, 312 storage section 242 Audience Profiles 244 Broadcaster Profile 246 Distribution Data DB 248 Price Data DB 300 User terminals 300a Smartphone 300b tablet 302 Display section 304 Operation input section 320 Sensor section 326 Gyro Sensor 328 Acceleration Sensor 600 viewers 602 Artists 700 stamps 702 Control Commands 800 display 802 Avatar 804 notification 806, 822 Icon 808 Trajectory 810 Comments 812 Models Showing 814 areas 816 Marker 820, 824 Cursor 826 waveform
Claims
1. a first acquisition unit that acquires a control command corresponding to presentation unit information that designates a presentation unit that presents a tactile stimulus by a tactile presentation device and form information that designates a form of the tactile stimulus, both input by a first user; a generation unit that generates a haptic control signal for presenting the haptic stimulus to the presentation unit in response to the control command; a first delivery unit that delivers the haptic control signal to the haptic presentation device worn on a body of a second user; a storage unit that stores the control command acquired by the first user in association with identification information of the first user; Equipped with issuing a new control command when the plurality of control commands acquired by the first user satisfy a predetermined condition; Information processing device.
2. The control command is pre-associated with a stamp displayed on the stamp selection screen, the first user inputs the control command by selecting the stamp displayed on a stamp selection screen; The information processing device according to claim 1 .
3. The information processing apparatus according to claim 1 , further comprising a price determination unit that determines a price for the input of the control command based on at least one of the presentation unit information and the form information.
4. A first acquisition unit that acquires control commands corresponding to presentation unit information that specifies a presentation unit that presents a tactile stimulus by a tactile presentation device and form information that specifies a form of the tactile stimulus, both input by a first user; a generation unit that generates a haptic control signal for presenting the haptic stimulus to the presentation unit in response to the control command; a first delivery unit that delivers the haptic control signal to the haptic presentation device worn on a body of a second user; a storage unit that stores the control command acquired by the first user in association with identification information of the first user; Equipped with the storage unit acquires an evaluation of the tactile stimulus input from the second user who perceived the tactile stimulus, and stores information of the evaluation in association with identification information of the first user who input the control command corresponding to the tactile stimulus. Information processing device.
5. A first acquisition unit that acquires control commands corresponding to presentation unit information that specifies a presentation unit that presents a tactile stimulus by a tactile presentation device and form information that specifies a form of the tactile stimulus, both input by a first user; a generation unit that generates a haptic control signal for presenting the haptic stimulus to the presentation unit in response to the control command; a first delivery unit that delivers the haptic control signal to the haptic presentation device worn on a body of a second user; a determination unit that determines whether or not to present the tactile stimulus in the tactile presentation device based on a motion of the second user; An information processing device comprising:
6. The motion is detected from at least one of an imaging device that images the second user, a motion sensor that acquires motion data of the second user, and a sound sensor that collects a speech sound of the second user. The information processing device according to claim 5 .
7. The information processing device according to claim 5 , wherein the determination unit determines not to present the tactile stimulation when the second user performs a predetermined action or when the second user utters a predetermined keyword.
8. the first acquisition unit displays a cursor for designating an intensity of the tactile stimulation, and accepts designation of the intensity by an operation of the first user on the cursor; The information processing device according to any one of claims 1 to 7.
9. the first acquisition unit displays an animation of the cursor moving, and accepts the designation of the strength by the operation of the first user according to a position of the cursor at the time the operation of the first user is accepted; The information processing device according to claim 8.
10. The tactile presentation device includes a tactile stimulation unit, The information processing apparatus according to claim 1 , wherein the presentation unit information includes ID information of the tactile stimulation unit.
11. the haptic control signal is a haptic control ID corresponding to the control command; the haptic presentation device performs haptic presentation based on the presentation unit information and the form information corresponding to the haptic control ID. The information processing device according to claim 1 .
12. The information processing device according to claim 1 , wherein the haptic control signal corresponds to a predetermined image that is superimposed on an image of real space delivered to the first user and that is generated based on the input.
13. The predetermined image and the image of the real space are delivered to the display device from another information processing device capable of communicating with the display device that displays an image for the first user. The information processing device according to claim 12.
14. the other information processing device acquires the control command corresponding to the input of the first user. The information processing device according to claim 13.
15. a second acquisition unit that acquires a predetermined image to be superimposed on an image in real space in synchronization with the presentation of the tactile stimulus in response to an input from the first user; A third acquisition unit that acquires an image of the real space; a second distribution unit that distributes the predetermined image and the image of the real space to a display device that displays images toward the first user; Further comprising: The information processing device according to claim 1 .
Citation Information
Patent Citations
Portable information collector and its information managing method
JP1997212331A
Vibration pattern information transmission system
JP2018195068A
Electronic device and skin sense presentation system
JP2019003708A
Information processing device, information processing method and recording medium
JP2019144629A
Communication control device, user terminal, and program
WO2016151794A1
