Information processing device, information processing method, and program
By using a tactile control unit in the information processing device to adjust the tactile signal according to the reproduction speed of the content, the problem of tactile stimulation discomfort when the content reproduction speed changes in the prior art is solved, and the authenticity and comfort of the user experience are improved.
Patent Information
- Application Number
- CN202080037716.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-05-28
- Filing Date
- 2020-04-30
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-04-30
AI Technical Summary
The prior art is difficult to properly provide tactile stimulation when the reproduction speed of content changes, resulting in the user's potential discomfort or damage to the sense of reality, especially when super slow reproduction.
By introducing a haptic control unit into the information processing device, the haptic signal is generated and adjusted according to the reproduction speed of the content, such as changing the reproduction period of the signal, so as to adapt to the speed change of the content, and ensure that the user experience is not affected.
This achieves the appropriate tactile stimulation at various reproduction speeds, reduces user discomfort and improves the sense of reality, ensuring accuracy and comfort of tactile feedback, especially when super slow or fast reproduction.
Smart Images

Figure CN113874815B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing device, an information processing method, and a program. Background Art
[0002] In recent years, various contents and devices capable of providing tactile stimulation such as vibration stimulation to users have been developed. For example, Patent Document 1 below discloses an information processing device capable of improving functions, operability, etc. using vibration stimulation.
[0003] Reference List
[0004] Patent Literature
[0005] Patent Document 1: JP 2018-64264 A Summary of the invention
[0006] Technical issues
[0007] However, using the technology disclosed in Patent Document 1 and the like, it may not be possible to appropriately provide tactile stimulation based on the reproduction speed of the content. For example, in a case where the reproduction speed of the content is much lower than the standard (in a case where the reproduction speed is lower than a predetermined value. Hereinafter, the reproduction with a lower reproduction speed may be referred to as "ultra-slow reproduction"), when the reproduction speed of the tactile stimulation is simply reduced, the user may feel uncomfortable with the tactile stimulation, and the sense of reality may be impaired. At the same time, in a case where the provision of tactile stimulation is omitted while performing ultra-slow reproduction of the content, the sense of reality may also be impaired (note that the above problem is only an example, and the problem according to the present disclosure is not limited to this).
[0008] Therefore, the present disclosure has been made in view of the above circumstances, and provides a novel and improved information processing apparatus, information processing method, and program capable of more appropriately providing tactile stimulation based on the reproduction speed of content.
[0009] Solution to the problem
[0010] In order to solve the above-mentioned problem, an information processing apparatus according to one aspect of the present disclosure has a haptic control unit that generates a signal for providing a user with haptic stimulation corresponding to content based on a reproduction speed of the content provided to the user.
[0011] An information processing method executed by a computer, the information processing method according to one aspect of the present disclosure includes: generating a signal for providing a user with a tactile stimulation corresponding to the content based on a reproduction speed of the content provided to the user.
[0012] A program according to an aspect of the present disclosure causes a computer to perform the following operations: generating a signal for providing a user with a tactile stimulation corresponding to content based on a reproduction speed of the content provided to the user.
[0013] An information processing device according to one aspect of the present disclosure has: a communication unit that receives a signal generated based on a reproduction speed of content provided to a user and used to provide a tactile stimulation corresponding to the content to the user; and a tactile output unit that outputs the tactile stimulation by using the signal. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 is a block diagram showing a configuration example of an information processing system according to the present embodiment.
[0015] Figure 2 : is a block diagram showing a configuration example of a distribution device according to the present embodiment.
[0016] Figure 3 is a block diagram showing a configuration example of a reproduction device according to the present embodiment.
[0017] Figure 4 is a diagram for describing a specific example of a process of changing a reproduction period of a haptic signal based on a change in a reproduction speed of content.
[0018] Figure 5 is a diagram for describing a specific example of a process of changing a reproduction period of a haptic signal based on a change in a reproduction speed of content.
[0019] Figure 6 is a diagram for describing a specific example of a reproduction mode of a haptic signal based on a reproduction speed of content.
[0020] Figure 7 is a flowchart showing an example of the processing flow of each component according to the present embodiment.
[0021] Figure 8 is a diagram showing an example of the frequency characteristics of a vibration actuator.
[0022] Fig. 9 : is a diagram for describing a specific example of a process of changing a reproduction period of a haptic signal based on a change in a reproduction speed of content in a modified example.
[0023] Fig.10 is a flowchart showing an example of a process flow of each component according to the modified example.
[0024] Fig.11 is a diagram for describing a specific example of a video displayed in the case where the reproduction speed is changed by a seek bar.
[0025] Fig.12 : is a block diagram showing a hardware configuration example of each device according to the present embodiment and modification examples. DETAILED DESCRIPTION
[0026] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and the accompanying drawings, components having substantially the same functional configuration will be denoted by the same reference numerals to omit repeated description.
[0027] Note that the description will be provided in the following order.
[0028] 1. Overview
[0029] 2. Implementation Method
[0030] 2.1. Configuration Example
[0031] 2.2. Example of control performed by the haptic control unit
[0032] 2.3. Processing flow example
[0033] 3. Modify the example
[0034] 4. Notes
[0035] 5. Hardware Configuration Example
[0036] 6. Conclusion
[0037] <1. Overview>
[0038] First, an overview of the present disclosure will be described.
[0039] As described above, in recent years, various devices capable of providing tactile stimulation such as vibration stimulation to users have been developed, and there is a possibility that tactile stimulation will be more widely provided as an element of (media) content together with video and sound.
[0040] Regarding content, various expressions and corresponding reproduction techniques have been developed. Specifically, various methods of expressing content in the case where the reproduction speed of the content is increased or decreased have been developed. For example, a technique has been developed for enabling recognition of actions that are too fast to be captured with the naked eye by reducing the reproduction speed of a video below the standard, and the technique is used, for example, in sports broadcasts, etc. Conversely, a technique has also been developed for increasing the reproduction speed of a video to be much higher than the standard, and the technique is used to search for a desired scene in the content, etc.
[0041] Regarding the method of expressing sound in the case of changing the reproduction speed of the video, when the reproduction speed is changed so that the sound also corresponds to the reproduction speed of the video, the user hears a sound with a lower pitch or a sound with a higher pitch compared to the actual sound. Therefore, a method of omitting the reproduction of the sound or replacing the sound with another sound while changing the reproduction speed of the video can be adopted. Of course, in addition to these expression methods, various expression methods have been developed and implemented.
[0042] Meanwhile, similar to sound, various methods of expressing tactile stimulation in the case of changing the reproduction speed of the video have been developed. However, using the technology according to the related art (e.g., the technology disclosed in the above-mentioned patent document 1, etc.), it may not be possible to properly provide tactile stimulation based on the reproduction speed of the content. For example, in the case of performing ultra-slow reproduction of a video, when the reproduction speed of the tactile stimulation is simply reduced, the user may feel uncomfortable with the tactile stimulation and may damage the sense of reality. Specifically, in the case of reproducing a vibration stimulus with a frequency of 160 [Hz] at 1 / 8 times the speed, the frequency of the vibration stimulus becomes 20 [Hz], which may make the user feel a great sense of discomfort. In addition, in some cases, when the frequency after the change in the reproduction speed deviates from the output range of the device (e.g., a vibration actuator, etc.) that outputs the vibration stimulus, the vibration stimulus is not output. At the same time, in the case of omitting the provision of tactile stimulation while performing ultra-slow reproduction of the video, the sense of reality may be damaged. These problems also apply to the case where the reproduction speed of the content is increased.
[0043] Here, the sensory characteristics of people regarding tactile stimulation are different from those regarding sound. For example, people's sense organs are less sensitive to frequency changes of tactile stimulation than to frequency changes of sound. Specifically, it is known that even when the rate of change of the frequency of sound is less than 1[%], people are likely to perceive the change, while when the rate of change of the frequency of vibration stimulation (an example of tactile stimulation) is less than 30[%], people are likely not to perceive the change.
[0044] In view of the above situation, the inventor of the present disclosure has created a technology according to the present disclosure. The information processing device according to the present disclosure generates a signal for providing a user with a tactile stimulation corresponding to the content based on the reproduction speed of the content provided to the user. Specifically, the information processing device according to the present disclosure changes the signal based on the change of the reproduction speed of the content. For example, the information processing device according to the present disclosure changes the signal based on the change of the reproduction speed of the content to change the reproduction period of the signal.
[0045] Therefore, the information processing device according to the present disclosure can provide tactile stimulation more appropriately based on the reproduction speed of the content. More specifically, as described above, since the human senses are relatively insensitive to changes in the frequency of tactile stimulation, even in the case of changing the signal to change the reproduction period of the signal used to provide tactile stimulation to the user, the information processing device according to the present disclosure can provide the user with tactile stimulation that does not make the user feel uncomfortable. Hereinafter, the functions and processing of the information processing device according to the present disclosure will be described in detail.
[0046] <2. Implementation Method>
[0047] (2.1. Configuration example)
[0048] The overview of the present disclosure has been described above. Next, various configuration examples according to an embodiment of the present disclosure will be described.
[0049] (Configuration Example of Information Processing System)
[0050] Figure 1 1 is a block diagram showing a configuration example of an information processing system 1 according to the present embodiment. Figure 1 As shown, the information processing system 1 according to the present embodiment includes a distribution device 100 and a reproduction device 200 .
[0051] The distribution device 100 is an information processing device that distributes content to the reproduction device 200. For example, the distribution device 100 distributes content to the reproduction device 200 based on a request signal (request) received from the reproduction device 200. Note that the distribution method is not necessarily limited to this. For example, the distribution device 100 can distribute content without a request signal from the reproduction device 200.
[0052] Here, it is sufficient that the "content" includes at least tactile stimulation and may also include, for example, video or sound in addition to the tactile stimulation. In the present embodiment, as an example, a case where the content includes video, sound, and tactile stimulation will be described. That is, the distribution device 100 generates a signal in a predetermined format for outputting video, sound, and tactile stimulation, and sends the signal to the reproduction device 200. Note that the signal generation method and the signal distribution method performed by the distribution device 100 are not particularly limited. In the following, the signal for outputting video is also referred to as a "video signal", the signal for outputting sound is also referred to as a "sound signal", and the signal for outputting tactile stimulation is also referred to as a "tactile signal".
[0053] In addition, "tactile stimulation" includes at least one of the following: vibration stimulation, electrical stimulation, stimulation caused by temperature change, stimulation related to force sensation (for example, stimulation related to the feeling of being pushed by an object, stimulation related to the feeling of contacting an object, stimulation related to the feeling of being tightened, etc.), or stimulation related to skin sensation (for example, stimulation related to the feeling of roughness, stimulation related to the feeling of smoothness, etc.), and may be a combination thereof. Note that the tactile stimulation is not necessarily limited to this, and may be any stimulation that acts on the user's sense of touch. In the present embodiment, as an example, the case where the tactile stimulation is a vibration stimulation will be mainly described.
[0054] The distribution device 100 does not have to be implemented by one device. For example, in the case where the content is a broadcast of a sport such as baseball, the distribution device 100 may be implemented by a video camera device that is arranged in a baseball field and performs filming, a device that edits the video of the video camera device, a device that distributes the edited video, etc., and the number of the respective devices is not particularly limited.
[0055] Meanwhile, the reproduction device 200 is an information processing device that reproduces content by using various signals received from the distribution device 100. It is sufficient that the reproduction device 200 can provide at least tactile stimulation and can be, for example, a smart phone, a tablet personal computer (PC), a head-mounted display, etc. In the present embodiment, as an example, a case where the reproduction device 200 is a smart phone will be described. That is, the reproduction device 200 outputs vibration stimulation by vibrating a vibration actuator or the like using a tactile signal received from the distribution device 100, displays a video on a display or the like using a video signal, and outputs sound from a speaker or the like using a sound signal.
[0056] Similar to the distribution device 100, the reproduction device 200 does not have to be realized by one device. For example, the reproduction device 200 can be realized by a device capable of outputting tactile stimulation, a device capable of outputting video, a device capable of outputting sound, etc., and the number of each device is not particularly limited.
[0057] The reproduction device 200 according to the present embodiment performs a process of changing the reproduction speed of the content and various controls associated therewith. For example, the reproduction device 200 changes the reproduction speed of the content based on the input made by the user (in other words, determines the reproduction speed of the content based on the input made by the user). Then, the reproduction device 200 changes the output by changing various signals received from the distribution device 100 according to the change in the reproduction speed of the content. Here, the "reproduction speed of the content" is the speed at which the content including video, sound and tactile stimulation is provided to the user, and may refer to any one of the speed felt by the user and the processing speed of the reproduction device 200. The range of the reproduction speed of the content is not particularly limited. Specifically, reproduction can be performed in various modes, including super slow reproduction at about 0.125 times the speed, reproduction at about 0.5 times to 0.9 times the speed (also referred to as "slow reproduction"), reproduction at about 2.0 times to 8.0 times the speed (also referred to as "fast forward reproduction"), etc. In addition, the speed of scene change performed by the operation of the user interface for controlling the reproduction scene of the content (for example, the movement of the knob on the search bar, etc.) can be regarded as the reproduction speed (the details will be described later). Note that the process of changing the reproduction speed of the content and various controls associated therewith can be implemented by the distribution device 100 or can be implemented by the distribution device 100 and the reproduction device 200 in a distributed manner.
[0058] also, Figure 1 The configuration shown in FIG. 1 is merely an example, and the configuration example of the information processing system 1 according to the present embodiment is not necessarily limited to Figure 1 For example, devices other than the distribution device 100 and the reproduction device 200 may be provided separately.
[0059] (Configuration example of distribution device)
[0060] Figure 2 1 is a block diagram showing a configuration example of the distribution device 100 according to the present embodiment. Figure 2 As shown, the distribution device 100 according to the present embodiment includes a control unit 110, a communication unit 120, and a storage unit 130. Then, the control unit 110 includes a video control unit 111, a sound control unit 112, and a tactile control unit 113.
[0061] The control unit 110 is configured to comprehensively control the overall processing performed by the distribution device 100. For example, the control unit 110 controls activation and deactivation of each component (e.g., the video control unit 111, the sound control unit 112, the haptic control unit 113, etc.) based on a request signal from the reproduction device 200. Note that the control content of the control unit 110 is not particularly limited. For example, the control unit 110 can control processing (e.g., processing related to an operating system (OS) etc.) that is generally performed in various servers, general-purpose computers, PCs, tablet PCs, etc.
[0062] The video control unit 111 is configured to control the content of the video output by the reproduction device 200. Specifically, the video control unit 111 generates a video signal based on a request signal from the reproduction device 200, and sends the video signal to the reproduction device 200 via the communication unit 120. Note that the content of the video provided by the video control unit 111 is not particularly limited. For example, the video provided by the video control unit 111 may be a video specified by a request signal from the reproduction device 200, or may be a video determined by the position and posture of the reproduction device 200 in the case where the reproduction device 200 is an information processing device such as a head-mounted display whose position and posture change. In addition, the video provided by the video control unit 111 may include a video for the right eye and a video for the left eye. In addition, the video signal may be provided as a set of data together with a sound signal and a tactile signal, or may be provided as separate data (in any case, it is desired that the video, sound, and tactile stimulation are provided synchronously).
[0063] The sound control unit 112 is configured to control the content of the sound output by the reproduction device 200. Specifically, the sound control unit 112 generates a sound signal based on a request signal from the reproduction device 200, and transmits the sound signal to the reproduction device 200 via the communication unit 120. Note that the content of the sound provided by the sound control unit 112 is not particularly limited. For example, the sound provided by the sound control unit 112 may be a sound specified by a request signal from the reproduction device 200, or may be a sound determined by the position and posture of the reproduction device 200 in the case where the reproduction device 200 is a head-mounted display or the like. In addition, the sound provided by the sound control unit 112 may include a sound for the right ear and a sound for the left ear.
[0064] The tactile control unit 113 is configured to control the content of tactile stimulation (e.g., vibration stimulation, etc.) output by the reproduction device 200. Specifically, the tactile control unit 113 generates a tactile signal based on a request signal from the reproduction device 200, and transmits the tactile signal to the reproduction device 200 via the communication unit 120. Note that the content of the tactile stimulation provided by the tactile control unit 113 is not particularly limited. For example, the tactile stimulation provided by the tactile control unit 113 may be a tactile stimulation specified by a request signal from the reproduction device 200, or may be a tactile stimulation determined by the position and posture of the reproduction device 200 in a case where the reproduction device 200 is a head-mounted display or the like.
[0065] The communication unit 120 is configured to communicate with the reproduction device 200. For example, the communication unit 120 receives a content request signal from the reproduction device 200, and transmits a video signal, a sound signal, and a haptic signal to the reproduction device 200. Note that information received and transmitted by the communication unit 120 and the case of communication are not limited thereto.
[0066] The storage unit 130 is configured to store various types of information. For example, the storage unit 130 stores various signals generated by the control unit 110, and stores programs, parameters, etc. used by each component of the distribution device 100. Note that the information stored in the storage unit 130 is not limited thereto.
[0067] In the above, the configuration example of the distribution device 100 has been described. Figure 2 The configuration described is merely an example, and the configuration of the distribution apparatus 100 is not limited to such an example. For example, the distribution apparatus 100 does not necessarily include Figure 2 All components shown and may include Figure 2 In addition, the configuration of the dispensing device 100 can be flexibly modified according to the specification and operation.
[0068] (Configuration Example of Reproduction Device)
[0069] Figure 3 2 is a block diagram showing a configuration example of a reproduction device 200 according to the present embodiment. Figure 3 As shown, the reproduction device 200 according to the present embodiment includes a control unit 210, a communication unit 220, an input unit 230, an output unit 240, and a storage unit 250. Then, the control unit 210 includes a speed determination unit 211, a video control unit 212, a sound control unit 213, and a tactile control unit 214, and the output unit 240 includes a video output unit 241, a sound output unit 242, and a tactile output unit 243.
[0070] The control unit 210 is configured to comprehensively control the overall processing performed by the reproduction device 200. For example, the control unit 210 controls the activation and deactivation of each component (e.g., the speed determination unit 211, the video control unit 212, the sound control unit 213, the haptic control unit 214, etc.) based on various signals from the distribution device 100. Note that the control content of the control unit 210 is not particularly limited. For example, the control unit 210 can control the processing (e.g., OS-related processing, etc.) that is generally performed in various servers, general-purpose computers, PCs, tablet PCs, etc.
[0071] The speed determination unit 211 is configured to determine the reproduction speed of the content. For example, the speed determination unit 211 determines the reproduction speed of the content based on the input made by the user to the input unit 230. Therefore, the user can reproduce the content at a desired speed. As described above, the range of the reproduction speed of the content is not particularly limited.
[0072] The video control unit 212 is configured to control the output of the video. Specifically, the video control unit 212 supplies the video signal supplied from the distribution device 100 to the video output unit 241, thereby controlling the output of the video performed by the video output unit 241. At this time, the video control unit 212 supplies the video signal so that the video is output at the reproduction speed determined by the speed determination unit 211.
[0073] The sound control unit 213 is configured to control the output of the sound. Specifically, the sound control unit 213 provides the sound signal provided from the distribution device 100 to the sound output unit 242, thereby controlling the output of the sound performed by the sound output unit 242. At this time, the sound control unit 213 provides the sound signal so that the sound is output at the reproduction speed determined by the speed determination unit 211. Here, as described above, the human senses are more sensitive to the frequency change of the sound than to the frequency change of the tactile stimulation. Therefore, in the case where the rate of change of the reproduction speed is higher than a predetermined value (in the case where the change of the sound is large enough to be perceived), the sound control unit 213 uses the speech rate conversion process to change the sound signal and provides the changed sound signal to the sound output unit 242. The "speech rate conversion process" is a process of changing the reproduction period while maintaining the quality and pitch of the sound. Therefore, the sound control unit 213 can output the sound slowly or quickly without making the user feel uncomfortable. Since the sound control unit 213 can use the existing speech rate conversion process, the detailed description of the speech rate conversion process will be omitted. Note that the sound control unit 213 does not have to maintain the quality and pitch of the sound before and after the change of the reproduction speed.
[0074] The tactile control unit 214 is configured to control the output of tactile stimulation. Specifically, the tactile control unit 214 provides the tactile signal provided from the distribution device 100 to the tactile output unit 243, thereby controlling the output of the tactile stimulation performed by the tactile output unit 243. At this time, the tactile control unit 214 provides the tactile signal so that the tactile stimulation is output at the reproduction speed determined by the speed determination unit 211. In addition, in the present embodiment, the tactile control unit 214 can change the tactile signal based on the reproduction speed of the content (note that changing the tactile signal is equivalent to generating a tactile signal). The details will be described later.
[0075] The communication unit 220 is configured to communicate with the distribution device 100. For example, the communication unit 220 transmits a content request signal to the distribution device 100, and receives a video signal, a sound signal, and a haptic signal from the distribution device 100. Note that the information received and transmitted by the communication unit 220 and the case of communication are not limited thereto.
[0076] The input unit 230 is configured to receive inputs made by the user. For example, the input unit 230 includes input devices such as a mouse, a keyboard, a touch panel, a button, a switch, and a microphone, and the user can perform input operations for requesting content, changing the reproduction speed of content, etc. by using these input devices. Note that the input device included in the input unit 230 is not limited thereto.
[0077] The output unit 240 is configured to perform various outputs under the control of the control unit 210. Specifically, the video output unit 241 is a video output device such as a display capable of outputting a video, the sound output unit 242 is a sound output device such as a speaker capable of outputting a sound, and the tactile output unit 243 is a tactile output device such as a vibration actuator capable of outputting a vibration stimulus. These components perform various outputs by using the signal (video signal, sound signal, and tactile signal) provided from the control unit 210. Note that the output device included in each component of the output unit 240 is not limited to the above device. For example, although the tactile stimulus is not necessarily limited to the vibration stimulus, it goes without saying that the type of the tactile output unit 243 varies according to the tactile stimulus to be provided.
[0078] The storage unit 250 is configured to store various types of information. For example, the storage unit 250 stores various signals processed by the control unit 210, and stores programs, parameters, etc. used by each component of the reproduction device 200. Note that the information stored in the storage unit 250 is not limited thereto.
[0079] In the above, the configuration example of the reproduction device 200 has been described. Figure 3The configuration described is merely an example, and the configuration of the reproduction apparatus 200 is not limited to such an example. For example, the reproduction apparatus 200 does not necessarily include Figure 3 All components shown and may include Figure 3 In addition, the configuration of the reproduction device 200 can be flexibly modified according to the specification and operation. In addition, in a case where various controls associated with the change of the reproduction speed of the content are implemented by the distribution device 100 instead of the reproduction device 200, the communication unit 220 of the reproduction device 200 receives the tactile signal generated by the distribution device 100 based on the reproduction speed, and the tactile output unit 243 outputs the tactile stimulation by using the tactile signal.
[0080] (2.2. Example of control performed by the haptic control unit)
[0081] Hereinabove, various configuration examples according to the present embodiment have been described. Next, an example of control performed by the haptic control unit 214 of the reproducing device 200 will be described.
[0082] As described above, the haptic control unit 214 changes the haptic signal (a signal for providing haptic stimulation to the user) based on the reproduction speed of the content (note that changing the haptic signal is equivalent to generating the haptic signal). Specifically, the haptic control unit 214 changes the haptic signal provided from the distribution device 100 based on the change in the reproduction speed of the content. For example, the haptic control unit 214 changes the haptic signal based on the change in the reproduction speed of the content to change the reproduction period of the haptic signal.
[0083] Here, we will refer to Figure 4 and Figure 5 A specific example of a process of changing a reproduction period of a haptic signal based on a change in a reproduction speed of content is described. Figure 4 1 shows haptic signals in the case where the content is reproduced at 1.0 times speed, in the case where the content is reproduced at 0.8 times speed, and in the case where the content is reproduced at 1.2 times speed. Figure 4 As shown, the tactile control unit 214 can extend or compress the tactile signal based on the change in the reproduction speed to change the frequency of the tactile signal, thereby extending or shortening the reproduction period of the tactile signal. Specifically, when the reproduction speed is 0.8 times the speed, the tactile control unit 214 can extend the reproduction period of the tactile signal by extending the tactile signal so that the frequency of the tactile signal is lower than the frequency when the reproduction speed is 1.0 times the speed. In addition, when the reproduction speed is 1.2 times the speed, the tactile control unit 214 can shorten the reproduction period of the tactile signal by compressing the tactile signal so that the frequency of the tactile signal is higher than the frequency when the reproduction speed is 1.0 times the speed.
[0084] As described above, since the human sense organs are relatively insensitive to the frequency change of the tactile stimulation, even when the tactile signal is extended or compressed based on the change of the reproduction speed to change the frequency of the tactile signal, the tactile control unit 214 can provide the user with a tactile stimulation that does not make the user feel uncomfortable. In addition, compared with the process of changing the tactile signal to maintain the frequency of the tactile signal described below, the process of extending or compressing the tactile signal to change the frequency of the tactile signal can be implemented with a lower load.
[0085] In addition, when the rate of change of the reproduction speed of the content is higher than a predetermined value (for example, about 30% ) Figure 4 As shown, when the frequency of the tactile signal is changed, people are likely to perceive the change in tactile stimulation. Figure 5 1 and 0.5 times the speed of the content, and the haptic control unit 214 may be configured as follows: Figure 5 As shown, the reproduction period of the tactile signal is extended or shortened by changing the tactile signal based on the change in the reproduction speed of the content to maintain the frequency of the tactile signal. Specifically, when the rate of change of the reproduction speed of the content is higher than a predetermined value (for example, about 30 [%]), the tactile control unit 214 can extend or shorten the reproduction period of the tactile signal by changing the tactile signal based on the rate of change to maintain the frequency of the tactile signal. For example, the tactile control unit 214 can change the tactile signal to maintain the frequency of the tactile signal by performing a process similar to the speech rate conversion process performed by the sound control unit 213. Note that the speech rate conversion process is not necessarily used. Therefore, even in the case where the rate of change of the reproduction speed of the content is high to the extent that the change of the tactile stimulus is perceived, the tactile control unit 214 can provide the user with a tactile stimulus that does not make the user feel uncomfortable. In addition, since the frequency of the tactile signal is maintained in some processes, the tactile control unit 214 can provide a tactile stimulus with higher accuracy (as intended by the creator).
[0086] Furthermore, the haptic control unit 214 may omit reproduction of the haptic signal based on the reproduction speed of the content, or may reproduce the haptic signal without changing the haptic signal. Figure 6 A specific example of a reproduction mode of a tactile signal based on the reproduction speed of the content is shown. For example, in a case where the reproduction speed of the content is within a predetermined range (for example, within a range of 0.5 times the speed to 4.0 times the speed), the reproduction period of the tactile signal is changed as described above. Meanwhile, in a case where the reproduction speed of the content is lower than a predetermined value (for example, 0.5 times the speed), when the reproduction period of the tactile signal is extended as described above, the user may feel discomfort (or discomfort) due to the excessively long reproduction period. Therefore, in a case where the reproduction speed of the content is lower than a predetermined value (for example, 0.5 times the speed), as described above, the reproduction period of the tactile signal is extended. Figure 6As shown, the haptic control unit 214 may omit the reproduction of the haptic signal. Figure 6 As shown in FIG. 1 , however, in a case where the reproduction speed of the content is higher than a predetermined value, the reproduction of the haptic signal may be similarly omitted.
[0087] In addition, for example, in the case where the reproduction speed of the content is higher than a predetermined value (for example, 4.0 times the speed), when the reproduction period of the tactile signal is shortened as described above, there is a possibility that the user cannot properly perceive the vibration stimulation due to the too short reproduction period. Figure 6 As shown, the haptic control unit 214 can reproduce the original haptic signal. Figure 6 , however, in the case where the reproduction speed of the content is lower than a predetermined value, the reproduction may be performed similarly without changing the haptic signal.
[0088] Note that the reproduction mode of the haptic signal based on the reproduction speed of the content is not necessarily limited to Figure 6 For example, in a case where there is a possibility that the user may feel discomfort (or discomfort) due to an excessively long reproduction period or an excessively high reproduction frequency of the tactile signal, the tactile control unit 214 may appropriately thin out the tactile signal. When performing the thinning process, a portion of the tactile signal to be reproduced may be limited to a characteristic portion. As a method of extracting a characteristic portion, for example, a portion in which the signal amount exceeds a specific value, a portion in which the signal strength per unit time exceeds a specific value, and the like may be extracted. Alternatively, the extraction may be performed by limiting the number of portions to be reproduced per unit time according to the reproduction speed, for example, a portion of an 8-second scene when the reproduction speed is 4 times the speed and a portion of a 16-second scene when the reproduction speed is 8 times the speed.
[0089] Even in the case of performing sparse processing, when the length of a portion of the tactile signal is long, the reproduction of multiple signals may overlap depending on the reproduction speed. In such a case, it is conceivable to set the reproduction period of a portion of the tactile signal to a specific value or less, and not perform the reproduction of the latter portion, or omit the reproduction of the overlapping latter portion of the tactile signal. In addition, as a human tactile characteristic, it is known that when the time interval between two tactile (vibration) stimuli is equal to or less than a specific value (it is said that when the vibration stimulus is strong, the time interval is, for example, about 10 [ms], and when the vibration stimulus is weak, the time interval is, for example, about 50 [ms]), the two stimuli are connected and feel as one stimulus. Therefore, taking this numerical value into account, in the case where the time interval between the two tactile signals (the end of the first tactile signal and the beginning of the second tactile signal) is equal to or less than a specific range, similarly, the processing of not reproducing the second signal or shortening the first signal and then reproducing the second signal after a specific time interval becomes effective.
[0090] In addition, as a reproduction mode of a tactile signal based on the reproduction speed of the content, it is also possible to conceive of performing a process of reproducing the tactile signal when the sound is reproduced according to the reproduction of the video (when the reproduction speed is close to 1.0 times the speed), and performing a process of not reproducing the tactile signal when the sound is not reproduced. On the contrary, it is also possible to conceive of reproducing the tactile signal even when the sound is not reproduced for the purpose of, for example, helping to understand the scene change of the content. Generally, algorithms for automatically generating tactile signals based on the sound output from the terminal are known and used commercially. However, in the present embodiment, the processing is characterized in that the algorithm is operated for the reproduction of the tactile signal even when the sound signal is not reproduced.
[0091] (2.3. Processing flow example)
[0092] In the foregoing, there has been described an example of control performed by the haptic control unit 214 of the reproducing device 200. Next, an example of a process flow of each component according to the present embodiment will be described.
[0093] Figure 7 is a flowchart showing an example of the processing flow of each component according to the present embodiment. In step S1000, the user makes an input, for example, via the input unit 230 of the reproduction device 200. In step S1004, the speed determination unit 211 determines the reproduction speed of the content based on the input. Note that in the case where there is no input made by the user, steps S1000 and S1004 are omitted.
[0094] In the case where the rate of change of the reproduction speed of the content is not higher than a predetermined value (e.g., about 30 [%]) (step S1008 / No), the change of the tactile stimulation according to the frequency change is likely not to be perceived. Therefore, in step S1012, the tactile control unit 214 extends (or compresses) the tactile signal based on the rate of change of the reproduction speed to change the frequency of the tactile signal, thereby extending (or shortening) the reproduction period of the tactile signal. Note that, as Figure 4 As shown, the haptic signal is prolonged when the reproduction speed is decreased, and the haptic signal is compressed when the reproduction speed is increased.
[0095] In the case where the rate of change of the reproduction speed of the content is higher than a predetermined value (e.g., about 30 [%]) (step S1008 / Yes), the change of the tactile stimulation according to the frequency change is likely to be perceived. Therefore, in step S1016, the tactile control unit 214 changes the tactile signal based on the rate of change of the reproduction speed to maintain the frequency of the tactile signal, thereby extending (or shortening) the reproduction period of the tactile signal.
[0096] In step S1020, the tactile output unit 243 outputs a vibration stimulus by using a tactile signal provided from the tactile control unit 214. When the content ends (step S1024 / Yes), a series of processes ends. When the content continues (step S1024 / No), the processes of step S1000 to step S1020 are continued.
[0097] Repeat for each predetermined unit (for example, for each frame) Figure 7 . Therefore, the information processing system 1 according to the present embodiment can provide vibration stimulation more appropriately based on the reproduction speed of the content. Specifically, in a case where the rate of change of the reproduction speed is so low that the change of the tactile stimulation according to the frequency change is not perceived, the information processing system 1 can provide the user with vibration stimulation that does not make the user feel uncomfortable by extending or compressing the tactile signal to change the frequency while reducing the processing load. In addition, even in a case where the rate of change of the reproduction speed is so high that the change of the tactile stimulation according to the frequency change is perceived, the information processing system 1 extends or shortens the reproduction period of the tactile signal to maintain the frequency, so that the user can be provided with vibration stimulation with higher accuracy that does not make the user feel uncomfortable (as intended by the creator).
[0098] Notice, Figure 7 The various steps in the flowchart described in the description do not necessarily need to be performed in a time series in the order described. That is, the various steps in the flowchart may be performed in an order different from the order described, or may be performed in parallel (this also applies to the flowcharts at later stages).
[0099] <3. Modification example>
[0100] Hereinabove, one embodiment of the present disclosure has been described. Next, a modified example of the present disclosure will be described.
[0101] The output range can be limited by the characteristics of the tactile output unit 243 that outputs tactile stimulation. For example, in the case of a vibration actuator that outputs vibration stimulation, the output frequency band is narrower than the frequency band of a speaker that outputs sound, etc., and is about 80 [Hz] to 500 [Hz] in a voice coil motor (VCM) and about 100 [Hz] ± 5 [Hz] in a linear resonant actuator (LRA). In addition, the output intensity can change depending on the frequency change. For example, in the case of a vibration actuator, the acceleration output of the same voltage input can change depending on the frequency change.
[0102] Will refer to Figure 8 Provide a detailed description. Figure 8 is a diagram showing an example of the frequency characteristics of a vibration actuator. Figure 8 In the example shown in FIG. 1 , the acceleration has a maximum value (1A [m / s 2 ]), and when the frequency is 90 [Hz], the acceleration decreases to 1 / 3 of the maximum value (1 / 3 × A [m / s 2 ]). Then, when the frequency is 80[Hz] or less, the acceleration is 0[m / s 2 ]. As described above, the output frequency band of the tactile output unit 243 is limited by its characteristics, and the acceleration output of the same voltage input also changes according to the frequency change. Figure 4 As shown, in the case where the haptic signal is prolonged or compressed based on a change in reproduction speed to change the frequency of the haptic signal, the acceleration output of the same voltage input may also change according to the frequency change, or no vibration stimulation may be output in some cases.
[0103] Therefore, the haptic control unit 214 of the reproducing apparatus 200 according to the modified example may change the haptic signal based on the characteristics of the haptic output unit 243 which outputs the haptic stimulation. Fig. 9 A specific example of a process of changing the reproduction period of a haptic signal based on a change in the reproduction speed of content in the modification example is described. Fig. 9 Haptic signals in a case where the content is reproduced at 1.0 times speed, in a case where the content is reproduced at 0.9 times speed, and in a case where the content is reproduced at 0.8 times speed are shown.
[0104] In the case of reproducing content at 0.9 times speed, when Figure 4 When the method shown in FIG. 1 extends the tactile signal, the frequency of the tactile signal (which is 100 [Hz] at 1.0 times the speed) becomes 90 [Hz] (100×0.9=90 [Hz]), and therefore, in the case of having Figure 8 In the case of the vibration actuator with frequency characteristics shown in Figure 1, the output acceleration changes from 1A [m / s 2 ] is reduced to 1 / 3×A[m / s 2 ]. Therefore, the output intensity of the vibration stimulation becomes weaker than the creator intended. Fig. 9 As shown, the tactile control unit 214 changes the amplitude of the tactile signal to maintain the output intensity of the tactile stimulation before and after the change of the reproduction speed (changing the amplitude of the tactile signal by three times), while extending the tactile signal. Therefore, the tactile control unit 214 can maintain the intensity of the tactile stimulation felt by the user before and after the change of the reproduction speed.
[0105] In addition, in the case of reproducing content at 0.8 times speed, when Figure 4 When the tactile signal is extended by the method shown in , the frequency of the tactile signal (which is 100 [Hz] at 1.0 times the speed) becomes 80 [Hz] (100×0.8=80 [Hz]). Figure 8 In the case of the vibration actuator with frequency characteristics shown in Figure 1, the output acceleration changes from 1A [m / s 2 ] to 0[m / s 2 ]. Therefore, no vibration stimulation is provided. Therefore, in a case where the output intensity of the tactile stimulation after the change in the reproduction speed is weaker than a predetermined value (for example, in a case where the output intensity is too weak to be coped with by amplifying the amplitude of the tactile signal), the tactile control unit 214 may limit the rate of change of the frequency before and after the change in the reproduction speed. Specifically, as Fig. 9 As shown, the tactile control unit 214 limits the rate of change of the frequency before and after the change of the reproduction speed to 0.9 (that is, the lower limit of the frequency is set to 90 [Hz], which is the frequency at 0.9 times the speed), and when the reproduction speed is changed so that the frequency is below 90 [Hz], the tactile signal is extended to maintain 90 [Hz]. For example, the tactile control unit 214 can extend the tactile signal by performing a process similar to the speech rate conversion process performed by the sound control unit 213 to maintain the frequency of the tactile signal at 90 [Hz] (not necessarily using the speech rate conversion process). At this time, similar to the case of 0.9 times the speed, the tactile control unit 214 changes the amplitude of the tactile signal by three times. Therefore, even in the case where the rate of change of the reproduction speed is high enough to deviate from the output range of the tactile output unit 243, the tactile control unit 214 can appropriately output tactile stimulation.
[0106] Note that, regarding the user's perception characteristics of tactile stimulation, in the case where the user feels the tactile stimulation more strongly as the frequency of the tactile stimulation is lower (in the case where the frequency of the tactile stimulation and the perceived intensity have a nonlinear relationship), the tactile control unit 214 may also change the tactile signal based on the user's perception characteristics. Therefore, the tactile control unit 214 may maintain the user's perceived intensity of the tactile stimulation with higher accuracy before and after the change in the reproduction speed.
[0107] In addition, in the above description, the mode of providing tactile stimulation in the modified example has been described. The mode of providing video and sound in the modified example can be similar to the mode described in the above embodiment. For example, the sound control unit 213 can change the reproduction period by speech rate conversion processing before and after the change of the reproduction speed while maintaining the quality and tone of the sound, or it is not necessary to maintain the quality and tone of the sound.
[0108] Fig.10 is a flowchart showing an example of the processing flow of each component according to the modified example. In step S1100, the user makes an input, for example, via the input unit 230 of the reproduction device 200. In step S1104, the speed determination unit 211 determines the reproduction speed of the content based on the input. Note that in the case where there is no input made by the user, steps S1100 and S1104 are omitted.
[0109] In the case where the rate of change of the reproduction speed of the content is not higher than a predetermined value (e.g., about 30 [%]) (step S1108 / No) and the acceleration is not lower than a predetermined value (i.e., the output intensity of the tactile stimulation is not weaker than the predetermined value, step S1112 / No), in step S1116, the tactile control unit 214 extends (or compresses) the tactile signal based on the rate of change of the reproduction speed to change the frequency of the tactile signal, and amplifies (or attenuates) the amplitude of the tactile signal based on the frequency characteristics of the tactile output unit 243. That is, the tactile control unit 214 performs Fig. 9 The processing is performed at 0.9 times the speed.
[0110] In step S1112, when the acceleration is lower than the predetermined value (i.e., when the output intensity of the tactile stimulation is weaker than the predetermined value, step S1112 / Yes), in step S1120, the tactile control unit 214 extends (or compresses) the tactile signal while limiting the frequency change rate based on the change rate of the reproduction speed and the frequency characteristics of the tactile output unit 243, and amplifies (or attenuates) the amplitude of the tactile signal. That is, the tactile control unit 214 performs Fig. 9 The processing is performed at 0.8 times the speed.
[0111] In step S1108, when the rate of change of the reproduction speed of the content is higher than a predetermined value (e.g., about 30 [%]) (step S1108 / Yes), the change of the tactile stimulation according to the frequency change is likely to be perceived. Therefore, in step S1124, the tactile control unit 214 changes the tactile signal based on the rate of change of the reproduction speed to maintain the frequency of the tactile signal, thereby extending (or shortening) the reproduction period of the tactile signal.
[0112] In step S1128, the tactile output unit 243 outputs a vibration stimulus by using the tactile signal provided from the tactile control unit 214. When the content ends (step S1132 / Yes), a series of processes ends. When the content continues (step S1132 / No), the processes of step S1100 to step S1128 are continued.
[0113] Repeat for each predetermined unit (for example, for each frame) Fig.10 Therefore, the information processing system 1 according to the modified example can provide vibration stimulation more appropriately based on the characteristics of the tactile output unit 243. Note that the technical matters described in the above embodiment can also be applied to the modified example.
[0114] <4. Notes>
[0115] As described above, the speed of scene change by operation of a user interface for controlling the reproduction scene of content (e.g., movement of a knob on a search bar, etc.) can be regarded as the reproduction speed. Therefore, hereinafter, as an example, a specific example in the case of changing the reproduction speed by moving a knob on a search bar will be described.
[0116] Fig.11 is a diagram for describing a specific example of a video 10 displayed in a case where the reproduction speed is changed by moving a knob on a seek bar. Fig.11 The video 10 of the embodiment of the present invention shows a scene in which a baseball player swings a bat to hit a ball. Then, a search bar 20, a knob 21 and a mark 22 indicating a scene providing tactile stimulation for controlling the reproduction scene are displayed at the lower side of the video 10.
[0117] The user can change the reproduction scene by moving the position of the knob 21 on the search bar 20 using the input unit 230 of the reproduction device 200. In addition, when the position of the knob 21 reaches the mark 22, a tactile stimulation is then provided. In this way, by displaying the mark 22 indicating the scene where the tactile stimulation is provided, the user can also use the mark 22 as a guide when searching for a desired scene.
[0118] Then, the tactile control unit 214 of the reproduction device 200 processes the moving speed (scene change speed) of the knob 21 on the search bar 20, for example, as the reproduction speed (not necessarily limited to the moving speed of the knob 21). That is, the tactile control unit 214 changes the tactile signal based on the change in the moving speed of the knob 21 to change the reproduction period of the tactile signal. At this time, the tactile control unit 214 can change the tactile signal to change the frequency of the tactile signal, or can change the tactile signal to maintain the frequency of the tactile signal. In addition, as in the modified example, the tactile control unit 214 can change the tactile signal based on the characteristics of the tactile output unit 243. Alternatively, regardless of the moving speed of the knob, the tactile signal of the original content can be reproduced while maintaining the frequency and the reproduction period. In this case, the tactile signal is reproduced at the timing when the knob reaches the mark. The tactile signal provided with a mark and reproduced when the knob moves can be limited to the characteristic part in the tactile signal provided to the entire content. As a method of extracting a characteristic portion, for example, a portion where the signal amount exceeds a specific value, a portion where the signal strength per unit time exceeds a specific value, etc. may be extracted. Alternatively, extraction may be performed by limiting the number of portions to be reproduced per unit time (for example, "one portion of a 5-second scene") according to the movement speed of the knob.
[0119] In addition, despite Fig.11, but a method of not displaying the mark at the portion extracted as the characteristic portion may be adopted. In either case, by reproducing the tactile signal according to the search bar operation, the tactile stimulation is presented to the user's finger at the timing when the knob 21 passes through a specific portion (for example, a scene where the ball hits the bat) according to the operation performed by the user on the knob 21 (for example, moving to the left), so that the effect of making it easier for the user to search for scenes and understand scene changes can be obtained. At this time, for example, consider a case where a tactile signal of one second is given to each of two scenes with a time interval of 5 seconds, and in a case where the movement speed of the finger is high and the finger passes through the two scenes within one second, the reproduction of the second tactile signal starts before the reproduction of the first tactile signal ends, and therefore, there is a possibility that the two tactile signals are mixed. In such a case, the reproduction of the latter tactile signal can be omitted. In addition, as a human tactile characteristic, it is known that when the time interval between two tactile (vibration) stimulations is equal to or less than a specific value (it is said that the time interval is, for example, about 10 [ms] when the vibration stimulation is strong, and about 50 [ms] when the vibration stimulation is weak), the two stimulations are connected and felt as one stimulation. Therefore, in consideration of this numerical value, in a condition where a tactile signal is reproduced according to a search bar operation, when the time interval between the two tactile signals (the end of the first tactile signal and the beginning of the second tactile signal) is equal to or less than a specific range, a process of not reproducing the second signal or a process of shortening the first signal and then reproducing the second signal after a specific time interval becomes effective.
[0120] Note that examples of methods for operating the search bar may include touch operations on a touch panel UI, remote control operations when watching on a TV screen, mouse operations when watching on a PC screen, touchpad operations, and the like. In addition, in the case of a search bar operation, similar to the above description, it is also possible to imagine that a process of reproducing a tactile signal is performed in the case of reproducing sound according to the reproduction of the video (in the case where the movement speed of the search bar is close to 1.0 times the speed), and a process of not reproducing a tactile signal is performed in the case of not reproducing the sound. On the contrary, it is also possible to imagine that even in the case of not reproducing the sound, a tactile signal is reproduced for the purpose of, for example, helping to understand the scene change of the above content. Generally, algorithms for automatically generating tactile signals based on the sound output from the terminal are known and used commercially. However, in the present embodiment, the processing is characterized in that the algorithm is operated for the reproduction of the tactile signal even when the sound signal is not reproduced. Note that the user interface for controlling the reproduction scene of the content is not necessarily limited to the search bar 20.
[0121] <5. Hardware Configuration Example>
[0122] Next, we will refer to Fig.12 Hardware configuration examples according to the present embodiment and modification examples are described. Fig.12 1 is a block diagram showing a hardware configuration example of an information processing device 900 that implements the reproduction device 200 (or distribution device 100) according to the present embodiment and the modified example. The information processing performed by the reproduction device 200 (or distribution device 100) according to the present embodiment and the modified example is implemented by the cooperation of the following software and hardware.
[0123] like Fig.12 As shown, the information processing device 900 includes a central processing unit (CPU) 901, a read-only memory (ROM) 902, a random access memory (RAM) 903, and a host bus 904a. In addition, the information processing device 900 includes a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a drive 909, a connection port 911, and a communication device 913. Instead of the CPU 901 or in addition to the CPU 901, the information processing device 900 may include a processing circuit such as a DSP or an ASIC.
[0124] The CPU 901 functions as an operation processing device and a control device, and controls the overall operation in the information processing device 900 according to various programs. In addition, the CPU 901 may be a microprocessor. The ROM 902 stores programs, calculation parameters, and the like used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that are appropriately changed in the execution, and the like. The CPU 901 may realize the control unit 210 of the reproduction device 200 (or the control unit 110 of the distribution device 100).
[0125] The CPU 901, the ROM 902, and the RAM 903 are connected to each other via a host bus 904a including a CPU bus, etc. The host bus 904a is connected to an external bus 904b such as a peripheral component interconnect / interface (PCI) bus via a bridge 904. Note that the host bus 904a, the bridge 904, and the external bus 904b do not need to be separate components, and these functions may be realized by one bus.
[0126] The input device 906 is implemented by, for example, a device such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, or a joystick, by which information is input by a user. In addition, the input device 906 may be, for example, a remote control device using infrared or other radio waves, or may be an external connection device such as a mobile phone or a PDA that supports the operation of the information processing device 900. In addition, the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by the user using the above-mentioned input means and outputs the input signal to the CPU 901. By operating the input device 906, the user can input various data to the information processing device 900 and instruct processing operations. The input device 906 can implement the input unit 230 of the reproduction device 200.
[0127] The output device 907 is configured by using a device capable of visually, auditorily, or tactilely notifying the user of acquired information. Examples of such a device include: a video output device such as a CRT display device, a liquid crystal display device, a plasma display device, or an EL display device; a sound output device such as a speaker or a headphone; a tactile output device such as a vibration actuator; and the like. The output device 907 outputs, for example, a result obtained by various processes performed by the information processing device 900. The output device 907 can implement the output unit 240 of the reproduction device 200.
[0128] The storage device 908 is a data storage device configured as an example of a storage unit that can be included in the information processing device 900. The storage device 908 is implemented by, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. Examples of the storage device 908 may include a storage medium, a recording device that records data in a storage medium, a reading device that reads data from a storage medium, and a deleting device that deletes data recorded in a storage medium. The storage device 908 stores a program executed by the CPU 901, various data, various data acquired from the outside, and the like. The storage device 908 can implement the storage unit 250 of the reproduction device 200 (or the storage unit 130 of the distribution device 100).
[0129] The drive 909 is a reader / writer for a storage medium, and is built in the information processing apparatus 900 or externally attached to the information processing apparatus 900. The drive 909 reads information recorded in a removable storage medium such as a mounted magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903. Furthermore, the drive 909 can also write information to the removable storage medium.
[0130] The connection port 911 is an interface connected to an external device, and is a connection port for connecting to an external device capable of transmitting data through, for example, a universal serial bus (USB) or the like.
[0131] The communication device 913 is, for example, a communication interface for connecting to the network 920 configured by using a communication device or the like. The communication device 913 is, for example, a communication card for a wired or wireless local area network (LAN), long term evolution (LTE), Bluetooth (registered trademark), wireless USB (WUSB), etc. In addition, the communication device 913 may be a router for optical communication, a router for an asymmetric digital subscriber line (ADSL), a modem for various types of communication, etc. The communication device 913 may, for example, send a signal to the Internet and another communication device and receive a signal from the Internet and another communication device according to a predetermined protocol such as TCP / IP. The communication device 913 may implement the communication unit 220 of the reproduction device 200 (or the communication unit 120 of the distribution device 100).
[0132] Note that the network 920 is a wired or wireless transmission path of information transmitted from a device connected to the network 920. For example, the network 920 may include: a public line network such as the Internet, a telephone line network, or a satellite communication network; various local area networks (LANs) including Ethernet (registered trademark); a wide area network (WAN), etc. In addition, the network 920 may include a dedicated line network such as an Internet Protocol-Virtual Private Network (IP-VPN).
[0133] An example of a hardware configuration capable of realizing the functions of the information processing device 900 according to the present embodiment has been described above. Each of the above components can be realized by using a general-purpose component, or can be realized by hardware dedicated to the functions of each component. Therefore, the hardware configuration to be used can be appropriately changed according to the technical level when realizing the present embodiment.
[0134] Note that a computer program for realizing each function of the information processing device 900 according to the present embodiment as described above can be created, and the computer program can be installed in a PC or the like. In addition, a computer-readable recording medium having such a computer program stored therein can be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, and the like. In addition, the above-mentioned computer program can be distributed via, for example, a network without using a recording medium.
[0135] <6. Conclusion>
[0136] As described above, the information processing device according to the present disclosure generates a tactile signal for providing a user with a tactile stimulus corresponding to the content based on the reproduction speed of the content provided to the user. Specifically, the information processing device according to the present disclosure changes the tactile signal based on the change in the reproduction speed of the content. For example, the information processing device according to the present disclosure changes the tactile signal based on the change in the reproduction speed of the content to change the reproduction period of the tactile signal.
[0137] Therefore, the information processing device according to the present disclosure can provide tactile stimulation more appropriately based on the reproduction speed of the content. Since human senses are relatively insensitive to changes in the frequency of tactile stimulation, even when the tactile signal is changed to change the reproduction period of the tactile signal, the information processing device according to the present disclosure can provide the user with tactile stimulation that does not make the user feel uncomfortable. At this time, the information processing device according to the present disclosure can change the tactile signal in various modes, such as changing the tactile signal to change the frequency or changing the tactile signal to maintain the frequency.
[0138] As described above, the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It will be obvious to those skilled in the art that various modifications or changes can be conceived within the scope of the technical ideas described in the claims, and it is naturally understood that these modifications or changes fall within the technical scope of the present disclosure.
[0139] In addition, the effects described in this specification are only illustrative or exemplary, not restrictive. That is, in addition to or instead of the above effects, the technology according to the present disclosure may also exhibit other effects that are obvious to those skilled in the art based on the description of this specification.
[0140] Note that the following configurations also fall within the technical scope of the present disclosure.
[0141] (1) An information processing device comprising:
[0142] A haptic control unit generates a signal for providing a haptic stimulation corresponding to the content to the user based on a reproduction speed of the content provided to the user.
[0143] (2) The information processing device according to (1) above, wherein:
[0144] The haptic control unit changes the signal based on the change in the reproduction speed.
[0145] (3) The information processing device according to (2) above, wherein:
[0146] The haptic control unit changes the signal based on the change in the reproduction speed to change a reproduction period of the signal.
[0147] (4) The information processing device according to (3) above, wherein:
[0148] The haptic control unit lengthens or compresses the signal to change a frequency of the signal based on the change in the reproduction speed.
[0149] (5) The information processing device according to (3) above, wherein:
[0150] The haptic control unit changes the signal to maintain a frequency of the signal based on the change in the reproduction speed.
[0151] (6) The information processing device according to (5) above, wherein:
[0152] In a case where a rate of change of the reproduction speed is higher than a predetermined value, the haptic control unit changes the signal based on the rate of change to maintain a frequency of the signal.
[0153] (7) The information processing device according to (4) above, wherein:
[0154] The tactile control unit changes the signal based on characteristics of a tactile output unit that outputs the tactile stimulus.
[0155] (8) The information processing device according to (7) above, wherein:
[0156] The tactile control unit changes the amplitude of the signal to maintain the output intensity of the tactile stimulation before and after the change of the reproduction speed.
[0157] (9) The information processing device according to (8) above, wherein:
[0158] In a case where the output intensity of the tactile stimulation after the change in the reproduction speed is lower than a predetermined value, the tactile control unit limits a change rate of the frequency before and after the change in the reproduction speed.
[0159] (10) The information processing device according to any one of (1) to (9) above, wherein:
[0160] The reproduction speed is determined based on an input made by the user.
[0161] (11) The information processing device according to any one of (1) to (10) above, wherein:
[0162] The tactile stimulation includes at least one of: vibration stimulation, electrical stimulation, stimulation caused by temperature change, stimulation related to force sensation, or stimulation related to skin sensation.
[0163] (12) An information processing method executed by a computer, the information processing method comprising:
[0164] A signal for providing a tactile stimulation corresponding to the content to the user is generated based on a reproduction speed of the content provided to the user.
[0165] (13) A program for causing a computer to perform the following operations:
[0166] A signal for providing a tactile stimulation corresponding to the content to the user is generated based on a reproduction speed of the content provided to the user.
[0167] (14) An information processing device comprising:
[0168] a communication unit that receives a signal generated based on a reproduction speed of content provided to a user and used to provide a tactile stimulation corresponding to the content to the user; and
[0169] A tactile output unit is configured to output the tactile stimulation by using the signal.
[0170] Reference numerals list
[0171] 100 Distribution Device
[0172] 110 Control unit
[0173] 111 Video Control Unit
[0174] 112 Sound Control Unit
[0175] 113 Haptic Control Unit
[0176] 120 Communication Unit
[0177] 130 storage units
[0178] 200 Reproduction Device
[0179] 210 Control unit
[0180] 211 Speed determination unit
[0181] 212 Video Control Unit
[0182] 213 Sound Control Unit
[0183] 214 Haptic Control Unit
[0184] 220 Communication Unit
[0185] 230 Input unit
[0186] 240 Output Units
[0187] 241 Video Output Unit
[0188] 242 Sound output unit
[0189] 243 Tactile output unit
[0190] 250 storage units
Claims
1. An information processing device, comprising: a haptic control unit configured to generate a signal for providing a haptic stimulus corresponding to the content to the user based on a reproduction speed of the content provided to the user, The haptic control unit is further configured to change the signal based on the change rate to maintain the frequency of the signal when the change rate of the reproduction speed is higher than a predetermined value.
2. The information processing device according to claim 1, wherein: The haptic control unit is further configured to change the signal based on the change in the reproduction speed to change a reproduction period of the signal.
3. The information processing device according to claim 2, wherein: The haptic control unit is further configured to lengthen or compress the signal to change a frequency of the signal based on the change in the reproduction speed.
4. The information processing device according to claim 3, wherein: The haptic control unit is further configured to change the signal based on a characteristic of a haptic output unit that outputs the haptic stimulus.
5. The information processing device according to claim 4, wherein: The haptic control unit is further configured to change the amplitude of the signal to maintain the output intensity of the haptic stimulation before and after the change in the reproduction speed.
6. The information processing device according to claim 5, wherein: The haptic control unit is further configured to, in a case where the output intensity of the tactile stimulation after the change in the reproduction speed is lower than the predetermined value, limit a change rate of the frequency before and after the change in the reproduction speed.
7. The information processing device according to claim 1, wherein: The reproduction speed is determined based on an input made by the user.
8. The information processing device according to claim 1, wherein: The tactile stimulation includes at least one of: vibration stimulation, electrical stimulation, stimulation caused by temperature change, stimulation related to force sensation, or stimulation related to skin sensation.
9. The information processing device according to claim 1, further comprising: a communication unit configured to receive the signal; as well as A tactile output unit is configured to output the tactile stimulation by using the signal.
10. An information processing method executed by a computer, the information processing method comprising: generating a signal for providing a tactile stimulation corresponding to the content to the user based on a reproduction speed of the content provided to the user, and In a case where the rate of change of the reproduction speed is higher than a predetermined value, the signal is changed based on the rate of change to maintain the frequency of the signal.
11. A computer-readable storage medium storing a program, the program being configured to cause a computer to perform the following operations: generating a signal for providing a tactile stimulation corresponding to the content to the user based on a reproduction speed of the content provided to the user, and In a case where the rate of change of the reproduction speed is higher than a predetermined value, the signal is changed based on the rate of change to maintain the frequency of the signal.
Citation Information
Patent Citations
Information processing device, information processing method, and program
JP2018064264A
Haptic playback adjustment system
CN106095069A
Modifying haptic effects for slow motion
CN107106908A
Audio data output and manipulation using haptic feedback
JP2005506614A
Correction of haptic effects for slow motion
JP2018513430A
