Tactile presentation system, control device, and computer program
The tactile sensation presenting device and system dynamically associate tactile feedback with specific positions on media content by using a reading device, vibration source, and control device, enhancing user engagement with media content.
Patent Information
- Application Number
- JP2024070420
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-04-24
- Publication Date
- 2025-06-18
- Estimated Expiration
- 2040-07-01
AI Technical Summary
Existing technologies for presenting tactile sensations to users, such as electronic input devices modeled after writing instruments, lack innovative applications that can dynamically associate tactile feedback with specific positions on media content.
A tactile sensation presenting device and system that includes a housing, a reading device to identify positions on media content, a vibration source to generate tactile feedback, and a control device to synchronize vibrations with vibration waveform information associated with those positions.
Enables the presentation or change of tactile sensations in association with positions on media content, providing a novel and engaging media content experience for users.
Smart Images

Figure 0007695443000001 
Figure 0007695443000002 
Figure 0007695443000003
Abstract
Description
Technical Field
[0001] The present invention relates to an apparatus and a system for presenting a tactile sensation to a user using a vibration source. The present invention also relates to a control device that generates vibration in the vibration source in the apparatus or the system. The present invention also relates to a computer program executable by a processing unit of the control device.
Background Art
[0002] Patent Document 1 discloses an electronic input device modeled after a writing instrument as an example of a tactile sensation presenting device. The device includes a vibration source that generates vibration corresponding to an operation when a writing operation by a user is detected. The vibration presents a tactile sensation as if writing by hand to the user.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] An object of the present invention is to provide a novel application of tactile sensation presenting technology.
Means for Solving the Problems
[0005] One aspect for achieving the above object is a tactile sensation presenting device, comprising: a housing having a shape that can be held by a user; a reading device mounted on the housing and configured to read identification information associated with a position on media content; a vibration source mounted on the housing and capable of generating vibration; a control device mounted on the housing and configured to generate vibration corresponding to vibration waveform information associated with the identification information in the vibration source. is provided with.
[0006] One aspect for achieving the above object is a control device mounted on a tactile presentation device having a shape that can be held by a user, a reception unit that receives identification information associated with a position on media content, a processing unit that generates, at a vibration source, a vibration corresponding to vibration waveform information associated with the identification information, is provided with.
[0007] One aspect for achieving the above object is a computer program executable by a processing unit of a control device mounted on a tactile presentation device having a shape that can be held by a user, which, when executed, causes the control device to receive identification information associated with a position on media content, generate, at a vibration source, a vibration corresponding to vibration waveform information associated with the identification information.
[0008] One aspect for achieving the above object is a tactile presentation system, a display device capable of displaying media content, a position specifying device having a shape that can be held by a user and specifying a position on the media content, a position detection unit mounted on the display device and outputting position information corresponding to the position on the media content specified by the position specifying device, a vibration source mounted on the position specifying device, a storage device storing vibration waveform information associated with the position information, a control device that generates, at the vibration source, a vibration corresponding to the vibration waveform information, is provided with.
[0009] One aspect for achieving the above object is a control device, A receiving unit that receives position information corresponding to a position on media content that is displayed by a display device and specified by a position specifying device; A processing unit that generates, at a vibration source, a vibration corresponding to vibration waveform information associated with the position information; It is provided with.
[0010] One aspect for achieving the above object is a computer program executable by a processing unit of a control device, When executed, cause the control device to Receive position information corresponding to a position on media content that is displayed by a display device and specified by a position specifying device, Generate, at a vibration source, a vibration corresponding to vibration waveform information associated with the position information.
[0011] According to the configuration according to each of the above aspects, the tactile sensation presented to the user through the vibration source can be presented or changed in association with the position on the media content. As a result, as a novel application of tactile sensation presentation technology, an interesting media content experience can be provided to the user.
Brief Description of the Drawings
[0012]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Embodiments for Carrying Out the Invention
[0013] With reference to the accompanying drawings, examples of embodiments will be described in detail below. In each of the drawings used in the following description, the scale is appropriately changed in order to make each member recognizable in size.
[0014] FIG. 1 illustrates a tactile presentation device 10 according to an embodiment. The tactile presentation device 10 includes a housing 11 having a shape that can be held by a user. In this example, the housing 11 has a shape that can be held by a user's finger, but may have a shape that can be grasped by a hand, or may have a shape that can be held by other body parts.
[0015] The user brings the tactile presentation device 10 close to a specific position in the media content M illustrated in FIGS. 2 and 3, and receives presentation of vibration according to the content at that position. The media content M may be printed on a book 20 as illustrated in FIG. 4, or may be displayed on a display unit 31 of a display device 30 as illustrated in FIG. 5.
[0016] Identification information is arranged on the media content M in a manner that does not interfere with the visual recognition of the content. The identification information is provided in the form of an optically readable code. Examples of such identification information include one-dimensional codes such as barcodes, and two-dimensional codes such as QR codes (registered trademark) and grid outputs (registered trademark). The identification information is generated to include at least information specifying a position on the media content M.
[0017] FIG. 6 illustrates the functional configuration of the tactile presentation device 10. The tactile presentation device 10 includes a reading device 12. The reading device 12 is mounted on the housing 11. The reading device 12 is configured to optically read the identification information ID disposed on the media content M. For example, when the identification information ID is printed on the book 20 using carbon ink or stealth ink that absorbs infrared light, the reading device 12 includes a light source that emits infrared light and a light receiving element that outputs a reading signal RS corresponding to the reflected light intensity. According to such a configuration, the identification information ID itself is not visually recognized by the user, and the identification information ID is read as a portion with low reflected light intensity. The reading signal RS corresponding to the identification information ID may be an analog signal or a digital signal.
[0018] The tactile presentation device 10 includes a vibration source 13. The vibration source 13 is mounted on the housing 11. The vibration source 13 is a device that generates vibration. The vibration source 13 can be realized by a voice coil, an actuator, a piezo element, an eccentric motor, or the like. The vibration generated by the vibration source 13 is presented to the user as a tactile sensation through the housing 11.
[0019] The tactile presentation device 10 includes a storage unit 14. The storage unit 14 stores vibration waveform information VW associated with the identification information ID. The vibration waveform information VW represents the waveform of the vibration generated by the vibration source 13. The storage unit 14 can be realized by a semiconductor memory or the like.
[0020] The tactile presentation device 10 includes a control device 15. The control device 15 is mounted on the housing 11. The control device 15 includes a reception unit 151. The reception unit 151 is configured as an interface that receives the reading signal RS output from the reading device 12. When the reading signal RS is an analog signal, the reception unit 151 includes an appropriate conversion circuit including an A / D converter.
[0021] The control device 15 includes a processing unit 152. The processing unit 152 is configured to read out vibration waveform information VW associated with identification information ID corresponding to the read signal RS received by the reception unit 151 from the storage unit 14.
[0022] The control device 15 includes an output unit 153. The processing unit 152 is configured to output, from the output unit 153, a control signal CS for causing the vibration source 13 to generate vibrations corresponding to the vibration waveform information VW. That is, the output unit 153 is configured as an interface for outputting the control signal CS. The control signal CS may be a digital signal or an analog signal. When the control signal CS is an analog signal, the output unit 153 includes an appropriate conversion circuit including a D / A converter.
[0023] The vibration source 13 that has received the control signal CS generates vibrations corresponding to the vibration waveform information VW. The vibrations are presented as a tactile sensation to the user holding the housing 11.
[0024] With reference to FIGS. 2 and 3, some specific operation examples of the tactile sensation presentation device 10 configured as described above will be described.
[0025] In the media content M illustrated in FIG. 2, a plurality of types of vehicles and a plurality of types of organisms are depicted. Identification information ID for specifying the position of each picture in the media content M is arranged at the location where each picture is drawn. In the storage unit 14 of the tactile sensation presentation device 10, vibration waveform information VW corresponding to the traveling sound of each vehicle and the crying sound or movement sound of each organism is stored.
[0026] As an example, when the user brings the reading device 12 of the tactile presentation device 10 close to a picture of a dog, identification information ID corresponding to the position of the picture of the dog is read. The reading device 12 outputs a reading signal RS corresponding to the read identification information ID. The reception unit 151 of the control device 15 receives the reading signal RS. The processing unit 152 of the control device 15 reads out vibration waveform information VW associated with the identification information ID corresponding to the reading signal RS from the storage unit 14. This vibration waveform information VW represents a vibration waveform corresponding to the barking sound of the dog. Thereby, the position of the picture of the dog specified through the reading device 12 and the vibration waveform corresponding to the barking sound of the dog are associated with each other.
[0027] The processing unit 152 causes a sound source (not shown) to output the barking sound of the dog, and outputs a control signal CS for generating vibrations corresponding to the vibration waveform information VW to the vibration source 13 from the output unit 153. The user who has brought the tactile presentation device 10 close to the picture of the dog hears the barking sound of the dog and receives the presentation of the tactile sensation corresponding to the barking sound of the dog.
[0028] As another example, when the user brings the reading device 12 of the tactile presentation device 10 close to a picture of a motorcycle, identification information ID corresponding to the position of the picture of the motorcycle is read. The reading device 12 outputs a reading signal RS corresponding to the read identification information ID. The reception unit 151 of the control device 15 receives the reading signal RS. The processing unit 152 of the control device 15 reads out vibration waveform information VW associated with the identification information ID corresponding to the reading signal RS from the storage unit 14. This vibration waveform information VW represents a vibration waveform corresponding to the running sound of the motorcycle. Thereby, the position of the picture of the motorcycle specified through the reading device 12 and the vibration waveform corresponding to the running sound of the motorcycle are associated with each other.
[0029] The processing unit 152 causes a sound source (not shown) to output the running sound of the motorcycle, and outputs a control signal CS for generating vibrations corresponding to the vibration waveform information VW to the vibration source 13 from the output unit 153. The user who has brought the tactile presentation device 10 close to the picture of the motorcycle hears the running sound of the motorcycle and receives the presentation of the tactile sensation corresponding to the running sound of the motorcycle.
[0030] In the media content M illustrated in FIG. 2, a circuit course is depicted. The circuit course includes a normal paved road section, a wooden bridge section, and a stone paved section. Identification information ID for specifying the position of the picture in the media content M is arranged at the location where the picture of each section is drawn.
[0031] When the user moves the tactile presentation device 10 so as to trace the paved road section of the circuit course, the identification information ID corresponding to the position of the paved road section is read by the reading device 12. The reading device 12 outputs a reading signal RS corresponding to the read identification information ID. The reception unit 151 of the control device 15 receives the reading signal RS. In this case, the processing unit 152 of the control device 15 may be configured to output, from the output unit 153, a control signal CS for generating vibrations corresponding to the traveling sound of a vehicle selected in advance to the vibration source 13. In addition, when the tactile presentation device 10 traces the wooden bridge section or the stone paved section, the processing unit 152 may be configured to output, from the output unit 153, a control signal CS for generating vibrations corresponding to the modulated traveling sound as if the vehicle is traveling on a wooden bridge or a stone paved surface to the vibration source 13.
[0032] For example, after a motorcycle is selected as described above and the user traces the paved road section of the circuit course with the tactile presentation device 10, the processing unit 152 causes a sound source (not shown) to output the traveling sound of the motorcycle, and generates vibrations corresponding to the traveling sound to the vibration source 13. When the tactile presentation device 10 traces the wooden bridge section, the traveling sound of the motorcycle output from the sound source changes as if it is crossing the wooden bridge, and the presented tactile sensation also changes. When the user is a child, it is possible not only to stimulate the interest in animals and vehicles, but also to promote the acquisition of the technique of writing characters through the act of tracing the route.
[0033] In the media content M illustrated in FIG. 3, an orchestra is depicted. At the location where each orchestral instrument is depicted, identification information ID for specifying the position of that picture in the media content M is arranged. In the storage unit 14 of the tactile presentation device 10, vibration waveform information VW corresponding to the performance sound of each instrument is stored.
[0034] As an example, when the user brings the reading device 12 of the tactile presentation device 10 close to the picture of the clarinet, the identification information ID corresponding to the position of the picture of the clarinet is read. The reading device 12 outputs a reading signal RS corresponding to the read identification information ID. The reception unit 151 of the control device 15 receives the reading signal RS. The processing unit 152 of the control device 15 reads out the vibration waveform information VW associated with the identification information ID corresponding to the reading signal RS from the storage unit 14. This vibration waveform information VW represents the vibration waveform corresponding to the performance sound of the clarinet. Thereby, the position of the picture of the clarinet specified through the reading device 12 and the vibration waveform corresponding to the performance sound of the clarinet are associated.
[0035] The processing unit 152 causes a sound source (not shown) to output the performance sound of the clarinet, and outputs a control signal CS for generating vibrations corresponding to the vibration waveform information VW from the output unit 153 to the vibration source 13. The user who brings the tactile presentation device 10 close to the picture of the clarinet hears the performance sound of the clarinet and receives the presentation of the tactile sensation corresponding to the performance sound of the clarinet.
[0036] In the media content M illustrated in FIG. 3, a plurality of marks each specifying a specific piece of music are depicted. At the location where each mark is depicted, identification information ID for specifying the position of that mark in the media content M is arranged.
[0037] When the user brings the tactile presentation device 10 close to a mark representing a specific piece of music, identification information ID corresponding to the position of the mark is read by the reading device 12. The reading device 12 outputs a reading signal RS corresponding to the read identification information ID. The reception unit 151 of the control device 15 receives the reading signal RS. In this case, the processing unit 152 of the control device 15 may be configured to output, from the output unit 153, a control signal CS that causes the vibration source 13 to generate vibrations corresponding to the sound of the music corresponding to the mark with a previously selected musical instrument. In addition, when the user brings the tactile presentation device 10 close to a picture of another musical instrument during the performance of the music, the processing unit 152 may be configured to output, from the output unit 153, a control signal CS that superimposes vibrations corresponding to the performance sound of the musical instrument on the vibration source 13.
[0038] For example, after the clarinet is selected as described above and the user brings the tactile presentation device 10 close to a mark representing "Piece of Music 1", the processing unit 152 causes a sound source (not shown) to output the sound of the clarinet playing "Piece of Music 1" and causes the vibration source 13 to generate vibrations corresponding to the performance sound. Then, when the user brings the tactile presentation device 10 close to the picture of the flute, the sound of the flute overlaps the performance of "Piece of Music 1" output from the sound source, and the tactile sensation corresponding to the performance sound of the flute is presented superimposedly. As a result, the user can experience a feeling as if conducting an orchestra. When the user is a young child, it is possible to promote the acquisition of a sense of pitch and interest in ensemble playing.
[0039] As another example of media content M in which sound and tactile sensation are presented superimposedly each time a plurality of pictures are selected, a cooking guide can be cited. For example, the cooking guide may include pictures of a plurality of ingredients and a plurality of cooking utensils required for cooking a specific menu. The cooking utensils may include a kitchen knife, a frying pan, a pot, and the like. When the user selects a picture of a kitchen knife and then selects a picture of a specific ingredient, the processing unit 152 causes a sound source (not shown) to output a sound of the ingredient being cut, and outputs a vibration corresponding to the cutting to the vibration source 13. When the user selects a picture of a frying pan and then selects a picture of a specific ingredient, the processing unit 152 outputs a sound of the ingredient being cooked by heating, and outputs a vibration corresponding to the cooking by heating to the vibration source 13. Further, when the user selects another ingredient, sounds and vibrations corresponding to the cooking by heating of the other ingredient are output superimposedly. Thereby, the user can experience a feeling as if cooking is being performed. When the user is an infant, understanding of ingredients and cooking methods can be promoted.
[0040] According to the configuration according to the present embodiment, the tactile sensation presented to the user through the vibration source 13 can be presented or changed in association with the position on the media content M. Thereby, as a novel application of the tactile sensation presentation technology, a media content experience rich in interest can be provided to the user.
[0041] As illustrated in FIG. 6, the tactile sensation presentation device 10 may include an acceleration detection unit 16. The acceleration detection unit 16 is configured to output an acceleration signal AS corresponding to the acceleration applied to the housing 11 using a well-known method. The acceleration signal AS may be a digital signal or an analog signal.
[0042] In this example, the reception unit 151 of the control device 15 is configured as an interface that also receives the acceleration signal AS. When the acceleration signal AS is an analog signal, the reception unit 151 includes an appropriate conversion circuit including an A / D converter.
[0043] In this example, the processing unit 152 of the control device 15 is configured to output, from the output unit 153, a control signal CS that modulates the vibration generated in the vibration source 13 based on the acceleration signal AS received by the reception unit 151.
[0044] As an example, in the case of the media content M illustrated in FIG. 2, a change in the speed of tracing the circuit course by the tactile presentation device 10 is detected by the acceleration detection unit 16. When a change indicating an increase in the tracing speed is detected, the processing unit 152 changes the traveling sound output from the sound source as if the selected vehicle has accelerated. When a change indicating a decrease in the tracing speed is detected, the processing unit 152 changes the traveling sound output from the sound source as if the selected vehicle has decelerated. The processing unit 152 also changes the vibration generated from the vibration source 13 according to the change in the traveling sound.
[0045] As another example, in the case of the media content M illustrated in FIG. 3, the user can perform an operation of swinging the tactile presentation device 10 like a baton. A change in the swinging speed of the tactile presentation device 10 is detected by the acceleration detection unit 16. When a change indicating an increase in the swinging speed is detected, the processing unit 152 changes the performance sound of the music output from the sound source so as to increase the tempo. When a change indicating a decrease in the swinging speed is detected, the processing unit 152 changes the performance sound of the music output from the sound source so as to decrease the tempo. The processing unit 152 also changes the vibration generated from the vibration source 13 according to the change in the performance sound.
[0046] According to the above configuration, the tactile sensation presented can be changed by associating the operation speed of the tactile presentation device 10 with the media content M. Therefore, a more diverse media content experience can be provided to the user.
[0047] The processing unit 152 of the control device 15 having the functions described so far can be realized by an integrated circuit such as a microcontroller, ASIC, or FPGA that can execute a computer program for performing processing corresponding to each function. In this case, the above computer program is pre-installed in a storage element included in the dedicated integrated circuit. The storage element is an example of a storage medium that stores a computer program. The storage unit 14 may be the storage element.
[0048] The configuration of this embodiment is merely an exemplification for facilitating the understanding of the present invention. The configuration according to this embodiment can be appropriately changed and improved without departing from the gist of the present invention.
[0049] In this embodiment, the storage unit 14 in which the vibration waveform information VW is stored is mounted on the housing 11. However, if the tactile presentation device 10 can have a communication function, the storage unit 14 can be arranged outside the housing 11. In this case, the storage unit 14 can also be realized by a hard disk device or the like. The communication between the control device 15 and the storage unit 14 may be performed by wired communication or wireless communication.
[0050] When the storage unit 14 is mounted on the housing 11 as in this embodiment, not only can the increase in size and weight of the tactile presentation device 10 due to the implementation of the communication function be suppressed, but also use that is not affected by the communication environment becomes possible.
[0051] In this embodiment, as illustrated in FIG. 1, the housing 11 has a shape imitating a writing instrument. The reading device 12 is arranged at a position corresponding to the tip of the writing instrument. According to such a configuration, the general-purpose operability of the tactile presentation device 10 is enhanced, and it becomes easy to specify a specific position in the media content M. However, from the viewpoint of providing the user with a media content experience rich in interest, the housing 11 may be configured to exhibit an appropriate shape according to the media content M.
[0052] In the above description, a sound source independent of the vibration source 13 is mounted on the tactile presentation device 10. However, the vibration source 13 may also serve as a sound source.
[0053] FIG. 7 illustrates the functional configuration of the tactile presentation system 40 according to the second embodiment. The tactile presentation system 40 includes a display device 30, a position specifying device 50, a storage device 60, and a control device 70.
[0054] As described with reference to FIG. 3, the display device 30 includes a display unit 31 on which the media content M is displayed.
[0055] Similar to the tactile presentation device 10 illustrated in FIG. 1, the position specifying device 50 includes a housing having a shape that can be held by a user. The position specifying device 50 has a shape that can specify the position on the media content M displayed on the display unit 31 of the display device 30.
[0056] The display device 30 includes a position detection unit 32. The position detection unit 32 is configured to be able to specify the position on the media content M specified by the position specifying device 50. Specifically, the surface of the display unit 31 is configured to have a touch panel function. The touch panel function can be realized by a pressure-sensitive method that detects the pressure associated with the contact of the position specifying device 50, a capacitance method that detects the change in capacitance associated with the contact or approach of the position specifying device, or the like. The portion involved in position specification in the position specifying device 50 has a configuration corresponding to the method adopted in the display unit 31.
[0057] The position detection unit 32 is configured to output position information PS corresponding to the position on the media content M specified by the position specifying device 50. Specifically, the position information PS is configured to include the coordinates of the position where the position specifying device 50 contacts or approaches on the display unit 31. The position information PS may be in the form of digital data or analog data.
[0058] The position specifying device 50 includes a vibration source 51. The vibration source 51 can be realized by a voice coil, an actuator, a piezo element, an eccentric motor, or the like. The vibration generated by the vibration source 51 is presented to the user as a tactile sensation through the housing of the position specifying device 50.
[0059] The storage device 60 stores vibration waveform information VW associated with the position information PS. The vibration waveform information VW represents the waveform of the vibration generated by the vibration source 51. The storage device 60 can be realized by a semiconductor memory, a hard disk device, or the like.
[0060] The control device 70 includes a reception unit 71. The reception unit 71 is configured as an interface that receives the position information PS output from the position detection unit 32 of the display device 30. When the position information PS is an analog signal, the reception unit 71 includes an appropriate conversion circuit including an A / D converter.
[0061] The control device 70 includes a processing unit 72. The processing unit 72 is configured to read the vibration waveform information VW associated with the position information PS received by the reception unit 71 from the storage device 60.
[0062] The control device 70 includes an output unit 73. The processing unit 72 is configured to output control information CS for causing the vibration source 51 of the position specifying device 50 to generate a vibration corresponding to the vibration waveform information VW from the output unit 73. That is, the output unit 153 is configured as an interface that outputs the control information CS. The control information CS may be in the form of digital data or analog data. When the control information CS is in the form of analog data, the output unit 73 includes an appropriate conversion circuit including a D / A converter.
[0063] The vibration source 51 that has received the control information CS generates a vibration corresponding to the vibration waveform information VW. The vibration is presented to the user holding the housing of the position specifying device 50 as a tactile sensation.
[0064] For example, when the media content M illustrated in FIG. 2 is being displayed on the display device 30, if the user brings the position specifying device 50 close to the location where the picture of the dog is displayed, position information PS representing the position coordinates of the display unit 31 corresponding to that location is output from the position detection unit 32. The reception unit 71 of the control device 70 receives the position information PS. The processing unit 72 of the control device 70 reads out vibration waveform information VW associated with the position information PS from the storage device 60. This vibration waveform information VW represents a vibration waveform corresponding to the barking sound of the dog. As a result, the position of the picture of the dog specified by the position specifying device 50 and the vibration waveform corresponding to the barking sound of the dog are associated with each other.
[0065] The processing unit 72 causes a sound source (not shown) to output the barking sound of the dog, and outputs control information CS for generating vibrations corresponding to the vibration waveform information VW from the output unit 73 to the vibration source 51. The user who has brought the position specifying device 50 close to the picture of the dog hears the barking sound of the dog and receives the presentation of the tactile sensation corresponding to the barking sound of the dog.
[0066] Other examples related to the tactile sensation presentation operation by the tactile sensation presentation device 10 described with reference to FIGS. 2 and 3 are also applicable to the tactile sensation presentation operation by the position specifying device 50, so repeated explanations are omitted.
[0067] Even with the configuration according to the present embodiment, the tactile sensation presented to the user through the vibration source 51 can be associated with or changed in relation to the position on the media content M. As a result, as a new application of the tactile sensation presentation technology, an interesting media content experience can be provided to the user.
[0068] As illustrated in FIG. 7, the position specifying device 50 may include an acceleration detection unit 52. The acceleration detection unit 52 is configured to output acceleration information AS corresponding to the acceleration applied to the position specifying device 50 using a well-known method. The acceleration information AS may be in the form of digital data or analog data.
[0069] In this example, the reception unit 71 of the control device 70 is configured as an interface that also receives the acceleration information AS. When the acceleration information AS is in the form of analog data, the reception unit 71 includes an appropriate conversion circuit including an A / D converter.
[0070] In this example, the processing unit 72 of the control device 70 is configured to output, from the output unit 73, control information CS for modulating the vibration generated in the vibration source 51 based on the acceleration information AS received by the reception unit 71.
[0071] Since the operation example related to the tactile sensation change by the tactile sensation presentation device 10 described with reference to FIGS. 2 and 3 is also applicable to the tactile sensation change operation by the position specifying device 50, repeated explanations are omitted.
[0072] According to the above configuration, the presented tactile sensation can be changed in association with the operation speed of the position specifying device 50 and the media content M. Therefore, a more diverse media content experience can be provided to the user.
[0073] The processing unit 72 of the control device 70 having the various functions described so far can be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor may include a CPU, an MPU, and a GPU. Examples of the general-purpose memory may include a ROM and a RAM. In this case, a computer program for executing the above-described processing may be stored in the ROM. The ROM is an example of a storage medium storing a computer program. The processor specifies at least a part of the computer program stored on the ROM and expands it on the RAM, and executes the above-described processing in cooperation with the RAM. The above computer program may be pre-installed in the general-purpose memory, or may be downloaded from an external server device via a communication network and installed in the general-purpose memory. In this case, the external server device is an example of a storage medium storing a computer program.
[0074] The processing unit 72 may be implemented by a dedicated integrated circuit capable of executing the above computer program, such as a microcontroller, ASIC, FPGA, etc. In this case, the above computer program is pre-installed in a storage element included in the dedicated integrated circuit. The storage element is an example of a storage medium storing the computer program. The processing unit 72 may also be implemented by a combination of a general-purpose microprocessor and a dedicated integrated circuit.
[0075] The storage device 60 and the control device 70 may be mounted on the position specifying device 50, or may be mounted on the display device 30. Alternatively, the storage device 60 and the control device 70 may be mounted on an independent device capable of communicating with the display device 30 and the position specifying device 50 via a communication network.
[0076] When the storage device 60 and the control device 70 are mounted on the position specifying device 50, since the tactile presentation operation is performed when the position information PS output from the position detection unit 32 of the display device 30 is transmitted to the position specifying device 50, the communication volume between the display device 30 and the position specifying device 50 can be suppressed to the minimum necessary.
[0077] When the storage device 60 and the control device 70 are mounted on the display device 30, the position specifying device 50 can perform the tactile presentation operation as long as it includes at least a vibration source 51 that receives the control information CS and operates. Thus, the configuration of the position specifying device 50 can be simplified. Thereby, an increase in size and weight of the position specifying device 50 can be suppressed. In addition, when the display device 30 is a general-purpose device such as a portable information terminal, a processor and a memory with sufficient processing power and memory capacity can be used, so that a decrease in responsiveness of the tactile presentation operation can be suppressed.
[0078] When the storage device 60 and the control device 70 are mounted on an independent device, flexibility with respect to updating the computer program and the vibration waveform information VW executed in the processing unit 72 can be enhanced. The same applies to the case where the storage device 60 and the control device 70 are mounted on the display device 30 as a general-purpose device capable of downloading a computer program and data from the outside through a communication network.
[0079] The configuration of this embodiment is merely an exemplification for facilitating the understanding of the present invention. The configuration according to this embodiment can be appropriately changed and improved without departing from the gist of the present invention.
[0080] In the above description, a sound source independent of the vibration source 51 is mounted on the position specifying device 50. However, the vibration source 51 may also serve as the sound source. Alternatively, the sound source may be mounted on the display device 30.
Description of Reference Numerals
[0081] 10: Tactile presentation device, 11: Housing, 12: Reading device, 13: Vibration source, 14: Memory unit, 15: Control device, 151: Reception unit, 152: Processing unit, 16: Acceleration detection unit, 30: Display device, 32: Position detection unit, 40: Tactile presentation system, 50: Position specifying device, 51: Vibration source, 52: Acceleration detection unit, 60: Storage device, 70: Control device, 71: Reception unit, 72: Processing unit, AS: Acceleration signal, acceleration information, ID: Identification information, M: Media content, PS: Position information, VW: Vibration waveform information
Claims
1. a display device capable of displaying media content; A tactile sensation providing device having a shape that can be held by a user; a reading device mounted on the tactile sense presentation device and configured to read one of a plurality of pieces of identification information associated with a plurality of parts included in a continuous path drawn on the media content; a vibration source mounted on the tactile sensation providing device and capable of generating vibrations; a sound source mounted on at least one of the tactile sensation providing device and the display device; a control device mounted on the tactile sensation providing device, which identifies one of a plurality of pieces of vibration waveform information corresponding to one of the plurality of pieces of identification information from a plurality of pieces of vibration waveform information respectively associated with the plurality of pieces of identification information, and causes the vibration source to generate a vibration corresponding to the one piece of vibration waveform information; It is equipped with when first identification information included in the plurality of identification information is read by tracing a first portion included in the plurality of portions, the control device causes the vibration source to generate a first vibration corresponding to first vibration waveform information included in the plurality of vibration waveform information and causes the sound source to output a first sound; When second identification information included in the plurality of identification information is read by tracing a second portion included in the plurality of portions subsequent to the first portion, the control device causes the vibration source to generate a second vibration corresponding to second vibration waveform information included in the plurality of vibration waveform information and different from the first vibration, and causes the sound source to output a second sound obtained by modulating the first sound. Tactile presentation system.
2. an acceleration detection unit that is mounted on the tactile sensation presentation device and outputs an acceleration signal corresponding to an acceleration applied to the tactile sensation presentation device; The control device causes the vibration source to change the vibration based on the acceleration signal. The tactile sensation presentation system according to claim 1 .
3. A storage unit is provided in the tactile sensation providing device and stores the vibration waveform information. The tactile sensation presentation system according to claim 1 .
4. The tactile sensation providing device has a shape resembling a writing instrument, The reading device is disposed at a position corresponding to the tip of the writing instrument. The tactile sensation presentation system according to claim 1 .
5. The media content includes a plurality of pictures corresponding to a plurality of sounds; the control device causes the sound source to output, as the first sound, one of the plurality of sounds associated with one picture selected from the plurality of pictures; The tactile sensation presentation system according to claim 1 .
6. A control device mounted on a tactile sensation providing device having a shape that can be held by a user, a reception unit for receiving one of a plurality of pieces of identification information respectively associated with a plurality of portions included in a continuous path depicted on the media content; a processing unit that identifies one of the plurality of vibration waveform information corresponding to one of the plurality of identification information from a plurality of vibration waveform information respectively associated with the plurality of identification information, and causes a vibration source to generate a vibration corresponding to the one of the vibration waveform information; It is equipped with when first identification information included in the plurality of identification information is read by tracing a first portion included in the plurality of portions, the processing unit causes the vibration source to generate a first vibration corresponding to first vibration waveform information included in the plurality of vibration waveform information and causes a sound source to output a first sound; When second identification information included in the plurality of identification information is read by tracing a second portion included in the plurality of portions subsequent to the first portion, the processing unit causes the vibration source to generate a second vibration corresponding to second vibration waveform information included in the plurality of vibration waveform information and different from the first vibration, and causes the sound source to output a second sound obtained by modulating the first sound. Control device.
7. A computer program executable by a processing unit of a control device mounted on a tactile sensation providing device having a shape that can be held by a user, By being executed, the control device receiving one of a plurality of identifications associated with a plurality of portions of a continuous path depicted on the media content; Identifying one of the plurality of vibration waveform information corresponding to one of the plurality of identification information from a plurality of vibration waveform information respectively associated with the plurality of identification information, and generating a vibration corresponding to the one of the vibration waveform information in a vibration source; When first identification information included in the plurality of identification information is read by tracing a first portion included in the plurality of portions, a first vibration corresponding to first vibration waveform information included in the plurality of vibration waveform information is generated in the vibration source, and a first sound is output from a sound source; When second identification information included in the plurality of identification information is read by tracing a second portion included in the plurality of portions subsequent to the first portion, a second vibration corresponding to second vibration waveform information included in the plurality of vibration waveform information and different from the first vibration is generated in the vibration source, and a second sound obtained by modulating the first sound is output from the sound source. Computer program.
Citation Information
Patent Citations
Interactive multimedia reading system
EP2230583A1
JP1973073376A
Fuenoorujushisekisobanoseizosuru hoho
JP1976062873A
Liquid crystal display electronic desk computer
JP1977035549A
Slot machine for beverage
JP1979051599A