Input device control system and input device control method

Abstract

To make it possible to feel like being actually writing on a writing medium when using a pen-type input device for input.SOLUTION: An input device control system includes: a vibration control unit which vibrates a pen-type input device using writing sound data so as to emit writing sound, in accordance with a detection of a state in which the pen-type input device is in contact with an operation target surface; and a correction unit which executes processing to change frequency characteristics of the writing sound data so that frequency characteristics of actual writing sound which is emitted in accordance with the vibration of the pen-type input device by the vibration control unit may be corrected to frequency characteristics of ideal writing sound.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an input device control system and an input device control method. [Background technology]

[0002] It is known that, when inputting data to an interactive display system, a pen-shaped stylus (pen-type input device) capable of providing tactile feedback by generating vibrations that drive a tactile actuator is used as an input device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2017-537395 Summary of the Invention [Problem to be solved by the invention]

[0004] By emitting vibrations from the pen-type input device, the tactile sensation of sliding the tip of a pen across a writing medium such as paper can be simulated, allowing a user inputting data using the pen-type input device to get a sensation similar to that of writing on a writing medium.

[0005] When inputting data using a pen-type input device, it is desirable to have a sensation as close as possible to that of writing on an actual writing medium. In consideration of the above-mentioned problems, the present invention has an object to provide an input using a pen-type input device that provides a sensation similar to that felt when actually writing on a writing medium. [Means for solving the problem]

[0006] One aspect of the present invention that solves the above-mentioned problems is an input device control system that includes a vibration control unit that vibrates the pen-type input device using writing sound data so that a writing sound is emitted in response to detection of a state in which the pen-type input device is in contact with an operation target surface, and a correction unit that performs processing to change the frequency characteristics of the writing sound data so that the frequency characteristics of the actual writing sound emitted in response to the vibration of the pen-type input device by the vibration control unit are corrected to the frequency characteristics of an ideal writing sound.

[0007] One aspect of the present invention is an input device control method in an input device control system, comprising: a vibration control step in which a vibration control unit vibrates the pen-type input device using writing sound data so that a writing sound is emitted in response to detection that the pen-type input device is in contact with an operation target surface; and a correction step in which a correction unit executes processing to change the frequency characteristics of the writing sound data so that the frequency characteristics of an actual writing sound emitted in response to the vibration of the pen-type input device by the vibration control step are corrected to the frequency characteristics of an ideal writing sound. Effect of the Invention

[0008] According to the present invention, when performing input using a pen-type input device, it is possible to obtain an effect that the feeling of actually writing on a writing medium can be approximated. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the external configuration of an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device and a pen-type input device according to a first embodiment, which supports writing sound feedback. [Diagram 3] 10 is a flowchart showing an example of a processing procedure executed by the information processing device and the pen-type input device in response to writing sound feedback in the first embodiment. [Figure 4]FIG. 13 is a diagram illustrating an example of a functional configuration of an information processing device and a pen-type input device according to a second embodiment, which supports writing sound feedback. [Diagram 5] FIG. 11 is a diagram showing an example of correction data in the second embodiment. [Figure 6] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen-type input device in response to writing sound feedback in the second embodiment. [Figure 7] FIG. 13 is a diagram illustrating an example of a functional configuration of an information processing device and a pen-type input device according to a third embodiment, which supports writing sound feedback. [Figure 8] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen-type input device in response to writing sound feedback in the third embodiment. [Figure 9] FIG. 13 is a diagram illustrating an example of a functional configuration of an information processing device and a pen-type input device according to a fourth embodiment, which supports writing sound feedback. [Figure 10] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen type input device in response to transmission and reception of a pen ID in the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] First Embodiment 1 shows an example of the external configuration of an information processing system according to the present embodiment. As shown in the figure, the information processing system according to the present embodiment includes an information processing device 100 and a pen-type input device 200.

[0011] The information processing device 100 is capable of executing information processing in response to an input operation by a pen-type input device 200. The information processing device 100 in the figure is an example of a tablet terminal or a notebook personal computer.

[0012] The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a portion in which a touch panel and a display unit are combined. The touch panel display unit 102 displays an image on a display surface, and allows operation by contacting an operating object such as a pen-type input device or a finger with the display surface. Note that in this embodiment, "contact" may also include a state in which the operating object is present within a certain distance even if it is not physically in contact with the touch panel display unit 102, and the touch panel display unit 102 is capable of detecting the operating object.

[0013] The pen-type input device 200 is a pen-type input device used by a user to perform operations on the touch panel of the touch panel display unit 102 of the information processing device 100. A user holds the pen-type input device 200 and moves the pen tip so as to contact the display surface of the touch panel display unit 102, thereby performing a handwritten input operation of characters, pictures, figures, and the like.

[0014] Note that operations using the pen-type input device 200 may also include pointing operations on a user interface image displayed on the touch panel display unit 102.

[0015] The detection method of the pen-type input device 200 by the touch panel in the touch panel display unit 102 of this embodiment is not particularly limited, but examples thereof include a capacitance method and an electromagnetic induction method. In the following description, a case where the capacitance method is used will be taken as an example.

[0016] An application compatible with input operations using the pen-type input device 200 (pen operation compatible application) is installed in the information processing device 100. The pen operation compatible application may be capable of, for example, inputting characters by touching the tip of the pen of the pen type input device 200 to the touch panel display unit 102, displaying characters or pictures drawn in response to handwriting input operations such as drawing, and executing processes for converting characters or pictures drawn by the operations into data.

[0017] In the information processing system of this embodiment, the pen type input device 200 vibrates to emit a writing sound when an operation corresponding to writing (writing operation) is being performed. By emitting the writing sound from the pen type input device 200 in this manner, the user can get a feeling similar to that when writing on a writing medium such as paper.

[0018] In the following description, the generation of writing sounds in response to a writing operation using the pen-type input device 200 is also referred to as "writing sound feedback."

[0019] FIG. 2 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 that support writing sound feedback according to this embodiment. First, a description will be given of an example of a functional configuration of the information processing device 100. The functions of the information processing device 100 shown in the figure are realized by executing programs by a central processing unit (CPU), a graphics processing unit (GPU), and the like provided in the hardware of the information processing device 100. The information processing device 100 in the figure includes a communication unit 101, a touch panel display unit 102, a control unit 103, and a storage unit 104.

[0020] The communication unit 101 performs wireless communication with the pen-type input device 200. There is no particular limitation on the wireless communication system supported by the communication unit 101. Note that the communication unit 101 may be capable of supporting wired communication with the pen-type input device 200.

[0021] Touch panel display unit 102 is a device in which a display unit 121 and a touch panel 122 (an example of a sensor unit) are combined. The display unit 121 displays an image under the control of the control unit 103 . The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position of the pen tip of the pen type input device 200, and outputs the coordinates of the detected position as pen position information. Specifically, the capacitive touch panel 122 may detect the position (coordinates) of the pen tip on the panel surface (an example of a surface to be operated) by detecting, with electrodes, electrostatic capacitance generated by contact of the pen tip of the pen type input device 200 with the panel surface.

[0022] The control unit 103 executes various controls in the information processing device 100. The control unit 103 includes an application support processing unit 131 that executes processing corresponding to a pen operation compatible application. When a writing operation is being performed with the pen type input device 200 as an operation for a pen operation compatible application, pen position information is input from the touch panel 122 to the application compatible processing unit 131. In response to the input of the pen position information, the application compatible processing unit 131 performs processing such as drawing.

[0023] The storage unit 104 stores various types of information corresponding to the information processing device 100 .

[0024] Next, a description will be given of an example of a functional configuration of the pen type input device 200. The functions of the pen type input device 200 shown in the figure may be realized by causing a microprocessor such as an MCU (Micro Controller Unit) included in the pen type input device 200 as hardware to execute a program.

[0025] The pen-type input device 200 in the figure includes a communication unit 201 , a vibration unit 202 , a sound detection unit 203 , a control unit 204 , and a storage unit 205 .

[0026] The communication unit 201 is communicably connected to the communication unit 101 of the information processing device 100 .

[0027] The vibration unit 202 (actuator) is a part that vibrates so as to emit a writing sound when a user holding the pen-type input device 200 is performing a writing operation. The vibration of the vibration unit 202 is controlled by a vibration control unit 241.

[0028] The sound detection unit 203 detects (collects) writing sounds emitted from the pen-type input device 200. The writing sounds detected by the sound detection unit 203 are subjected to frequency analysis. The structure of the sound detection unit 203 is not particularly limited, and may be configured, for example, by a microphone, a piezoelectric sensor, or the like.

[0029] The control unit 204 executes various controls in the pen type input device 200. The control unit 204 includes a vibration control unit 241 and a correction unit 242.

[0030] The vibration control unit 241 vibrates the vibration unit 202 based on a waveform indicated by the handwriting sound data stored in the handwriting sound data storage unit 251 .

[0031] The correction unit 242 executes a process for changing the frequency characteristics of the writing sound data so that the frequency characteristics of the actual writing sound are corrected to the frequency characteristics of the ideal writing sound. The actual writing sound is a writing sound that is actually generated in response to the vibration of the pen-type input device 200 by the vibration control unit 241. The ideal writing sound is a writing sound that should be generated originally.

[0032] For example, the writing sound data stored in the writing sound data storage unit 251 has frequency characteristics corresponding to the ideal writing sound. However, the actual writing sound that the pen type input device 200 actually produces may deviate from the ideal writing sound depending on, for example, the material, structure, weight, and other conditions of the touch panel 122 that the pen type input device 200 touches, and the material, structure, weight, and other conditions of the pen type input device 200 itself. When the actual writing sound differs from the ideal writing sound in this way, it becomes difficult for the user to get a sense of actually writing on a writing medium. Therefore, the correction unit 242 in this embodiment corrects the writing sound data used by the vibration control unit 241 so that the frequency characteristics of the actual writing sound detected by the sound detection unit 203 approach the ideal writing sound. By performing the correction in this manner, the user can hear writing sounds close to the ideal while performing a writing operation with the pen-type input device 200, and can experience a sensation close to that when actually writing on a writing medium.

[0033] The storage unit 205 stores various types of information supported by the pen type input device 200. The storage unit 205 includes a writing sound data storage unit 251. The writing sound data storage unit 251 stores writing sound data. The writing sound data is data indicating a waveform for vibrating the pen type input device 200 to emit a writing sound.

[0034] An example of a process procedure executed by the information processing device 100 and the pen type input device 200 of this embodiment in response to writing sound feedback will be described with reference to the flowchart of FIG.

[0035] First, an example of a processing procedure executed by the information processing device 100 will be described. Step S100: In the information processing device 100, the application-compatible processor 131 waits for a writing operation to be started. The application processing unit 131 may detect that a writing operation has started in response to, for example, the start of input of pen position information indicating the pen tip position from the touch panel 122.

[0036] Step S102: In response to the start of a writing operation, the application corresponding processing unit 131 starts transmitting writing operation information to the pen type input device 200. The writing operation information is information notifying that a writing operation is currently being performed on the touch panel 122 using the pen type input device 200.

[0037] Step S104: After starting the transmission of the handwriting operation information in step S102, the application-compatible processor 131 waits for the handwriting operation started in step S100 to end. The application-compatible processor 131 may determine that the handwriting operation has ended when the pen position information that had been input up until that point is no longer input.

[0038] Step S106: If it is determined in step S104 that the handwriting operation has ended, the application-compatible processor 131 stops the transmission of the handwriting operation information started in step S102.

[0039] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S200: In the pen type input device 200, the vibration control unit 241 waits for the start of reception of the writing operation information transmitted from the information processing device 100 in step S102.

[0040] Step S202: In response to the start of receiving the writing operation information in step S100, the sound detection unit 203 detects the actual writing sound. The correction unit 242 acquires data of the actual writing sound (actual writing sound data) detected by the sound detection unit 203. The correction unit 242 may acquire the actual writing sound data of the actual writing sound detected by the sound detection unit 203 for a predetermined time (a predetermined number of samples).

[0041] Step S204: The correction unit 242 generates correction data for correcting the actual writing sound so that it approaches the ideal writing sound. In generating the correction data, the correction unit 242 calculates the frequency characteristics of the actual writing sound, for example, by performing a frequency analysis on the actual writing sound data acquired in response to step S202. The correction unit 242 calculates the difference between the frequency characteristics of the actual writing sound and the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251 (i.e., the frequency characteristics of the ideal writing sound). Based on the calculated difference, the correction unit 242 generates correction data that sets the frequency characteristics of the actual writing sound as the frequency characteristics of the writing sound data. The correction data may be, for example, parameters of a filter, an equalizer, etc. that change the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251. Alternatively, the correction data may be a functional module such as a filter, an equalizer, etc. Alternatively, the correction data may be writing sound data (corrected writing sound data) having frequency characteristics that become an ideal writing sound when generated as an actual writing sound. In addition, such correction data as filter and equalizer parameters or functional modules may be prepared, for example, by storing a plurality of different ones in the storage unit 205 in advance, and the correction unit 242 may select from the plurality of correction data based on the calculated difference. In the following description, a case will be taken as an example in which the correction data is generated as a filter module.

[0042] Step S206: The correction unit 242 corrects the frequency characteristics of the writing sound data read from the writing sound data storage unit 251 with the correction data generated in step S204. That is, the correction unit 242 in this case generates a filter module as the correction data generated in step S204, and passes the writing sound data read from the writing sound data storage unit 251 through the generated filter. The correction unit 242 inputs the writing sound data corrected by passing through the filter (corrected writing sound data) to the vibration control unit 241.

[0043] Step S208: The vibration control unit 241 drives the vibration unit 202 with the writing sound data (corrected writing sound data) input in step S206. By driving the vibration unit 202 with the corrected writing sound data in this manner, the pen-type input device 200 in which the writing operation is being performed vibrates, and an actual writing sound that is made closer to an ideal writing sound is generated.

[0044] Step S210: When the vibration unit 202 is vibrated in step S208, the vibration control unit 241 judges whether or not reception of the handwriting operation information transmitted from the information processing device 100 has stopped. If it is judged that reception of the handwriting operation information has not stopped, the process returns to step S208. By returning the process to step S208, while the handwriting operation information is being received, the pen type input device 200 continues to vibrate in response to the corrected handwriting sound data. When it is determined in step S210 that the reception of the handwriting operation information has stopped, the process in the figure is ended. In response to the process being ended in this manner, the vibration of the pen type input device 200 is also stopped.

[0045] In addition, if the correction unit 242 is configured to generate corrected writing sound data as the correction data, the vibration control unit 241 may skip the processing of step S206 and drive the vibration unit 202 using the corrected writing sound data generated as the correction data in step S208.

[0046] In this embodiment, while a writing operation is being performed, feedback control may be performed in such a way that the actual writing sound is continuously detected to generate correction data, and the vibration unit 202 is vibrated using the writing sound data corrected using the generated correction data.

[0047] <Second embodiment> Next, a second embodiment will be described. In the information processing system of the first embodiment, the pen-type input device 200 is vibrated by using corrected writing sound data corrected based on the difference between the actual writing sound and the ideal writing sound detected by the sound detection unit 203. In contrast, in the information processing system of this embodiment, the pen type input device 200 is configured to store in advance correction data as a filter or the like having a characteristic that can make the actual writing sound into the ideal writing sound according to a combination with the type (e.g., model number, type, etc.) of the touch panel 122 to be operated. The pen type input device 200 corrects the writing sound data using the correction data associated with the type of the touch panel 122 to be operated, and vibrates the vibration unit 202 using the corrected writing sound data. In this way, in this embodiment, the actual writing sound generated by the vibration of the pen type input device 200 is made to approach the ideal writing sound.

[0048] 4 shows an example of the functional configuration of the information processing device 100 and the pen-type input device 200 according to the present embodiment, which are compatible with writing sound feedback. In the figure, the same parts as those in FIG. 2 are given the same reference numerals, and the description thereof will be omitted as appropriate. In the pen type input device 200 shown in the figure, the storage unit 205 includes a correction data storage unit 252. The correction data storage unit 252 stores correction data corresponding to each type of touch panel 122. In this embodiment, the sound detection unit 203 may be omitted.

[0049] 5 shows an example of the correction data stored in the correction data storage unit 252. As shown in the figure, the correction data storage unit 252 stores the correction data in association with each touch panel type. The correction data corresponding to one touch panel type is data used to correct the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251 so that the actual writing sound approaches the ideal writing sound in response to a writing operation using the pen-type input device 200 on a touch panel of the corresponding touch panel type. In other words, the correction data storage unit 252 stores the correction data corresponding to each combination of various touch panel types with the pen-type input device 200. The correction data in this embodiment may be parameters of a filter, an equalizer, etc. Alternatively, the correction data may be a functional module such as a filter, an equalizer, etc. Furthermore, such correction data as parameters of a filter or an equalizer or a functional module may be prepared, for example, by storing a plurality of different correction data in the storage unit 205 in advance, and the correction unit 242 may select from the plurality of correction data based on the calculated difference.

[0050] An example of a process procedure executed by the information processing device 100 and the pen type input device 200 of this embodiment in response to writing sound feedback will be described with reference to the flowchart of FIG.

[0051] First, an example of a processing procedure executed by the information processing device 100 will be described. Step S300: In the information processing device 100, the application-compatible processor 131 waits for a writing operation to be started.

[0052] Step S302: In response to the start of a writing operation, the application-compatible processing unit 131 starts transmitting writing operation information to the pen-type input device 200. The writing operation information of this embodiment includes type information indicating the type (touch panel type) of the touch panel 122 included in the information processing device 100. For example, the storage unit 104 stores type information indicating the type of the touch panel 122. The application-compatible processing unit 131 may be configured to include the type information acquired from the storage unit 104 in the writing operation information.

[0053] Step S304: After starting the transmission of the handwriting operation information in step S302, the application-compatible processor 131 waits for the handwriting operation started in response to step S300 to end.

[0054] Step S306: If it is determined in step S304 that the handwriting operation has ended, the application-compatible processor 131 stops the transmission of the handwriting operation information started in step S302.

[0055] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S400: In the pen type input device 200, the vibration control unit 241 waits for the start of reception of handwriting operation information transmitted from the information processing device 100 in step S302.

[0056] Step S402: In response to the start of reception of handwriting operation information in step S400, the correction unit 242 acquires type information included in the received handwriting operation information.

[0057] Step S404: The correction unit 242 acquires, from the correction data storage unit 252, correction data associated with the same touch panel type as that indicated by the type information acquired in step S402.

[0058] Step S406: The correction unit 242 corrects the frequency characteristics of the writing sound data read from the writing sound data storage unit 251 using the correction data acquired in step S404. The correction unit 242 inputs the corrected writing sound data (corrected writing sound data) to the vibration control unit 241.

[0059] Step S408: The vibration control unit 241 drives the vibration unit 202 with the writing sound data (corrected writing sound data) input in step S406.

[0060] Step S410: While the vibration unit 202 is being vibrated in step S408, the vibration control unit 241 determines whether or not reception of the handwriting operation information transmitted from the information processing device 100 has stopped. If it is determined that reception of the handwriting operation information has not stopped, the process returns to step S408. When it is determined in step S410 that the reception of the handwriting operation information has stopped, the process in the figure is ended. In response to the process in the figure being ended, the vibration of the pen type input device 200 is also stopped.

[0061] In this embodiment, each of the correction data stored in the correction data storage unit 252 may be writing sound data having a frequency characteristic that makes the actual writing sound become the ideal writing sound according to the writing operation on the corresponding touch panel type. In this case, the vibration control unit 241 may vibrate the vibration unit 202 by the writing sound data as the correction data acquired by the correction unit 242. In this case, the writing sound data storage unit 251 may be omitted.

[0062] <Third embodiment> Next, a third embodiment will be described. In the first embodiment, the pen-type input device 200 detects the actual writing sound and corrects the writing sound data based on the detected actual writing sound. In contrast, in this embodiment, the information processing device 100 detects the actual writing sound and executes a process for correcting the writing sound data based on the detected actual writing sound. The pen-type input device 200 uses the writing sound data corrected by the information processing device 100 to emit the actual writing sound that is closer to the ideal writing sound.

[0063] 7 shows an example of the functional configuration of the information processing device 100 and the pen-type input device 200 according to the present embodiment, which are compatible with the writing sound feedback. In the figure, the same parts as those in FIG. 1 are given the same reference numerals, and the following mainly describes the differences from FIG. 1. The information processing device 100 includes a sound detection unit 105 and a correction unit 132 . The sound detection unit 105 is provided so as to be capable of detecting the writing sound emitted from the pen type input device 200 when the user touches the pen tip of the pen type input device 200 to the touch panel 122 to perform a writing operation.

[0064] 7, the sound detection unit 203 and the correction unit 242 provided in the pen type input device 200 in Fig. 1 are omitted. The correction unit 132 in this embodiment may be, for example, one of the functions of a pen operation compatible application, or may be provided as a function of an OS (Operating System).

[0065] The storage unit 104 of the information processing device 100 also includes an ideal writing sound data storage unit 141. The ideal writing sound data storage unit 141 stores ideal writing sound data. The ideal writing sound data is, for example, writing sound data corresponding to a writing sound that should be generated corresponding to the touch panel 122 of the information processing device 100. The ideal writing sound data stored in the ideal writing sound data storage unit 141 may indicate the frequency characteristics of the corresponding ideal writing sound. The ideal writing sound data storage unit 141 may also store ideal writing sound data corresponding to each type of writing implement selected under a pen operation compatible application, for example.

[0066] An example of a process procedure executed by the information processing device 100 and the pen type input device 200 of this embodiment in response to writing sound feedback will be described with reference to the flowchart of FIG.

[0067] Step S500: In the information processing device 100, the application-compatible processor 131 waits for a writing operation to be started.

[0068] Step S502: In response to the start of a writing operation, the sound detection unit 105 detects an actual writing sound.

[0069] Step S504: The correction unit 132 generates correction data. For example, the correction unit 132 calculates the frequency characteristics of the actual writing sound by performing frequency analysis on the actual writing sound (actual writing sound data) detected in response to step S502. The correction unit 132 generates correction data that sets the frequency characteristics of the actual writing sound to the frequency characteristics of the ideal writing sound data based on the difference between the frequency characteristics of the actual writing sound and the frequency characteristics of the ideal writing sound data stored in the ideal writing sound data storage unit 141. The correction data in this embodiment may be parameters such as a filter, an equalizer, etc. Or the correction data may be a functional module such as a filter, an equalizer, etc. In addition, such correction data as parameters or functional modules of the filter or equalizer may be prepared, for example, by storing a plurality of different ones in advance in the storage unit 205, and the correction unit 242 may select from the plurality of correction data based on the calculated difference.

[0070] Step S506: The correction unit 132 starts transmitting the handwriting operation information, and transmits the correction data generated in step S504 at the timing when the transmission of the handwriting operation information starts.

[0071] Step S508: After starting the transmission of the handwriting operation information in step S506, the application-compatible processor 131 waits for the handwriting operation started in response to step S500 to end.

[0072] Step S510: If it is determined in step S508 that the handwriting operation has ended, the application-compatible processor 131 stops the transmission of the handwriting operation information started in step S506.

[0073] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S600: In the pen type input device 200, the vibration control unit 241 waits for the start of reception of handwriting operation information transmitted from the information processing device 100 in step S506.

[0074] Step S602: The vibration control unit 241 sets a filter based on the correction data received at the same timing as when reception of the handwriting operation information is started.

[0075] Step S604: The vibration control unit 241 obtains corrected handwriting sound data by passing the handwriting sound data stored in the handwriting sound data storage unit 251 through the filter set in step S602, and then drives the vibration unit 202 with the corrected handwriting sound data.

[0076] Step S606: While the vibration unit 202 is being vibrated in step S604, the vibration control unit 241 determines whether or not reception of the handwriting operation information transmitted from the information processing device 100 has stopped. If it is determined that reception of the handwriting operation information has not stopped, the process returns to step S604. If it is determined in step S606 that the reception of the handwriting operation information has stopped, the process in FIG.

[0077] In this embodiment, the correction unit 132 of the information processing device 100 may transmit the ideal writing sound data stored in the ideal writing sound data storage unit 141 to the pen type input device 200 as correction data. In this case, the vibration control unit 241 of the pen type input device 200 may drive the vibration unit 202 by the ideal writing sound data as the received correction data. In this case, the writing sound data storage unit 251 in the pen type input device 200 may be omitted.

[0078] <Fourth embodiment> Next, a fourth embodiment will be described. In the second embodiment, the pen-type input device 200 corrects the writing sound data with the correction data corresponding to the type of the touch panel 122, and vibrates the vibration unit 202 with the corrected writing sound data. In contrast to this, in the present embodiment, the information processing device 100 is configured to store correction data associated with each type (pen type) of the pen type input device 200. The information processing device 100 transmits, from among the stored correction data, correction data corresponding to the pen type of the pen type input device 200 used for a writing operation on the touch panel 122 to the pen type input device 200. The pen type corresponds to the model, etc., of the pen type input device 200. The pen type input device 200 vibrates the vibration section 202 using the writing sound data corrected by the received correction data (corrected writing sound data), thereby emitting an actual writing sound that is made closer to an ideal writing sound.

[0079] 9 shows an example of the functional configuration of the information processing device 100 and the pen-type input device 200 according to the present embodiment, which are compatible with writing sound feedback. In the figure, the same parts as those in FIG. 4 are given the same reference numerals, and the description thereof will be omitted as appropriate.

[0080] 9 includes a correction unit 132 in a control unit 103. The information processing device 100 in the same figure also includes a correction data storage unit 142 and a pen type storage unit 143 in a storage unit 104. 4. In the pen type input device 200 in FIG. 9, the correction section 242 and the correction data storage section 252 in FIG. 4 are omitted.

[0081] The correction data storage unit 142 stores the correction data in association with each pen type. The correction data corresponding to one pen type is data for correcting the writing sound data so as to obtain an ideal writing sound when a writing operation is performed on the touch panel 122 with the pen type input device 200 of the corresponding pen type. In other words, the correction data storage unit 142 stores the correction data corresponding to each combination of various pen type input devices with the touch panel 122 provided in the information processing device 100. Also in this embodiment, the correction data may be parameters of a filter, an equalizer, etc. Alternatively, the correction data may be a functional module such as a filter, an equalizer, etc. In the following description, a case where the correction data is a functional module such as a filter will be taken as an example.

[0082] The pen type storage unit 143 stores the pen type of the pen type input device 200 that is communicatively connected. The pen type input device 200 is adapted to notify the information processing device 100 of its own pen type during negotiation executed for establishing communication with the information processing device 100. The pen type storage unit 143 stores the pen type thus notified.

[0083] An example of a processing procedure executed by the information processing device 100 and the pen type input device 200 of this embodiment in response to writing sound feedback will be described with reference to the flowchart of Fig. 10. The processing procedure in the figure is executed in a state where communication between the information processing device 100 and the pen type input device 200 has already been established and the pen type of the connected pen type input device 200 is stored in the pen type storage unit 143.

[0084] Step S700: In the information processing device 100, the application-compatible processor 131 waits for the start of a writing operation.

[0085] Step S702: In response to the start of a writing operation, the correction unit 132 acquires, from the correction data storage unit 142, the correction data associated with the same pen type as that currently stored in the pen type storage unit 143.

[0086] Step S704: The correction unit 132 starts transmitting the handwriting operation information, and transmits the correction data acquired in step S702 at the timing when the transmission of the handwriting operation information starts.

[0087] Step S706: After starting the transmission of the handwriting operation information in step S704, the application-compatible processor 131 waits for the handwriting operation started in response to step S700 to end.

[0088] Step S708: If it is determined in step S706 that the handwriting operation has ended, the application-compatible processor 131 stops the transmission of the handwriting operation information started in step S704.

[0089] The processing in steps S800 to S806 executed by the pen type input device 200 may be similar to steps S600 to S606 in FIG.

[0090] In this embodiment, the correction data stored in the correction data storage unit 142 may be writing sound data created so that the actual writing sound is equivalent to the ideal writing sound corresponding to the pen type of the corresponding pen type input device 200. In this case, the vibration control unit 241 of the pen type input device 200 may drive the vibration unit 202 by the writing sound data received as the correction data.

[0091] In addition, a program for realizing the functions of the above-mentioned information processing device 100, pen-type input device 200, etc. may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing as the above-mentioned information processing device 100, pen-type input device 200, etc. Here, "reading a program recorded in a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include a plurality of computer devices connected via a network including the Internet, a WAN, a LAN, a dedicated line, and other communication lines. In addition, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, an optical magnetic disk, a ROM, a CD-ROM, and a storage device such as an HDD or SSD built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium provided inside or outside the computer system that can be accessed from a distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by a terminal device. That is, the format in which the program is stored in the distribution server does not matter as long as the program can be downloaded from the distribution server and installed in a form executable by the terminal device. The program may be divided into multiple parts, each of which may be downloaded at a different time and then combined on the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" includes a storage medium that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that is a server or client when a program is transmitted over a network. The program may also be one that realizes part of the above-mentioned functions.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0092] 100 Information processing device, 101 Communication unit, 102 Touch panel display unit, 103 Control unit, 104 Memory unit, 105 Sound detection unit, 121 Display unit, 122 Touch panel, 131 Application correspondence processing unit, 132 Correction unit, 141 Ideal writing sound data storage unit, 142 Correction data storage unit, 143 Pen type storage unit, 200 Pen type input device, 201 Communication unit, 202 Vibration unit, 203 Sound detection unit, 204 Control unit, 205 Memory unit, 241 Vibration control unit, 242 Correction unit, 251 Writing sound data storage unit, 252 Correction data storage unit

Claims

1. a vibration control unit that vibrates the pen-type input device using writing sound data so as to generate a writing sound in response to detection of a state in which the pen-type input device is in contact with an operation target surface; a correction unit that executes a process for changing a frequency characteristic of writing sound data so that a frequency characteristic of an actual writing sound generated in response to vibration of the pen-type input device by the vibration control unit is corrected to a frequency characteristic of an ideal writing sound; An input device control system comprising:

2. A detection unit that detects an actual writing sound generated in response to vibration of the pen-type input device, The correction unit executes a process for changing the frequency characteristics of the writing sound data so that the frequency characteristics of the actual writing sound detected by the detection unit are corrected to the frequency characteristics of the ideal writing sound. The input device control system of claim 1 .

3. A storage unit stores correction data for correcting a frequency characteristic of an actual writing sound to a frequency characteristic of an ideal writing sound for each combination of the pen-type input device and an operation target surface, The correction unit executes a process for changing the frequency characteristics of the writing sound data based on correction data corresponding to a combination of the pen-type input device to be used and the operation target surface, among the correction data stored in the storage unit. The input device control system of claim 1 .

4. An input device control method in an input device control system, comprising: a vibration control step of vibrating the pen-type input device using writing sound data so as to generate a writing sound in response to detection of a state in which the pen-type input device is in contact with an operation target surface by a vibration control unit; a correction step of executing a process for changing a frequency characteristic of the writing sound data so that a frequency characteristic of an actual writing sound generated in response to the vibration of the pen-type input device by the vibration control step is corrected to a frequency characteristic of an ideal writing sound; An input device control method comprising:

Images