Input device control system and input device control method

Abstract

The invention relates to an input device control system and an input device control method, which can approach the feeling when writing on a writing medium in reality when inputting by using a pen-type input device. The input device control system comprises: a vibration control unit that vibrates a pen-type input device using writing sound data to generate writing sound, in response to the detection of a state in which the pen-type input device is in contact with a surface to be operated, and a correction unit that corrects the writing sound data when the pen-type input device is in contact with the surface to be operated; and a correction unit that performs a process relating to a change in the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound generated by the vibration control unit vibrating the pen-type input device to the frequency characteristics of the ideal writing sound.

Description

Technical Field

[0001] The invention relates to an input device control system and an input device control method. Background Art

[0002] It is known that when inputting to an interactive display system, a pen-shaped stylus (pen-type input device) capable of providing tactile feedback by generating vibrations to drive a tactile actuator is used as an input device.

[0003] Patent Document 1: Japanese Patent Application No. 2017-537395

[0004] By vibrating the pen-type input device, a tactile sensation similar to that of sliding the pen tip on a writing medium such as paper can be obtained, so that a user who uses the pen-type input device to input can obtain a sensation close to that of writing on a writing medium.

[0005] There is an aspect that it is preferred to use a pen-type input device to input data in a manner as close as possible to the feeling of writing on a physical writing medium. Summary of the invention

[0006] Therefore, the present invention takes the above-mentioned problems into consideration, and aims to make the feeling of writing on a writing medium in reality closer when inputting using a pen-type input device.

[0007] One method of the present invention for solving the above-mentioned problems is an input device control system, comprising: a vibration control unit, which uses writing sound data to vibrate the above-mentioned pen-type input device to emit a writing sound based on the detection of a state in which the pen-type input device is in contact with the surface of an operation object; and a correction unit, which performs processing related to the change of the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound emitted by the above-mentioned pen-type input device being vibrated by the above-mentioned vibration control unit to the frequency characteristics of the ideal writing sound.

[0008] One embodiment of the present invention is an input device control method in an input device control system, the input device control method comprising: a vibration control step, wherein a vibration control unit uses writing sound data to vibrate the pen-type input device to emit a writing sound based on the detection of a state in which the pen-type input device is in contact with the surface of an operation object; and a correction step, wherein the correction unit performs processing related to a change in the frequency characteristics of the writing sound data so as to correct the frequency characteristics of an actual writing sound emitted by vibrating the pen-type input device through the vibration control step to a frequency characteristic of an ideal writing sound.

[0009] According to the present invention, when inputting using a pen-type input device, it is possible to achieve an effect that the feeling of writing on a writing medium in reality can be approximated. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a diagram showing an example of the external configuration of the information processing system in the first embodiment.

[0011] Figure 2 This is a diagram showing an example of a functional configuration corresponding to writing sound feedback of the information processing apparatus and the pen-type input device in the first embodiment.

[0012] Figure 3 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in accordance with writing sound feedback in the first embodiment.

[0013] Figure 4 This is a diagram showing an example of a functional configuration corresponding to writing sound feedback of an information processing apparatus and a pen-type input device in a second embodiment.

[0014] Figure 5 This is a diagram showing an example of correction data in the second embodiment.

[0015] Figure 6 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in accordance with writing sound feedback in the second embodiment.

[0016] Figure 7 It is a diagram showing an example of a functional configuration corresponding to writing sound feedback of an information processing apparatus and a pen-type input device in a third embodiment.

[0017] Figure 8 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in accordance with writing sound feedback in the third embodiment.

[0018] Fig. 9 It is a diagram showing an example of a functional configuration corresponding to writing sound feedback of an information processing apparatus and a pen-type input device in a fourth embodiment.

[0019] Fig.10 This is a flowchart showing an example of processing procedures executed by the information processing apparatus and the pen-type input device in accordance with the transmission and reception of the pen ID in the fourth embodiment.

[0020] Description of Reference Numerals

[0021] 100…information processing device; 101…communication unit; 102…touch panel display unit; 103…control unit; 104…storage unit; 105…sound detection unit; 121…display unit; 122…touch panel; 131…application corresponding processing unit; 132…correction unit; 141…ideal writing sound data storage unit; 142…correction data storage unit; 143…pen type storage unit; 200…pen type input device; 201…communication unit; 202…vibration unit; 203…sound detection unit; 204…control unit; 205…storage unit; 241…vibration control unit; 242…correction unit; 251…writing sound data storage unit; 252…correction data storage unit. DETAILED DESCRIPTION

[0022] <First embodiment>

[0023] Figure 1 An example of the external configuration of an information processing system according to the present embodiment is shown. As shown in the figure, the information processing system according to the present embodiment includes an information processing apparatus 100 and a pen-type input device 200 .

[0024] The information processing apparatus 100 can execute information processing according to an input operation using the pen-type input device 200. The information processing apparatus 100 in the figure shows an example of a tablet terminal or a notebook computer.

[0025] The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a part formed by combining a touch panel and a display unit. The touch panel display unit 102 displays an image on the display surface, and can perform operations based on contacting an operating body such as a pen-type input device or a finger with the display surface. In addition, in this embodiment, "contact" may also include a state in which the touch panel display unit 102 can detect the operating body even if the operating body is not physically in contact with the touch panel display unit 102 but the operating body exists within a certain distance.

[0026] The pen-shaped input device 200 is a pen-shaped input device used by a user to operate the touch panel in the touch panel display unit 102 of the information processing apparatus 100 .

[0027] The user holds the pen-shaped input device 200 , brings the pen tip into contact with the display surface of the touch panel display unit 102 , and moves the pen to perform handwriting input operations such as characters, pictures, and graphics.

[0028] Furthermore, an operation using the pen-shaped input device 200 may be an instruction operation on a user interface image displayed on the touch-panel display portion 102 .

[0029] The detection method of the pen-type input device 200 based on the touch panel in the touch panel display unit 102 of this embodiment is not particularly limited, and examples thereof include electrostatic capacitance method, electromagnetic induction method, etc. In the following description, the case of using the electrostatic capacitance method is described.

[0030] An application corresponding to input operation by the pen-type input device 200 (pen operation corresponding application) is installed in the information processing apparatus 100 .

[0031] The pen operation corresponding application can perform the following processing, for example, displaying text and pictures drawn by handwriting input operations such as text input and painting by bringing the pen tip of the pen-type input device 200 into contact with the touch panel display unit 102 on the touch panel display unit 102, or digitizing the text and pictures drawn by the operation.

[0032] In addition, in the information processing system of this embodiment, when an operation corresponding to writing (writing operation) is performed, the pen-type input device 200 vibrates so that the pen-type input device 200 emits a writing sound. In this way, by emitting a writing sound from the pen-type input device 200, the user can feel a feeling close to that of writing on a writing medium such as paper.

[0033] In the following description, the generation of writing sound corresponding to the writing operation using the pen-type input device 200 is also referred to as “writing sound feedback”.

[0034] Figure 2 An example of the functional configuration of the information processing apparatus 100 and the pen-type input device 200 corresponding to writing sound feedback according to the present embodiment is shown.

[0035] First, a functional configuration example of the information processing device 100 is described. The functions of the information processing device 100 shown in the figure are realized by executing a program by a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) etc. provided as hardware of the information processing device 100.

[0036] The information processing device 100 in the figure includes a communication unit 101 , a touch panel display unit 102 , a control unit 103 , and a storage unit 104 .

[0037] The communication unit 101 performs wireless communication with the pen-shaped input device 200. There is no particular limitation on the method of wireless communication supported by the communication unit 101. In addition, the communication unit 101 may also support communication with the wired pen-shaped input device 200.

[0038] The touch panel display unit 102 is a device in which a display unit 121 and a touch panel 122 (an example of a sensor unit) are combined.

[0039] The display unit 121 displays an image under the control of the control unit 103 .

[0040] The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position of the pen tip of the pen-shaped input device 200, and outputs the coordinates of the detected position as pen position information. Specifically, the electrostatic capacitance touch panel 122 can detect the position (coordinates) of the pen tip on the panel surface by detecting the electrostatic capacitance generated by the contact between the pen tip of the pen-shaped input device 200 and the panel surface (an example of the operation object surface) using electrodes.

[0041] The control unit 103 executes various controls in the information processing device 100. The control unit 103 includes an application-supporting processing unit 131 that executes a process corresponding to the pen operation-supporting application.

[0042] When a writing operation is performed using the pen input device 200 as an operation on a pen operation-compatible application, pen position information is input from the touch panel 122 to the application-compatible processing unit 131. The application-compatible processing unit 131 performs processing such as drawing based on the input pen position information.

[0043] The storage unit 104 stores various information corresponding to the information processing device 100 .

[0044] Next, a functional configuration example of the pen-type input device 200 will be described. The functions of the pen-type input device 200 shown in the figure can be realized by causing a microprocessor such as an MCU (Micro Controller Unit) included in the pen-type input device 200 as hardware to execute a program.

[0045] The pen-shaped input device 200 in the figure includes a communication unit 201 , a vibration unit 202 , a sound detection unit 203 , a control unit 204 , and a storage unit 205 .

[0046] The communication unit 201 is connected to the communication unit 101 of the information processing device 100 so as to be communicable therewith.

[0047] The vibration unit 202 (actuator) is a part that vibrates to generate writing sound when a user holding the pen-type input device 200 performs a writing operation. The vibration of the vibration unit 202 is controlled by the vibration control unit 241 .

[0048] The sound detection unit 203 detects (receives) writing sounds emitted from the pen-shaped input device 200. The writing sounds detected by the sound detection unit 203 are subjected to frequency analysis. The structure of the sound detection unit 203 is not particularly limited, and may be composed of, for example, a microphone, a piezoelectric sensor, or the like.

[0049] The control unit 204 executes various controls in the pen-type input device 200. The control unit 204 includes a vibration control unit 241 and a correction unit 242.

[0050] The vibration control unit 241 vibrates the vibration unit 202 based on the waveform represented by the writing sound data stored in the writing sound data storage unit 251 .

[0051] The correction unit 242 performs processing related to the change of the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound to the frequency characteristics of the ideal writing sound. The actual writing sound is the writing sound actually emitted by the vibration control unit 241 causing the pen-shaped input device 200 to vibrate. The ideal writing sound is the writing sound that should be emitted.

[0052] For example, the writing sound data stored in the writing sound data storage unit 251 has a frequency characteristic corresponding to an ideal writing sound. However, in reality, the actual writing sound emitted by the pen-type input device 200 sometimes deviates from the ideal writing sound due to conditions such as the material, structure, weight, etc. of the touch panel 122 that the pen-type input device 200 contacts, and the material, structure, weight, etc. of the pen-type input device 200 itself. In this way, since the actual writing sound is different from the ideal writing sound, it is difficult for the user to feel the feeling of writing on a writing medium in reality.

[0053] Therefore, the correction unit 242 in this embodiment corrects the writing sound data used by the vibration control unit 241 so that the frequency characteristics of the actual writing sound detected by the sound detection unit 203 are close to the ideal writing sound. By making such corrections, the user can hear a writing sound close to the ideal when performing a writing operation through the pen-type input device 200, and can feel a feeling close to that when writing on a writing medium in reality.

[0054] The storage unit 205 stores various information corresponding to the pen-shaped input device 200. The storage unit 205 includes a writing sound data storage unit 251. The writing sound data storage unit 251 stores writing sound data. The writing sound data is data representing a waveform for vibrating the pen-shaped input device 200 to emit a writing sound.

[0055] Reference Figure 3 The flowchart of FIG. 1 is used to describe an example of processing steps executed by the information processing apparatus 100 and the pen-type input device 200 according to the present embodiment in response to writing sound feedback.

[0056] First, an example of a process procedure executed by the information processing device 100 will be described.

[0057] Step S100: In the information processing device 100, the application corresponding processing unit 131 waits for the start of a writing operation.

[0058] The application-compatible processing unit 131 can detect the start of a writing operation, for example, based on the start of input of pen position information indicating the position of the pen tip from the touch panel 122 .

[0059] Step S102: In response to the start of the writing operation, the application-supporting processing unit 131 starts to transmit writing operation information to the pen-type input device 200. The writing operation information is information notifying that a writing operation on the touch panel 122 using the pen-type input device 200 is currently being performed.

[0060] Step S104: After starting to send the writing operation information in step S102, the application-corresponding processing unit 131 waits for the writing operation started in response to step S100 to end. The application-corresponding processing unit 131 may determine that the writing operation has ended based on the pen position information not inputted thereto.

[0061] Step S106 : If it is determined in step S104 that the writing operation is completed, the application-corresponding processing unit 131 stops sending the writing operation information started in step S102 .

[0062] Next, an example of a processing procedure executed by the pen-type input device 200 will be described.

[0063] Step S200 : In the pen-type input device 200 , the vibration control unit 241 waits to start receiving the writing operation information transmitted from the information processing apparatus 100 in step S102 .

[0064] Step S202: In response to the start of receiving writing operation information in step S200, the sound detection unit 203 detects actual writing sound. The correction unit 242 obtains data (actual writing sound data) of the actual writing sound detected by the sound detection unit 203. The correction unit 242 can obtain the actual writing sound data of the actual writing sound detected by the sound detection unit 203 within a specified time (specified number of samples).

[0065] Step S204: The correction unit 242 generates correction data for correcting the actual writing sound so that the actual writing sound approaches the ideal writing sound. When generating the correction data, the correction unit 242 calculates the frequency characteristics of the actual writing sound by, for example, performing frequency analysis on the actual writing sound data acquired corresponding to step S202. The correction unit 242 calculates the difference between the frequency characteristics of the actual writing sound and the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251 (that is, the frequency characteristics of the ideal writing sound). Based on the calculated difference, the correction unit 242 generates correction data that uses the frequency characteristics of the actual writing sound as the frequency characteristics of the writing sound data.

[0066] The correction data may be, for example, parameters of a filter, an equalizer, etc. that change the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251. Alternatively, the correction data may be a functional module of a filter, an equalizer, etc. Alternatively, the correction data may be writing sound data (corrected writing sound data) having frequency characteristics that make it an ideal writing sound when it is generated as an actual writing sound. In addition, for correction data such as parameters of such a filter or an equalizer or functional module, for example, a plurality of different correction data may be stored in advance in the storage unit 205 and prepared, and the correction unit 242 may select from the plurality of correction data based on the calculated difference.

[0067] In the following description, a case where correction data is generated as correction data of a module of a filter is exemplified.

[0068] Step S206: The correction unit 242 corrects the frequency characteristics of the writing sound data read from the writing sound data storage unit 251 using the correction data generated in step S204. That is, the correction unit 242 in this case generates a module as a filter of the correction data generated in step S204, and passes the generated filter through the writing sound data read from the writing sound data storage unit 251. The correction unit 242 inputs the writing sound data (corrected writing sound data) corrected by passing through the filter to the vibration control unit 241.

[0069] Step S208: The vibration control unit 241 drives the vibration unit 202 using the writing sound data (corrected writing sound data) input in step S206. In this way, by driving the vibration unit 202 using the corrected writing sound data, the pen-type input device 200 performing the writing operation vibrates and emits an actual writing sound close to the ideal writing sound.

[0070] Step S210: When the vibration unit 202 is vibrated in step S208, the vibration control unit 241 determines whether the reception of the writing operation information sent from the information processing device 100 has stopped. When it is determined that the reception of the writing operation information has not stopped, the process returns to step S208. Since the process returns to step S208, the state of vibrating the pen-type input device 200 by correcting the writing sound data in the state of receiving the writing operation information continues.

[0071] If it is determined in step S210 that the reception of the writing operation information has stopped, the processing of the figure ends. Thus, according to the fact that the processing ends, the vibration of the pen-type input device 200 also stops.

[0072] In addition, when the correction unit 242 generates the corrected writing sound data as the correction data, the vibration control unit 241 can skip the processing of step S206 and drive the vibration unit 202 using the corrected writing sound data generated as the correction data in step S208.

[0073] Furthermore, in the present embodiment, during the writing operation, feedback control may be performed so that the actual writing sound is continuously detected and correction data is generated, and the vibration unit 202 is vibrated using the writing sound data corrected by the generated correction data.

[0074] <Second embodiment>

[0075] The information processing system of the first embodiment vibrates the pen-type input device 200 using the corrected writing sound data corrected based on the difference between the actual writing sound detected by the sound detection unit 203 and the ideal writing sound.

[0076] In contrast, in the information processing system of the present embodiment, the pen-type input device 200 pre-stores correction data such as a filter having characteristics that can make the actual writing sound the ideal writing sound, according to the combination with the type (e.g., model, type, etc.) of the touch panel 122 to be operated. The pen-type input device 200 corrects the writing sound data using the correction data corresponding to the type of the touch panel 122 to be operated, and vibrates the vibration unit 202 using the corrected writing sound data. In this way, in the present embodiment, the actual writing sound emitted by the vibration of the pen-type input device 200 is made close to the ideal writing sound.

[0077] Figure 4 FIG. 2 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 corresponding to writing sound feedback according to the present embodiment. Figure 2 The same parts are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0078] In the pen-type input device 200 of the figure, the storage unit 205 includes a correction data storage unit 252. The correction data storage unit 252 stores correction data corresponding to each type of the touch panel 122.

[0079] In addition, in this embodiment, the sound detection unit 203 can be omitted.

[0080] Figure 5 An example of correction data stored in the correction data storage unit 252 is shown. As shown in the figure, the correction data storage unit 252 stores correction data corresponding to each touch panel type. The correction data corresponding to one touch panel type is data for correcting the frequency characteristics of the writing sound data stored in the writing sound data storage unit 251 so as to make the actual writing sound close to the ideal writing sound in correspondence with the case where a writing operation is performed on a touch panel of the corresponding touch panel type using the pen-type input device 200. That is, the correction data storage unit 252 stores correction data corresponding to each combination of various touch panel types for the pen-type input device 200.

[0081] The correction data in this embodiment may be parameters of a filter, an equalizer, etc. Alternatively, the correction data may be a functional module of a filter, an equalizer, etc. In addition, for correction data as parameters or functional modules of such a filter or an equalizer, for example, a plurality of different correction data may be stored in advance in the storage unit 205 and prepared, and the correction unit 242 may select from the plurality of correction data based on the calculated difference.

[0082] Reference Figure 6 The flowchart of FIG. 1 is used to describe an example of processing steps executed by the information processing apparatus 100 and the pen-type input device 200 according to the present embodiment in response to writing sound feedback.

[0083] First, an example of a process procedure executed by the information processing device 100 will be described.

[0084] Step S300: In the information processing device 100, the application corresponding processing unit 131 waits for the start of the writing operation.

[0085] Step S302: In response to the start of the writing operation, the application corresponding processing unit 131 starts to send writing operation information to the pen-type input device 200. The writing operation information of this embodiment includes type information indicating the type of the touch panel 122 (touch panel type) provided in the information processing device 100. For example, the type information indicating the type of the touch panel 122 is stored in the storage unit 104. The application corresponding processing unit 131 can include the type information obtained from the storage unit 104 in the writing operation information.

[0086] Step S304: After starting to send the writing operation information in step S302, the application-corresponding processing unit 131 waits for the writing operation started in response to step S300 to end.

[0087] Step S306 : If it is determined in step S304 that the writing operation is completed, the application-corresponding processing unit 131 stops sending the writing operation information started in step S302 .

[0088] Next, an example of a processing procedure executed by the pen-type input device 200 will be described.

[0089] Step S400 : In the pen-type input device 200 , the vibration control unit 241 waits to start receiving the writing operation information transmitted from the information processing apparatus 100 in step S302 .

[0090] Step S402 : Based on the fact that the writing operation information starts to be received in step S400 , the correction unit 242 obtains the type information included in the received writing operation information.

[0091] Step S404 : The correction unit 242 acquires, from the correction data storage unit 252 , correction data associated with the same touch panel type as indicated by the type information acquired in step S402 .

[0092] Step S406 : The correction unit 242 corrects the frequency characteristics of the writing sound data read from the writing sound data storage unit 251 using the correction data acquired in step S404 . The correction unit 242 inputs the corrected writing sound data (corrected writing sound data) to the vibration control unit 241 .

[0093] Step S408: The vibration control unit 241 drives the vibration unit 202 using the writing sound data (corrected writing sound data) input in step S406.

[0094] Step S410: When the vibration unit 202 is vibrated in step S408, the vibration control unit 241 determines whether the reception of the writing operation information transmitted from the information processing device 100 has stopped. If it is determined that the reception of the writing operation information has not stopped, the process returns to step S408.

[0095] If it is determined in step S410 that the reception of the writing operation information has stopped, the processing of the figure is terminated. In accordance with the termination of the processing of the figure, the vibration of the pen-type input device 200 is also stopped.

[0096] Furthermore, in the present embodiment, the correction data stored in the correction data storage unit 252 may be writing sound data that causes the actual writing sound to have a frequency characteristic that becomes an ideal writing sound according to the writing operation on the corresponding touch panel type. In this case, the vibration control unit 241 may vibrate the vibration unit 202 using the writing sound data as the correction data acquired by the correction unit 242. In this case, the writing sound data storage unit 251 may be omitted.

[0097] <Third embodiment>

[0098] Next, the third embodiment is described. In the previous first embodiment, the pen-type input device 200 detects the actual writing sound and corrects the writing sound data based on the detected actual writing sound. In contrast, in this embodiment, the information processing device 100 detects the actual writing sound and performs processing related to the correction of the writing sound data based on the detected actual writing sound. The pen-type input device 200 uses the writing sound data corrected by the information processing device 100 to emit an actual writing sound close to the ideal writing sound.

[0099] Figure 7 FIG. 2 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 corresponding to writing sound feedback according to the present embodiment. Figure 2 The same parts are marked with the same reference numerals. Figure 2 The differences are explained below.

[0100] The information processing device 100 includes a sound detection unit 105 and a correction unit 132 .

[0101] The sound detection unit 105 is provided so as to be able to detect writing sound emitted from the pen-type input device 200 when the user brings the pen tip of the pen-type input device 200 into contact with the touch panel 122 to perform a writing operation.

[0102] In addition, Figure 7 In the Figure 2 The pen-type input device 200 includes a sound detection unit 203 and a correction unit 242. The correction unit 132 in this embodiment may be one of the functions of a pen operation-supported application, or may be provided as a function of an OS (Operating System).

[0103] In addition, the storage unit 104 of the information processing device 100 includes an ideal writing sound data storage unit 141. The ideal writing sound data storage unit 141 stores ideal writing sound data. The ideal writing sound data is, for example, writing sound data corresponding to the writing sound that should be emitted in response to the touch panel 122 provided in the information processing device 100. The ideal writing sound data stored in the ideal writing sound data storage unit 141 may be data indicating the frequency characteristics of the corresponding ideal writing sound. In addition, the ideal writing sound data storage unit 141 may store the ideal writing sound data corresponding to the type of each pen selected in the pen operation corresponding application, for example.

[0104] Reference Figure 8 The flowchart of FIG. 1 is used to describe an example of processing steps executed by the information processing apparatus 100 and the pen-type input device 200 according to the present embodiment in response to writing sound feedback.

[0105] Step S500: In the information processing device 100, the application corresponding processing unit 131 waits for the writing operation to start.

[0106] Step S502: In response to the start of the writing operation, the sound detection unit 105 detects the actual writing sound.

[0107] Step S504: The correction unit 132 generates correction data. For example, the correction unit 132 calculates the frequency characteristics of the actual writing sound by performing frequency analysis on the actual writing sound (actual writing sound data) detected corresponding to step S502. The correction unit 132 generates correction data that uses the frequency characteristics of the actual writing sound as the frequency characteristics of the ideal writing sound data based on the difference between the frequency characteristics of the actual writing sound and the frequency characteristics of the ideal writing sound data stored in the ideal writing sound data storage unit 141. The correction data in this embodiment may be parameters of a filter, an equalizer, etc. Alternatively, the correction data may be a functional module of a filter, an equalizer, etc. In addition, for correction data that is a parameter or a functional module of such a filter or an equalizer, for example, a plurality of different correction data may be stored in advance in the storage unit 205 and prepared, and the correction unit 242 may select from the plurality of correction data based on the calculated difference.

[0108] Step S506: The correction unit 132 starts sending the writing operation information, and sends the correction data generated in step S504 at the timing when the sending of the writing operation information starts.

[0109] Step S508 : After starting to send the writing operation information in step S506 , the application-corresponding processing unit 131 waits for the writing operation started in response to step S500 to end.

[0110] Step S510 : If it is determined in step S508 that the writing operation is completed, the application-corresponding processing unit 131 stops sending the writing operation information started in step S506 .

[0111] Next, an example of a processing procedure executed by the pen-type input device 200 will be described.

[0112] Step S600 : In the pen-type input device 200 , the vibration control unit 241 waits to start receiving the writing operation information transmitted from the information processing apparatus 100 in step S506 .

[0113] Step S602 : The vibration control unit 241 sets a filter based on the correction data received at the same timing as the timing when reception of the writing operation information is started.

[0114] Step S604: After the vibration control unit 241 passes the writing sound data stored in the writing sound data storage unit 251 through the filter set in step S602 to obtain corrected writing sound data, the vibration control unit 241 drives the vibration unit 202 using the corrected writing sound data.

[0115] Step S606: When the vibration unit 202 is vibrated in step S604, the vibration control unit 241 determines whether the reception of the writing operation information transmitted from the information processing device 100 has stopped. If it is determined that the reception of the writing operation information has not stopped, the process returns to step S604.

[0116] If it is determined in step S606 that the reception of the writing operation information has stopped, the processing of the figure is terminated and the vibration of the pen-type input device 200 is also stopped.

[0117] Furthermore, in this embodiment, the correction unit 132 of the information processing device 100 may also send the ideal writing sound data stored in the ideal writing sound data storage unit 141 as correction data to the pen-type input device 200. In this case, the vibration control unit 241 of the pen-type input device 200 may drive the vibration unit 202 using the ideal writing sound data received as correction data. In this case, the writing sound data storage unit 251 in the pen-type input device 200 may be omitted.

[0118] <Fourth embodiment>

[0119] In the second embodiment described above, the pen-type input device 200 corrects the writing sound data using the correction data corresponding to the type of the touch panel 122 and vibrates the vibration unit 202 using the corrected writing sound data.

[0120] In contrast, in the present embodiment, the information processing apparatus 100 stores correction data corresponding to the type (pen type) of each pen-type input device 200. The information processing apparatus 100 transmits the correction data corresponding to the pen type of the pen-type input device 200 used for writing operation on the touch panel 122 to the pen-type input device 200 among the stored correction data. The pen type corresponds to the style of the pen-type input device 200, etc.

[0121] The pen-type input device 200 vibrates the vibration unit 202 using the writing sound data corrected by the received correction data (corrected writing sound data), thereby emitting an actual writing sound close to the ideal writing sound.

[0122] Fig. 9 1 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 corresponding to writing sound feedback according to the present embodiment. Figure 4 The same parts are denoted by the same reference numerals, and the description thereof will be appropriately omitted.

[0123] Fig. 9 The information processing device 100 of FIG. 1 includes a correction unit 132 in the control unit 103. In addition, the information processing device 100 of FIG. 1 includes a correction data storage unit 142 and a pen type storage unit 143 in the storage unit 104. Fig. 9 In the pen-type input device 200, the Figure 4 The correction unit 242 and the correction data storage unit 252 in.

[0124] The correction data storage unit 142 stores correction data corresponding to each pen type. The correction data corresponding to one pen type is data for correcting writing sound data to obtain an ideal writing sound when a writing operation is performed on the touch panel 122 using the pen-type input device 200 of the corresponding pen type. In other words, the correction data storage unit 142 stores correction data corresponding to each combination of various pen-type input devices with respect to the touch panel 122 provided in the information processing device 100.

[0125] In the present embodiment, the correction data may be parameters of a filter, an equalizer, etc. Alternatively, the correction data may be a functional module of a filter, an equalizer, etc. In the following description, the case where the correction data is a functional module of a filter, etc. is cited.

[0126] The pen type storage unit 143 stores the pen type of the pen-type input device 200 that is communicatively connected.

[0127] The pen-type input device 200 notifies the information processing apparatus 100 of its own pen type during negotiation performed when establishing communication with the information processing apparatus 100. The pen type storage unit 143 stores the pen type thus notified.

[0128] Reference Fig.10 The flowchart of FIG. 1 is used to illustrate an example of processing steps performed by the information processing device 100 and the pen-type input device 200 in accordance with the writing sound feedback of the present embodiment. The processing steps of the figure are performed when the communication between the information processing device 100 and the pen-type input device 200 has been established and the pen type of the pen-type input device 200 of the connection object is stored in the pen type storage unit 143.

[0129] Step S700: In the information processing device 100, the application corresponding processing unit 131 waits for the writing operation to start.

[0130] Step S702: In response to the start of the writing operation, the correction unit 132 obtains correction data corresponding to the same pen type as that stored in the current pen type storage unit 143 from the correction data storage unit 142.

[0131] Step S704: The correction unit 132 starts sending the writing operation information, and sends the correction data acquired in step S702 at the timing when the sending of the writing operation information starts.

[0132] Step S706: After starting to send the writing operation information in step S704, the application-corresponding processing unit 131 waits for the writing operation started in response to step S700 to end.

[0133] Step S708 : If it is determined in step S706 that the writing operation is completed, the application-corresponding processing unit 131 stops sending the writing operation information started in step S704 .

[0134] The processing of steps S800 to S806 performed by the pen-type input device 200 may be the same as Figure 8 Steps S600 to S606 are the same.

[0135] Furthermore, in the present embodiment, the correction data stored in the correction data storage unit 142 may be writing sound data created so that the actual writing sound is identical to the ideal writing sound corresponding to the pen type of the corresponding pen-type input device 200. In this case, the vibration control unit 241 of the pen-type input device 200 may drive the vibration unit 202 by the writing sound data received as the correction data.

[0136] In addition, the program for realizing the functions of the above-mentioned information processing device 100, pen-type input device 200, etc. can also be recorded in a computer-readable recording medium, and the processing of the above-mentioned information processing device 100, pen-type input device 200, etc. can be performed by making the computer system read the program recorded in the recording medium and execute it. Here, the so-called "making the computer system read the program recorded in the recording medium and execute it" includes installing the program to the computer system. The so-called "computer system" here includes hardware such as OS and peripheral devices. In addition, the "computer system" may also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. In addition, the so-called "computer-readable recording medium" refers to portable media such as floppy disks, optical magnetic disks, ROMs, CD-ROMs, and recording devices such as HDDs and SSDs built into the computer system. In this way, the recording medium storing the program can be a non-temporary recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium set inside or outside that can be accessed from a distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may also be a code different from the code of the program in a form that can be executed in the terminal device. That is, as long as it can be downloaded from the distribution server and installed in a form that can be executed in the terminal device, it does not matter what the form stored in the distribution server is. In addition, the program may be divided into multiple parts, and the structure formed by combining the terminal device after downloading at different time intervals, and the distribution server for each of the divided programs may be different. Moreover, the so-called "computer-readable recording medium" also includes a structure that keeps the program for a certain period of time, such as a server in the case of sending a program via a network, and a volatile memory (RAM) inside a computer system that becomes a client. In addition, the above-mentioned program may also be a structure for realizing a part of the above-mentioned functions. Furthermore, it may also be a so-called differential file (differential program) that can realize the above-mentioned functions by combining them with the programs already recorded in the computer system.

Claims

1. An input device control system comprising: a vibration control unit that, upon detecting that the pen-type input device is in contact with the operation object surface, uses the writing sound data to vibrate the pen-type input device to produce a writing sound; and The correction unit performs processing related to the change of the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound generated by vibrating the pen-shaped input device according to the vibration control unit to the frequency characteristics of the ideal writing sound.

2. The input device control system according to claim 1, wherein: The device further comprises a detection unit for detecting the actual writing sound generated by the vibration of the pen-type input device. The correction unit performs processing related to changing the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound detected by the detection unit to the frequency characteristics of the ideal writing sound.

3. The input device control system according to claim 1, wherein: The device further comprises a storage unit for storing correction data for correcting the frequency characteristics of the actual writing sound to the frequency characteristics of the ideal writing sound for each combination of the pen-shaped input device and the operation target surface. The correction unit executes processing related to the change of the frequency characteristics of the writing sound data based on the correction data corresponding to the combination of the pen-shaped input device to be used and the operation target surface among the correction data stored in the storage unit.

4. An input device control method, which is an input device control method in an input device control system, The above input device control method has the following features: a vibration control step, in which the vibration control unit, upon detecting that the pen-type input device is in contact with the operation object surface, uses the writing sound data to vibrate the pen-type input device to produce a writing sound; and In the correction step, the correction unit performs processing related to the change of the frequency characteristics of the writing sound data so as to correct the frequency characteristics of the actual writing sound emitted by vibrating the above-mentioned pen-type input device through the above-mentioned vibration control step to the frequency characteristics of the ideal writing sound.

Images