Information processing system

Abstract

To make it possible to feel like being actually writing on a writing medium when using a pen-type input device for input.SOLUTION: An information processing system includes: a sensor unit which outputs a detection signal according to a distance of a pen-type input device from an operation target surface; a speed detection unit which detects, based on the detection signal output by the sensor unit, a speed at which the pen-type input device separated from the operation target surface moves to come in contact with the operation target surface in a range of a predetermined distance from the operation target surface; and a vibration control unit which changes a state of vibration of the pen-type input device at a timing of the contact between the pen-type input device and the operation target surface, in accordance with the speed detected by the speed detection unit.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system. [Background technology]

[0002] It is known that, when inputting data to an interactive display system, a pen-shaped stylus (pen-type input device) capable of providing tactile feedback by generating vibrations that drive a tactile actuator is used as an input device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2017-537395 Summary of the Invention [Problem to be solved by the invention]

[0004] By emitting vibrations from the pen-type input device, the tactile sensation of sliding the tip of a pen across a writing medium such as paper can be simulated, allowing a user inputting data using the pen-type input device to get a sensation similar to that of writing on a writing medium.

[0005] When inputting data using a pen-type input device, it is desirable to have a sensation as close as possible to that of writing on an actual writing medium. In consideration of the above-mentioned problems, the present invention has an object to provide an input using a pen-type input device that provides a sensation similar to that felt when actually writing on a writing medium. [Means for solving the problem]

[0006] One aspect of the present invention that solves the above-mentioned problems is an information processing system that includes a sensor unit that outputs a detection signal according to the distance of a pen-type input device from an operation target surface, a speed detection unit that detects the speed at which the pen-type input device, which has been separated from the operation target surface within a certain distance range from the operation target surface, moves until it comes into contact with the operation target surface based on the detection signal output by the sensor unit, and a vibration control unit that changes the state of vibration to be performed by the pen-type input device at the timing at which the pen-type input device comes into contact with the operation target surface, according to the speed detected by the speed detection unit. Effect of the Invention

[0007] According to the present invention, when performing input using a pen-type input device, it is possible to obtain an effect that the feeling of actually writing on a writing medium can be approximated. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the external configuration of an information processing system according to a first embodiment. [Diagram 2] 2 is a diagram illustrating an example of a functional configuration according to tactile feedback between an information processing device and a pen-type input device in the first embodiment. FIG. [Diagram 3] 5A to 5C are diagrams illustrating an example of a method for detecting a contact speed in the first embodiment. [Figure 4] 10 is a flowchart showing an example of a processing procedure executed by the information processing device and the pen-type input device in response to haptic feedback in the first embodiment. [Diagram 5] 13A to 13C are diagrams illustrating an example of a method for detecting a contact speed in the second embodiment. [Figure 6] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen-type input device in response to haptic feedback in the second embodiment. [Figure 7] FIG. 13 is a diagram illustrating an example of a functional configuration corresponding to tactile and writing sound feedback between an information processing device and a pen-type input device in a third embodiment. [Figure 8] 13 is a flowchart showing an example of a processing procedure executed by the pen-type input device in accordance with the third embodiment in response to tactile-writing sound feedback. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] First Embodiment 1 shows an example of the external configuration of an information processing system according to the present embodiment. As shown in the figure, the information processing system according to the present embodiment includes an information processing device 100 and a pen-type input device 200.

[0010] The information processing device 100 is capable of executing information processing in response to an input operation by a pen-type input device 200. The information processing device 100 in the figure is an example of a tablet terminal or a notebook personal computer.

[0011] The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a portion in which a touch panel and a display unit are combined. The touch panel display unit 102 displays an image on a display surface, and enables operation by contacting the display surface with an operating object such as a pen-type input device or a finger.

[0012] The pen-type input device 200 is a pen-type input device used by a user to perform operations on the touch panel of the touch panel display unit 102 of the information processing device 100. A user holds the pen-type input device 200 and moves the pen tip so as to contact the display surface of the touch panel display unit 102, thereby performing a handwritten input operation of characters, pictures, figures, and the like.

[0013] Note that operations using the pen-type input device 200 may also include pointing operations on a user interface image displayed on the touch panel display unit 102.

[0014] The detection method of the pen-type input device 200 by the touch panel in the touch panel display unit 102 of this embodiment is not particularly limited, but examples thereof include a capacitance method and an electromagnetic induction method. In the following description, a case where the capacitance method is used will be taken as an example.

[0015] An application compatible with input operations using the pen-type input device 200 (pen operation compatible application) is installed in the information processing device 100. The pen operation compatible application may be capable of, for example, inputting characters by touching the tip of the pen of the pen type input device 200 to the touch panel display unit 102, displaying characters or pictures drawn in response to handwriting input operations such as drawing, and executing processes for converting characters or pictures drawn by the operations into data.

[0016] In the information processing system of this embodiment, the pen type input device 200 vibrates in response to an operation (writing operation) corresponding to writing. Such vibration of the pen type input device 200 allows the user to feel a tactile sensation similar to that felt when writing on a writing medium such as paper, and allows the user to obtain a sensation similar to that felt when writing on a writing medium with an actual writing implement.

[0017] In the following description, the generation of vibrations when a writing operation is being performed with the pen-type input device 200 is also referred to as "tactile feedback."

[0018] FIG. 2 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 that support haptic feedback according to this embodiment. First, a description will be given of an example of a functional configuration of the information processing device 100. The functions of the information processing device 100 shown in the figure are realized by executing programs by a central processing unit (CPU), a graphics processing unit (GPU), and the like provided in the hardware of the information processing device 100. The information processing device 100 in the figure includes a communication unit 101, a touch panel display unit 102, a control unit 103, a storage unit 104, and a speed detection unit 105.

[0019] The communication unit 101 performs wireless communication with the pen-type input device 200. There is no particular limitation on the wireless communication system supported by the communication unit 101. Note that the communication unit 101 may be capable of supporting wired communication with the pen-type input device 200.

[0020] Touch panel display unit 102 is a device in which a display unit 121 and a touch panel 122 (an example of a sensor unit) are combined. The display unit 121 displays an image under the control of the control unit 103 . The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position of the pen tip of the pen type input device 200, and outputs the coordinates of the detected position as pen operation information. Specifically, the capacitive touch panel 122 may detect the position (coordinates) of the pen tip on the panel surface (an example of a surface to be operated) by detecting, with electrodes, electrostatic capacitance generated by contact (or proximity) of the pen tip of the pen type input device 200 with the panel surface.

[0021] The control unit 103 executes various controls in the information processing device 100. The control unit 103 includes an application support processing unit 131 that executes processing corresponding to a pen operation compatible application. When a writing operation is being performed with the pen type input device 200 as an operation for a pen operation compatible application, pen operation information is input from the touch panel 122 to the application compatible processing unit 131. In response to the input of the pen operation information, the application compatible processing unit 131 performs processing such as drawing.

[0022] The storage unit 104 stores various types of information corresponding to the information processing device 100 .

[0023] The speed detection unit 105 detects the speed (contact speed) at which the pen tip of the pen type input device 200 contacts the panel surface based on a detection signal indicating the capacitance generated on the touch panel 122 in response to the approach or contact of the pen type input device 200 to the panel surface.

[0024] The speed detection unit 105 may be provided in the touch panel display unit 102 or in the control unit 103.

[0025] Next, a description will be given of an example of a functional configuration of the pen type input device 200. The functions of the pen type input device 200 shown in the figure may be realized by causing a microprocessor such as an MCU (Micro Controller Unit) included in the pen type input device 200 as hardware to execute a program.

[0026] The pen-type input device 200 in the figure includes a communication unit 201 , a vibration unit 202 , a control unit 204 , and a storage unit 205 .

[0027] The communication unit 201 is communicably connected to the communication unit 101 of the information processing device 100 .

[0028] The vibration unit 202 (actuator) is a part that vibrates to give a tactile sensation during a writing operation to a user holding the pen-type input device 200. The vibration of the vibration unit 202 is controlled by a vibration control unit 241.

[0029] The control unit 204 executes various controls in the pen type input device 200. The control unit 204 includes a vibration control unit 241.

[0030] The vibration control unit 241 vibrates the vibration unit 202 based on the vibration waveform data stored in the vibration waveform data storage unit 251 .

[0031] The storage unit 205 stores various types of information that the pen type input device 200 supports. The storage unit 205 includes a vibration waveform data storage unit 251. The vibration waveform data storage unit 251 stores vibration waveform data. The vibration waveform data is data that indicates a vibration waveform for generating a desired vibration state in the pen type input device 200.

[0032] The pen-type input device 200 of the information processing system of this embodiment configured as described above can provide tactile feedback. That is, the pen-type input device 200 of this embodiment is operable to vibrate in response to an operation corresponding to writing being performed with the pen tip in contact with the panel surface of the touch panel display unit 102 (touch panel 122). By vibrating the pen-type input device 200 in this manner when a writing operation is being performed, it is possible to approximate the sensation of writing on a writing medium with an actual writing implement. As such tactile feedback, it is preferable to be able to control the vibration, for example by changing the vibration strength depending on the strength (contact strength) with which the pen-type input device 200 contacts the panel surface, since this makes it possible to further approximate the sensation of writing on a writing medium with an actual writing instrument.

[0033] Therefore, in the information processing system of this embodiment, the speed (panel contact speed) at which the tip (pen tip) of the pen type input device 200 contacts the panel surface of the touch panel 122 due to a user's operation is detected. Since the contact strength increases as the contact speed increases, there is a correlation between the contact speed and the contact strength. Therefore, the panel contact speed can be treated as the contact strength of the pen type input device 200 with respect to the panel surface of the touch panel 122. Therefore, the pen type input device 200 of this embodiment is configured to vibrate at an intensity corresponding to the detected contact speed when it contacts the panel surface of the touch panel 122.

[0034] An example of a method for detecting the contact speed in this embodiment will be described with reference to Fig. 3. In this embodiment, the capacitive touch panel 122 detects the position of the pen tip 210 and outputs a detection signal by generating a change in capacitance when the pen tip 210 of the pen-type input device 200 is not in contact with the panel surface 1221 and is within a certain detectable range d1 from the panel surface 1221. The capacitance also changes depending on the distance from the pen tip 210 to the panel surface 1221 within the detectable range d1.

[0035] When the user starts writing on the panel surface 1221 with the pen type input device 200, the pen tip 210 of the pen type input device 200 is brought into contact with the panel surface 1221. Fig. 3 shows the change in the positional relationship between the pen tip 210 and the panel surface 1221 over time when the user is about to bring the pen tip 210 into contact with the panel surface 1221.

[0036] When a user is about to bring the pen tip 210 of the pen type input device 200 into contact with the panel surface 1221, the pen tip 210 of the pen type input device 200 is moved closer to the panel surface 1221 from a state in which the pen tip 210 is spaced a certain distance from the panel surface 1221.

[0037] In FIG. 3, first, the pen type input device 200 is brought closer to the panel surface 1221 from a position farther away from the panel surface 1221 than the detectable range d1, so that the pen tip 210 reaches the detectable range d1 at time t1. In this embodiment, a speed detection range d2 is defined. The speed detection range d2 is a range from the panel surface 1221 to a predetermined distance that is shorter than the detectable range d1.

[0038] After time t1, the pen type input device 200 is brought closer to the panel surface 1221, and at time t2, the pen tip 210 reaches the speed detection target range d2. The touch panel 122 detects (samples) operations on the panel surface 1221 at a predetermined sampling rate. The sampling number at time t2 is "m". The sampling number is a number that is assigned such that it is incremented each time a sampling is performed, for example. In this way, the sampling number m corresponding to the timing when the pen tip 210 reaches the speed detection target range d2 is the sampling number corresponding to the timing when the pen tip 210 is at the speed detection start position.

[0039] After time t2, as shown by the passage of time at times t3 and t4, the pen tip 210 of the pen type input device 200 continues to be brought closer to the panel surface 1221. During this time, the capacitance generated in the touch panel 122 changes according to the distance of the pen tip 210 from the panel surface 1221.

[0040] After time t4, the pen tip 210 of the pen type input device 200 continues to be brought closer to the panel surface 1221, and at time t5, the pen tip 210 comes into contact with the panel surface 1221. The sampling number at this time is "n." The speed detection unit 105 may determine whether the pen tip 210 has come into contact with the panel surface 1221, for example, based on whether or not electrostatic capacitance is obtained that is generated in response to the state in which the pen tip 210 has come into contact with the panel surface 1221. In this way, the sampling number n corresponding to the timing at which the pen tip 210 comes into contact with the panel surface 1221 is the sampling number corresponding to the timing at which the pen tip 210 is at the speed detection end position.

[0041] The speed detection unit 105 detects the contact speed of the pen type input device 200 in response to the pen tip 210 contacting the panel surface 1221. The speed detection unit 105 can obtain the contact speed by dividing the speed detection target range d2 by the time (corresponding to the period from time t2 to time t5) that the pen tip 210 takes to move through the speed detection target range d2. Specifically, the speed detection unit 105 may calculate the contact speed V, for example, by the following formula 1. In formula 1, sr is the sampling rate, m is the sampling number corresponding to the speed detection start position, and n is the sampling number corresponding to the speed detection end position. V=d2×sr / (nm) (Formula 1)

[0042] In addition, for example, when it is detected that the pen tip 210 is present in the detectable range d1 or the speed detection target range d2, the touch panel 122 may change to a predetermined sampling rate higher than the sampling rate set when the pen tip 210 is not detected. In response to changing the sampling rate in this way, it is possible to reduce the error between the sampling timing of sampling number m and the timing when the pen tip 210 actually reaches the speed detection start position, and the error between the sampling timing of sampling number n and the timing when the pen tip 210 actually contacts the panel surface 1221. By reducing the timing error in this way, it is also possible to improve the accuracy of the detected contact speed.

[0043] An example of a processing procedure executed by the information processing device 100 and the pen type input device 200 of this embodiment in response to haptic feedback will be described with reference to the flowchart of FIG.

[0044] First, an example of a processing procedure executed by the information processing device 100 will be described. Step S100: In the information processing device 100, the speed detection unit 105 waits for the touch panel 122 to start detecting the pen tip 210. The speed detection unit 105 may determine that detection of the pen tip 210 has started in response to the occurrence of capacitance on the touch panel 122 in response to the pen tip 210 reaching the detectable range d1, as at time t1 in Fig. 3, and the start of output of a detection signal in response to the generated capacitance.

[0045] Step S102: The speed detection unit 105 changes the sampling rate of the touch panel 122 to a higher rate in response to the start of detection of the pen tip 210 by the touch panel 122. That is, the process in the figure shows an example in which the sampling rate is changed in response to the state in which the pen tip 210 is present in the detectable range d1.

[0046] Step S104: After the process of step S102, the speed detection unit 105 waits until the distance from the pen tip 210 to the panel surface 1221 (pen tip-panel distance) falls within the speed detection range d2. In other words, the speed detection unit 105 waits until the state corresponding to time t1 in FIG. 3 changes to a state corresponding to time t2. During standby in step S104, the pen tip 210 may return to a state outside the detectable range d1 without the pen tip-panel distance falling below the speed detection range d2. In such a case, the sampling rate changed in step S102 may be returned to the default state, and the process in the figure may be terminated.

[0047] Step S106: The speed detection unit 105 acquires a sampling number m indicating the sampling executed at the timing when the pen tip-panel distance falls below the speed detection target range d2. The sampling number m is the sampling number corresponding to the speed detection start position.

[0048] Step S108: Next, the speed detection unit 105 waits for the pen tip 210 to come into contact with the panel surface 1221. During standby in step S108, the pen tip 210 may return to a state outside the detectable range d1 without contacting the panel surface 1221. In such a case, the sampling rate changed in step S102 may be returned to the default state, and the process in the figure may be terminated.

[0049] Step S110: The speed detection unit 105 acquires a sampling number n indicating the sampling performed in response to the timing at which it is determined that the pen tip 210 has come into contact with the panel surface 1221. The sampling number n is the sampling number corresponding to the speed detection end position.

[0050] Step S112: The speed detection unit 105 calculates the contact speed, for example, by Equation 1, using the sampling number m corresponding to the speed detection start position acquired in step S106 and the sampling number n corresponding to the speed detection end position acquired in step S110.

[0051] Step S114: The speed detection unit 105 causes the communication unit 101 to transmit the contact speed calculated in step S112 to the pen-type input device.

[0052] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S200: In the pen type input device 200, the communication unit 201 receives the contact speed transmitted from the information processing device 100 in step S114.

[0053] Step S202: In the pen type input device 200, the vibration control unit 241 sets the vibration intensity when vibrating the pen type input device 200 according to the timing when the pen tip 210 contacts the panel surface 1221, based on the contact speed received in step S200.

[0054] Step S204: The vibration control unit 241 drives the vibration unit 202 with the vibration intensity set in step S202, using the vibration waveform data stored in the vibration waveform data storage unit 251. By vibrating the vibration unit 202 in this manner, the pen type input device 200 vibrates with an intensity according to the contact intensity at the timing when the pen tip 210 contacts the panel surface 1221. For example, a user can perform a writing operation by bringing the pen tip 210 of the pen type input device 200 into contact with the panel surface 1221 and then moving the pen tip 210 while keeping it in contact with the panel surface 1221. In this case, although the corresponding processing is not shown in the figure, tactile feedback according to the movement of the pen tip 210 is provided to the pen type input device 200.

[0055] <Second embodiment> Next, a second embodiment will be described. When a user performs a writing operation after once contacting the pen tip 210 of the pen type input device 200 with the panel surface 1221, there is a case where the pen tip 210 is slightly separated from the panel surface 1221 and then contacted with the panel surface 1221 again. In this case, the pen tip 210 may once be separated from the panel surface 1221 within a range less than the speed detection target range d2, and then contact the panel surface 1221. In such a case, since the pen tip 210 contacts the panel surface 1221 without moving outside the detectable range d1, in the processing procedure example of FIG. 4, the processing after step S106 is not executed, and the contact speed cannot be detected. Therefore, in this embodiment, the contact speed can be appropriately detected according to the movement of the pen tip 210 within a range less than the speed detection target range d2.

[0056] With reference to FIG. 5, an example of a method for detecting the contact speed in response to the movement of the pen tip 210 within a range less than the speed detection target range d2 will be described. For example, time t11 in Fig. 5 is a timing when a certain time has elapsed since the state in which the pen tip 210 was in contact at time t5 in Fig. 3. In the period from time t5 to time t11, the pen tip 210 is maintained in contact with the panel surface 1221. Note that in the period from time t5 to time t11, the pen tip 210 may be moved on the panel surface 1221 by, for example, a writing operation. At time t11, the user starts to separate the pen tip 210 from the panel surface 1221. During the period from time t11 through time t12 to time t13, the pen tip 210 is moved in a direction (separation direction) moving away from the panel surface 1221, and the distance (separation distance) from the panel surface 1221 gradually increases with time. In the speed detection unit 105, the touch panel 122 grasps the distance from the panel surface 1221 to the pen tip 210 based on a detection signal indicating a change in capacitance that occurs according to the distance from the panel surface 1221 to the pen tip 210.

[0057] At time t13, the user reverses the direction of movement of the pen tip 210 and starts to move the pen tip 210 in a direction (approach direction) approaching the panel surface 1221. After time t13, the pen tip 210 moves closer to the panel surface 1221, and after time t14, at time t15, the pen tip 210 comes into contact with the panel surface 1221. In response to such a movement of the pen tip 210, the speed detection unit 105 determines that the movement direction of the pen tip 210 is reversed from the separating direction to the approaching direction at time t13 within a range less than the speed detection target range d2. The speed detection unit 105 acquires a sampling number m corresponding to the speed detection start position at the timing when the movement direction of the pen tip 210 is reversed from the separating direction to the approaching direction. The speed detection unit 105 also acquires a sampling number n corresponding to the speed detection end position at the timing when the pen tip 210 contacts the panel surface 1221 at time t15. The speed detection unit 105 calculates the contact speed by Equation 1 using the sampling numbers m and n acquired in this way and the distance between the pen tip 210 and the panel surface 1221 at time t13 when the movement direction of the pen tip 210 is reversed from the separating direction to the approaching direction. In this way, the speed detection unit 105 of this embodiment is capable of detecting the contact speed when the pen tip 210 contacts the panel surface 1221 within a range less than the speed detection target range d2.

[0058] An example of a process procedure executed by information processing device 100 of this embodiment in response to detection of contact speed will be described with reference to the flowchart of FIG. In the figure, the processes in steps S300 to S314 are similar to those in steps S100 to S114 in FIG.

[0059] Step S316: By the processing of steps S300 to S314, the contact speed caused when the pen tip, which has been moved from outside the detectable range d1, comes into contact with the panel surface 1221 is detected and transmitted, as shown in Fig. 3. In response to the transmission of the contact speed, the processing of steps S200 to S204 in Fig. 4 is executed, whereby tactile feedback is given such that the pen-type input device 200 vibrates with an intensity according to the contact speed at the timing when the pen-type input device 200 comes into contact with the panel surface 1221. Then, in this embodiment, when the process of step S314 is executed, the speed detection unit 105 determines whether or not the pen tip-panel distance becomes equal to or greater than the speed detection range d2 under the user's subsequent writing operation.

[0060] Step S318: When the distance between the pen tip and the panel is within the speed detection range d2, the speed detection unit 105 determines whether the movement direction of the pen tip 210 has reversed from the away direction to the approaching direction, as shown as an example at time t13 in Figure 5. If it is determined that the movement direction of the pen tip 210 has not reversed from the separating direction to the approaching direction, the process returns to step S316.

[0061] Step S320: If it is determined in step S318 that the movement direction of the pen tip 210 has reversed from the away direction to the approaching direction, the speed detection unit 105 acquires a sampling number m indicating the sampling performed on the touch panel 122 in accordance with the timing of the reversal to the approaching direction, as a value corresponding to the speed detection start position.

[0062] Step S322: After the process of step S320, the speed detection unit 105 waits for the pen tip 210 to come into contact with the panel surface 1221. In this case, similarly to step S108 in Fig. 4, if the pen tip 210 returns to a state outside the detectable range d1 without coming into contact with the panel surface 1221 while waiting in step S322, the sampling rate changed in step S302 may be returned to the default state, and the process in the figure may be terminated. Then, when the pen tip 210 comes into contact with the panel surface 1221, the speed detection unit 105 returns the process to step S310. In this case, the speed detection unit 105 executes the processes of steps S310 to S314 to detect the contact speed when the pen tip 210 comes into contact with the panel surface 1221 in a state in which the pen tip-panel distance is less than the speed detection target range d2, and transmits the detected contact speed to the pen type input device 200. The pen type input device 200 executes the processes of steps S200 to S204 (FIG. 4) in response to the transmitted contact speed. As a result, the pen type input device 200 is made to vibrate according to the strength at which the pen tip 210 comes into contact with the panel surface 1221 at the timing when the pen tip 210 comes into contact with the panel surface 1221.

[0063] Step S324: If it is determined in step S316 that the pen tip-panel distance is equal to or greater than the speed detection range d2, the speed detection unit 105 determines whether or not detection of the pen tip 210 has ended on the touch panel 122. When the pen tip 210 is positioned outside the detectable range d1, no capacitance is generated on the panel surface 1221, and no detection signal corresponding to the capacitance is output, it is determined that detection of the pen tip 210 has ended. If it is determined that the detection of the pen tip 210 has not ended, the process returns to step S316. When it is determined that the detection of the pen tip 210 is completed, the process in the figure is terminated. When the process in the figure is terminated, the sampling rate of the touch panel 122 changed in step S302 is returned to the default state.

[0064] <Third embodiment> Next, a third embodiment will be described. In the information processing system of this embodiment, the pen type input device 200 is capable of outputting a sound (writing sound) that is generated when writing on a writing medium with a real writing implement in response to a writing operation, in addition to vibration due to haptic feedback. The output of the writing sound corresponding to the writing operation using the pen type input device 200 in this manner is also called "writing sound feedback." By providing writing sound feedback in this manner, when writing on the touch panel 122 using the pen-type input device 200, it is possible to more closely resemble the sensation of writing on a writing medium with an actual writing implement.

[0065] 7 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 according to the present embodiment, which are compatible with tactile and written sound feedback. In the figure, the same parts as those in FIG. 2 are given the same reference numerals, and the description thereof will be omitted. The differences from FIG. 2 will be mainly described. In the figure, the configuration of the information processing device 100 is the same as that in FIG.

[0066] The pen type input device 200 in the figure includes a sound output unit 203. The pen type input device 200 in the figure also includes a sound output control unit 242 in the control unit 204, and a handwriting sound data storage unit 252 in the storage unit 205. The sound output unit 203 includes, for example, a speaker, and outputs handwriting sounds under the control of the sound output control unit 242. Note that the sound output unit 203 may also be capable of outputting sounds such as electronic sounds and voices. The sound output control unit 242 outputs audio data as handwriting sound data stored in the handwriting sound data storage unit 252 to the sound output unit 203, thereby causing the sound output unit 203 to output handwriting sounds. The handwriting-sound data storage unit 252 stores handwriting-sound data. The handwriting-sound data is audio data created to reproduce handwriting sounds.

[0067] In this embodiment, the information processing device 100 may be configured to execute the same process as that shown in FIG. 4 or FIG. 6 as the process corresponding to the tactile-sound feedback.

[0068] The flowchart in FIG. 8 shows an example of a processing procedure that the pen type input device 200 of this embodiment executes in response to tactile / writing sound feedback. Step S400: In the pen type input device 200, the communication unit 201 receives the contact speed transmitted from the information processing device 100 in step S114 in FIG. 4 or step S314 in FIG.

[0069] Step S402: In the pen type input device 200, the vibration control unit 241 sets the vibration intensity when vibrating the pen type input device 200 according to the timing when the pen tip 210 contacts the panel surface 1221, based on the contact speed received in step S400.

[0070] Step S404: Furthermore, the sound output control unit 242 sets the volume of the writing sound (writing volume) to be output from the pen type input device 200 according to the timing at which the pen tip 210 contacts the panel surface 1221, based on the contact speed received in step S400.

[0071] Step S406: The vibration control unit 241 uses the vibration waveform data stored in the vibration waveform data storage unit 251 to drive the vibration unit 202 with the vibration intensity set in step S402.

[0072] Step S408: Furthermore, the sound output control unit 242 uses the handwriting sound data stored in the handwriting sound data storage unit 252 to cause the sound output unit 203 to output the handwriting sound at the handwriting volume set in step S404. Although the corresponding processing is not shown in the figure, tactile and writing sound feedback may be provided to the pen-type input device 200 in response to the movement of the pen tip 210 in contact with the panel surface 1221 .

[0073] The functions of the sound output unit 203 and the sound output control unit 242 may be provided in the information processing device 100, so that the writing sound feedback may be performed in the information processing device.

[0074] As a modified example of this embodiment, the application-compatible processing unit 131 of the information processing device 100 may perform drawing in response to a writing operation based on the contact speed detected by the speed detection unit 105. Specifically, for example, in the case where drawing in response to a writing operation is performed using a writing implement such as a brush, if the contact speed is equal to or higher than a predetermined value, drawing may be performed in such a way that ink (and further paint, ink, etc.) splashes on the writing medium due to the brush coming into contact with the writing medium with great force.

[0075] In each of the above embodiments, the tactile feedback at the timing when the pen tip 210 contacts the panel surface 1221 may change the vibration intensity according to the contact speed, and may also change the vibration duration, vibration waveform, and the like.

[0076] In addition, a program for realizing the functions of the above-mentioned information processing device 100, pen-type input device 200, etc. may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing as the above-mentioned information processing device 100, pen-type input device 200, etc. Here, "reading a program recorded in a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include a plurality of computer devices connected via a network including the Internet, a WAN, a LAN, a dedicated line, and other communication lines. In addition, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, an optical magnetic disk, a ROM, a CD-ROM, and a storage device such as an HDD or SSD built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium provided inside or outside the computer system that can be accessed from a distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by a terminal device. That is, the format in which the program is stored in the distribution server does not matter as long as the program can be downloaded from the distribution server and installed in a form executable by the terminal device. The program may be divided into multiple parts, each of which may be downloaded at a different time and then combined on the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" includes a storage medium that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that is a server or client when a program is transmitted over a network. The program may also be one that realizes part of the above-mentioned functions.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program). [Explanation of symbols]

[0077] 100 Information processing device, 101 Communication unit, 102 Touch panel display unit, 103 Control unit, 104 Memory unit, 105 Speed ​​detection unit, 121 Display unit, 122 Touch panel, 1221 Panel surface, 131 Application processing unit, 200 Pen-type input device, 201 Communication unit, 202 Vibration unit, 203 Sound output unit, 204 Control unit, 205 Memory unit, 241 Vibration control unit, 242 Sound output control unit, 251 Vibration waveform data storage unit, 252 Handwriting sound data storage unit

Claims

1. a sensor unit that outputs a detection signal according to a distance from an operation target surface of the pen-type input device; a speed detection unit that detects a speed at which the pen-type input device moves from the operation surface to the operation surface within a certain distance range based on a detection signal output by the sensor unit; and a vibration control unit that changes a state of vibration to be performed by the pen-type input device at a timing when the pen-type input device comes into contact with the operation target surface in accordance with the speed detected by the speed detection unit; An information processing system comprising:

2. The speed detection unit changes a sampling rate at which the sensor unit samples the detection signal in a state in which the sensor unit can output a detection signal according to a distance from the pen-type input device. The information processing system according to claim 1 .

3. The speed detection unit detects the speed from the time when the pen type input device reaches the operation target surface to a predetermined distance to the time when the pen type input device touches the operation target surface.

3. The information processing system according to claim 1 or 2.

4. The speed detection unit detects the speed within a certain distance range from the operation surface based on a distance to the operation surface at a reversal timing when a moving direction of the pen type input device is reversed from a direction away from the operation surface to a direction approaching the operation surface, and based on a time from the reversal timing to a timing when the pen type input device comes into contact with the operation surface.

3. The information processing system according to claim 1 or 2.

5. a sound output control unit that outputs a writing sound from a sound output unit at a timing when the pen-type input device comes into contact with the operation target surface in accordance with the speed detected by the speed detection unit; 3. The information processing system according to claim 1 or 2.

Images