Information processing system

Abstract

To bring a user the usefulness by using vibrations of a pen-type input device.SOLUTION: The information processing system includes: a coordinate detection unit for detecting the coordinates which correspond to a position of an operation target surface in which a pen-type input device is in contact with; and a vibration control unit for controlling to switch turning-on and the turning-off of the pen-type input device in accordance with a section pattern formed by dividing the moving trace of the coordinates detected by the coordinate detection unit according to a predetermined distance when the pen-type input device is moving in contact with the operation target surface.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system. [Background technology]

[0002] It is known that, when inputting data to an interactive display system, a pen-shaped stylus (pen-type input device) capable of providing tactile feedback by generating vibrations that drive a tactile actuator is used as an input device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2017-537395 Summary of the Invention [Problem to be solved by the invention]

[0004] The vibration of the pen-type input device simulates the tactile sensation of sliding the tip of a pen across a writing medium such as paper, allowing a user inputting data using the pen-type input device to get a sensation similar to that of writing with an actual writing instrument. By making the pen-type input device emit vibrations, it is possible to provide the user with a useful experience in addition to experiencing the tactile sensation of writing with an actual writing instrument, thereby improving user convenience, etc. Therefore, an object of the present invention is to provide a useful function for users by utilizing the vibration of a pen-type input device. [Means for solving the problem]

[0005] One aspect of the present invention that solves the above-mentioned problems is an information processing system that includes a coordinate detection unit that detects coordinates corresponding to a position on an operation surface where a pen-type input device is in contact, and a vibration control unit that controls the vibration of the pen-type input device to be switched on and off in accordance with a section pattern that divides a movement trajectory of the coordinates detected by the coordinate detection unit according to a predetermined distance when the pen-type input device is moving while in contact with the operation surface.

[0006] One aspect of the present invention is an information processing system comprising a coordinate detection unit that detects coordinates corresponding to a position on an operation surface that is in contact with a pen-type input device, and a vibration control unit that, based on the coordinate detection status by the coordinate detection unit, causes the pen-type input device to perform a temporary vibration at a timing when the movement state of the detected coordinates satisfies a predetermined condition when the pen-type input device is moving while in contact with the operation surface.

[0007] One aspect of the present invention is an information processing system comprising a coordinate detection unit that detects coordinates corresponding to the position of a surface to be operated on that is in contact with a pen-type input device, and a vibration control unit that changes the intensity of vibrations caused by the pen-type input device based on the state of the coordinates detected by the coordinate detection unit relative to predetermined reference coordinates when the pen-type input device is moving while in contact with the surface to be operated. Effect of the Invention

[0008] According to the present invention, it is possible to obtain an effect that it is possible to provide a user with usefulness by utilizing the vibration of a pen-type input device. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the external configuration of an information processing system according to a first embodiment. [Diagram 2] 2 is a diagram illustrating an example of the functional configuration of an information processing device and a pen-type input device according to vibration control in the first embodiment. FIG. [Diagram 3]4A to 4C are diagrams illustrating examples of vibration control in the first embodiment. [Figure 4] 5 is a flowchart showing an example of a processing procedure executed by the information processing device and the pen-type input device in response to vibration control in the first embodiment. [Diagram 5] 13A to 13C are diagrams illustrating an example of vibration control in a first application example of the second embodiment. [Figure 6] 13A to 13C are diagrams illustrating an example of vibration control in a first application example of the second embodiment. [Figure 7] 13A to 13C are diagrams illustrating an example of vibration control in a second application example of the second embodiment. [Figure 8] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen-type input device in response to vibration control in a second application example of the second embodiment. [Figure 9] 13A to 13C are diagrams illustrating an example of vibration control in a third application example of the second embodiment. [Figure 10] 13A to 13C are diagrams illustrating an example of vibration control in a first application example of the third embodiment. [Figure 11] 13A to 13C are diagrams illustrating an example of vibration control in a second application example of the third embodiment. [Figure 12] 13A to 13C are diagrams illustrating an example of a method for determining a coordinate movement direction in a second application example of the third embodiment. [Figure 13] 13A to 13C are diagrams illustrating an example of a method for determining a coordinate movement direction in a second application example of the third embodiment. [Figure 14] 13 is a flowchart showing an example of a processing procedure executed by an information processing device and a pen-type input device in response to vibration control in a second application example of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] First Embodiment 1 shows an example of the external configuration of an information processing system according to the present embodiment. As shown in the figure, the information processing system according to the present embodiment includes an information processing device 100 and a pen-type input device 200.

[0011] The information processing device 100 is capable of executing information processing in response to an input operation by a pen-type input device 200. The information processing device 100 in the figure is an example of a terminal or a notebook personal computer.

[0012] The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a portion in which a touch panel and a display unit are combined. The touch panel display unit 102 displays an image on a display surface, and enables operation by contacting the display surface with an operating object such as a pen-type input device or a finger.

[0013] The pen-type input device 200 is a pen-type input device used by a user to perform operations on the touch panel of the touch panel display unit 102 of the information processing device 100. A user holds the pen-type input device 200 and moves the pen tip so as to contact the display surface of the touch panel display unit 102, thereby performing a handwritten input operation of characters, pictures, figures, and the like.

[0014] Note that operations using the pen-type input device 200 may also include pointing operations on a user interface image displayed on the touch panel display unit 102.

[0015] The detection method of the pen-type input device 200 by the touch panel in the touch panel display unit 102 of this embodiment is not particularly limited, but examples thereof include a capacitance method and an electromagnetic induction method. In the following description, a case where the capacitance method is used will be taken as an example.

[0016] An application compatible with input operations using the pen-type input device 200 (pen operation compatible application) is installed in the information processing device 100. The pen operation compatible application may be capable of, for example, inputting characters by contacting the tip of the pen of the pen type input device 200 against the operation target surface of the touch panel display unit 102, displaying characters or pictures drawn in response to handwriting input operations such as drawing, on the touch panel display unit 102, and executing processes for converting characters or pictures drawn by the operation into data.

[0017] In the information processing system of this embodiment, the pen type input device 200 vibrates in response to an operation (writing operation) corresponding to writing. Such vibration of the pen type input device 200 allows the user to feel a tactile sensation similar to that felt when writing on a writing medium such as paper, and allows the user to obtain a sensation similar to that felt when writing on a writing medium with an actual writing implement.

[0018] In the following description, the generation of vibrations when a writing operation is performed with the pen-type input device 200 is also referred to as "tactile feedback." The tactile feedback may be controlled so that the vibrations change according to the speed at which the pen-type input device 200 moves while in contact with the operation target surface of the touch panel display unit 102, the pressure at which the pen tip of the pen-type input device 200 is in contact with the operation target surface, and the like.

[0019] FIG. 2 shows an example of the functional configuration of an information processing device 100 and a pen-type input device 200 according to the vibration control of this embodiment. First, a description will be given of an example of a functional configuration of the information processing device 100. The functions of the information processing device 100 shown in the figure are realized by executing programs by a central processing unit (CPU), a graphics processing unit (GPU), and the like provided in the hardware of the information processing device 100. The information processing device 100 in the figure includes a communication unit 101, a touch panel display unit 102, a control unit 103, a storage unit 104, and a coordinate detection unit 105.

[0020] The communication unit 101 performs wireless communication with the pen-type input device 200. There is no particular limitation on the wireless communication method supported by the communication unit 101, but an example of the method is Bluetooth (registered trademark). Note that the communication unit 101 may be capable of supporting wired communication with the pen-type input device 200. The hardware supported by the communication unit 101 may be configured to include a communication module compatible with the communication method implemented in the information processing device 100 .

[0021] Touch panel display unit 102 is a device in which a display unit 121 and a touch panel 122 (an example of a sensor unit) are combined. The display unit 121 displays an image under the control of the control unit 103 . The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position of the pen tip of the pen type input device 200, and outputs operation position information indicating the detected position. Specifically, the capacitive touch panel 122 may detect the position of the pen tip on the panel surface (an example of a surface to be operated) by detecting, with electrodes, electrostatic capacitance generated by contact of the pen tip of the pen type input device 200 with the panel surface.

[0022] Coordinate detection unit 105 detects coordinates corresponding to the operation position information output from touch panel 122. That is, coordinate detection unit 105 converts the position on the panel surface indicated by the operation position information output from touch panel 122 into coordinates. In this case, the coordinates detected by coordinate detection unit 105 may be, for example, two-dimensional coordinates corresponding to a drawing area displayed on touch panel display unit 102 by a pen operation compatible application. The coordinate detection unit 105 may be provided in the touch panel display unit 102 or in the control unit 103.

[0023] The control unit 103 executes various controls in the information processing device 100. The control unit 103 includes an application support processing unit 131 that executes processing corresponding to a pen operation compatible application, and a vibration control unit 132.

[0024] When the pen tip of the pen type input device 200 is in contact with the panel surface of the touch panel 122 as an operation for a pen operation compatible application, pen operation information is input from the touch panel 122 to the application compatible processing unit 131. In response to the input of the pen operation information, the application compatible processing unit 131 performs processing such as drawing.

[0025] The vibration control unit 132 executes control (vibration control) to vibrate the pen type input device 200. The vibration control unit 132 transmits vibration control information to the pen type input device 200 to instruct the pen type input device 200 to vibrate. The vibration control information may include, for example, vibration intensity as a parameter. In response to receiving the vibration control information, the pen type input device 200 operates to vibrate at the vibration intensity included in the vibration control information.

[0026] The control unit 103 may be configured as a computer equipped with a CPU, a GPU, a RAM, a ROM, and the like as hardware.

[0027] The storage unit 104 stores various types of information corresponding to the information processing device 100 . The hardware supported by the storage unit 104 may be, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like.

[0028] Next, a description will be given of an example of a functional configuration of the pen type input device 200. The functions of the pen type input device 200 shown in the figure may be realized by causing a microprocessor such as an MCU (Micro Controller Unit) included in the pen type input device 200 as hardware to execute a program.

[0029] The pen-type input device 200 in the figure includes a communication unit 201 , a vibration unit 202 , a control unit 204 , and a storage unit 205 .

[0030] The communication unit 201 is communicably connected to the communication unit 101 of the information processing device 100. The communication unit 201 may be configured to include, for example, hardware compatible with an implemented communication method. The hardware corresponding to the communication unit 201 may be configured to include a communication module corresponding to the communication method implemented in the pen type input device 200 .

[0031] The vibration unit 202 (actuator) is a part that vibrates so as to give a tactile sensation, for example, during a writing operation, to a user who is moving the pen tip of the pen type input device 200 on the panel surface of the touch panel 122. The vibration of the vibration unit 202 is controlled by a drive control unit 241.

[0032] The control unit 204 executes various controls in the pen type input device 200. The control unit 204 includes a drive control unit 241.

[0033] The drive control unit 241 drives the vibration unit 202 to vibrate using the vibration waveform data stored in the vibration waveform data storage unit 251 .

[0034] The storage unit 205 stores various types of information that the pen type input device 200 supports. The storage unit 205 includes a vibration waveform data storage unit 251. The vibration waveform data storage unit 251 stores vibration waveform data. The vibration waveform data is data that indicates a vibration waveform for generating a desired vibration state in the pen type input device 200. The hardware corresponding to the storage unit 205 may be, for example, a flash memory.

[0035] The pen-type input device 200 of the information processing system of this embodiment configured as described above can provide tactile feedback. That is, the pen-type input device 200 of this embodiment can be operated so as to vibrate in response to an operation (pen movement operation) of moving the pen tip while touching the panel surface of the touch panel display unit 102 (touch panel 122). By vibrating the pen-type input device 200 when a writing operation is performed as such a pen movement operation, it becomes possible to approximate the sensation of writing on a writing medium with an actual writing implement.

[0036] It is preferable that the usefulness of the vibration control that vibrates the pen-type input device 200 be enhanced by expanding the function of tactile feedback or by applying it to functions other than tactile feedback, for example, in consideration of the convenience of the user of the information processing device 100.

[0037] In the pen operation compatible application of this embodiment, a line (pattern line) in which line portions and non-line portions are repeated in a predetermined pattern, such as a dotted line, a dashed line, or a chain line (one-dot chain line, two-dot chain line, etc.), can be drawn using the pen type input device 200. When drawing a pattern line, the user performs a writing operation in which the pen tip of the pen type input device 200 is brought into contact with the operation target surface and moved as if drawing a line. In response to such a writing operation, a selected pattern line is drawn according to the movement locus of the pen tip of the pen type input device 200. Therefore, in the information processing system of this embodiment, when a writing operation is performed in which the pen tip is moved on the panel surface in response to drawing a pattern line, vibration control is performed so that vibrations are generated as tactile feedback in the line portions of the pattern line and no vibrations are generated in the non-line portions. By controlling vibration in this way, the tactile feedback is expanded so that the pen vibrates when lines are drawn and does not vibrate when non-lines are drawn, in response to the writing operation of moving the pen tip on the panel surface to draw a pattern line. This allows the user to receive tactile feedback that alternates between vibration and non-vibration while performing the writing operation of drawing a pattern line, allowing the user to feel that he or she is drawing a pattern line.

[0038] An example of vibration control corresponding to drawing of pattern lines in this embodiment will be described with reference to FIG. For example, the user operates a pen operation compatible application to select a certain pattern line as a drawing target. Then, the user starts a writing operation to draw the pattern line at time t1. That is, at time t1, the user touches the pen tip of the pen type input device 200 to the panel surface of the touch panel 122 to draw the pattern line. In the information processing device 100, the vibration control unit 132 sets a range from zero ("0") to a predetermined maximum value (max) as the movement distance range of the pen tip on the panel surface in response to drawing of a pattern line, and sets a certain distance in the movement distance range as a threshold value th. The maximum value (max) in the movement distance range and the threshold value th are determined according to the repeating pattern of line portions and non-line portions in the pattern line. In explaining the same figure, an example is given of a case where the pattern line is a broken line having a pattern in which line portions and non-line portions are repeated at the same length (an example of a section pattern).

[0039] After time t1, the user performs a writing operation by moving the pen tip of the pen type input device 200 on the panel surface to draw a line. After time t1, the vibration control unit 132 measures the movement distance of the pen tip based on the change in coordinates detected by the coordinate detection unit 105 in response to the movement of the pen tip on the panel surface. As shown in the figure, the vibration control unit 132 sets a threshold value th as an initial value of the movement distance at time t1 when the movement of the pen tip starts. The movement distance measured after time t1 increases with time, and reaches a maximum value max at time t2. When the movement distance reaches the maximum value max, the vibration control unit 132 resets it to zero and resumes measurement from zero. As the vibration control unit 132 measures the movement distance after time t2, the movement distance increases, reaches a threshold value th at time t3, and then reaches the maximum value max at time t4. The vibration control unit 132 resets the movement distance to zero at time t4 and resumes measurement. In this way, the vibration control unit 132 repeats measurement of the movement distance from zero to the maximum value max based on the coordinates detected by the coordinate detection unit 105 in response to the movement of the pen tip on the panel surface.

[0040] When drawing a dashed line, the application-compatible processing unit 131 draws a line portion LP when the movement distance measured by the vibration control unit 132 is equal to or greater than a threshold th, and draws a non-line portion when the movement distance is less than the threshold th. Furthermore, the vibration control unit 132 controls the pen type input device 200 to vibrate when the movement distance is equal to or greater than the threshold th, and stops the vibration of the pen type input device 200 when the movement distance is less than the threshold th. In this manner, the vibration control unit 132 controls the pen type input device 200 to switch between on and off the vibration depending on whether the movement distance is equal to or greater than the threshold th. By performing drawing and vibration control in this manner, a dashed line is drawn on the touch panel display unit 102 in response to the user's writing operation, and the pen-type input device 200 can vibrate each time a line portion is drawn.

[0041] An example of a processing procedure executed by the information processing device 100 and the pen-type input device 200 of this embodiment in relation to vibration control in drawing a pattern line will be described with reference to the flowchart of Fig. 4. As in Fig. 3, the processing procedure in this figure takes as an example a case in which the pattern line to be drawn is a dashed line with a pattern in which the line portion and the lined portion alternate at the same flow rate.

[0042] First, an example of a processing procedure executed by the information processing device 100 will be described. Step S100: In the information processing device 100, the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates. The coordinate detection unit 105 starts detecting coordinates in response to the start of contact of the pen tip of the pen type input device 200 with the panel surface of the touch panel 122.

[0043] Step S102: In response to the start of coordinate detection in step S100, the vibration control unit 132 sets a threshold value th as an initial value for the movement distance to be measured.

[0044] Step S104: Furthermore, in response to the start of coordinate detection in step S100, the vibration control unit 132 starts measuring the movement distance.

[0045] Step S106: At the current time, the moving distance is equal to or greater than the threshold value th. Therefore, the application-aware processing unit 131 starts drawing the line portion of the broken line. The application-aware processing unit 131 is caused to draw the line portion at a position corresponding to the coordinates detected by the coordinate detection unit 105 on the drawing plane.

[0046] Step S108: Furthermore, the vibration control unit 132 starts transmitting vibration control information to the pen type input device 200 so that the pen type input device 200 vibrates.

[0047] Step S110: The vibration control unit 132 judges whether or not the detection of coordinates by the coordinate detection unit 105 has been stopped. When the user moves the pen tip of the pen type input device 200 away from the panel surface of the touch panel 122 to finish the writing operation for drawing a line, the detection of coordinates by the coordinate detection unit 105 stops.

[0048] Step S112: If it is determined in step S110 that the detection of the coordinates has not been stopped, the vibration control unit 132 determines whether the currently measured moving distance is equal to or greater than the maximum value max. If the moving distance is less than the maximum value max, the process returns to step S110.

[0049] Step S114: If it is determined in step S112 that the movement distance is equal to or greater than the maximum value max, the vibration control unit 132 stops the transmission of the vibration control information started in step S108.

[0050] Step S116: Moreover, in response to the movement distance becoming equal to or greater than the maximum value max, the application-compatible processor 131 stops drawing the line portion that was started in step S106.

[0051] Step S118: Furthermore, in response to the movement distance becoming equal to or greater than the maximum value max, the vibration control unit 132 resets the movement distance measured up to that point to zero, and then restarts measurement of the movement distance.

[0052] Step S120: The vibration control unit 132 determines whether or not the detection of coordinates by the coordinate detection unit 105 has been stopped.

[0053] Step S122: The vibration control unit 132 also determines whether the currently measured moving distance is equal to or greater than the threshold th. If the moving distance is less than the threshold th, the process returns to step S120. While the processes of steps S120 and S122 are looped, the line portion of the broken line is not drawn, and a non-line portion is formed, and the vibration of the pen-type input device 200 is also stopped. On the other hand, if the movement distance is equal to or greater than the threshold value th, the process returns to step S106, whereby drawing of the line portion and transmission of vibration control information for vibrating the pen type input device 200 are started.

[0054] Step S124: If it is determined in step S110 or step S120 that the detection of coordinates has been stopped, a stop process is executed. As the stop process, the application corresponding processing unit 131 stops drawing the line portion if the line portion has been drawn, and the vibration control unit 132 ends the measurement of the movement distance and stops the transmission of the vibration control information if the vibration control information has been transmitted.

[0055] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S200: In the pen type input device 200, the drive control section 241 waits for the start of reception of the vibration control information transmitted in step S108.

[0056] Step S202: When reception of vibration control information starts, the drive control unit 241 starts driving the vibration unit 202 based on the vibration waveform data stored in the vibration waveform data storage unit 251. At this time, if the vibration control information specifies a vibration intensity, the drive control unit 241 may drive the vibration unit 202 to vibrate at the specified vibration intensity.

[0057] Step S204: After starting driving of the vibration unit 202 in step S202, the drive control unit 241 waits for the reception of vibration control information up to now to stop.

[0058] Step S206: In response to the stop of the reception of the vibration control information, the drive control unit 241 stops driving the vibration unit 202 so far.

[0059] <Second embodiment> Next, a second embodiment will be described. In this embodiment, a user performs an operation (pen movement operation) of moving the pen tip of the pen type input device 200 while touching it on the panel surface of the touch panel 122. When performing the pen tip movement operation, the coordinates detected by the coordinate detection unit 105 change (move). In this embodiment, as vibration control, when the pen movement operation is being performed and the coordinates that change in response to the movement of the pen tip pass through a boundary line of a predetermined pattern set on a coordinate plane corresponding to the panel surface, the pen type input device 200 is temporarily vibrated. The information processing device 100 and the pen-type input device 200 may have the configuration shown in FIG.

[0060] 5 shows an application example (first application example) of vibration control of this embodiment. In this embodiment, in response to the user first touching the pen tip of the pen type input device 200 to the panel surface of the touch panel 122, the vibration control unit 132 sets the coordinates of the position where the pen tip is touched on the coordinate plane as the reference coordinate p0. In addition, the vibration control unit 132 sets a grid GD. When setting the grid GD, the vibration control unit 132 makes the reference coordinate p0 correspond to one of the intersections between a horizontal grid line (boundary line) and a vertical grid line.

[0061] The user moves the pen in any direction while keeping the pen tip in contact with the panel surface from the reference coordinate p0. In Fig. 5, an example is shown in which the pen tip is moved diagonally upward to the right from the reference coordinate p0, as indicated by the dashed arrow. When the pen tip is moved as shown in Fig. 5, the pen tip is positioned on the grid lines in the order of coordinates p1, p2, and p3 on the vertical grid lines arranged in the row direction. In this embodiment, the vibration control unit 132 temporarily vibrates the pen type input device 200 every time the pen tip is positioned at coordinates p1, p2, and p3. That is, in this embodiment, a temporary pulse-like vibration (pulse vibration (an example of temporary vibration)) is generated every time the pen tip passes a grid line on the coordinate plane. By generating pulse vibrations in this manner, the user can intuitively grasp the distance traveled from the reference coordinate p0 on the coordinate plane according to the pen tip being moved by a pen movement operation.

[0062] Figure 6 shows an example of the result of vibration control when the pen tip is moved from the reference coordinate p0 in a moving direction different from that in Figure 5. In the case of Figure 6, as the pen tip is moved from the reference coordinate p0, a pulse vibration is generated each time the grid line is passed in the order of coordinates p1, p2, p3, p4, p5, and p6. In this case, because the inclination is smaller than in Fig. 5, the pen tip passes not only through coordinates p1, p3, and p5 on the horizontal grid lines, but also through coordinates p2, p4, and p6 on the vertical grid lines, allowing the user to intuitively grasp the extent of the movement distance from the reference coordinate p0 in terms of the vertical and horizontal components.

[0063] That is, in this embodiment, a reference position and a boundary line based on the reference position are set on the coordinate plane in response to the start of a pen movement operation by the pen type input device 200. Then, vibration control is performed so that a pulse vibration is generated in the pen type input device 200 at the timing when the coordinates moving from the reference position in response to the movement of the pen tip pass through the boundary line.

[0064] 7 shows another application example (second application example) of the vibration control of the present embodiment. In the second application example, the pen operation compatible application has a function of presenting a map. In this application example, the map is displayed on the touch panel display unit 102 as shown in the figure. The user performs an operation to designate an arbitrary position on the displayed map as a starting point (starting point designation operation). The starting point designation operation may be an operation to touch the pen tip of the pen type input device 200 to the position of the starting point on the map. The position of the start point on the map specified by the start point specification operation is set as the reference coordinate p0 on the coordinate plane. In addition, multiple circular boundary lines BD (BD1 to BD4) are set with a common center at the reference coordinate p0 in response to the start point designation operation. In the figure, the boundary line BD1 has a radius corresponding to the unit movement distance ud, and adjacent boundary lines BD are spaced apart at equal intervals of the unit movement distance ud. The boundary line BD may or may not be displayed on the map. Also, for example, the boundary line BD may be switched between being displayed and not displayed in response to a user's operation on a pen-operation compatible application.

[0065] The unit movement distance ud can be arbitrarily set by the user in accordance with the scale of the map by operating the pen operation compatible application. Note that the unit movement distance ud may be fixed.

[0066] The user touches the pen tip of the pen type input device 200 to the panel surface on which the map is displayed by the start point designation operation, and then moves the pen tip toward the destination. By moving the pen tip in this manner, the pen tip passes through the boundary line BD in the order of, for example, coordinate p1 on boundary line BD1, coordinate p2 on boundary line BD2, and coordinate p3 on boundary line BD3, as shown in FIG. In this application example, vibration control is performed so that a pulse vibration is generated in the pen type input device 200 every time the pen tip is positioned at coordinates on the boundary line BD. By performing vibration control in this manner, the user can easily grasp the approximate distance from the starting point to the destination based on the number of pulse vibrations generated while moving the pen tip from the starting point to the destination. In this example, the strength of the pulse vibration may be changed according to the distance from the starting point to the destination.

[0067] An example of a processing procedure executed by the information processing device 100 and the pen type input device 200 in response to the vibration control of FIG. 7 will be described with reference to a flowchart of FIG.

[0068] First, an example of a processing procedure executed by the information processing device 100 will be described. Step S300: In the information processing device 100, the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates.

[0069] Step S302: When coordinate detection is started, the vibration control unit 132 sets the coordinates that are first detected on the coordinate plane corresponding to the map as the reference coordinates p0.

[0070] Step S304: Furthermore, in response to the start of coordinate detection, the vibration control unit 132 acquires a unit movement distance ud set by the user.

[0071] Step S306: The vibration control unit 132 sets a boundary line BD on the coordinate plane corresponding to the map, using the reference coordinate p0 set in step S302 and the unit movement distance acquired in step S304.

[0072] Step S308: The vibration control unit 132 determines whether or not the detection of the coordinates started in step S300 has stopped.

[0073] Step S310: If it is determined in step S308 that the detection of the coordinates has not stopped, the vibration control unit 132 determines whether or not the currently detected coordinates have reached the boundary line BD. If it is determined that the coordinates have not reached the boundary line BD, the process returns to step S308.

[0074] Step S312: If it is determined in step S310 that the coordinates have reached the boundary line BD, the vibration control unit 132 transmits pulse vibration control information to the pen type input device 200.

[0075] Step S314: If it is determined in step S308 that the detection of the coordinates has been stopped, a stop process is executed. As the stop process, the vibration control unit 132 clears the reference coordinate p0 set in step S302 and the boundary line BD set in step S306.

[0076] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S400: In the pen type input device 200, the drive control section 241 waits for reception of the pulse vibration control information transmitted from the information processing device 100 in step S312.

[0077] Step S402: In response to receiving the pulse vibration control information, the drive control unit 241 drives the vibration unit 202 to emit a pulse vibration.

[0078] 9 shows a third application example of the second embodiment. In this application example as well, the pen operation compatible application has a function of presenting a map, and the map is displayed on the touch panel display unit 102 as shown in the figure.

[0079] The user performs a start point designation operation on the displayed map. The coordinates of the start point on the map designated by the start point designation operation are set as the reference coordinates p0. The user touches the pen tip of the pen type input device 200 to the panel surface on which the map is displayed by the start point designation operation, and then moves the pen tip along the route to the destination. The user can move the pen tip along a route that is arbitrarily determined on the map. The pen operation compatible application may show the route by displaying the trajectory of the pen tip movement.

[0080] In this application example, vibration control is performed so that a pulse vibration is emitted from the pen-type input device 200 each time the distance traveled along a route on the map in response to the movement of the pen tip passes a unit travel distance ud set in accordance with the scale of the map. By controlling vibration in this manner, the user can easily grasp the distance of the route from the starting point to the destination based on the number of pulse vibrations emitted while moving the pen tip from the starting point to the destination. When a route is displayed on a map, a mark M may be displayed at the position of a reference coordinate p0 on the displayed route and for each unit movement distance ud from the reference coordinate p0.

[0081] <Third embodiment> Next, a third embodiment will be described. In the third embodiment, the pen type input device 200 is made to vibrate continuously in response to a user's pen movement operation, and the vibration strength of the pen type input device 200 is changed according to the positional relationship of the coordinates (current coordinates) detected during the pen movement operation with respect to the reference coordinates p0.

[0082] 10 shows a first application example of the third embodiment. In this application example, a reference coordinate p0 is set in response to the start of a pen movement operation by a user. That is, the user touches the pen tip of the pen type input device 200 to the panel surface of the touch panel 122 to start a pen movement operation. In response to the touch of the pen tip to the panel surface, the vibration control unit 132 of the information processing device 100 sets the coordinates that are first detected by the coordinate detection unit 105 as the reference coordinate p0. After the user brings the pen tip of the pen type input device 200 into contact with the panel surface as described above, the user performs a pen movement operation by moving the pen tip while maintaining the state in which the pen tip is in contact with the panel surface.

[0083] The current coordinates detected by the coordinate detection unit 105 change in response to the pen movement operation. The vibration control unit 132 calculates the distance between the current coordinates and the reference coordinates p0, and changes the vibration intensity of the pen type input device 200 in response to the calculated distance. Specifically, the vibration control unit 132 may set the vibration intensity to be increased in response to an increase in the calculated distance ds. The vibration control unit 132 transmits vibration control information including the set vibration intensity to the pen type input device 200.

[0084] In response to receiving the vibration control information, the drive control unit 241 in the pen type input device 200 vibrates the vibration unit 202 with the vibration intensity included in the received vibration control information. As a result, the vibration intensity of the pen type input device 200 is changed in response to a change in the distance ds from the reference coordinate p0 when a pen movement operation is being performed. By changing the vibration intensity in this way, the user can intuitively grasp how far the pen tip of the pen type input device 200 on the panel surface is currently from the reference coordinate p0.

[0085] In addition, a dashed circle centered on the reference coordinate p0 is shown in the figure. The dashed circle in the figure is an auxiliary line indicating that the distance ds in this application example is calculated in a 360° direction centered on the reference coordinate p0, and does not need to be displayed on the touch panel display unit 102.

[0086] 11 shows a second application example of the third embodiment. In this application example as well, the coordinates detected by the coordinate detection unit 105 when the pen tip of the pen type input device 200 first touches the panel surface at the start of a pen movement operation are set as the reference coordinates p0. After this, the user can perform a pen movement operation by moving the pen tip in any direction while keeping the pen tip in contact with the panel surface. Figure 11 shows the movement locus TR of the pen tip caused by the pen movement operation, which starts from the reference coordinate p0 where the pen tip first touches the panel surface.

[0087] In this application example, when the pen tip is moved in any direction by a pen movement operation as described above, the vibration intensity of the pen-type input device 200 is changed depending on whether the direction in which the coordinates detected by the coordinate detection unit 105 move in response to the movement of the pen tip (coordinate movement direction) is approaching or moving away from the reference coordinate p0.

[0088] An example of a method for determining whether the coordinate movement direction is toward or away from the reference coordinate p0 will be described with reference to Figs. The vibration control unit 132 calculates the direction in which the current coordinate changes (the coordinate movement direction) by, for example, differentiating a plurality of current coordinates at different times detected by the coordinate detection unit 105. Such a coordinate movement direction may be obtained as a directional component of a vector.

[0089] 12, the vibration control unit 132 sets a straight line A passing through the reference coordinate p0 and the current coordinate ps, and a straight line B passing through the current coordinate ps and perpendicular to the straight line A. For example, the vibration control unit 132 sets the straight lines A and B as the y-axis and x-axis, respectively, and sets angles of 0° to 360° centered on the current coordinate ps.

[0090] 12, two examples of coordinate movement directions calculated by the vibration control unit 132 as described above are shown: a coordinate movement direction dr1 having an angle θ1 and a coordinate movement direction dr2 having an angle θ2. When the angle θ(n) formed in the unit circle is in the range of 0° to 180°, the vibration control unit 132 determines that the coordinate movement direction is a direction (away direction) away from the reference coordinate p0. That is, the vibration control unit 132 determines that both of the coordinate movement directions dr1 and dr2 shown in FIG. 12 are away directions.

[0091] 13, two examples of coordinate movement directions calculated by the vibration control unit 132 are shown: a coordinate movement direction dr11 having an angle θ11 and a coordinate movement direction dr12 having an angle θ12. When the angle θ(n) formed in the unit circle is in a range greater than 180° and less than 360°, the vibration control unit 132 determines that the coordinate movement direction is a direction approaching the reference coordinate p0 (approaching direction). Therefore, the vibration control unit 132 determines that both of the coordinate movement directions dr11 and dr12 shown in FIG. 13 are approaching directions.

[0092] The vibration control unit 132 controls the pen type input device 200 so that the manner of vibration is changed depending on whether the coordinate movement direction is a moving away direction or a moving closer direction. For example, the vibration control unit 132 may change the strength (vibration strength) of vibrating the pen type input device 200 depending on whether the coordinate movement direction is the away direction or the approach direction. Specifically, the pen type input device 200 may be controlled to vibrate with a predetermined strength when the coordinate movement direction is the away direction, and not vibrate (vibration strength zero) or vibrate with a strength smaller than that in the approach direction when the coordinate movement direction is the approach direction.

[0093] An example of a processing procedure executed by the information processing device 100 and the pen type input device 200 in accordance with the second application example of the third embodiment will be described with reference to the flowchart of FIG. First, an example of a processing procedure executed by the information processing device 100 will be described. Step S500: In the information processing device 100, the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates.

[0094] Step S502: When coordinate detection is started, the vibration control unit 132 sets the coordinates that are first detected on the coordinate plane corresponding to the map as the reference coordinates p0.

[0095] Step S504: The vibration control unit 132 determines whether the coordinate movement direction of the current coordinate that moves in response to the pen movement operation after the reference coordinate p0 is set is the separating direction or the approaching direction.

[0096] Step S506: The vibration control unit 132 determines whether or not the coordinate movement direction determined in step S504 is the separating direction.

[0097] Step S508: If it is determined in step S506 that the direction is the moving away direction, the vibration control unit 132 transmits vibration control information.

[0098] Step S510: If it is determined in step S506 that the direction is not the moving away direction but the approaching direction, the vibration control unit 132 does not transmit vibration control information. At this time, if vibration control information has been transmitted up to this point, the vibration control unit 132 stops transmitting the vibration control information up to this point in step S510.

[0099] Step S512: The vibration control unit 132 determines whether or not the detection of the coordinates started in step S300 has stopped. If it is determined that the detection of the coordinates has not stopped, the process returns to step S504.

[0100] Step S514: If it is determined in step S512 that the detection of the coordinates has been stopped, a stop process is executed. As the stop process, the vibration control unit 132 clears the reference coordinate p0 set in step S502, and if the vibration control information has been transmitted in step S508, stops the transmission of the vibration control information.

[0101] Next, an example of a process procedure executed by the pen type input device 200 will be described. Step S600: In the pen type input device 200, the drive control section 241 waits for reception of the vibration control information transmitted from the information processing device 100 in step S312. Step S602: In response to receiving the vibration control information, the drive control unit 241 drives the vibration unit 202 to cause the pen type input device 200 to vibrate.

[0102] Step S604: The drive control unit 241 waits for the reception of the vibration control information to be stopped.

[0103] Step S606: When the reception of the vibration control information is stopped, the drive control section 241 stops driving the vibration section 202. When the driving of the vibration section 202 is stopped, the vibration of the pen type input device 200 stops.

[0104] In step S510, the vibration control unit 132 may transmit vibration control information specifying zero as the vibration intensity. In this case, the drive control unit 241 of the pen type input device 200 may control the vibration unit 202 to be driven with the vibration intensity indicated by the received vibration control information. In this case, when the vibration intensity indicated by the vibration control information is zero, the drive control unit 241 may stop driving the vibration unit 202.

[0105] In addition, in this application example, the vibration strength may be changed according to the angle θ of the coordinate movement direction in a unit circle with the current coordinate ps as the origin. For example, when the coordinate movement direction is the away direction, the vibration control unit 132 may control the vibration strength of the pen type input device 200 to be greater as the angle θ approaches 90°, and when the coordinate movement direction is the approach direction, the vibration control unit 132 may control the vibration strength of the pen type input device 200 to be greater as the angle θ approaches 270°. Furthermore, the vibration control unit 132 may perform control so that the vibration strength of the pen type input device 200 changes according to the distance from the reference coordinate p0 to the current coordinate ps.

[0106] In addition, a program for realizing the functions of the above-mentioned information processing device 100, pen-type input device 200, etc. may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to perform processing as the above-mentioned information processing device 100, pen-type input device 200, etc. Here, "reading a program recorded in a recording medium into a computer system and executing it" includes installing the program into a computer system. The "computer system" here includes hardware such as an OS and peripheral devices. In addition, the "computer system" may include a plurality of computer devices (personal computers, tablet terminals, smartphones, etc., corresponding to the present embodiment, which are computer devices that support input by a pen-type input device) connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. In addition, the "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, etc., and storage devices such as an HDD and SSD built into a computer system. In this way, the recording medium storing the program may be a non-transient recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium provided inside or outside and accessible from a distribution server to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by the terminal device. In other words, the format in which the program is stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a format executable by the terminal device. Note that the program may be divided into multiple parts, each of which may be downloaded at a different time and then combined on the terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" includes a memory that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that is a server or client when a program is transmitted over a network.The program may be for implementing some of the above-mentioned functions, or may be a so-called differential file (differential program) that can implement the above-mentioned functions in combination with a program already recorded in the computer system. [Explanation of symbols]

[0107] 100 Information processing device, 101 Communication unit, 102 Touch panel display unit, 103 Control unit, 104 Memory unit, 105 Coordinate detection unit, 121 Display unit, 122 Touch panel, 131 Application processing unit, 132 Vibration control unit, 200 Pen-type input device, 201 Communication unit, 202 Vibration unit, 204 Control unit, 205 Memory unit, 241 Drive control unit, 251 Vibration waveform data storage unit

Claims

1. a coordinate detection unit that detects coordinates corresponding to a position on an operation surface where a pen-type input device is in contact; a vibration control unit that controls the vibration of the pen-type input device to be switched on and off in accordance with a section pattern that divides a movement locus of coordinates detected by the coordinate detection unit according to a predetermined distance when the pen-type input device is moving while in contact with the operation surface; An information processing system comprising:

2. The vibration control unit determines that the section pattern corresponds to a pattern of dashed lines that is drawn in response to movement of the detected coordinates. The information processing system according to claim 1 .

3. a coordinate detection unit that detects coordinates corresponding to a position on an operation surface where a pen-type input device is in contact; a vibration control unit that, when the pen-type input device is moving while in contact with the operation surface, causes the pen-type input device to perform a temporary vibration at a timing when a movement state of the detected coordinates satisfies a predetermined condition based on a detection state of the coordinates by the coordinate detection unit; An information processing system comprising:

4. The vibration control unit causes the pen-type input device to perform the temporary vibration in response to the coordinates detected by the coordinate detection unit reaching a boundary line of a predetermined pattern set for a coordinate plane corresponding to the operation target surface. The information processing system according to claim 3 .

5. The boundary line is set based on the coordinates detected by the coordinate detection unit when the touch of the pen-type input device on the operation surface is started.

5. The information processing system according to claim 4.

6. The vibration control unit causes the pen-type input device to perform the temporary vibration in response to a coordinate detected by the coordinate detection unit reaching a predetermined distance from a reference coordinate when the pen-type input device is moving in contact with the operation target surface. The information processing system according to claim 3 .

7. The vibration control unit causes the pen-type input device to perform the temporary vibration every time the pen-type input device moves a predetermined distance of coordinates detected by the coordinate detection unit, starting from a predetermined reference coordinate, while the pen-type input device is moving in contact with the operation surface. The information processing system according to claim 3 .

8. The reference coordinates are coordinates at the time when the touch of the pen-type input device on the operation surface is started.

8. The information processing system according to claim 6 or 7.

9. a coordinate detection unit that detects coordinates corresponding to a position on an operation surface where a pen-type input device is in contact; a vibration control unit that changes an intensity of vibration caused by the pen-type input device based on a state of a coordinate detected by the coordinate detection unit relative to a predetermined reference coordinate when the pen-type input device is moving in contact with the operation surface; An information processing system comprising:

10. The vibration control unit changes the intensity of the vibration caused by the pen-type input device in accordance with the distance from the reference coordinates of the coordinates detected by the coordinate detection unit when the pen-type input device is moving in contact with the operation surface. The information processing system according to claim 9.

11. The vibration control unit changes the intensity of vibration caused by the pen-type input device depending on whether a moving direction of a coordinate detected by the coordinate detection unit when the pen-type input device is moving in contact with the operation surface is a direction moving away from or toward the reference coordinate. The information processing system according to claim 9.

12. The reference coordinates are coordinates at the time when the touch of the pen-type input device on the operation surface is started.

12. An information processing system according to claim 9.

Images