Information processing system

Abstract

The invention relates to an information processing system capable of bringing usefulness to a user by using vibration of a pen-shaped input device. The information processing system includes: a coordinate detection unit that detects coordinates corresponding to a position of an operation target surface in contact with the pen-shaped input device; and a vibration control unit that controls the pen-shaped input device so as to switch the on / off of the vibration in accordance with a section pattern. The interval pattern is obtained by dividing, according to a predetermined distance, the movement trajectory of the coordinates detected by the coordinate detection unit when the pen-shaped input device is moved in contact with the surface to be operated.

Description

Technical Field

[0001] The present invention relates to information processing systems. Background Art

[0002] It is known that when inputting to an interactive display system, a pen-shaped stylus pen (pen-shaped input device) capable of providing tactile feedback by generating vibrations that drive a tactile actuator is used as an input device.

[0003] Patent document 1: Japanese Patent Application Publication No. 2017-537395.

[0004] By vibrating the pen-shaped input device, for example, the tactile sensation of sliding the pen tip on a writing medium such as paper can be simulated, so that a user who uses the pen-shaped input device to input can obtain a feeling close to that of writing with a real writing tool.

[0005] By vibrating the pen-shaped input device, in addition to allowing people to experience the tactile sensation of writing with a real writing instrument, if it can provide usefulness to the user, the convenience of the user can be improved. Summary of the invention

[0006] Therefore, an object of the present invention is to be able to bring usefulness to a user by utilizing the vibration of a pen-shaped input device.

[0007] One way of the present invention to solve the above-mentioned problems is an information processing system, comprising: a coordinate detection unit, which detects coordinates corresponding to the position of an operating object surface in contact with a pen-shaped input device; and a vibration control unit, which controls the turning on and off of the vibration performed by the above-mentioned pen-shaped input device in a manner of switching according to an interval pattern, wherein the interval pattern is obtained by dividing the movement trajectory of the coordinates detected by the above-mentioned coordinate detection unit when the above-mentioned pen-shaped input device moves in contact with the above-mentioned operating object surface according to a specified distance.

[0008] One embodiment of the present invention is an information processing system comprising: a coordinate detection unit, which detects coordinates corresponding to the position of an operating object surface in contact with a pen-shaped input device; and a vibration control unit, which, when the pen-shaped input device is moving in contact with the operating object surface based on the detection status of the coordinates by the coordinate detection unit, causes the pen-shaped input device to vibrate once when the moving state of the detected coordinates meets a prescribed condition.

[0009] One embodiment of the present invention is an information processing system comprising: a coordinate detection unit that detects coordinates corresponding to the position of an operating object surface that is in contact with a pen-shaped input device; and a vibration control unit that changes the intensity of vibration performed by the pen-shaped input device based on a state relative to a prescribed reference coordinate related to the coordinates detected by the coordinate detection unit when the pen-shaped input device moves in contact with the operating object surface.

[0010] According to the present invention, it is possible to obtain an effect of providing usefulness to a user by utilizing the vibration of a pen-shaped input device. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 This is a diagram showing an example of the external configuration of the information processing system according to the first embodiment.

[0012] Figure 2 It is a diagram showing an example of the functional configuration of the information processing apparatus and the pen-type input device corresponding to the vibration control of the first embodiment.

[0013] Figure 3 This is a diagram for explaining an example of the vibration control method according to the first embodiment.

[0014] Figure 4 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in accordance with the first embodiment in response to vibration control.

[0015] Figure 5 This is a diagram for explaining an example of vibration control according to the first application example of the second embodiment.

[0016] Figure 6 This is a diagram for explaining an example of vibration control according to the first application example of the second embodiment.

[0017] Figure 7 This is a diagram for explaining an example of vibration control according to a second application example of the second embodiment.

[0018] Figure 8 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in response to vibration control in the second application example of the second embodiment.

[0019] Fig. 9 This is a diagram for explaining an example of vibration control according to a third application example of the second embodiment.

[0020] Fig.10 This is a diagram for explaining an example of vibration control according to the first application example of the third embodiment.

[0021] Fig.11 This is a diagram for explaining an example of vibration control according to the second application example of the third embodiment.

[0022] Fig.12 This is a diagram for explaining an example of a method for determining a coordinate movement direction according to a second application example of the third embodiment.

[0023] Fig.13This is a diagram for explaining an example of a method for determining a coordinate movement direction according to a second application example of the third embodiment.

[0024] Fig.14 This is a flowchart showing an example of processing steps executed by the information processing apparatus and the pen-type input device in response to the vibration control of the second application example of the third embodiment. DETAILED DESCRIPTION

[0025] <First embodiment>

[0026] Figure 1 FIG. 1 is a diagram showing an example of the external configuration of an information processing system according to the present embodiment. As shown in the diagram, the information processing system according to the present embodiment includes an information processing apparatus 100 and a pen-type input device 200 .

[0027] The information processing apparatus 100 can perform information processing according to an input operation using the pen-shaped input device 200. The information processing apparatus 100 shown in the figure is an example of a terminal, a notebook computer, or the like.

[0028] The information processing device 100 includes a touch panel display unit 102. The touch panel display unit 102 is a combination of a touch panel and a display unit. The touch panel display unit 102 displays images on a display surface and enables operations by bringing an operating body such as a pen-shaped input device or a finger into contact with the display surface.

[0029] The pen-shaped input device 200 is a pen-shaped input device used by the user to operate the touch panel of the touch panel display unit 102 of the information processing device 100. The user holds the pen-shaped input device 200 and moves the pen tip in contact with the display surface of the touch panel display unit 102 to perform handwriting input operations such as text, pictures, and graphics.

[0030] Furthermore, as an operation using the pen-shaped input device 200 , a pointing operation on a user interface image displayed on the touch panel display portion 102 may also be possible.

[0031] The detection method of the pen-type input device 200 by the touch panel of the touch panel display unit 102 of the present embodiment is not particularly limited, and examples thereof include electrostatic capacitance method, electromagnetic induction method, etc. In the following description, the case of using the electrostatic capacitance method is taken as an example.

[0032] An application corresponding to input operation using the pen-shaped input device 200 (pen operation corresponding application) is installed in the information processing apparatus 100 .

[0033] The pen operation corresponding application may be, for example, capable of performing handwriting input operations such as text input and picture drawing performed by bringing the pen tip of the pen-shaped input device 200 into contact with the operation object surface of the touch panel display unit 102, displaying the text and pictures drawn on the touch panel display unit 102, or digitizing the drawn text and pictures through operations.

[0034] In addition, in the information processing system of this embodiment, the pen-shaped input device 200 vibrates in response to an operation corresponding to writing (writing operation). Through the vibration of the pen-shaped input device 200, the user can feel a tactile sensation close to that of writing on a writing medium such as paper, and obtain a feeling close to that of writing on a writing medium using a real writing tool.

[0035] In the following description, the vibration generated when writing is performed by the pen-shaped input device 200 is also referred to as "tactile feedback". As tactile feedback, the vibration can be controlled in a manner that changes according to the speed at which the pen-shaped input device 200 moves in contact with the operation target surface of the touch panel display unit 102, the pressure at which the pen tip of the pen-shaped input device 200 contacts the operation target surface, and the like.

[0036] Figure 2 An example of the functional configuration of the information processing apparatus 100 and the pen-type input device 200 corresponding to the vibration control of the present embodiment is shown.

[0037] First, a functional configuration example of the information processing device 100 will be described. The functions of the seat information processing device 100 shown in the figure are realized by the CPU (Central Processing Unit), GPU (Graphics Processing Unit) and the like included as hardware of the information processing device 100 executing a program.

[0038] The information processing device 100 in the figure includes a communication unit 101 , a touch panel display unit 102 , a control unit 103 , a storage unit 104 , and a coordinate detection unit 105 .

[0039] The communication unit 101 performs wireless communication with the pen-shaped input device 200. The wireless communication method supported by the communication unit 101 is not particularly limited, but Bluetooth (registered trademark) can be cited as an example. In addition, the communication unit 101 can also be capable of communicating with the pen-shaped input device 200 based on wires.

[0040] The hardware corresponding to the communication unit 101 may be configured to include a communication module corresponding to the communication method installed in the information processing device 100 .

[0041] The touch panel display portion 102 is a device in which a display portion 121 and a touch panel 122 (an example of a sensor portion) are combined.

[0042] The display unit 121 displays an image under the control of the control unit 103 .

[0043] The touch panel 122 is provided corresponding to the display surface of the display unit 121, detects the position of the pen tip of the pen-shaped input device 200, and outputs operation position information indicating the detected position. Specifically, the electrostatic capacitance touch panel 122 can detect the position of the pen tip on the panel surface by detecting the electrostatic capacitance generated by the contact of the pen tip of the pen-shaped input device 200 with the panel surface (an example of the operation target surface) using electrodes.

[0044] The coordinate detection unit 105 detects coordinates corresponding to the operation position information output from the touch panel 122. That is, the coordinate detection unit 105 converts the position of the panel surface indicated by the operation position information output from the touch panel 122 into coordinates. In this case, the coordinates detected by the coordinate detection unit 105 may be, for example, two-dimensional coordinates corresponding to a drawing area displayed on the touch panel display unit 102 by a pen operation corresponding application.

[0045] In addition, the coordinate detection unit 105 may be provided in the touch panel display unit 102 or in the control unit 103 .

[0046] The control unit 103 performs various controls on the information processing device 100. The control unit 103 includes an application-compatible processing unit 131 that performs a process corresponding to the pen operation-compatible application, and a vibration control unit 132.

[0047] When the pen tip of pen-shaped input device 200 touches the panel surface of touch panel 122 as an operation for a pen operation-compatible application, pen operation information is input from touch panel 122 to application-compatible processing unit 131. Application-compatible processing unit 131 performs processing such as drawing based on the input pen operation information.

[0048] The vibration control unit 132 performs control (vibration control) to vibrate the pen-shaped input device 200. The vibration control unit 132 sends vibration control information instructing the pen-shaped input device 200 to vibrate to the pen-shaped input device 200. The vibration control information may include, for example, vibration intensity as a parameter. The pen-shaped input device 200 operates in a manner of vibrating according to the vibration intensity included in the vibration control information in response to reception of the vibration control information.

[0049] The control unit 103 can be configured as a computer including a CPU, a GPU, a RAM, a ROM, and the like as hardware.

[0050] The storage unit 104 stores various information corresponding to the information processing device 100 .

[0051] The hardware corresponding to the storage unit 104 may be, for example, a HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like.

[0052] Next, a functional configuration example of the pen-type input device 200 will be described. The functions of the pen-type input device 200 shown in the figure can be realized by, for example, causing a microprocessor such as an MCU (Micro Controller Unit) included in the pen-type input device 200 as hardware to execute a program.

[0053] The pen-type input device 200 in the figure includes a communication unit 201 , a vibration unit 202 , a control unit 204 , and a storage unit 205 .

[0054] The communication unit 201 is connected to the communication unit 101 of the information processing device 100 so as to be communicable. The communication unit 201 may be configured to include hardware corresponding to the communication method installed. The hardware corresponding to the communication unit 201 may be configured to include a communication module corresponding to the communication method installed in the pen-shaped input device 200.

[0055] The vibration unit 202 (actuator) is a part that vibrates so as to provide a tactile sensation during, for example, writing operation to a user who moves the pen tip of the pen-shaped input device 200 on the panel surface of the touch panel 122 . The vibration of the vibration unit 202 is controlled by the drive control unit 241 .

[0056] The control unit 204 performs various controls in the pen-type input device 200. The control unit 204 includes a drive control unit 241.

[0057] The drive control unit 241 drives the vibration unit 202 to vibrate using the vibration waveform data stored in the vibration waveform data storage unit 251 .

[0058] The storage unit 205 stores various information corresponding to the pen-type input device 200. The storage unit 205 includes a vibration waveform data storage unit 251. The vibration waveform data storage unit 251 stores vibration waveform data. The vibration waveform data is data indicating a vibration waveform for causing the pen-type input device 200 to generate a desired vibration state.

[0059] The hardware corresponding to the storage unit 205 may be, for example, a flash memory or the like.

[0060] The pen-shaped input device 200 of the information processing system of the present embodiment based on the above-mentioned structure can provide tactile feedback. That is, the pen-shaped input device 200 of the present embodiment can operate in a manner of vibrating in response to an operation (pen movement operation) of moving the pen tip in contact with the panel surface of the touch panel display unit 102 (touch panel 122). When a writing operation is performed as such a pen movement operation, the pen-shaped input device 200 vibrates, thereby being able to approximate the feeling of writing on a writing medium with a real writing tool.

[0061] For example, considering the convenience of the user who uses the information processing apparatus 100, it is preferable that the vibration control for vibrating the pen-shaped input device 200 is extended to include the tactile feedback function or is applied to functions other than the tactile feedback to improve usefulness.

[0062] In the pen operation corresponding application of this embodiment, a line (pattern line) in which a line portion and a non-line portion are repeated in a predetermined pattern, such as a dotted line, a dashed line, or a dotted line (single-dot-dash line, double-dot-dash line, etc.) can be drawn using the pen-shaped input device 200. When drawing a pattern line, the user performs a writing operation of drawing a line while the pen tip of the pen-shaped input device 200 is in contact with the operation object surface and then moves. By performing the writing operation in this way, the selected pattern line is drawn according to the movement trajectory of the pen tip of the pen-shaped input device 200.

[0063] Therefore, in the information processing system of this embodiment, when a writing operation is performed by moving the pen tip on the panel surface corresponding to drawing a pattern line, vibration control is performed in a manner that generates vibration as tactile feedback in the line portion of the pattern line and does not generate vibration in the non-line portion.

[0064] By performing vibration control in this way, the tactile feedback is extended in a manner that the pen tip vibrates when drawing a line portion and does not vibrate when drawing a non-line portion, corresponding to the writing operation of moving the pen tip on the panel surface to draw a pattern line. As a result, the user receives the tactile feedback designed to switch between vibration and non-vibration when performing the writing operation of drawing a pattern line, and can actually feel that the pattern line is being drawn.

[0065] Reference Figure 3 , an example of vibration control corresponding to the drawing of pattern lines in this embodiment is described.

[0066] For example, the user operates the pen to operate the corresponding application to select a certain pattern line as the drawing object. On this basis, the user starts the writing operation for drawing the pattern line from time t1. That is, the user makes the pen tip of the pen-shaped input device 200 contact the panel surface of the touch panel 122 at time t1 to draw the pattern line.

[0067] In the information processing device 100, the vibration control unit 132 sets a range from zero ("0") to a predetermined maximum value (max) as a moving distance range of the pen tip in the panel surface corresponding to the drawing of the pattern line, and sets a certain distance in the moving distance range as a threshold value th. The maximum value (max) and the threshold value th in the moving distance range are determined according to the repeated pattern of the line part and the non-line part in the pattern line. In the description of this figure, the case where the pattern line is a dotted line and has a pattern in which the line part and the non-line part are repeated with the same length (an example of an interval pattern) is taken as an example.

[0068] After time t1, the user moves the pen tip of the pen-shaped input device 200 on the panel surface to perform a writing operation in order to draw a line. After time t1, the vibration control unit 132 measures the moving distance of the pen tip based on the change in coordinates detected by the coordinate detection unit 105 according to the movement of the pen tip on the panel surface. As shown in the figure, the vibration control unit 132 sets the threshold value th as the initial value of the moving distance at time t1 when the movement of the pen tip is started.

[0069] The moving distance measured after time t1 increases as time passes and reaches a maximum value max at time t2. If the moving distance reaches the maximum value max, the vibration control unit 132 starts measuring again from zero after resetting to zero. After time t2, the moving distance increases according to the moving distance measured by the vibration control unit 132, reaches a threshold value th at time t3, and reaches a maximum value max at time t4. The vibration control unit 132 starts measuring again after resetting the moving distance to zero at time t4. In this way, the vibration control unit 132 repeatedly measures the moving distance from zero to the maximum value max based on the coordinates detected by the coordinate detection unit 105 according to the movement of the pen tip on the panel surface.

[0070] When drawing a dotted line, the application processing unit 131 draws a line portion LP when the movement distance measured by the vibration control unit 132 is equal to or greater than the threshold value th, and draws a non-line portion when it is less than the threshold value th.

[0071] In addition, the vibration control unit 132 controls the pen-shaped input device 200 to vibrate when the moving distance is greater than the threshold value th, and stops the vibration of the pen-shaped input device 200 when the moving distance is less than the threshold value th. In this way, the vibration control unit 132 controls the pen-shaped input device 200 to switch on and off the vibration according to whether the moving distance is greater than the threshold value th.

[0072] By performing drawing and vibration control in this way, a dotted line can be drawn on the touch panel display portion 102 according to the writing operation of the user, and the pen-type input device 200 can vibrate every time a line portion is drawn.

[0073] Reference Figure 4 The flowchart of FIG. 1 is used to explain an example of the processing steps performed by the information processing apparatus 100 and the pen-shaped input device 200 of the present embodiment for the vibration control in the drawing of the pattern line. The processing steps of the figure are as follows: Figure 3 Likewise, an example is given of a dotted line pattern in which linear portions and non-linear portions alternate with the same length.

[0074] First, an example of a process procedure executed by the information processing device 100 will be described.

[0075] Step S100 : In the information processing apparatus 100 , the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates. The coordinate detection unit 105 starts detecting coordinates when the pen tip of the pen-shaped input device 200 starts contacting the panel surface of the touch panel 122 .

[0076] Step S102 : The vibration control unit 132 sets a threshold value th as an initial value for the moving distance to be measured, in response to the start of coordinate detection in step S100 .

[0077] Step S104 : Furthermore, the vibration control unit 132 starts measuring the moving distance in response to the start of coordinate detection in step S100 .

[0078] Step S106: At the current moment, the moving distance is greater than the threshold value th. Therefore, the application corresponding processing unit 131 starts drawing the line portion in the dotted line. The application corresponding processing unit 131 draws the line portion at a position corresponding to the coordinates detected by the coordinate detection unit 105 in the drawing plane.

[0079] Step S108: In addition, the vibration control section 132 starts sending vibration control information to the pen-type input device 200 so that the pen-type input device 200 vibrates.

[0080] Step S110: The vibration control unit 132 determines whether the coordinate detection by the coordinate detection unit 105 has stopped. The coordinate detection by the coordinate detection unit 105 stops when the user separates the pen tip of the pen-shaped input device 200 from the panel surface of the touch panel 122 to end the writing operation for drawing a line.

[0081] Step S112: When it is determined in step S110 that the detection of coordinates has not stopped, the vibration control unit 132 determines whether the currently measured movement distance is greater than the maximum value max. When the movement distance is less than the maximum value max, the process returns to step S110.

[0082] Step S114 : When it is determined in step S112 that the moving distance is equal to or greater than the maximum value max, the vibration control unit 132 stops the transmission of the vibration control information started from step S108 .

[0083] Step S116 : Furthermore, the application-compatible processing unit 131 stops drawing the line portion started from step S106 when the moving distance is equal to or greater than the maximum value max.

[0084] Step S118 : Furthermore, the vibration control unit 132 restarts the measurement of the moving distance after resetting the moving distance measured so far to zero, based on the moving distance being equal to or greater than the maximum value max.

[0085] Step S120 : The vibration control unit 132 determines whether the coordinate detection unit 105 has stopped detecting the coordinates up to that point.

[0086] Step S122: In addition, the vibration control unit 132 determines whether the currently measured moving distance is greater than the threshold value th. If the moving distance is less than the threshold value th, the process returns to step S120. During the process of looping steps S120 and S122, the line part of the dotted line is not drawn, and the non-line part is formed, and the vibration of the pen-shaped input device 200 is stopped.

[0087] On the other hand, when the movement distance is equal to or greater than the threshold value th, the process returns to step S106 , and drawing of the line portion and transmission of vibration control information for vibrating the pen-shaped input device 200 are started.

[0088] Step S124: When it is determined in step S110 or step S120 that the detection of the coordinates has stopped, a stop process is executed. As the stop process, the application corresponding processing unit 131 stops drawing the line portion when drawing the line portion, and the vibration control unit 132 ends the measurement of the moving distance and stops the transmission of the vibration control information when sending the vibration control information.

[0089] Next, an example of a processing procedure executed by the pen-shaped input device 200 will be described.

[0090] Step S200: In the pen-type input device 200, the drive control section 241 waits for the start of reception of the vibration control information transmitted in step S108.

[0091] Step S202: When the reception of the vibration control information starts, the drive control unit 241 starts driving the vibration unit 202 according to the vibration waveform data stored in the vibration waveform data storage unit 251. At this time, when the vibration intensity is specified according to the vibration control information, the drive control unit 241 can drive the vibration unit 202 in a manner that the vibration unit 202 vibrates according to the specified vibration intensity.

[0092] Step S204: After the driving of the vibration unit 202 is started in step S202, the driving control unit 241 waits until the reception of the vibration control information so far stops.

[0093] Step S206 : The drive control unit 241 stops the driving of the vibration unit 202 in response to the cessation of reception of the vibration control information.

[0094] <Second embodiment>

[0095] Next, the second embodiment is described. In this embodiment, the user performs an operation (pen movement operation) of moving the pen tip of the pen-shaped input device 200 in contact with the panel surface of the touch panel 122. During the pen tip movement operation, the coordinates detected by the coordinate detection unit 105 change (move). In this embodiment, as vibration control, when the coordinates that change corresponding to the movement of the pen tip pass through a boundary line of a prescribed pattern set on a coordinate plane corresponding to the panel surface during the pen movement operation, the pen-shaped input device 200 is temporarily vibrated.

[0096] The structures of the information processing apparatus 100 and the pen-shaped input device 200 may be Figure 2 .

[0097] Figure 5 1 (first application example) of the vibration control of the present embodiment is shown. In the present embodiment, the vibration control unit 132 sets the coordinates of the position where the pen tip of the pen-shaped input device 200 contacts the panel surface of the touch panel 122 for the first time as the reference coordinate p0 in the coordinate plane. In addition, the vibration control unit 132 sets the grid GD. When setting the grid GD, the vibration control unit 132 makes the reference coordinate p0 correspond to one of the intersections of the horizontal grid line (dividing line) and the plumb grid line.

[0098] The user moves the pen in an arbitrary direction from the reference coordinate p0 with the pen tip in contact with the panel surface. Figure 5 , as indicated by a dotted arrow, an example is shown in which the pen tip is moved from the reference coordinate p0 to the upper right direction.

[0099] At the tip of the pen Figure 5When the pen tip moves in this way, the pen tip is located on the grid line in the order of coordinates p1, p2, and p3 on the grid line in the plumb direction arranged along the row direction. In the present embodiment, each time the pen tip is located at the coordinates p1, p2, and p3, the vibration control unit 132 temporarily vibrates the pen-shaped input device 200. That is, in the present embodiment, each time the pen tip passes through a grid line on the coordinate plane, a temporary pulse-like vibration (pulse vibration (an example of temporary vibration)) occurs.

[0100] By generating pulse vibrations in this way, the user can sense how far the pen tip moved by the pen movement operation has moved from the reference coordinate p0 in the coordinate plane.

[0101] Figure 6 Shows the tip of the pen being Figure 5 Example of the result of vibration control when moving from the reference coordinate p0 in different moving directions. Figure 6 In the case of , as the pen tip moves from the reference coordinate p0, pulse vibration occurs each time it passes through a grid line in the order of coordinates p1, p2, p3, p4, p5, and p6.

[0102] In this case, the slope ratio Figure 5 The pen tip passes not only the coordinates p1, p3, and p5 of the grid lines arranged in the horizontal direction, but also the coordinates p2, p4, and p6 of the grid lines arranged in the plumb direction. Therefore, the user can intuitively understand the extent of the movement distance from the reference coordinate p0 in terms of the directional components in the plumb direction and the horizontal direction.

[0103] That is, in this embodiment, a reference position and a boundary line based on the reference position are set on the coordinate plane according to the start of the pen movement operation based on the pen-shaped input device 200. On this basis, vibration control is performed in a manner that pulse vibration occurs in the pen-shaped input device 200 when the coordinates moved from the reference position according to the movement of the pen tip pass through the boundary line.

[0104] Figure 7 Another example (second application example) of the application example of the vibration control of this embodiment is shown. In the second application example, the pen operation corresponding application has a function of presenting a map. In this application example, a map is displayed on the touch panel display unit 102 as shown in the figure.

[0105] The user performs an operation of specifying an arbitrary position on the displayed map as a starting point (a starting point specifying operation). The starting point specifying operation may be an operation of bringing the pen tip of the pen-shaped input device 200 into contact with the position of the starting point on the map.

[0106] The position of the start point on the map designated by the start point designation operation is set as the reference coordinate p0 in each coordinate plane.

[0107] In addition, a plurality of circular boundary lines BD (BD1 to BD4) having the reference coordinate p0 as a common center are set according to the start point designation operation. In the figure, the boundary line BD1 has a radius corresponding to the unit movement distance ud, and adjacent boundary lines BD are equally spaced according to the unit movement distance ud.

[0108] The boundary line BD may be displayed on the map or not. In addition, for example, the display and non-display of the boundary line BD may be switched according to the operation of the pen operation corresponding application by the user.

[0109] The unit movement distance ud can be arbitrarily set by the user in accordance with the scale of the map by operating the pen operation corresponding application. In addition, the unit movement distance ud can also be fixed.

[0110] The user moves the pen tip of the pen-shaped input device 200 toward the destination from the state where the pen tip is in contact with the panel surface on which the map is displayed by the start point designation operation. By moving the pen tip in this way, the pen tip moves as shown in FIG. Figure 7 As shown, for example, the coordinate p1 on the boundary line BD1, the coordinate p2 on the boundary line BD2, and the coordinate p3 on the boundary line BD3 pass through the boundary line BD in this order.

[0111] In this application example, vibration control is performed in such a manner that pulse vibration occurs in the pen-shaped input device 200 whenever the pen tip is located at a coordinate on the boundary line BD. By performing vibration control in this way, the user can easily grasp the approximate distance from the starting point to the destination based on the number of pulse vibrations that occur while the pen tip is moved from the starting point to the destination.

[0112] Furthermore, in this application example, the intensity of the pulse vibration may be changed according to the distance from the starting point to the destination.

[0113] Reference Figure 8 The flowchart of the information processing apparatus 100 and the pen-shaped input device 200 and Figure 7 An example of processing steps performed corresponding to vibration control is described.

[0114] First, an example of a process procedure executed by the information processing device 100 will be described.

[0115] Step S300 : In the information processing device 100 , the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates.

[0116] Step S302 : When the coordinate detection starts, the vibration control unit 132 sets the coordinates detected for the first time in the coordinate plane corresponding to the map as the reference coordinates p0 .

[0117] Step S304 : In addition, the vibration control unit 132 acquires the unit movement distance ud set by the user in response to the start of coordinate detection.

[0118] Step S306 : The vibration control unit 132 sets a boundary line BD in the coordinate plane corresponding to the map using the reference coordinate p0 set in step S302 and the unit movement distance acquired in step S304 .

[0119] Step S308 : The vibration control unit 132 determines whether the detection of the coordinates started in step S300 has stopped.

[0120] Step S310: When it is determined in step S308 that the detection of the coordinates has not stopped, the vibration control unit 132 determines whether the currently detected coordinates have reached the boundary line BD. When it is determined that the coordinates have not reached the boundary line BD, the process returns to step S308.

[0121] Step S312 : When it is determined in step S310 that the coordinates have reached the boundary line BD, the vibration control unit 132 transmits pulse vibration control information to the pen-type input device 200 .

[0122] Step S314: If it is determined in step S308 that the detection of the coordinates has stopped, a stop process is executed. As the stop process, the vibration control unit 132 clears the reference coordinate p0 set in step S302 and the boundary line BD set in step S306.

[0123] Next, an example of a processing procedure executed by the pen-shaped input device 200 will be described.

[0124] Step S400 : In the pen-type input device 200 , the drive control section 241 waits for reception of the pulse vibration control information transmitted from the information processing apparatus 100 in step S312 .

[0125] Step S402 : the drive control unit 241 drives the vibration unit 202 to generate pulse vibration according to the received pulse vibration control information.

[0126] Fig. 9 The third application example of the second embodiment is shown. In this application example, the pen operation-supporting application also has a function of presenting a map, and a map is displayed on the touch panel display unit 102 as shown in the figure.

[0127] The user performs a start point designation operation on the displayed map. The coordinates of the start point on the map designated by the start point designation operation are set as reference coordinates p0.

[0128] The user moves the pen tip of the pen-shaped input device 200 along a path to the destination from a state where the pen tip is in contact with the panel surface on which the map is displayed by the start point designation operation. The user can move the pen tip along a path arbitrarily determined on the map. The pen operation corresponding application can represent the path by displaying the trajectory of the pen tip movement.

[0129] In this application example, vibration control is performed in such a manner that pulse vibration occurs in the pen-shaped input device 200 every time the movement distance along the path on the map corresponding to the movement of the pen tip exceeds a unit movement distance ud set corresponding to the scale of the map.

[0130] By performing vibration control in this way, the user can easily grasp the distance of the path from the starting point based on the number of pulse vibrations generated while the pen tip is moved from the starting point to the destination.

[0131] Furthermore, when a route is displayed on a map, the position of the reference coordinate p0 in the displayed route may be displayed, and a mark M may be displayed for each unit movement distance ud from the reference coordinate p0.

[0132] <Third embodiment>

[0133] Next, the third embodiment is described. In the third embodiment, the pen-shaped input device 200 continuously vibrates in response to the user's pen movement operation, and the vibration intensity of the pen-shaped input device 200 is changed according to the positional relationship of the coordinates (current coordinates) detected during the pen movement operation relative to the reference coordinate p0.

[0134] Fig.10 The first application example of the third embodiment is shown. In this application example, the reference coordinate p0 is set corresponding to the start of the pen movement operation by the user. That is, the user makes the pen tip of the pen-shaped input device 200 contact the panel surface of the touch panel 122 in order to start the pen movement operation. The vibration control unit 132 of the information processing device 100 sets the coordinates detected by the coordinate detection unit 105 for the first time as the reference coordinate p0 according to the contact between the pen tip and the panel surface.

[0135] After the user brings the pen tip of the pen-shaped input device 200 into contact with the panel surface as described above, the user performs a pen movement operation in a manner of moving the pen tip while maintaining the state in which the pen tip is in contact with the panel surface.

[0136] The current coordinate detected by the coordinate detection unit 105 changes according to the pen movement operation. The vibration control unit 132 calculates the distance between the current coordinate and the reference coordinate p0, and changes the vibration intensity of the pen-shaped input device 200 according to the calculated distance. Specifically, the vibration control unit 132 can be set so that the vibration intensity also increases according to the increase in the calculated distance ds. The vibration control unit 132 can send vibration control information including the set vibration intensity to the pen-shaped input device 200.

[0137] The drive control unit 241 of the pen-shaped input device 200 vibrates the vibration unit 202 according to the vibration intensity included in the received vibration control information in response to the reception of the vibration control information. As a result, the pen-shaped input device 200 is designed so that the vibration intensity changes according to the change in the distance ds from the reference coordinate p0 when the pen is moved. By changing the vibration intensity in this way, the user can sense how far the pen tip of the pen-shaped input device 200 on the current panel surface is from the reference coordinate p0.

[0138] The figure shows a dotted circle centered on the reference coordinate p0 . The dotted circle in the figure is an auxiliary line indicating that the distance ds of this application example is a distance calculated in the 360° direction centered on the reference coordinate p0 , and may not be displayed on the touch panel display unit 102 .

[0139] Fig.11 The second application example of the third embodiment is shown. In this application example, the coordinates detected by the coordinate detection unit 105 when the pen tip of the pen-shaped input device 200 first contacts the panel surface at the start of the pen movement operation are set as the reference coordinates p0.

[0140] Then, the user can perform a pen movement operation by moving the pen tip in an arbitrary direction while maintaining the pen tip in contact with the panel surface. Fig.11 , a movement trajectory TR of the pen tip related to the pen movement operation performed with the reference coordinate p0 where the pen tip first comes into contact with the panel surface as a starting point is shown.

[0141] In this application example, when the pen tip is moved in an arbitrary direction through the pen movement operation as described above, the vibration intensity of the pen-shaped input device 200 is changed according to whether the direction of the coordinate movement (coordinate movement direction) detected by the coordinate detection unit 105 based on the movement of the pen tip is close to or away from the reference coordinate p0.

[0142] Reference Fig.12 , Fig.13 , an example of a method for determining whether the coordinate movement direction is approaching or moving away from the reference coordinate p0 is described.

[0143] The vibration control unit 132 calculates the direction of change of the current coordinates (coordinate movement direction) by, for example, differentiating a plurality of current coordinates at different times detected by the coordinate detection unit 105. Such a coordinate movement direction can be obtained as a direction component in a vector.

[0144] like Fig.12 As shown, the vibration control unit 132 sets a straight line A passing through the reference coordinate p0 and the current coordinate ps and a straight line B passing through the current coordinate ps orthogonal to the straight line A. The vibration control unit 132 sets an angle of 0° to 360° centered on the current coordinate ps, for example, using the straight lines A and B as the y-axis and the x-axis, respectively.

[0145] exist Fig.12 , two examples of coordinate movement directions calculated by the vibration control unit 132 as described above are shown, namely, a coordinate movement direction dr1 having an angle θ1 and a coordinate movement direction dr2 having an angle θ2. When the angle θ(n) formed in the unit circle is in the range of 0° to 180°, the vibration control unit 132 determines that the coordinate movement direction is a direction separating from the reference coordinate p0 (separation direction). That is, the vibration control unit 132 determines that Fig.12 The coordinate movement directions dr1 and dr2 shown are both determined as separation directions.

[0146] In addition, Fig.13 , two examples of coordinate movement directions calculated by the vibration control unit 132 are shown, namely, a coordinate movement direction dr11 having an angle θ11 and a coordinate movement direction dr12 having an angle θ12. When the angle θ(n) formed in the unit circle is greater than 180° and less than 360°, the vibration control unit 132 determines that the coordinate movement direction is a direction approaching the reference coordinate p0 (approaching direction). Therefore, the vibration control unit 132 Fig.13 The coordinate movement directions dr11 and dr12 shown are both determined as approach directions.

[0147] The vibration control unit 132 performs control so as to change the vibration of the pen-type input device 200 depending on whether the coordinate movement direction is the separating direction or the approaching direction.

[0148] For example, the vibration control unit 132 can change the intensity (vibration intensity) of vibrating the pen-shaped input device 200 according to whether the coordinate movement direction is the separation direction or the approaching direction. Specifically, the pen-shaped input device 200 can be controlled so that it vibrates with a predetermined intensity when the coordinate movement direction is the separation direction, and does not vibrate (vibration intensity zero) or vibrates with a smaller intensity than in the approaching direction when the coordinate movement direction is the approaching direction.

[0149] Reference Fig.14 The flowchart of FIG. 1 is used to describe an example of processing steps executed by the information processing apparatus 100 and the pen-type input device 200 in accordance with the second application example of the third embodiment.

[0150] First, an example of a process procedure executed by the information processing device 100 will be described.

[0151] Step S500 : In the information processing device 100 , the vibration control unit 132 waits for the coordinate detection unit 105 to start detecting coordinates.

[0152] Step S502 : When the coordinate detection starts, the vibration control unit 132 sets the coordinates detected for the first time in the coordinate plane corresponding to the map as the reference coordinates p0 .

[0153] Step S504 : The vibration control unit 132 determines whether the coordinate movement direction of the current coordinates moved in accordance with the pen movement operation after the reference coordinate p0 is set is the separation direction or the approaching direction.

[0154] Step S506 : The vibration control unit 132 determines whether the coordinate movement direction determined in step S504 is a separation direction.

[0155] Step S508: When it is determined in step S506 that the direction is the separation direction, the vibration control unit 132 sends vibration control information.

[0156] Step S510: When it is determined in step S506 that the direction is not the separation direction but the approaching direction, the vibration control unit 132 does not send the vibration control information. At this time, when the vibration control information is sent so far, the vibration control unit 132 stops the sending of the vibration control information so far in this step S510.

[0157] Step S512: The vibration control unit 132 determines whether the detection of the coordinates started in step S300 has stopped. If it is determined that the detection of the coordinates has not stopped, the process returns to step S504.

[0158] Step S514: If it is determined in step S512 that the detection of the coordinates has stopped, a stop process is executed. As a stop process, the vibration control unit 132 clears the reference coordinate p0 set in step S502, and stops sending the vibration control information when the vibration control information has been sent in step S508.

[0159] Next, an example of a processing procedure executed by the pen-shaped input device 200 will be described.

[0160] Step S600 : In the pen-type input device 200 , the drive control section 241 waits for reception of the vibration control information transmitted from the information processing apparatus 100 in step S312 .

[0161] Step S602 : the drive control unit 241 drives the vibration unit 202 according to the received vibration control information, so that the pen-type input device 200 vibrates.

[0162] Step S604: The drive control unit 241 waits until the reception of the vibration control information so far stops.

[0163] Step S606: When the reception of the vibration control information stops, the drive control unit 241 stops the driving of the vibration unit 202. When the driving of the vibration unit 202 stops, the vibration of the pen-shaped input device 200 stops.

[0164] In addition, in step S510, the vibration control section 132 may send vibration control information that specifies the vibration intensity as zero. In this case, the drive control section 241 of the pen-shaped input device 200 may be controlled in a manner to drive the vibration section 202 according to the vibration intensity indicated by the received vibration control information. In this case, when the vibration intensity indicated by the vibration control information is zero, the drive control section 241 may stop driving the vibration section 202.

[0165] On this basis, in this application example, for example, the vibration intensity can be changed according to the angle θ of the coordinate movement direction in the unit circle with the current coordinate ps as the origin. For example, the vibration control unit 132 controls the vibration intensity of the pen-shaped input device 200 to be greater as the angle θ approaches 90° when the coordinate movement direction is the separation direction, and controls the vibration intensity of the pen-shaped input device 200 to be greater as the angle θ approaches 270° when the coordinate movement direction is the approaching direction.

[0166] Also, the vibration control section 132 may control in such a manner that the vibration intensity of the pen-shaped input device 200 varies according to the distance from the reference coordinate p0 to the current coordinate ps.

[0167] In addition, the program for realizing the functions of the above-mentioned information processing device 100, pen-shaped input device 200, etc. can be recorded in a computer-readable recording medium, and the processing of the above-mentioned information processing device 100, pen-shaped input device 200, etc. can be performed by making the computer system read the program recorded in the recording medium and execute it. Here, "making the computer system read the program recorded in the recording medium and execute it" includes installing a program in the computer system. The "computer system" mentioned here includes hardware such as OS and peripheral devices. In addition, the "computer system" may include multiple computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and a dedicated line (in the correspondence with this embodiment, it is a personal computer, a tablet terminal, a smart phone, etc., which is a computer device that responds to input with a pen-shaped input device). In addition, the "computer-readable recording medium" refers to a removable medium such as a floppy disk, a magneto-optical disk, a ROM, a CD-ROM, and a storage device such as a HDD and SSD built into the computer system. In this way, the recording medium storing the program may be a non-temporary recording medium such as a CD-ROM. In addition, the recording medium also includes a recording medium set inside or outside that can be accessed from a distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in the form that can be executed on the terminal device. That is, as long as it can be downloaded from the distribution server and installed in the form that can be executed on the terminal device, the form stored on the distribution server is arbitrary. In addition, the mechanism that divides the program into multiple parts and combines them in the terminal device after downloading them at different times, and the distribution server that distributes each of the divided programs may be different. And "computer-readable recording medium" also includes a medium that keeps the program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or client when the program is sent via a network. In addition, the above program can be used to implement part of the above functions. And it can also be a so-called differential file (differential program) that can be realized by combining with a program that has already recorded the above functions in the computer system.

[0168] Description of Reference Numerals

[0169] 100…information processing device; 101…communication unit; 102…touch panel display unit; 103…control unit; 104…storage unit; 105…coordinate detection unit; 121…display unit; 122…touch panel; 131…application corresponding processing unit; 132…vibration control unit; 200…pen-shaped input device; 201…communication unit; 202…vibration unit; 204…control unit; 205…storage unit; 241…drive control unit; 251…vibration waveform data storage unit.

Claims

1. An information processing system, characterized in that: have: a coordinate detection unit for detecting coordinates corresponding to a position of a surface of an operation object in contact with the pen-shaped input device; The vibration control unit controls the on and off switching of the vibration performed by the pen-shaped input device in accordance with an interval pattern, wherein the interval pattern is obtained by dividing the movement trajectory of the coordinates detected by the coordinate detection unit when the pen-shaped input device moves in contact with the operation object surface according to a specified distance.

2. The information processing system according to claim 1, characterized in that Regarding the vibration control unit, the interval pattern corresponds to a pattern of dotted lines drawn according to the movement of the detected coordinates.

3. An information processing system, characterized in that: have: a coordinate detection unit that detects coordinates corresponding to a position of an operation object surface in contact with the pen-shaped input device; and The vibration control unit vibrates the pen-shaped input device once when the movement state of the detected coordinates satisfies a predetermined condition, when the pen-shaped input device is moving in contact with the operation object based on the detection status of the coordinates by the coordinate detection unit.

4. The information processing system according to claim 3, characterized in that: The vibration control unit causes the pen-type input device to vibrate once in response to the coordinates detected by the coordinate detection unit reaching a boundary line of a predetermined pattern set for a coordinate plane corresponding to the operation target plane.

5. The information processing system according to claim 4, characterized in that: The boundary line is set based on coordinates detected by the coordinate detection unit when the pen-type input device starts contacting the operation target surface.

6. The information processing system according to claim 3, characterized in that: The vibration control section causes the pen-type input device to vibrate once in response to the coordinates detected by the coordinate detection section reaching a predetermined distance from a reference coordinate when the pen-type input device moves in surface contact with the operation target.

7. The information processing system according to claim 3, characterized in that: When the pen-shaped input device moves in contact with the operation target surface, the vibration control unit causes the pen-shaped input device to vibrate once every time the coordinates detected by the coordinate detection unit move a predetermined distance starting from predetermined reference coordinates.

8. The information processing system according to claim 6 or 7, characterized in that: The reference coordinates are coordinates when the pen-shaped input device starts to contact the operation target surface.

9. An information processing system, characterized in that: have: a coordinate detection unit that detects coordinates corresponding to a position of an operation object surface in contact with the pen-shaped input device; and The vibration control unit changes the intensity of the vibration of the pen-shaped input device based on the state of the coordinates detected by the coordinate detection unit relative to a predetermined reference coordinate when the pen-shaped input device moves in contact with the operation target.

10. The information processing system according to claim 9, characterized in that: The vibration control section changes the intensity of the vibration performed by the pen-type input device according to the distance of the coordinates detected by the coordinate detection section from the reference coordinates when the pen-type input device moves in surface contact with the operation target.

11. The information processing system according to claim 9, characterized in that: The vibration control unit changes the intensity of the vibration of the pen-shaped input device according to whether the moving direction of the coordinates detected by the coordinate detection unit is a direction away from or a direction approaching the reference coordinates when the pen-shaped input device moves in contact with the operation object.

12. The information processing system according to any one of claims 9 to 11, characterized in that: The reference coordinates are coordinates when the pen-shaped input device starts to contact the operation target surface.

Images