Information processing device and information processing method

Abstract

The present invention provides an information processing device and an information processing method, which can prevent the drawing formed by the pen operation that the user does not want with high precision. The above-mentioned information processing device comprises: a drawing information acquisition unit, which acquires drawing information including at least touch position information and pressure information, wherein the touch position information indicates the touch position where the touch operation is performed on the touch screen, and the pressure information indicates the pressure applied to the touch position; a calculation unit, which calculates the change amount related to the movement of the touch position based on the acquired first drawing information and the second drawing information acquired after the first drawing information; a determination unit, which determines whether the touch operation is an operation to be drawn based on the calculated change amount; and a mode control unit, which sets a first mode for executing the drawing related to the touch operation when it is determined that the touch operation is an operation to be drawn, and sets a second mode for not executing the drawing related to the touch operation when it is determined that the touch operation is not an operation to be drawn.

Description

Technical Field

[0001] The present invention relates to an information processing device and an information processing method. Background Art

[0002] In the past, various technologies have been proposed, which are: when a user performs a touch operation on a touch screen using a stylus as an operating medium (hereinafter also referred to as a "pen touch operation"), the processing to be executed is controlled based on the pressure applied to the touch position of the stylus (hereinafter also referred to as the "pen touch position").

[0003] For example, the following patent document 1 discloses a technology for controlling the display processing of a pen touch position based on the pressure applied to the pen touch position by a pen touch operation of a user. In this technology, for example, the display or non-display of the pen touch position is controlled based on whether the pressure applied to the pen touch position is below a predetermined threshold.

[0004] However, when a user uses a stylus pen to handwrite text or the like on a touch screen, sometimes a drawing is made by a touch operation that the user does not want. For example, when an operating medium in contact with the touch screen slides and moves in a direction that the user does not want, a drawing that the user does not want is made. In addition, if the operating medium slides, the pressure applied to the touch position decreases. Therefore, as in the technology of Patent Document 1, the magnitude of the pressure applied to the touch position is utilized, for example, by controlling not to draw when the pressure applied to the touch position is below a predetermined threshold, it is possible to prevent the drawing that the user does not want to make.

[0005] Patent document 1: Japanese Patent Application Publication No. 2019-086965.

[0006] However, when judging only by whether the pressure applied to the pen touch position is below a predetermined threshold, not only the drawing that the user does not want to do is prevented, but also the drawing that the user wants to do is prevented. For example, in the case of a user with weak pen pressure, even if the drawing is desired, the pressure applied to the pen touch position is below the predetermined threshold, and the drawing may not be performed. Summary of the invention

[0007] In view of the above-mentioned problems, an object of the present invention is to provide an information processing device and an information processing method that can prevent drawing by pen touch operation not intended by the user with high accuracy.

[0008] In order to solve the above-mentioned problems, an information processing device involved in one embodiment of the present invention comprises: a drawing information acquisition unit, which acquires drawing information including at least touch position information and pressure information, the above-mentioned touch position information indicating the touch position where a touch operation is performed on the touch screen, and the above-mentioned pressure information indicating the pressure applied to the above-mentioned touch position; a calculation unit, which calculates a change amount related to the movement of the above-mentioned touch position based on the first drawing information acquired by the above-mentioned drawing information acquisition unit and the second drawing information acquired after the above-mentioned first drawing information; a determination unit, which determines whether the above-mentioned touch operation is an operation to be drawn based on the above-mentioned change amount calculated by the above-mentioned calculation unit; and a mode control unit, which sets a first mode for executing the drawing related to the above-mentioned touch operation when the above-mentioned determination unit determines that the above-mentioned touch operation is an operation to be drawn, and sets a second mode for not executing the drawing related to the above-mentioned touch operation when the above-mentioned touch operation is determined by the above-mentioned determination unit to be an operation to be drawn.

[0009] An information processing method involved in one embodiment of the present invention includes the following processes: a drawing information acquisition unit acquires drawing information including at least touch position information and pressure information, the touch position information indicating the touch position where a touch operation is performed on the touch screen, and the pressure information indicating the pressure applied to the touch position; a calculation unit calculates a change amount related to the movement of the touch position based on the first drawing information acquired by the drawing information acquisition unit and the second drawing information acquired after the first drawing information; a determination unit determines whether the touch operation is an operation to be drawn based on the change amount calculated by the calculation unit; and a mode control unit sets a first mode for executing the drawing related to the touch operation when the determination unit determines that the touch operation is an operation to be drawn, and sets a second mode for not executing the drawing related to the touch operation when the determination unit determines that the touch operation is not an operation to be drawn.

[0010] According to the present invention, it is possible to prevent drawing by a pen touch operation not intended by a user with high accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a diagram showing an example of a system configuration according to each embodiment.

[0012] Figure 2 This is a diagram showing an example of drawing on a general touch screen.

[0013] Figure 3 This is a diagram showing an example of an overview of mode transitions according to each embodiment.

[0014] Figure 4 It is a diagram showing an example of drawing on the touch screen according to each embodiment.

[0015] Figure 5 It is a diagram showing an example of the hardware configuration of a tablet terminal according to each embodiment.

[0016] Figure 6 It is a diagram showing an example of the hardware configuration of the stylus according to each embodiment.

[0017] Figure 7 It is a diagram showing the outline of the first embodiment.

[0018] Figure 8 This is a diagram showing an example of the functional configuration of the tablet terminal according to the first embodiment.

[0019] Fig. 9 It is a diagram showing an example of the functional structure of the stylus pen according to the first embodiment.

[0020] Fig.10 This is a sequence diagram showing an example of the flow of processing according to the first embodiment.

[0021] Fig.11 This is a flowchart showing an example of the flow of pen touch operation determination processing according to each embodiment.

[0022] Fig.12 It is a diagram showing the outline of the second embodiment.

[0023] Fig.13 This is a diagram showing an example of a functional configuration of a tablet terminal according to the second embodiment.

[0024] Fig.14 It is a diagram showing an example of the functional structure of the stylus pen according to the second embodiment.

[0025] Fig.15 This is a sequence diagram showing an example of the flow of processing according to the second embodiment.

[0026] Fig.16 This is a flowchart showing an example of the flow of pen touch operation determination processing according to a modification.

[0027] Description of Reference Numerals

[0028] 1 (1-1, 1-2) ... tablet terminal; 2 ... housing; 3 (3-1, 3-2) ... stylus; 11 ... CPU; 12 ... main memory; 13 ... GPU; 14 ... touch screen; 15 ... display screen; 16 ... touch panel; 17 ... chipset; 18 ... BIOS memory; 19 ... HDD; 20 ... audio system; 21 ... communication device; 22 ... EC; 23 ... input device; 24 ... power supply circuit; 25 ... battery; 26 ... OS; 27 ... application; 31 ... IC; 32 ... pressure sensor; 33 ... storage device; 34 ... communication device; 35 ... battery; 110 (110-1, 110-2) ... input unit; 120 (120-1, 120-2) ... pen touch position detection unit; 130 (130-1, 130-2) ... communication unit; 140 (140-1, 140-2 )…control unit; 141…drawing information acquisition unit; 142…calculation unit; 143…determination unit; 144…mode control unit; 145…drawing information update unit; 146…drawing control unit; 147…drawing control unit; 150 (150-1, 150-2)…storage unit; 160 (160-1, 160-2)…display unit; 310 (310-1, 310-2)…control unit; 3 20 (320-1, 320-2) ... pressure detection unit; 330 (330-1, 330-2) ... storage unit; 340 (340-1, 340-2) ... communication unit; 311 ... drawing information acquisition unit; 312 ... calculation unit; 313 ... determination unit; 314 ... mode control unit; 315 ... drawing information update unit; 1000 (1000-1, 1000-2) ... information processing system. DETAILED DESCRIPTION

[0029] Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in the accompanying drawings, mutually orthogonal X-axis, Y-axis, and Z-axis are shown as needed. In each axis, the direction in which the arrow extends is called the "positive direction", and the direction opposite to the positive direction is called the "negative direction".

[0030] <<1. System structure>>

[0031] First, refer to Figure 1 , the system structure involved in each implementation method is explained. Figure 1 1 is a diagram showing an example of a system configuration according to each embodiment. Figure 1 The tablet terminal 1 and the stylus pen 3 are shown.

[0032] The tablet terminal 1 is an example of an electronic device that can input information through pen touch operation. The electronic device is not limited to the tablet terminal 1 as long as it is a terminal equipped with at least a touch screen. For example, the electronic device can also be implemented by a notebook PC (Personal Computer) equipped with a touch screen, a smart phone, a foldable terminal (Foldable Device) that can fold the touch screen, etc. In addition, the terminal that implements the electronic device is not limited to the above example.

[0033] In addition, the number of touch screens provided in the electronic device is not particularly limited. For example, if the electronic device has two displays (Dual Display), one of the two displays may be a touch screen, or both displays may be touch screens.

[0034] like Figure 1 As shown, the tablet terminal 1 includes a housing 2 and a touch screen 14. In the following description, the long side direction of the touch screen 14 is the X-axis direction, the short side direction of the touch screen 14 is the Y-axis direction, and the direction perpendicular to the surface of the touch screen 14 is the Z-axis direction.

[0035] The frame 2 is a frame having a touch screen 14. Figure 1 As shown, the touch screen 14 is an input / output device including a display screen 15 capable of displaying various information and a touch panel 16 capable of detecting pen touch operations. In the present embodiment, pen touch operations are performed by bringing the stylus pen 3 into contact with the surface of the touch screen 14.

[0036] The stylus pen 3 is an example of an operation medium used for a pen touch operation on the touch screen 14. The user uses the stylus pen 3 to perform a pen touch operation to input, for example, characters, numbers, symbols, or graphics by handwriting. The handwritten input information is drawn on the touch screen 14. Figure 1 The characters “Hello” are drawn on the touch screen 14 shown. This is an example of drawing when the user inputs the characters “Hello” by handwriting on the touch screen 14 using the stylus pen 3 .

[0037] However, with a general touch screen, when a user performs handwriting input using an operation medium, sometimes a drawing that the user does not intend is performed.

[0038] For example, when the user makes the pen tip contact with the touch screen, and performs a pen touch operation to move the position where the pen tip contacts the touch screen (hereinafter, also referred to as the "pen touch position"), there is a case where the position of the pen tip moves in a direction that the user does not want due to the sliding of the pen tip. At this time, if the position of the pen tip moves in a direction that the user does not want while the pen tip is in contact with the touch screen, a drawing that the user does not want is performed. In the drawing that the user does not want due to the sliding of the pen tip, a sudden change in the moving direction of the pen touch position (hereinafter, also referred to as the "drawing direction") and a sharp decrease in the pressure applied to the pen touch position (hereinafter, also referred to as the "drawing pressure") occur simultaneously. On the other hand, in the case where the movement of the pen touch position is the movement that the user wants, the sudden change in the drawing direction and the sharp decrease in the drawing pressure do not occur simultaneously. Therefore, depending on whether the sharp decrease in the drawing pressure and the sudden change in the drawing direction occur simultaneously, it is possible to distinguish between the drawing that the user wants and the drawing that the user does not want.

[0039] Here, refer to Figure 2 , an example of drawing on a common touch screen is described. Figure 2 FIG. 1 is a diagram showing an example of drawing on a general touch screen. Figure 2 2 shows the drawing that the user does not want due to the sliding of the pen tip. Specifically, the drawing in the interval from position P1 to position P2, the drawing in the interval from position P3 to position P4, and the drawing in the interval from position P5 to position P6 are the drawings that the user does not want.

[0040] For example, in the interval from position P1 to position P2, when the pen tip slides at position P1, the drawing direction changes greatly (abruptly) from direction D1 to direction D2. At this time, the drawing pressure applied to position P2 (pen touch position) is greatly reduced (suddenly reduced) compared to the drawing pressure applied to position P1.

[0041] In addition, in the interval from position P3 to position P4, when the pen tip slides at position P3, the drawing direction changes greatly (abruptly) from direction D3 to direction D4. At this time, the drawing pressure applied to position P4 (pen touch position) is greatly reduced (suddenly reduced) compared to the drawing pressure applied to position P3.

[0042] In addition, in the interval between position P5 and position P6, when the pen tip slides at position P5, the drawing direction changes greatly (abruptly) from direction D5 to direction D6. At this time, the drawing pressure applied to position P6 (pen touch position) is greatly reduced (suddenly reduced) compared to the drawing pressure applied to position P5.

[0043] In addition, in Figure 2In the depiction similar to the depiction that the user does not want to draw as shown, there are "strokes" and "hooks" that the user wants to draw. When the user wants to draw "strokes", the user reduces the pen pressure and moves the pen tip in the direction of the stroke. Therefore, in the depiction of the desired "stroke", the drawing pressure drops sharply, but the drawing direction does not suddenly change at the same time. When the user wants to draw a "hook", the user increases the pen pressure and then moves the pen tip in the direction of the hook. Therefore, in the depiction of the desired "hook", the drawing direction suddenly changes, but the drawing pressure does not drop sharply at the same time. In this way, in the case of user-desired depictions such as "strokes" and "hooks", the sharp drop in drawing pressure and the sudden change in drawing direction occur at different times.

[0044] Therefore, it is possible to distinguish between drawing desired by the user and drawing not desired by the user, at least based on whether a sharp decrease in drawing pressure and a sudden change in drawing direction occur simultaneously.

[0045] In view of the above, in the information processing system 1000 involved in each embodiment of the present invention, whether the pen touch operation is an operation that should be drawn (an operation desired by the user) is determined based on whether a sharp decrease in drawing pressure and a sudden change in drawing direction occur at the same time. In the case where the pen touch operation is an operation that should be drawn (an operation desired by the user), the information processing system 1000 sets a drawing mode (a first mode) in which drawing of data corresponding to the pen touch operation is performed. On the other hand, in the case where the pen touch operation is an operation that should not be drawn (an operation not desired by the user), the information processing system 1000 sets a non-drawing mode (a second mode) in which drawing of data corresponding to the pen touch operation is not performed. As a result, the information processing system 1000 can prevent drawing caused by pen touch operations that are not desired by the user with high accuracy.

[0046] In addition, the user's undesired drawing may be performed when the user inadvertently makes the operating medium contact with the touch screen. In the drawing formed by the contact that the user does not want, the drawing pressure may become extremely low. On the other hand, when the contact between the touch screen and the operating medium is the contact that the user wants, a drawing pressure above a certain level is detected at the pen touch position. Therefore, the information processing system 1000 can also distinguish between the operation of performing drawing and the operation of not performing drawing according to whether the drawing pressure is extremely low, and control the drawing mode and the non-drawing mode.

[0047] Here, refer to Figure 3 An overview of mode transitions according to each embodiment will be described. Figure 3 FIG. 1 is a diagram showing an example of an overview of mode transitions according to each embodiment. Figure 3 The mode transition between the drawing mode and the non-drawing mode is shown in . In addition, the initial state is the drawing mode.

[0048] like Figure 3As shown, in the drawing mode, when a sudden change in the drawing direction and a sharp decrease in the drawing pressure occur simultaneously, the drawing mode is switched to the non-drawing mode. In addition, in the drawing mode, when the drawing pressure is extremely low, the drawing mode is switched to the non-drawing mode.

[0049] In the non-drawing mode, the user does not perform the desired pen operation, so the drawing pressure (pen pressure) becomes low. In the case of performing the desired pen operation from the state of not performing the desired pen operation, the user increases the pen pressure. Therefore, the drawing pressure increases. Thus, it can be determined that the operation to be drawn (the desired pen operation) is performed based on the increase in the drawing pressure. Therefore, in the non-drawing mode, when the drawing pressure increases, the non-drawing mode is changed to the drawing mode.

[0050] Here, refer to Figure 4 An example of drawing on the touch screen 14 according to each embodiment will be described. Figure 4 FIG. 1 is a diagram showing an example of drawing on the touch screen 14 according to each embodiment. Figure 4 Shown in Figure 2 The example shown is an example of drawing when the same pen touch operation is performed on the touch screen 14. In addition, the drawing mode is set at the position P1, the position P3, and the position P5.

[0051] In the interval from position P1 to position P2, the drawing direction changes suddenly and the drawing pressure drops sharply due to the sliding of the pen tip in position P1. Therefore, the pen touch operation in the interval from position P1 to position P2 is determined to be an operation that should not be drawn (a pen touch operation that the user does not want), and the non-drawing mode is set while the pen touch position moves from position P1 to position P2. Therefore, drawing is not performed in the interval from position P1 to position P2.

[0052] Similarly, in the section from position P3 to position P4 and the section from position P5 to position P6, since the non-drawing mode is set, drawing is not performed.

[0053] <<2. Hardware structure>>

[0054] The system configurations involved in each embodiment have been described above. Figure 5 as well as Figure 6 , the hardware structure involved in each implementation is described.

[0055] <2-1. Hardware structure of tablet terminal>

[0056] Reference Figure 5 The hardware configuration of the tablet terminal 1 according to each embodiment will be described. Figure 51 is a diagram showing an example of the hardware configuration of the tablet terminal 1 according to each embodiment. Figure 5 As shown, the tablet terminal 1 includes a CPU 11 (Central Processing Unit), a main memory 12, a GPU 13 (Graphic Processing Unit), a touch screen 14, a display screen 15, a touch panel 16, a chipset 17, a BIOS memory 18 (Basic Input Output System), an HDD 19 (Hard Disk Drive), an audio system 20, a communication device 21, an EC 22 (Embedded Controller), an input device 23, a power circuit 24, and a battery 25.

[0057] The CPU 11 executes various calculation processes under program control and controls the entire tablet terminal 1 .

[0058] The main memory 12 is a writable memory used as a read area for the execution program of the CPU 11 or as a work area for writing processing data of the execution program. The main memory 12 is composed of, for example, a plurality of DRAM (Dynamic Random Access Memory) chips. The execution program includes an OS (Operating System), various drivers for hardware operations of peripheral devices, various services / utilities, and application programs.

[0059] The GPU 13 performs image processing and generates display data based on the control of the CPU 11. The GPU 13 is connected to the display screen 15 and outputs the generated display data to the display screen 15.

[0060] The touch screen 14 includes a display screen 15 and a touch panel 16. The touch screen 14 displays various information corresponding to display data converted into a video signal on the display screen 15, and detects a touch by an operating medium such as a user's finger or a stylus pen or the proximity of the operating medium through the touch panel 16, thereby receiving an operation input based on the operating medium.

[0061] The display screen 15 is, for example, a display device such as an OLED display (organic EL display). In addition, the display screen 15 may be configured to be bendable (foldable).

[0062] The touch panel 16 is arranged to overlap the display surface of the display screen 15. The touch panel 16 may be formed integrally with the display screen 15 and may be configured to be bendable (foldable) similarly to the display screen 15.

[0063] The touch panel 16 detects the operation position. Specifically, the operation position is the pen touch position where the pen touch operation is performed on the touch screen 14. The pen touch position is indicated by coordinates, for example. The range of the coordinates of the pen touch position is determined according to the size of the touch screen 14. Information indicating the pen touch position on the touch panel 16 such as the coordinates is also referred to as "pen touch position information" below.

[0064] Chipset 17 has controllers such as USB (Universal Serial Bus), Serial ATA (AT Attachment), SPI (Serial Peripheral Interface) bus, PCI (Peripheral Component Interconnect) bus, PCI-Express bus, and LPC (Low Pin Count) bus to connect multiple devices. Figure 5 In the embodiment, as an example of the plurality of devices, the CPU 11 , the BIOS memory 18 , the HDD 19 , the audio system 20 , the communication device 21 , and the EC 22 are connected to the chipset 17 .

[0065] The BIOS memory 18 is composed of an electrically rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash ROM (Read Only Memory). The BIOS memory 18 stores system firmware for controlling the BIOS and the EC 22. The system firmware is firmware executed by the CPU 11 and is different from the EC firmware executed by the EC 22.

[0066] The HDD 19 (an example of a nonvolatile storage device) stores the OS, various drivers, various services / utilities, application programs, and various data.

[0067] The audio system 20 records, plays, and outputs audio data. For example, a microphone, a speaker, and the like are connected to the audio system 20 .

[0068] The communication device 21 is connected to other devices via a wireless or wired communication network to transmit and receive various data. For example, the communication device 21 includes a wired LAN interface such as Ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), etc. In addition, the communication device 21 may also include a USB interface or a Bluetooth (registered trademark) interface.

[0069] EC22 (embedded controller) is a one-chip microcomputer that monitors and controls various devices (peripheral devices, sensors, etc.) regardless of the system status of tablet terminal 1. EC22 includes a CPU, ROM, and RAM (Random Access Memory) (not shown).

[0070] EC22 operates independently of CPU11 and mainly functions as a control unit that manages the internal operating environment of tablet terminal 1. EC22 reads a control program (EC firmware) pre-stored in ROM and executes processing instructed by various commands described in the read control program to realize various functions.

[0071] The EC 22 also includes A / D input terminals of multiple channels, D / A output terminals, a timer, and digital input / output terminals, etc. For example, the input device 23 and the power supply circuit 24 are connected to the EC 22 via these input / output terminals, and the EC 22 controls these operations.

[0072] The input device 23 is an input device for performing input such as a power switch or a function switch.

[0073] The power circuit 24 includes, for example, a DC / DC converter, a charging and discharging unit, a battery unit, an AC / DC adapter, etc., and converts a DC voltage supplied from an external power source or a battery unit into a plurality of voltages required to operate the tablet terminal 1. In addition, the power circuit 24 supplies power to each part of the tablet terminal 1 based on control from the EC 22.

[0074] The battery 25 is, for example, a lithium battery. When power is supplied from an external power source to the tablet terminal 1, the battery 25 is charged via the power circuit 24. When power is not supplied from an external power source to the tablet terminal 1, the battery 25 outputs the power charged via the power circuit 24 as operating power for the tablet terminal 1.

[0075] <2-2. Hardware structure of the stylus>

[0076] Reference Figure 6 The hardware configuration of the stylus pen 3 according to each embodiment will be described. Figure 6 is a diagram showing an example of the hardware configuration of the stylus pen 3 according to each embodiment. Figure 6 As shown, the stylus pen 3 includes an IC 31 (Integrated Circuit), a pressure sensor 32 , a storage device 33 , a communication device 34 , and a battery 35 .

[0077] The IC 31 executes various calculation processes under program control and controls the entire stylus pen 3 .

[0078] The pressure sensor 32 is a sensor device that detects pressure. Information indicating the pressure detected by the pressure sensor 32 is hereinafter also referred to as "pressure information."

[0079] The storage device 33 stores various information and is composed of, for example, ROM, RAM, EEPROM, and the like.

[0080] The communication device 34 is connected to other devices via a wireless communication network to transmit and receive various data. For example, the communication device 34 communicates with the tablet terminal 1 using a communication protocol unique to the stylus pen 3. The protocol is Wacom AES (Active Electro Static). The stylus pen 3 can also communicate with the tablet terminal 1 via short-range wireless communication such as Bluetooth (registered trademark).

[0081] The battery 35 is, for example, a lithium ion battery or an alkaline ion battery. The battery 35 supplies power to the IC 31 , and the IC 31 adjusts the voltage level and supplies the voltage to the pressure sensor 32 , the storage device 33 , and the communication device 34 .

[0082] <<3. First embodiment>>

[0083] The hardware configurations of the various embodiments have been described above. Figure 7 to Figure 11 A first embodiment will be described. In the first embodiment, an example in which the information processing device is a tablet terminal 1 will be described as an example.

[0084] <3-1. Overview of the first embodiment>

[0085] Reference Figure 7 The outline of the first embodiment will be described. Figure 7 1 is a diagram showing an overview of the first embodiment. Figure 7 As shown, the information processing system 1000 - 1 according to the first embodiment is composed of a tablet terminal 1 - 1 and a stylus pen 3 - 1 .

[0086] In the first embodiment, a process for controlling not to perform a drawing formed by a pen touch operation that the user does not want is installed in the tablet terminal 1-1. Hereinafter, a drawing formed by a pen touch operation that the user does not want is also referred to as "interfering drawing". In addition, the process for controlling not to perform an interfering drawing is also referred to as "interference removal process" below.

[0087] For example, the interference removal process is installed in the application 27 executed on the OS 26 of the tablet terminal 1-1. The application 27 performs the interference removal process based on the drawing information input from the OS. The application 27 controls the setting of the drawing mode or the non-drawing mode according to the result of the interference removal process. When the drawing mode is set, the application 27 outputs a signal indicating that the drawing is to be performed (hereinafter also referred to as a "drawing signal") to the display screen 15, and when the non-drawing mode is set, the application 27 outputs a signal indicating that the drawing is not to be performed (hereinafter also referred to as a "non-drawing signal") to the display screen 15.

[0088] The drawing information is information related to drawing including at least pressure information and pen position information. In the first embodiment, the pressure information is acquired by the stylus 3-1 and sent to the tablet terminal 1-1. The pen position information is acquired by the tablet terminal 1-1.

[0089] The interference removal process is implemented in the application 27, and the intensity of interference removal can be set according to the type of application, the type of pen used in the application 27 (such as pencil, pen, ballpoint pen, etc.), etc. In addition, the intensity of interference removal can also be changed during interaction.

[0090] <3-2. Functional structure of tablet terminal>

[0091] Reference Figure 8 The functional configuration of the tablet terminal 1 - 1 according to the first embodiment will be described. Figure 8 1 is a diagram showing an example of the functional configuration of the tablet terminal 1-1 according to the first embodiment. Figure 8 As shown, the tablet terminal 1 - 1 includes an input unit 110 - 1 , a pen touch position detection unit 120 - 1 , a communication unit 130 - 1 , a control unit 140 - 1 , a storage unit 150 - 1 , and a display unit 160 - 1 .

[0092] (1) Input Unit 110 - 1

[0093] The input unit 110-1 has a function of receiving input of various information. Figure 5 The touch screen 14 and the input device 23 described above are implemented. The input unit 110 - 1 receives input of information input to the touch screen 14 by the user.

[0094] (2) Pen Touch Position Detection Unit 120-1

[0095] The pen touch position detection unit 120-1 has a function of detecting the pen touch position on the touch screen 14. This function is performed by referring to Figure 5The pen position detection unit 120-1 detects the pen position when the user performs a pen touch operation on the touch screen 14 using the operation medium. The pen position detection unit 120-1 outputs the detected pen position as pen position information. In addition, the pen position detection unit 120-1 also obtains a time stamp indicating the date and time when the pen position is detected. The pen position detection unit 120-1 outputs the obtained time stamp as time stamp information.

[0096] (3) Communications Department 130-1

[0097] The communication unit 130-1 has a function of transmitting and receiving various information. Figure 5 The communication unit 130-1 is implemented by the communication device 21 described above. For example, the communication unit 130-1 receives pressure information transmitted from the stylus pen 3-1.

[0098] (4) Control Unit 140-1

[0099] The control unit 140-1 has a function of controlling the overall operation of the tablet terminal 1-1. This function is performed by referring to Figure 5 The CPU 11 and the chipset 17 described above are implemented. Figure 8 As shown, the control unit 140 - 1 includes a drawing information acquisition unit 141 , a calculation unit 142 , a determination unit 143 , a mode control unit 144 , a drawing information update unit 145 , and a drawing control unit 146 .

[0100] (4-1) Drawing Information Acquisition Unit 141

[0101] The drawing information acquisition unit 141 has a function of acquiring drawing information. For example, when a pen touch operation is detected on the touch screen 14, the drawing information acquisition unit 141 acquires pressure information, pen touch position information, and timestamp information corresponding to the pen touch operation as drawing information. In addition, the information included in the drawing information is not particularly limited as long as it includes at least pressure information and pen touch position information.

[0102] Specifically, the drawing information acquisition unit 141 acquires the pressure information received by the communication unit 130-1 from the stylus 3-1. In addition, the drawing information acquisition unit 141 acquires the pen touch position information and time stamp information output by the pen touch position detection unit 120-1. The time stamp indicates the date and time when the pen touch operation corresponding to the pressure information and pen touch position information acquired by the drawing information acquisition unit 141 is detected.

[0103] The drawing information acquisition unit 141 outputs drawing information including various information acquired from the communication unit 130 - 1 and the pen touch position detection unit 120 - 1 when a pen touch operation is detected to the calculation unit 142 .

[0104] Furthermore, when a pen touch operation on the touch screen 14 is detected, the drawing information acquisition unit 141 acquires the drawing information stored in the storage unit 150-1. In addition, the drawing information output by the drawing information acquisition unit 141 to the calculation unit 142 is information acquired after the drawing information stored in the storage unit 150-1. That is, the drawing information output by the drawing information acquisition unit 141 to the calculation unit 142 is the first drawing information, and the drawing information stored in the storage unit 150-1 is the second drawing information. Specifically, the second drawing information is drawing information acquired before one of the first drawing information and stored in the storage unit 150-1. Therefore, in the following, the drawing information output by the drawing information acquisition unit 141 to the calculation unit 142 is referred to as "this drawing information", and the drawing information acquired by the drawing information acquisition unit 141 from the storage unit 150 is referred to as "last drawing information". That is, when a pen touch operation on the touch screen 14 is detected, the drawing information acquisition unit 141 also acquires the previous drawing information from the storage unit 150 - 1 , and outputs it to the calculation unit 142 together with the current drawing information.

[0105] When acquiring drawing information for the first time, the storage unit 150-1 does not store the previous drawing information. Therefore, when acquiring drawing information for the first time, the drawing information acquisition unit 141 outputs only the current drawing information.

[0106] (4-2) Calculation Unit 142

[0107] The calculation unit 142 has a function of calculating the amount of change related to the movement of the pen touch position. For example, the calculation unit 142 calculates the amount of change related to the movement of the pen touch position based on the last drawing information and the current drawing information acquired by the drawing information acquisition unit 141.

[0108] As an example, the calculation unit 142 calculates the amount of change in drawing pressure and the amount of change in drawing direction as the amount of change associated with the movement of the pen touch position.

[0109] Specifically, the calculation unit 142 calculates the difference between the drawing pressure indicated by the pressure information included in the current drawing information and the drawing pressure indicated by the pressure information included in the previous drawing information as the amount of change in the drawing pressure. In addition, the calculation unit 142 calculates the angle between the coordinates of the brush position indicated by the brush position information included in the current drawing information and the coordinates of the brush position information indicated by the brush position information included in the previous drawing information as the amount of change in the drawing direction.

[0110] After the calculation, the calculation unit 142 outputs the calculated amount of change in the drawing pressure and the amount of change in the drawing direction to the determination unit 143 .

[0111] (4-3) Determination Unit 143

[0112] The determination unit 143 has a function of performing a determination process (hereinafter also referred to as "pen touch operation determination process") to determine whether the pen touch operation is an operation to be drawn. For example, the determination unit 143 determines whether the pen touch operation is an operation to be drawn based on the change amount calculated by the calculation unit 142. The change amount input from the calculation unit 142 includes at least the change amount of the drawing pressure and the change amount of the drawing direction.

[0113] Specifically, it is assumed that the change amount of the drawing pressure (the decrease amount of the drawing pressure) is greater than a predetermined threshold value (a first threshold value, for example, 80%) and the drawing pressure decreases suddenly, and the change amount of the drawing direction is greater than a predetermined threshold value (a second threshold value, for example, 20 degrees) and the drawing direction changes suddenly. In this case, it can be seen that the sudden decrease in the drawing pressure and the sudden change in the drawing direction occur simultaneously. Therefore, the determination unit 143 can determine that the pen touch operation is not an operation to be drawn because the user does not want the pen touch operation to be performed.

[0114] In addition, it is assumed that the drawing pressure indicated by the pressure information included in the drawing information acquired by the drawing information acquisition unit 141 is a predetermined threshold value (a fourth threshold value, for example, 100 gf / cm 2 ) or less, and the drawing pressure is extremely low. In this case, since the drawing pressure is extremely low, it can be known that the user did not apply the pen pressure. Therefore, the determination unit 143 can determine that since the pen touch operation that the user does not want is performed, the pen touch operation is not an operation to be drawn.

[0115] In addition, it is assumed that the determination unit 143 determines that the pen touch operation is not an operation to be drawn at a determination time (second determination time) earlier than the first determination time when determining whether the pen touch operation is an operation to be drawn (first determination time). In addition, hereinafter, the first determination time is referred to as "this determination time" and the second determination time is referred to as "last determination time". And, it is assumed that the drawing pressure at this determination time has not increased compared to the last determination time. In this case, since the drawing pressure has not increased, it can be known that the user has not applied pen pressure. Therefore, the determination unit 143 can determine that the pen touch operation desired by the user has not been performed, and the undesirable pen touch operation continues, so the pen touch operation is not an operation to be drawn.

[0116] In addition, it is assumed that the drawing pressure during this determination is higher than that during the previous determination. In this case, since the drawing pressure has increased, it can be known that the user has applied pen pressure. Therefore, the determination unit 143 can determine that since the user's desired pen operation is performed, the pen operation is an operation that should be performed for drawing.

[0117] After making the determination, the determination unit 143 outputs the determination result to the mode control unit 144 .

[0118] (4-4) Mode Control Unit 144

[0119] The mode control unit 144 has a function of controlling a mode related to drawing. For example, the mode control unit 144 sets a drawing mode or a non-drawing mode based on the result of the determination by the determination unit 143. Specifically, the mode control unit 144 sets the drawing mode when the determination unit 143 determines that the pen touch operation is an operation to be drawn, and sets the non-drawing mode when the determination unit 143 determines that the pen touch operation is not an operation to be drawn.

[0120] The mode control unit 144 outputs information indicating the set mode as mode information. The mode information is indicated by, for example, a flag. As an example, when the pen touch operation is an operation to be drawn, the mode control unit 144 sets information indicating that the flag is on (for example, 1) as the mode information. On the other hand, when the pen touch operation is not an operation to be drawn, the mode control unit 144 sets information indicating that the flag is off (for example, 0) as the mode information. In addition, the mode information may also be set with information indicating that the flag is off when the pen touch operation is an operation to be drawn, and information indicating that the flag is on when the pen touch operation is not an operation to be drawn.

[0121] The mode control unit 144 may set the drawing mode or the non-drawing mode based on the last set mode and the result of the determination by the determination unit 143. The last set mode can be confirmed by referring to the mode information associated with the last drawing information stored in the storage unit 150-1.

[0122] For example, if the last set mode is the drawing mode and the pen touch operation is not an operation to be drawn, the mode control unit 144 sets the non-drawing mode. If the last set mode is the drawing mode and the pen touch operation is an operation to be drawn, the mode control unit 144 keeps the drawing mode as it is.

[0123] If the last set mode is the non-drawing mode and the pen touch operation is an operation to perform drawing, the mode control unit 144 sets the drawing mode. If the last set mode is the non-drawing mode and the pen touch operation is not an operation to perform drawing, the mode control unit 144 keeps the non-drawing mode as it is.

[0124] The brush operation determination process by the determination unit 143 and the mode control by the mode control unit 144 are performed based only on the last drawing information and the current drawing information. Therefore, the data stored in the storage unit 150-1 can be minimized, and the processing response is also fast.

[0125] (4-5) Drawing Information Update Unit 145

[0126] The drawing information updating unit 145 has a function of updating drawing information. For example, the drawing information updating unit 145 updates the last drawing information stored in the storage unit 150-1 with the current drawing information. When updating, the drawing information updating unit 145 causes the storage unit 150-1 to store information associating the amount of change in drawing pressure, the amount of change in drawing direction, and mode information with the current drawing information. The amount of change in drawing pressure and the amount of change in drawing direction associated with the current drawing information are calculated by the calculation unit 142 based on the current drawing information. In addition, the mode information associated with the current drawing information is output by the mode control unit 144 based on the current drawing information.

[0127] (4-6) Drawing Control Unit 146

[0128] The drawing control unit 146 has a function of controlling drawing in the display unit 160-1. For example, the drawing control unit 146 controls drawing in the display unit 160-1 according to the mode set by the mode control unit 144. When the drawing mode is set by the mode control unit 144, the drawing control unit 146 outputs a drawing signal to the display unit 160-1. On the other hand, when the non-drawing mode is set by the mode control unit 144, the drawing control unit 146 outputs a non-drawing signal to the display unit 160-1.

[0129] (5) Storage Unit 150-1

[0130] The storage unit 150-1 has a function of storing various information. The storage unit 150-1 can store various information by referring to Figure 5 The storage unit 150-1 is implemented by the ROM and RAM of the main memory 12, BIOS memory 18, HDD 19, and EC 22. For example, the storage unit 150-1 stores the drawing information updated by the drawing information update unit 145. In addition, the storage unit 150-1 stores software such as the OS and various applications, system firmware, and various firmware such as EC firmware.

[0131] (6) Display Unit 160-1

[0132] The display unit 160-1 has a function of displaying various information. The function of the display unit 160-1 is realized by, for example, a display provided as hardware by the information processing device. Figure 5 The touch screen 14 is described.

[0133] Display unit 160-1 performs drawing according to a signal input from drawing control unit 146. For example, when a drawing signal is input from drawing control unit 146, display unit 160-1 performs drawing related to a pen touch operation. On the other hand, when a non-drawing signal is input from drawing control unit 146, display unit 160-1 does not perform drawing related to a pen touch operation.

[0134] <3-3. Functional structure of the stylus>

[0135] Reference Fig. 9 The functional structure of the stylus pen 3 - 1 according to the first embodiment will be described. Fig. 9 FIG. 1 is a diagram showing an example of the functional structure of the stylus pen 3-1 according to the first embodiment. Fig. 9 As shown, the stylus pen 3 - 1 includes a control unit 310 - 1 , a pressure detection unit 320 - 1 , a storage unit 330 - 1 , and a communication unit 340 - 1 .

[0136] (1) Control Unit 310-1

[0137] The control unit 310-1 has a function of controlling all actions of the stylus pen 3-1. This function is performed by referring to Figure 6 This is achieved by IC31 described below.

[0138] (2) Pressure Detection Unit 320-1

[0139] The pressure detection unit 320-1 has a function of detecting the drawing pressure based on the pen touch operation. This function is performed by referring to Figure 6 The pressure sensor 32 to be described is implemented.

[0140] For example, when the stylus pen 3-1 is pressed on the touch screen 14 by a pen touch operation, the pressure detection unit 320-1 detects the pressure (pen pressure) applied to the pen tip as drawing pressure. The pressure detection unit 320-1 outputs pressure information indicating the detected drawing pressure.

[0141] (3) Storage Unit 330-1

[0142] The storage unit 330-1 has a function of storing various information. This function is, for example, by referring to Figure 6 The storage device 33 described above is implemented.

[0143] (4) Communications Department 340-1

[0144] The communication unit 340-1 has the function of transmitting and receiving various information. Figure 6 The communication device 34 described above is implemented.

[0145] For example, the communication unit 340 - 1 transmits a signal including information related to the stylus pen 3 - 1 to the tablet terminal 1 - 1. Specifically, the communication unit 340 - 1 transmits a signal including pressure information output by the pressure detection unit 320 - 1 to the tablet terminal 1 - 1.

[0146] <3-4. Processing flow>

[0147] Reference Fig.10and Fig.11 The flow of processing according to the first embodiment will be described. Fig.10 This is a sequence diagram showing an example of the flow of processing according to the first embodiment.

[0148] like Fig.10 As shown, first, the stylus pen 3 - 1 comes into contact with the touch screen 14 of the tablet terminal 1 - 1 through a user's operation (step S100 ).

[0149] When the stylus pen 3-1 contacts the touch screen 14, the pressure detection unit 320-1 of the stylus pen 3-1 detects the drawing pressure (step S101). The pressure detection unit 320-1 outputs pressure information indicating the detected drawing pressure. The communication unit 340-1 of the stylus pen 3-1 transmits the pressure information output by the pressure detection unit 320-1 to the tablet terminal 1-1 (step S102).

[0150] When the stylus pen 3-1 touches the touch screen 14, the touch position detector 120-1 of the tablet terminal 1-1 detects the touch position and obtains a timestamp (step S103). The touch position detector 120-1 outputs touch position information indicating the detected touch position and timestamp information indicating the obtained timestamp.

[0151] The drawing information acquisition unit 141 of the tablet terminal 1-1 acquires the current drawing information and the previous drawing information (step S104). For example, the drawing information acquisition unit 141 acquires the pressure information sent from the stylus 3-1 in step S102 and the pen touch position information and timestamp information output by the pen touch position detection unit 120-1 in step S103 as the current drawing information. In addition, the drawing information acquisition unit 141 acquires the drawing information stored in the storage unit 150-1 of the tablet terminal 1-1 as the previous drawing information.

[0152] The calculation unit 142 of the tablet terminal 1-1 calculates the change amount based on the current drawing information and the previous drawing information acquired by the drawing information acquisition unit 141 in step S104 (step S105). Specifically, the calculation unit 142 calculates the difference between the pressure information included in the current drawing information and the pressure information included in the previous drawing information as the change amount of the drawing pressure. In addition, the calculation unit 142 calculates the angle between the coordinates of the pen position indicated by the pen position information included in the current drawing information and the coordinates of the pen position indicated by the pen position information included in the previous drawing information as the change amount of the drawing direction.

[0153] The determination unit 143 of the tablet terminal 1 - 1 performs pen touch operation determination processing based on the amount of change calculated by the calculation unit 142 (step S106 ). The flow of the pen touch operation determination processing will be described later.

[0154] The mode control unit 144 of the tablet terminal 1-1 controls the mode related to drawing based on the determination result of the determination unit 143 (step S107). Specifically, when the determination unit 143 determines in step S106 that the pen touch operation is an operation to be drawn, the mode control unit 144 sets the drawing mode. On the other hand, when the determination unit 143 determines in step S106 that the pen touch operation is not an operation to be drawn, the mode control unit 144 sets the non-drawing mode. After the mode is set, the mode control unit 144 outputs mode information indicating the set mode.

[0155] The drawing information updating unit 145 of the tablet terminal 1-1 updates the drawing information stored in the storage unit 150-1 (step S108). Specifically, the drawing information updating unit 145 updates the drawing information stored in the storage unit 150-1 by associating the change amount of the drawing pressure and the change amount of the drawing direction calculated by the calculation unit 142 in step S105 and the mode information output by the mode control unit 144 in step S107 with the current drawing information.

[0156] The drawing control unit 146 of the tablet terminal 1-1 controls the drawing on the display unit 160-1 of the tablet terminal 1-1 according to the mode set by the mode control unit 144 (step S109). Specifically, when the drawing mode is set by the mode control unit 144 in step S107, the drawing control unit 146 outputs a drawing signal to the display unit 160-1. On the other hand, when the non-drawing mode is set by the mode control unit 144 in step S107, the drawing control unit 146 outputs a non-drawing signal to the display unit 160-1.

[0157] Here, refer to Fig.11 The flow of the pen touch operation determination process will be described. Fig.11 This is a flowchart showing an example of the flow of pen touch operation determination processing according to each embodiment.

[0158] like Fig.11 As shown, first, the determination unit 143 determines whether the drawing pressure detected this time is greater than a predetermined threshold value (fourth threshold value) based on the pressure information included in the drawing information this time (step S200). When the drawing pressure detected this time is greater than the predetermined threshold value (step S200 / Yes), the determination unit 143 proceeds to step S202. On the other hand, when the drawing pressure detected this time is not greater than the predetermined threshold value (step S200 / No), the determination unit 143 determines that the pen touch operation is not an operation to be drawn (step S201), and ends the pen touch operation determination process.

[0159] The determination unit 143 determines whether the drawing pressure detected this time is higher than the drawing pressure detected last time (step S202). If the drawing pressure is higher (step S202 / Yes), the determination unit 143 determines that the pen touch operation is an operation to be drawn (step S203), and ends the pen touch operation determination process. On the other hand, if the drawing pressure is not higher (step S202 / No), the determination unit 143 proceeds to step S204.

[0160] The determination unit 143 determines whether the amount of reduction in the drawing pressure is greater than or equal to a predetermined threshold value (first threshold value) (step S204). If the amount of reduction in the drawing pressure is greater than or equal to the predetermined threshold value (step S204 / Yes), the determination unit 143 proceeds to step S205. On the other hand, if the amount of reduction in the drawing pressure is not greater than or equal to the predetermined threshold value (step S204 / No), the determination unit 143 proceeds to step S206.

[0161] The determination unit 143 determines whether the amount of change in the drawing direction is greater than or equal to a predetermined threshold value (second threshold value) (step S205). If the amount of change in the drawing direction is greater than or equal to the predetermined threshold value (step S205 / Yes), the determination unit 143 determines that the pen touch operation is not an operation to be drawn (step S201), and ends the pen touch operation determination process. On the other hand, if the amount of change in the drawing direction is not greater than or equal to the predetermined threshold value (step S205 / No), the determination unit 143 proceeds to step S206.

[0162] The determination unit 143 determines whether the drawing corresponding to the pen touch operation detected last time has been performed (step S206). If the drawing was performed last time (step S206 / Yes), the determination unit 143 determines that the pen touch operation is an operation to be drawn (step S203), and ends the pen touch operation determination process. On the other hand, if the drawing was not performed last time (step S206 / No), the determination unit 143 determines that the pen touch operation is not an operation to be drawn (step S201), and ends the pen touch operation determination process.

[0163] As described above, the tablet terminal 1 - 1 according to the first embodiment includes the drawing information acquisition unit 141 , the calculation unit 142 , the determination unit 143 , and the mode control unit 144 .

[0164] The drawing information acquisition unit 141 acquires drawing information including at least pen touch position information indicating the pen touch position where the pen touch operation is performed on the touch screen 14 and pressure information indicating the drawing pressure applied to the pen touch position.

[0165] The calculation unit 142 calculates the amount of change related to the movement of the pen touch position based on the previous drawing information and the current drawing information acquired by the drawing information acquisition unit 141 .

[0166] The determination unit 143 determines whether the pen touch operation is an operation to execute drawing based on the amount of change calculated by the calculation unit 142 .

[0167] The mode control unit 144 sets a drawing mode for executing drawing related to the brush operation when the brush operation is an operation for executing drawing, and sets a non-drawing mode for not executing drawing related to the brush operation when the brush operation is not an operation for executing drawing.

[0168] With the above configuration, the tablet terminal 1 - 1 according to the first embodiment can determine whether the pen operation is an operation to be drawn based on the change amount calculated from the pen position information and pressure information, and set the drawing mode or the non-drawing mode.

[0169] Thus, the tablet terminal 1-1 can more accurately determine whether the pen touch operation is an operation to be drawn than when only drawing pressure is used. Furthermore, the tablet terminal 1-1 can also accurately control switching between the drawing mode and the non-drawing mode by using the more accurate determination result.

[0170] Therefore, the tablet terminal 1 - 1 according to the first embodiment can prevent drawing (interfering drawing) by pen operation not intended by the user with high accuracy.

[0171] In addition, in the tablet terminal 1-1 involved in the first embodiment, by preventing the drawing of interference, interference is removed from the drawing formed by the handwriting input using the stylus 3-1 with high accuracy. In particular, the accuracy of removing interference caused by drawing on a screen that is easy to slide is improved. Therefore, the drawing result is more preferable. In addition, it is also expected that the recognition accuracy in handwriting recognition will be improved.

[0172] In addition, in the first embodiment described above, an example in which the operation medium is the stylus 3-1 is described, but the present invention is not limited to the above example. For example, the operation medium may also be a human finger. In this case, the tablet terminal 1-1 refers to Figure 5 and Figure 8 The configuration described above also includes a configuration for detecting the drawing pressure applied to the pen touch position on the touch screen 14 .

[0173] In addition, in the first embodiment described above, an example is described in which the drawing control unit 146 outputs a drawing signal to the display unit 160-1 when the drawing mode is set, and outputs a non-drawing signal to the display unit 160-1 when the non-drawing mode is set, but the present invention is not limited to the above example. For example, the drawing control unit 146 may output a drawing signal to the display unit 160-1 when the drawing mode is set, and may not output a signal to the display unit 160-1 when the non-drawing mode is set.

[0174] <<4. Second embodiment>>

[0175] The first embodiment has been described above. Figure 12 to Figure 15 A second embodiment will be described. In the second embodiment, an example in which the information processing device is a stylus pen 3 will be described as an example. In addition, descriptions overlapping with those of the first embodiment described above will be omitted.

[0176] <4-1. Overview of Second Embodiment>

[0177] Reference Fig.12 The outline of the second embodiment will be described. Fig.12 2 is a diagram showing an overview of the second embodiment. Fig.12 As shown, the information processing system 1000 - 2 according to the second embodiment is composed of a tablet terminal 1 - 2 and a stylus pen 3 - 2 .

[0178] In the second embodiment, the interference removal process is implemented in the stylus pen 3 - 2 .

[0179] For example, the interference removal process is installed in IC31 of the stylus 3-2. IC31 performs the interference removal process based on the drawing information. IC31 controls the setting of the drawing mode or the non-drawing mode according to the result of the interference removal process. IC31 sends a drawing signal to the tablet terminal 1-2 when the drawing mode is set, and sends a non-drawing signal to the tablet terminal 1-2 when the non-drawing mode is set.

[0180] When the tablet terminal 1-2 receives a drawing signal from the stylus 3-2, the application 27 executed on the OS 26 outputs the drawing signal to the display screen 15. On the other hand, when the tablet terminal 1-2 receives a non-drawing signal from the stylus 3-2, the application 27 outputs the non-drawing signal to the display screen 15.

[0181] In the second embodiment, the pressure information is acquired on the stylus pen 3 - 2 side, and the touch position information is acquired on the tablet terminal 1 - 2 side and transmitted to the stylus pen 3 - 2 .

[0182] The noise removal process is implemented in the IC 31 , and therefore, it is possible to prevent the drawing of noise regardless of the type of application on the tablet terminal 1 - 2 side.

[0183] <4-2. Functional structure of tablet terminal>

[0184] Reference Fig.13 The functional configuration of the tablet terminal 1 - 2 according to the second embodiment will be described. Fig.13 1 is a diagram showing an example of a functional configuration of a tablet terminal 1-2 according to the second embodiment. Fig.13 As shown, the tablet terminal 1 - 2 includes an input unit 110 - 2 , a pen touch position detection unit 120 - 2 , a communication unit 130 - 2 , a control unit 140 - 2 , a storage unit 150 - 2 , and a display unit 160 - 2 .

[0185] (1) Input unit 110 - 2

[0186] The function of the input unit 110-2 is the same as that in the first embodiment described above. Figure 8 The function of the input unit 110 - 1 described above is the same, so duplicate description is omitted.

[0187] (2) Pen Touch Position Detection Unit 120-2

[0188] The function of the pen touch position detection unit 120-2 is the same as that in the first embodiment described above. Figure 8 The functions of the pen touch position detection unit 120 - 1 described above are the same, and therefore duplicate descriptions are omitted.

[0189] (3) Communications Department 130-2

[0190] The communication unit 130-2 has a function of transmitting and receiving various information. Figure 5 The communication unit 130-2 is implemented by the communication device 21 described above. For example, the communication unit 130-2 transmits the pen touch position information output by the pen touch position detection unit 120-2 to the stylus pen 3-2. In addition, the communication unit 130-2 receives a signal (for example, a drawing signal or a non-drawing signal) transmitted from the stylus pen 3-2.

[0191] (4) Control Unit 140-2

[0192] The control unit 140-2 has a function of controlling the overall operation of the tablet terminal 1-2. This function is performed by referring to Figure 5 The CPU 11 and the chipset 17 described above are implemented. Fig.13 As shown, the control unit 140 - 2 includes a drawing control unit 147 .

[0193] (4-1) Drawing Control Unit 147

[0194] The drawing control unit 147 has a function of controlling drawing in the display unit 160-2. For example, the drawing control unit 147 controls drawing in the display unit 160-2 based on the signal received by the communication unit 130-2 from the stylus 3-2. When the communication unit 130-2 receives a drawing signal, the drawing control unit 147 outputs the drawing signal to the display unit 160-2. On the other hand, when the communication unit 130-2 receives a non-drawing signal, the drawing control unit 147 outputs the non-drawing signal to the display unit 160-2.

[0195] (5) Storage Unit 150-2

[0196] The function of the storage unit 150-2 is the same as that in the first embodiment described above. Figure 8 The functions of the storage unit 150 - 1 described above are the same, and therefore duplicate descriptions are omitted. In the second embodiment, the storage unit 150 - 2 does not store drawing information.

[0197] (6) Display Unit 160-2

[0198] The function of the display unit 160-2 is the same as that in the first embodiment described above. Figure 8 The functions of the display unit 160 - 1 described above are the same, and therefore duplicate descriptions are omitted.

[0199] <4-3. Functional structure of the stylus>

[0200] Reference Fig.14 The functional structure of the stylus pen 3 - 2 according to the second embodiment will be described. Fig.14 2 is a diagram showing an example of the functional structure of the stylus pen 3-2 according to the second embodiment. Fig.14 As shown, the stylus pen 3 - 2 includes a control unit 310 - 2 , a pressure detection unit 320 - 2 , a storage unit 330 - 2 , and a communication unit 340 - 2 .

[0201] (1) Control Unit 310-2

[0202] The control unit 310-2 has a function of controlling all actions of the stylus pen 3-2. This function is performed by referring to Figure 6 This is achieved by IC31 as described below. Fig.14 As shown, the control unit 310 - 2 includes a rendering information acquisition unit 311 , a calculation unit 312 , a determination unit 313 , a mode control unit 314 , and a rendering information update unit 315 .

[0203] (1-1) Drawing Information Acquisition Unit 311

[0204] The function of the drawing information acquisition unit 311 is the same as that in the first embodiment described above. Figure 8The function of the drawing information acquisition unit 141 described is the same, so repeated description is omitted. In addition, the drawing information acquisition unit 311 acquires the pressure information output by the pressure detection unit 320-2, the pen position information and time stamp information received by the communication unit 340-2 from the tablet terminal 1-2 as the current drawing information. In addition, the drawing information acquisition unit 311 acquires the drawing information stored in the storage unit 330-2 as the previous drawing information.

[0205] (1-2) Calculation Unit 312

[0206] The function of the calculation unit 312 is the same as that in the first embodiment described above. Figure 8 The function of the calculation unit 142 described above is the same, so duplicate description is omitted.

[0207] (1-3) Determination Unit 313

[0208] The function of the determination unit 313 is the same as that in the first embodiment described above. Figure 8 The function of the determination unit 143 described above is the same, and therefore duplicate descriptions are omitted.

[0209] (1-4) Mode Control Unit 314

[0210] The function of the mode control unit 314 is the same as that in the first embodiment described above. Figure 8 The functions of the mode control unit 144 described are the same, so repeated descriptions are omitted. In addition, the mode control unit 314 sends a signal corresponding to the set mode from the communication unit 340-2 to the tablet terminal 1-2. For example, when the drawing mode is set, the mode control unit 314 sends a drawing signal from the communication unit 340-2 to the tablet terminal 1-2. On the other hand, when the non-drawing mode is set, the mode control unit 314 sends a non-drawing signal from the communication unit 340-2 to the tablet terminal 1-2.

[0211] (1-5) Drawing Information Update Unit 315

[0212] The function of the drawing information updating unit 315 is the same as that in the first embodiment described above. Figure 8 The function of the rendering information updating unit 145 described above is the same, and therefore duplicate descriptions are omitted. In addition, the rendering information updating unit 315 updates the rendering information stored in the storage unit 330 - 2 .

[0213] (2) Pressure Detection Unit 320-2

[0214] The function of the pressure detection unit 320-2 is the same as that in the first embodiment described above. Fig. 9 The function of the pressure detection unit 320 - 1 described above is the same, so repeated description is omitted.

[0215] (3) Storage Unit 330-2

[0216] The function of the storage unit 330-2 is the same as that in the first embodiment described above. Fig. 9 The functions of the storage unit 330 - 1 described above are the same, so duplicate descriptions are omitted. In addition, the storage unit 330 - 2 stores the drawing information updated by the drawing information update unit 315 .

[0217] (4) Communications Department 340-2

[0218] The function of the communication unit 340-2 is the same as that in the first embodiment described above. Fig. 9 The functions of the communication unit 340-1 described are the same, so repeated descriptions are omitted. In addition, the communication unit 340-2 does not send a signal including pressure information output by the pressure detection unit 320-2 to the tablet terminal 1-2. The communication unit 340-2 sends a drawing signal or a non-drawing signal to the tablet terminal 1-2 according to the mode set by the mode control unit 314. In addition, the communication unit 340-2 receives the pen touch position information and time stamp information sent from the tablet terminal 1-2.

[0219] <4-4. Processing flow>>

[0220] Reference Fig.15 The flow of processing according to the second embodiment will be described. Fig.15 This is a sequence diagram showing an example of the flow of processing according to the second embodiment.

[0221] like Fig.15 As shown, first, the stylus pen 3 - 2 comes into contact with the touch screen 14 of the tablet terminal 1 - 2 through a user's operation (step S300 ).

[0222] When the stylus pen 3 - 2 comes into contact with the touch screen 14 , the pressure detection unit 320 - 2 of the stylus pen 3 - 2 detects the drawing pressure (step S301 ). The pressure detection unit 320 - 2 outputs pressure information indicating the detected drawing pressure.

[0223] In addition, when the stylus pen 3-2 contacts the touch screen 14, the pen touch position detection unit 120-2 of the tablet terminal 1-2 detects the pen touch position and obtains a timestamp (step S302). The pen touch position detection unit 120-2 outputs pen touch position information indicating the detected pen touch position and timestamp information indicating the obtained timestamp. The communication unit 130-2 of the tablet terminal 1-2 sends the pen touch position information and timestamp information output by the pen touch position detection unit 120-2 to the stylus pen 3-2 (step S303).

[0224] The drawing information acquisition unit 311 of the stylus pen 3-2 acquires the current drawing information and the last drawing information (step S304). For example, the drawing information acquisition unit 311 acquires the pressure information output by the pressure detection unit 320-2 in step S301, the pen touch position information and the timestamp information sent from the tablet terminal 1-2 in step S303 as the current drawing information. In addition, the drawing information acquisition unit 311 acquires the drawing information stored in the storage unit 330-2 of the stylus pen 3-2 as the last drawing information.

[0225] The calculation unit 312 of the stylus pen 3-2 calculates the change amount based on the current drawing information and the previous drawing information acquired by the drawing information acquisition unit 311 in step S304 (step S305). Specifically, the calculation unit 312 calculates the difference between the pressure information included in the current drawing information and the pressure information included in the previous drawing information as the change amount of the drawing pressure. In addition, the calculation unit 312 calculates the angle between the coordinates of the pen position indicated by the pen position information included in the current drawing information and the coordinates of the pen position indicated by the pen position information included in the previous drawing information as the change amount of the drawing direction.

[0226] The determination unit 313 of the stylus pen 3-2 performs a pen touch operation determination process based on the change amount calculated by the calculation unit 312 (step S306). The details of the pen touch operation determination process in step S306 are similar to those in the first embodiment. Fig.11 The flow of the processing to be described is the same, so repeated description is omitted.

[0227] The mode control unit 314 of the stylus pen 3-2 controls the mode related to drawing based on the determination result of the determination unit 313 (step S307). Specifically, when the determination unit 313 determines in step S306 that the pen touch operation is an operation to perform drawing, the mode control unit 314 sets the drawing mode. On the other hand, when the determination unit 313 determines in step S306 that the pen touch operation is not an operation to perform drawing, the mode control unit 314 sets the non-drawing mode. After the mode is set, the mode control unit 314 outputs mode information indicating the set mode.

[0228] The drawing information updating unit 315 of the stylus pen 3-2 updates the drawing information stored in the storage unit 330-2 (step S308). Specifically, the drawing information updating unit 315 updates the drawing information stored in the storage unit 330-2 by associating the drawing pressure change amount and the drawing direction change amount calculated by the calculation unit 312 in step S305 and the mode information output by the mode control unit 314 in step S307 with the current drawing information.

[0229] The communication unit 340-2 of the stylus pen 3-2 transmits a signal corresponding to the mode set by the mode control unit 314 to the tablet terminal 1-2 (step S309). Specifically, when the drawing mode is set by the mode control unit 314 in step S307, the communication unit 340-2 transmits the drawing signal to the tablet terminal 1-2. On the other hand, when the non-drawing mode is set by the mode control unit 314 in step S307, the communication unit 340-2 transmits the non-drawing signal to the tablet terminal 1-2.

[0230] The drawing control unit 147 of the tablet terminal 1-2 controls the drawing in the display unit 160-2 of the tablet terminal 1-2 according to the signal received by the communication unit 130-2 of the tablet terminal 1-2 from the stylus 3-2 (step S310). Specifically, when the communication unit 130-2 receives a drawing signal from the stylus 3-2, the drawing control unit 147 outputs the drawing signal to the display unit 160-2. On the other hand, when the communication unit 130-2 receives a non-drawing signal from the stylus 3-2, the drawing control unit 147 outputs the non-drawing signal to the display unit 160-2.

[0231] As described above, the stylus pen 3 - 2 according to the second embodiment includes the drawing information acquisition unit 311 , the calculation unit 312 , the determination unit 313 , and the mode control unit 314 .

[0232] The drawing information acquisition unit 311 acquires drawing information including at least pen touch position information indicating the pen touch position where the pen touch operation is performed on the touch screen 14 and pressure information indicating the drawing pressure applied to the pen touch position.

[0233] The calculation unit 312 calculates the amount of change related to the movement of the pen touch position based on the previous drawing information and the current drawing information acquired by the drawing information acquisition unit 311 .

[0234] The determination unit 313 determines whether the pen touch operation is an operation to execute drawing based on the amount of change calculated by the calculation unit 312 .

[0235] The mode control unit 314 sets a drawing mode for executing drawing related to the brush operation when the brush operation is an operation for executing drawing, and sets a non-drawing mode for not executing drawing related to the brush operation when the brush operation is not an operation for executing drawing.

[0236] With the above configuration, the stylus pen 3 - 2 according to the second embodiment can determine whether a pen touch operation is an operation to perform drawing based on the amount of change calculated from the pen touch position information and pressure information, and set the drawing mode or the non-drawing mode.

[0237] Thus, the stylus pen 3-2 can more accurately determine whether the pen touch operation is an operation to perform drawing than when only drawing pressure is used. Furthermore, the stylus pen 3-2 can also control the switching between the drawing mode and the non-drawing mode with high accuracy by using the more accurate determination result.

[0238] Therefore, the stylus pen 3 - 2 according to the second embodiment can prevent drawing (interfering drawing) by a pen touch operation not intended by the user with high accuracy.

[0239] In addition, in the tablet terminal 1-2 involved in the second embodiment, by preventing the drawing of interference, interference is removed from the drawing formed by handwriting input using the stylus 3-2 with high accuracy. In particular, the accuracy of removing interference caused by drawing on a screen that is easy to slide is improved. Therefore, the drawing result is more preferable. In addition, it is also possible to expect an improvement in the recognition accuracy in handwriting recognition.

[0240] In addition, in the above-mentioned second embodiment, an example is described in which the drawing information updated by the drawing information updating unit 315 of the stylus 3-2 is stored in the storage unit 330-2 of the stylus 3-2, but it is not limited to the above-mentioned example. For example, the drawing information updated by the drawing information updating unit 315 can also be stored in the storage unit 150-2 of the tablet terminal 1-2. In this case, when the drawing information acquisition unit 311 of the stylus 3-2 acquires the drawing information stored in the storage unit 150-2 of the tablet terminal 1-2 as the last drawing information. In addition, when updating the drawing information, the drawing information updating unit 315 of the stylus 3-2 updates the drawing information stored in the storage unit 150-2 of the tablet terminal 1-2.

[0241] In addition, in the second embodiment described above, an example is described in which the stylus pen 3-2 sends a drawing signal to the tablet terminal 1-2 when the drawing mode is set, and sends a non-drawing signal to the tablet terminal 1-2 when the non-drawing mode is set, but the present invention is not limited to the above example. For example, the stylus pen 3-2 may send a drawing signal to the tablet terminal 1-2 when the drawing mode is set, and may not send a signal to the tablet terminal 1-2 when the non-drawing mode is set.

[0242] <<5. Modifications>>

[0243] The second embodiment has been described above. Fig.16 Modifications of each embodiment will be described.

[0244] In the above-mentioned embodiments, examples are described in which the amount of change calculated by the calculation unit 142 and the calculation unit 312 includes the amount of change in the drawing pressure and the amount of change in the drawing direction, but the invention is not limited to the above-mentioned examples. For example, the amount of change calculated by the calculation unit 142 and the calculation unit 312 may also include the amount of change in the pen touch position. The amount of change in the pen touch position is, for example, the distance from the pen touch position detected last time to the pen touch position detected this time, that is, the movement distance of the pen touch position. The calculation unit 142 and the calculation unit 312, for example, calculate the distance between the coordinates of the pen touch position indicated by the pen touch position information included in the current drawing information and the coordinates of the pen touch position indicated by the pen touch position information included in the previous drawing information as the movement distance.

[0245] When the change amount calculated by the calculation unit 142 and the calculation unit 312 also includes the moving distance, the determination unit 143 and the determination unit 313 determine that the pen touch operation is not an operation to be drawn when the decrease amount of the drawing pressure is greater than a predetermined threshold value (first threshold value), the change amount of the drawing direction is greater than a predetermined threshold value (second threshold value), and the moving distance is greater than a predetermined threshold value (third threshold value, for example, 0.5 mm). In this way, the moving distance is also used in the determination of the pen touch operation, so that the determination unit 143 can improve the accuracy of the pen touch operation determination.

[0246] Here, refer to Fig.16 The flow of the pen touch operation determination process when the change amount also includes the movement distance will be described. Fig.16 This is a flowchart showing an example of the flow of pen touch operation determination processing according to a modification. Fig.16 The flowchart shown is relative to Fig.11 The flowchart shown in FIG. 1 adds step S207. Fig.16 Step S200, step S201, step S202, step S203, step S204, and step S206 are shown in Fig.11 The illustrated step S200 , step S201 , step S202 , step S203 , step S204 , and step S206 are the same, so repeated descriptions are omitted.

[0247] exist Fig.16 In the flowchart shown, in step S205 , when the amount of change in the drawing direction is equal to or larger than a predetermined threshold value (step S205 / Yes), the determination unit 143 and the determination unit 313 proceed to step S207 .

[0248] The determination unit 143 and the determination unit 313 determine whether the moving distance is greater than or equal to a predetermined threshold value (third threshold value) (step S207). If the moving distance is greater than or equal to the predetermined threshold value (step S207 / Yes), the determination unit 143 and the determination unit 313 determine that the pen touch operation is not an operation to be drawn (step S201), and the pen touch operation determination process ends. On the other hand, if the moving distance is not greater than or equal to the predetermined threshold value (step S207 / No), the determination unit 143 proceeds to step S206.

[0249] In the above, each embodiment of the present invention has been described.

[0250] In addition, each structure of the tablet terminal 1 and the stylus pen 3 has a computer system inside. In addition, a program for realizing the functions of each structure of the tablet terminal 1 and the stylus pen 3 may be recorded in a computer-readable recording medium, and the computer system may read the program recorded in the recording medium and execute it, thereby performing processing in each structure of the tablet terminal 1 and the stylus pen 3. Here, the so-called "reading the program recorded in the recording medium and executing it" includes installing a program in the computer system. The "computer system" here includes hardware such as OS and peripheral devices.

[0251] In addition, the "computer system" may also include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, or a dedicated line. In addition, the so-called "computer-readable recording medium" refers to a portable medium such as a floppy disk, a magneto-optical disk, a ROM, a CD-ROM, or a recording device such as a hard disk built into the computer system. In this way, the recording medium storing the program may be a non-temporary recording medium such as a CD-ROM.

[0252] In addition, the recording medium also includes an internal or external recording medium that can be accessed from a distribution server in order to distribute the program. In addition, the program can also be divided into multiple pieces, and the structure formed by the combination of the various structures possessed by the tablet terminal 1 and the stylus 3 after downloading at different times, and the distribution server for distributing each of the divided programs is different.

[0253] Moreover, the so-called "computer-readable recording medium" also includes a structure that keeps the program for a certain period of time, such as a server in the case of sending a program via a network, or a volatile memory (RAM) inside a computer system that becomes a client. In addition, the above-mentioned program may also be a structure for realizing a part of the above-mentioned functions. Furthermore, it may also be a so-called differential file (differential program) that can realize the above-mentioned functions by combining them with a program already recorded in a computer system.

[0254] In addition, part or all of the above functions may be implemented as an integrated circuit such as LSI (Large Scale Integration). Each of the above functions may be processed independently, or part or all of them may be integrated for processing. In addition, the method of integrated circuitization is not limited to LSI, and may also be implemented with a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI emerges with the advancement of semiconductor technology, an integrated circuit based on the technology may also be used.

[0255] As mentioned above, although embodiment of this invention is demonstrated in detail with reference to drawings, the specific structure is not limited to the above content, Various design changes etc. can be made within the range which does not deviate from the summary of this invention.

Claims

1. An information processing device comprising: a drawing information acquisition unit that acquires drawing information including at least touch position information and pressure information, wherein the touch position information indicates a touch position where a touch operation is performed on the touch screen, and the pressure information indicates a pressure applied to the touch position; a calculation unit that calculates a change amount related to movement of the touch position based on the first drawing information acquired by the drawing information acquisition unit and the second drawing information acquired after the first drawing information; a determination unit that determines whether the touch operation is an operation to be drawn based on the change amount calculated by the calculation unit; as well as a mode control unit that sets a first mode for executing drawing related to the touch operation when the determination unit determines that the touch operation is an operation for which drawing should be executed, and sets a second mode for not executing drawing related to the touch operation when the determination unit determines that the touch operation is not an operation for which drawing should be executed, The change amount calculated by the calculation unit includes at least a change amount of pressure applied to the touch position and a change amount of a moving direction of the touch position. When the pressure change amount is greater than a first threshold and the pressure drops suddenly, and the moving direction change amount is greater than a second threshold and the moving direction changes suddenly, the determination unit determines that the touch operation is not an operation to perform drawing.

2. The information processing device according to claim 1, wherein: The change amount calculated by the calculation unit further includes a moving distance of the touch position. When the amount of reduction in the pressure is equal to or greater than the first threshold, the amount of change in the moving direction is equal to or greater than the second threshold, and the moving distance is equal to or greater than a third threshold, the determination unit determines that the touch operation is not an operation to perform drawing.

3. The information processing device according to claim 1 or 2, wherein: When the pressure indicated by the pressure information included in the second drawing information is equal to or less than a fourth threshold value and the pressure is extremely low, the determination unit determines that the touch operation is not an operation to perform drawing.

4. The information processing device according to claim 1 or 2, wherein: When it is determined that the touch operation is not an operation to be drawn in the first determination and the pressure in the second determination later than the first determination is not increased compared to the first determination, the determination unit determines that the operation to be drawn continues.

5. The information processing device according to claim 1 or 2, wherein: The determination unit determines that the touch operation is an operation to perform drawing when the pressure increases during a first determination as compared to a second determination that occurs before the first determination.

6. An information processing method, comprising the following steps: The drawing information acquisition unit acquires drawing information including at least touch position information and pressure information, wherein the touch position information indicates a touch position where a touch operation is performed on the touch screen, and the pressure information indicates a pressure applied to the touch position; a calculation unit calculating a change amount related to movement of the touch position based on first drawing information acquired by the drawing information acquisition unit and second drawing information acquired after the first drawing information; A determination unit determines whether the touch operation is an operation to be drawn based on the change amount calculated by the calculation unit. as well as The mode control unit sets a first mode for executing drawing related to the touch operation when the determination unit determines that the touch operation is an operation for which drawing should be executed, and sets a second mode for not executing drawing related to the touch operation when the determination unit determines that the touch operation is not an operation for which drawing should be executed. The amount of change calculated by the calculation unit includes at least an amount of change in pressure applied to the touch position and an amount of change in a moving direction of the touch position. When the pressure change amount is greater than a first threshold and the pressure drops suddenly, and the moving direction change amount is greater than a second threshold and the moving direction changes suddenly, the determination unit determines that the touch operation is not an operation to perform drawing.

Images