Information processing apparatus, information processing system, and control method

Abstract

The information processing apparatus of the present invention includes: a display unit; a touch sensor unit disposed on the screen of the display unit for detecting contact with an object on the screen; an input processing unit for performing acquisition processing, calculation processing, and selection processing, wherein, in the acquisition processing, a plurality of first detection position data on the screen detected by the touch sensor unit at predetermined detection intervals when an operating medium contacts the screen; in the calculation processing, a movement parameter representing the movement of the operating medium is calculated based on the plurality of first detection position data; in the selection processing, a specific smoothing algorithm is selected from a plurality of smoothing algorithms with different processing delays based on the movement parameter and executed; and a display processing unit for displaying the movement trajectory on the screen of the operating medium, which is contacted and moved by the operating medium, on the display unit based on the second detection position data output by the input processing unit.

Description

Technical Field

[0001] This invention relates to information processing apparatus, information processing system, and control method. Background Technology

[0002] In recent years, personal computers and other information processing devices have included devices equipped with input devices for handwriting input. In such information processing devices, it is known that in handwriting input based on the input device, a smoothing process is performed to remove noise from the detected position data to form a smooth drawing, thereby improving the drawing quality (for example, see Patent Document 1).

[0003] Patent document 1: Japanese Patent Application Publication No. 5-165598.

[0004] However, in conventional information processing devices, the more the rendering quality is improved through smoothing, the more delay is generated in the output of the detection position data, making it difficult to perform smoothing appropriately while maintaining an acceptable input delay. Summary of the Invention

[0005] The present invention was made to solve the above-mentioned problems, and its object is to provide an information processing apparatus, an information processing system, and a control method capable of appropriately smoothing the input while maintaining an acceptable input delay.

[0006] To address the aforementioned problems, one aspect of the present invention is an information processing apparatus comprising: a display unit; a touch sensor unit disposed on a screen of the display unit for detecting contact with an object on the screen; an input processing unit for performing acquisition processing, calculation processing, and selection processing, wherein, in the acquisition processing, a plurality of first detection position data on the screen detected by the touch sensor unit at predetermined detection intervals due to contact with an operating medium on the screen; in the calculation processing, based on the plurality of first detection position data, a movement parameter representing the movement of the operating medium during the detection of the plurality of first detection position data is calculated; in the selection processing, based on the movement parameter, a specific smoothing algorithm is selected from a plurality of smoothing algorithms and executed, wherein the plurality of smoothing algorithms are smoothing algorithms that perform noise removal to smooth the depicted movement trajectory, and the plurality of smoothing algorithms represent different processing delay amounts between the specific detected first detection position data and the corresponding smoothed second detection position data; and a display processing unit for displaying on the display unit the movement trajectory on the screen caused by the operating medium contacting and moving on the screen based on the second detection position data output by the input processing unit.

[0007] Alternatively, in the above-described information processing apparatus, the movement parameters include the movement speed of the operating medium on the screen, and the input processing unit selects and executes the smoothing algorithm with different sample delay numbers based on the movement speed.

[0008] Alternatively, in the above-described information processing apparatus, when the moving speed is above a first threshold, the input processing unit is changed to a smoothing algorithm with fewer sample delays than the currently selected smoothing algorithm; and when the moving speed is below a second threshold, the input processing unit is changed to a smoothing algorithm with more sample delays than the currently selected smoothing algorithm.

[0009] Alternatively, in another aspect of the present invention, the first threshold is greater than the second threshold in the aforementioned information processing apparatus.

[0010] Alternatively, in the above-described information processing apparatus, the input processing unit calculates the moving speed using a predetermined number of samples of the plurality of first detection position data, and switches the smoothing algorithm with different sample delay numbers using the predetermined number of samples.

[0011] Alternatively, in another embodiment of the present invention, in the aforementioned information processing apparatus, the smoothing process includes a first smoothing process and a second smoothing process with a sample delay number less than that of the first smoothing process. When the input processing unit changes from the first smoothing process to the second smoothing process, it sets a predetermined sample number transition period and outputs a weighted average of the processing results of the first smoothing process and the processing results of the second smoothing process as the second detection position data during the predetermined sample number transition period. The weighted average is a weighted average in which the weight of the second smoothing process increases as the transition proceeds. When changing from the second smoothing process to the first smoothing process, it sets a transition period of adding one sample number to the predetermined sample number and outputs a weighted average of the processing results of the second smoothing process and the processing results of the first smoothing process as the second detection position data during the predetermined sample number plus one sample number transition period. The weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

[0012] Alternatively, in another aspect of the present invention, the information processing apparatus described above may include a main control unit that performs OS (Operating System) based processing. The main control unit includes the input processing unit and the display processing unit, and the input processing unit is implemented by a device driver attached to the OS.

[0013] Alternatively, in another aspect of the present invention, the information processing apparatus described above may include: a main control unit that performs OS (operating system)-based processing; and an embedded control unit different from the main control unit, wherein the input processing unit is included in the embedded control unit, the display processing unit is included in the main control unit, and the input processing unit outputs the second detection position data to the main control unit.

[0014] Another aspect of the present invention is an information processing apparatus comprising: a display unit; a touch sensor unit disposed on a screen of the display unit for detecting contact with an object on the screen; a memory for temporarily storing a program; and a processor for executing the program stored in the memory. The processor performs the following processing by executing the program stored in the memory: input processing, acquisition processing, calculation processing, and selection processing. In the acquisition processing, it acquires multiple first detection position data on the screen detected by the touch sensor unit at predetermined detection intervals when the object is touched by an operating medium on the screen. In the calculation processing, it calculates a representation of the multiple first detection position data. The movement parameters of the operation medium during the detection of the first detection position data; in the selection process, based on the movement parameters, a specific smoothing algorithm is selected from a plurality of smoothing algorithms and executed, wherein the plurality of smoothing algorithms are smoothing algorithms that remove noise to smooth the depicted movement trajectory, and the plurality of smoothing algorithms indicate that the processing delay amount between the specific first detection position data detected and the corresponding smoothed second detection position data is different; and the display process, based on the second detection position data output by the input process, displays the movement trajectory on the screen on the screen that causes the operation medium to contact and move on the screen on the display unit.

[0015] Another aspect of the present invention is an information processing system comprising: a display unit; a touch sensor unit disposed on a screen of the display unit for detecting contact with an object on the screen; an input processing unit for performing acquisition processing, calculation processing, and selection processing, wherein, in the acquisition processing, a plurality of first detection position data on the screen detected by the touch sensor unit at predetermined detection intervals due to contact with the screen by an operating medium; in the calculation processing, a movement parameter representing the movement of the operating medium during the detection of the plurality of first detection position data is calculated based on the plurality of first detection position data; in the selection processing, a specific smoothing algorithm is selected from a plurality of smoothing algorithms based on the movement parameter and executed, wherein the plurality of smoothing algorithms are smoothing algorithms that perform noise removal to smooth the depicted movement trajectory, and the plurality of smoothing algorithms represent different processing delay amounts between the specific detected first detection position data and the corresponding smoothed second detection position data; and a display processing unit for displaying the movement trajectory on the screen caused by the operating medium contacting and moving on the screen based on the second detection position data output by the input processing unit on the display unit.

[0016] Another aspect of the present invention is a control method for an information processing apparatus comprising a display unit and a touch sensor unit, wherein the touch sensor unit is disposed on the screen of the display unit and detects contact with objects on the screen. The control method includes an input processing step, wherein the input processing unit performs acquisition processing, calculation processing, and selection processing. In the acquisition processing, a plurality of first detection position data on the screen, detected by the touch sensor unit at predetermined detection intervals through contact with an operating medium on the screen, are acquired. In the calculation processing, based on the plurality of first detection position data, the movement of the operating medium during the detection of the plurality of first detection position data is calculated. The selection process includes: a movement parameter; in the selection process described above, a specific smoothing algorithm is selected from multiple smoothing algorithms based on the movement parameter and executed; the multiple smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory; and the multiple smoothing algorithms indicate that the processing delay amount between the specific first detection position data and the corresponding smoothed second detection position data is different; and a display processing step, in which the display processing unit displays the movement trajectory on the screen, which is caused by the operation medium to contact and move on the screen based on the second detection position data output by the input processing step, on the display unit.

[0017] According to the above-described method of the present invention, smoothing can be performed appropriately while maintaining an acceptable input delay. Attached Figure Description

[0018] Figure 1 This is a diagram illustrating an example of the main hardware structure of a notebook PC according to the first embodiment.

[0019] Figure 2 This is a block diagram illustrating an example of the functional structure of a notebook PC according to the first embodiment.

[0020] Figure 3 This is a diagram illustrating an example of the processing delay in the smoothing process of the first embodiment.

[0021] Figure 4 This is a diagram illustrating an example of how the pen's movement speed is generated in the first embodiment.

[0022] Figure 5 This is a diagram illustrating an example of the speed mode for smoothing processing in the first embodiment.

[0023] Figure 6 This is a diagram illustrating an example of the speed mode change processing in the first embodiment.

[0024] Figure 7 This is a diagram illustrating an example of the speed mode change processing in the first embodiment.

[0025] Figure 8 This is a flowchart illustrating an example of pen input processing for a notebook PC according to the first embodiment.

[0026] Figure 9 This is a flowchart illustrating an example of the speed mode change process of a notebook PC according to the first embodiment.

[0027] Figure 10 This is a diagram illustrating a variation of the speed mode change processing of a notebook PC according to the first embodiment.

[0028] Figure 11 This is a graph showing the relationship between the pen's movement speed and noise in the first embodiment.

[0029] Figure 12 This is a block diagram illustrating an example of the functional structure of a notebook PC according to the second embodiment.

[0030] Figure 13 This is a diagram illustrating an example of the main hardware structure of a PC system according to the third embodiment.

[0031] Explanation of reference numerals in the attached figures

[0032] 1, 1a, 1b… Notebook PC; 10, 10a… Main control unit; 20, 52… Touchscreen; 11… CPU; 12… Main memory; 13… Video subsystem; 14, 521… Display unit; 21… Chipset; 22… BIOS memory; 23… HDD; 24… USB connector; 25… Audio system; 26… WLAN card; 31, 31a… Embedded controller; 32… Key input unit; 33… Pointing device; 34… Power supply circuit; 35, 522… Touch sensor unit; 40, 40a… Main storage unit; 41, 323… Speed ​​information storage unit; 42, 324… Mode information storage unit; 50… Digital tablet; 51… Controller; 100… PC system; 110, 110a… Pen input driver; 111, 321… Speed ​​detection processing unit; 112, 322… Smoothing processing unit; 120… Pen input setting unit; 130… Application; 131… Display processing unit; 311… Pen input buffer unit; 320… Pen input processing unit. Detailed Implementation

[0033] Hereinafter, with reference to the accompanying drawings, an information processing apparatus, an information processing system, and a control method according to an embodiment of the present invention will be described.

[0034] [First Implementation Method]

[0035] Figure 1 This diagram illustrates an example of the main hardware structure of the notebook PC1 (notebook-type personal computer) according to the first embodiment. Furthermore, in this embodiment, the notebook PC1 will be described as an example of an information processing device.

[0036] like Figure 1 As shown, the notebook PC1 includes: CPU 11, main memory 12, video subsystem 13, display unit 14, chipset 21, BIOS memory 22, HDD 23, USB connector 24, audio system 25, WLAN card 26, embedded controller 31, key input unit 32, pointing device 33, power circuit 34, and touch sensor unit 35.

[0037] The CPU (Central Processing Unit) 11 performs various calculations and processes through program control, controlling the entire laptop PC1.

[0038] Main memory 12 is a writable memory used as a read-in area for the CPU 11's executable program or as a work area for writing processing data to the executable program. Main memory 12 is, for example, composed of multiple DRAM (Dynamic Random Access Memory) chips. The executable program includes various device drivers, various services / utilities, applications, etc., for hardware operations on the OS (Operating System), peripheral devices, etc.

[0039] The video subsystem 13 is a subsystem for implementing functions related to image display and includes a video controller. The video controller processes drawing commands from the CPU 11, writes the processed drawing information into the video memory, and reads the drawing information from the video memory and outputs it as drawing data (display data) to the display unit 14.

[0040] Display unit 14, for example, is a liquid crystal display or an organic EL (Electro-Luminescence) display, serving as the main screen of notebook PC1, and displays a screen based on the drawing data (display data) output from video subsystem 13.

[0041] Chipset 21 features controllers for USB (Universal Serial Bus), Serial ATA (AT Attachment), SPI (Serial Peripheral Interface), PCI (Peripheral Component Interconnect), PCI-Express, and LPC (Low Pin Count) buses, enabling the connection of multiple devices. Figure 1 In the example of the device, BIOS memory 22, HDD 23, USB connector 24, audio system 25, WLAN card 26 and embedded controller 31 are connected to chipset 21.

[0042] The BIOS (Basic Input Output System) memory 22 is composed of electrically rewritable non-volatile memory such as EEPROM (Electrically Erasable Programmable Read Only Memory) or Flash ROM. The BIOS memory 22 stores system firmware used to control the BIOS and embedded controller 31, etc.

[0043] HDD (Hard Disk Drive) 23 (an example of a non-volatile storage device) stores the OS, various drivers, various services / utilities, applications, and various data.

[0044] USB connector 24 is a connector used to connect peripheral devices that utilize USB.

[0045] The audio system 25 records, reproduces, and outputs sound data.

[0046] The WLAN (Wireless Local Area Network) card 26 connects to the network via a wireless LAN for data communication.

[0047] The embedded controller 31 (an example of an embedded control unit) is a one-chip microcomputer that monitors and controls various devices (peripherals, sensors, etc.) independently of the system state of the notebook PC 1. Furthermore, the embedded controller 31 has power management functions for controlling the power supply circuit 34. In addition, the embedded controller 31 is composed of a CPU, ROM, RAM, etc. (not shown), and has multiple channels of A / D input terminals, D / A output terminals, timers, and digital input / output terminals. The embedded controller 31 controls the operation of devices such as the key input unit 32, the pointing device 33, the power supply circuit 34, and the touch sensor unit 35, which are connected to the embedded controller 31 via these input / output terminals.

[0048] The key input unit 32 is an input device such as a keyboard or touch panel, which accepts key input from the user. In addition, the pointing device 33 is an input device such as a mouse or touch panel, which mainly accepts the designation of the position on the display screen, the designation or selection of the operation object (target) such as operation buttons, etc.

[0049] The power supply circuit 34 includes, for example, a DC / DC converter, a charging / discharging unit, a battery unit, an AC / DC adapter, etc., and converts the DC voltage supplied from the AC / DC adapter or the battery unit into multiple voltages required to operate the laptop PC1. Furthermore, the power supply circuit 34 supplies power to various parts of the laptop PC1 based on control from the embedded controller 31.

[0050] Furthermore, in this embodiment, the CPU 11 and chipset 21 described above correspond to the main control unit 10. The main control unit 10 performs OS-based processing (e.g., Windows (registered trademark)).

[0051] In addition, the display unit 14 and the touch sensor unit 35 correspond to the touch screen 20.

[0052] The touch sensor unit 35, such as a touch panel or other input device, is disposed overlapping with the display unit 14. The touch sensor unit 35 is disposed on the screen of the display unit 14 and detects contact with objects on the screen. The touch sensor unit 35 is touched on the screen, for example, by an operating medium such as a pen, to detect position data indicating the position on the screen of the display unit 14 and the contact pressure of the operating medium on the screen.

[0053] Next, refer to Figure 2 The functional structure of the notebook PC1 according to this embodiment will be described.

[0054] Figure 2 This is a block diagram illustrating an example of the functional structure of a notebook PC1 according to this embodiment.

[0055] like Figure 2 As shown, the notebook PC1 includes: a main control unit 10, a touchscreen 20, an embedded controller (EC) 31, and a main storage unit 40. Furthermore, in Figure 2 In this document, only the main functional structures related to the invention of this embodiment are described as the structure of the notebook PC1.

[0056] The main storage unit 40 is a storage unit implemented by the main memory 12 or HDD 23, which stores various information used by the notebook PC 1. For example, the main storage unit 40 stores working data used in the processing of the pen input driver 110 (described later), the application 130, and setting information of the pen input setting unit 120. The main storage unit 40 includes a speed information storage unit 41 and a mode information storage unit 42.

[0057] The speed information storage unit 41 is, for example, a storage unit implemented by the main memory 12, storing the movement speed of an operating medium such as a pen. Here, the movement speed is the average movement speed per group of a specified number of samples. Details regarding the movement speed of the operating medium such as a pen will be described later.

[0058] The mode information storage unit 42 is, for example, a storage unit implemented by the main memory 12, storing mode information representing the speed mode of the smoothing process described later. The speed modes of the smoothing process include a low-speed mode, a medium-speed mode, and a high-speed mode, and the mode information storage unit 42 stores mode information representing one of the low-speed mode, medium-speed mode, and high-speed mode. Details of the speed modes will be described later.

[0059] The embedded controller 31 is an embedded control unit different from the main control unit 10. The embedded controller 31 acquires multiple detection position data (first detection position data) on the screen of the display unit 14 by touching the screen with an operating medium such as a pen, which is detected by the touch sensor unit 35 at predetermined detection intervals, and stores the acquired multiple detection position data in the pen input buffer unit 311. Furthermore, the embedded controller 31 outputs the detection position data (first detection position data) stored in the pen input buffer unit 311 to the pen input driver 110 according to a request from the pen input driver 110 of the main control unit 10 (described later).

[0060] In addition, the embedded controller 31 has a pen input buffer 311.

[0061] The pen input buffer 311 is, for example, composed of RAM within the embedded controller 31, and stores the detection position data detected by the touch sensor 35 of the touch screen 20 at predetermined detection intervals in a time sequence. The pen input buffer 311, for example, stores the two-dimensional coordinate data on the screen of the display unit 14, which serves as the detection position data, in a corresponding manner with the contact pressure.

[0062] The main control unit 10 is a functional unit that executes programs stored in the main memory 12 via the CPU 11 and chipset 21, and performs various OS-based processing. For example, the main control unit 10 displays the movement trajectory on the screen of an operating medium such as a pen, which is touched and moved by the detection position data output by the embedded controller 31, on the display unit 14. Furthermore, the main control unit 10 includes a pen input driver 110, a pen input setting unit 120, and an application unit 130.

[0063] The pen input driver 110 (an example of an input processing unit) is a functional unit implemented by the CPU 11 and chipset 21, controlling pen input processing (handwriting input processing) based on the touch screen 20. The pen input driver 110 obtains detection position data (first detection position data) on the screen of the display unit 14 detected by the touch sensor unit 35 from the embedded controller 31 and outputs it to the application 130. The pen input driver 110 is a device driver attached to the OS (e.g., Windows (registered trademark)).

[0064] The pen input driver 110 performs smoothing processing based on detection position data (first detection position data) of multiple samples on the screen detected by the touch sensor unit 35 at predetermined detection intervals, and outputs detection position data (second detection position data) as the result of the smoothing processing. Here, the smoothing processing is a filtering process that removes noise to smooth the depicted movement trajectory. In the smoothing processing, a predetermined number of sample delays (processing delay) are generated based on the performance of noise removal (depicting quality). See here... Figure 3The processing delay of the smoothing process is explained.

[0065] Figure 3 This is a diagram illustrating an example of the processing delay in the smoothing process of this embodiment.

[0066] like Figure 3 As shown, the pen input driver 110 generates the Nth smoothed detection position data DO by smoothing a predetermined number of detection position data DI (first detection position data) detected by the touch sensor unit 35. N (Second detection location data). In this case, it is an example of a delay DLY that produces 2 sample numbers compared to the detection location data DI used to generate the data.

[0067] Furthermore, the pen input driver 110 selectively performs smoothing processes with varying processing performance and processing latency based on the drawing conditions based on the detection position data. Here, the drawing conditions include, for example, the pen's movement speed (e.g., the average speed based on multiple detection position data), changes in movement speed (movement acceleration, etc.), changes in the movement angle on the screen, and the drawn shape (curve, straight line, text, etc.). The drawing conditions include movement parameters and the drawn shape (curve, straight line, text, etc.). Movement parameters are parameters representing the movement of the operating medium, such as the pen, during the detection of multiple detection position data (first detection position data), and are parameters related to the movement of the operating medium. Movement parameters include, for example, the pen's movement speed (e.g., the average speed based on multiple detection position data), changes in movement speed (movement acceleration, etc.), changes in the movement angle on the screen, and the drawn shape (curve, straight line, text, etc.).

[0068] The pen input driver 110 selectively performs smoothing processes with different sample delay numbers based on the pen's movement speed (the movement speed of the operating medium on the screen). The pen input driver 110 performs acquisition processing, calculation processing, and selection processing, for example. As an acquisition process, the pen input driver 110 acquires multiple detection position data (first detection position data) detected by the touch sensor unit 35 at predetermined detection intervals. As a calculation process, the pen input driver 110 calculates movement parameters based on the multiple detection position data (first detection position data). As a selection process, the pen input driver 110 selects and executes a specific smoothing algorithm from multiple smoothing algorithms based on the movement parameters. These multiple smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory, and represent different processing delay amounts indicating the delay between the detected specific detection position data (first detection position data) and the corresponding smoothed detection position data (second detection position data).

[0069] In addition, the pen input driver 110 includes a speed detection processing unit 111 and a smoothing processing unit 112.

[0070] The speed detection processing unit 111 is a functional unit that executes the program stored in the main memory 12 by the CPU 11 and chipset 21, and performs processing of the movement speed of the operating medium such as the detection pen on the screen of the display unit 14.

[0071] For example, such as Figure 4 As shown, the speed detection processing unit 111 groups the detection position data (first detection position data) into a predetermined number of samples (e.g., 4 samples) and generates the average moving speed in each group (GP1, GP2, GP3) as the moving speed of the pen. Here, if the distances of each sample in the 4 samples are set as distance d1, distance d2, and distance d3, the moving speed vt in sample t is represented by the following equation (1).

[0072] Formula 1

[0073]

[0074] Here, variable Tstart is the detection time of the first sample, and variable Tend is the detection time of the fourth sample. Therefore, (Tend - Tstart) is the time interval for the detection position data of the group of 4 samples, which corresponds to (sample time interval × 3).

[0075] The speed detection processing unit 111 uses the above formula (1) to generate the moving speed Vt in groups (in units of a specified number of samples), and stores the generated moving speed Vt in the speed information storage unit 41.

[0076] The smoothing unit 112 is a functional unit implemented by the CPU 11 and chipset 21 executing the program stored in the main memory 12, and performs different smoothing processes according to the movement speed Vt. The smoothing unit 112 selects and executes one of two smoothing processes with different sample delay numbers and rendering quality (processing performance) based on the movement speed Vt. Here, see... Figure 5 Here is an example illustrating the movement speed Vt and the speed pattern.

[0077] Figure 5 This is a diagram illustrating an example of the speed mode for smoothing processing in this embodiment.

[0078] exist Figure 5 In this context, "pen movement speed" refers to the range of pen movement speeds Vt mentioned above, and "speed mode" refers to the speed mode corresponding to each range of movement speeds Vt. Additionally, "sample latency" and "description quality" refer to the sample latency and description quality within each speed mode.

[0079] exist Figure 5 In the example shown, the smoothing unit 112 performs smoothing in a low-speed mode when the moving speed Vt is less than a predetermined threshold Vth1 (Vt < Vth1). This low-speed mode is a smoothing process with a sample delay of "2" and a rendering quality of "high".

[0080] Furthermore, when the moving speed Vt is above a predetermined threshold Vth1 but below a predetermined threshold Vth2 (Vth1≤Vt<Vth2), the smoothing unit 112 performs smoothing in a medium-speed mode. Here, the threshold Vth2 is greater than the threshold Vth1. This medium-speed mode is a smoothing process with a sample delay of "1" and a rendering quality of "medium".

[0081] Furthermore, when the moving speed Vt is above a predetermined threshold Vth2 (Vth2≤Vt), the smoothing unit 112 performs smoothing in a high-speed mode. This high-speed mode is a smoothing process with a sample delay of "0" and a rendering quality of "low".

[0082] The smoothing processing unit 112 acquires the moving speed Vt stored in the speed information storage unit 41, and determines whether the acquired moving speed Vt matches the aforementioned... Figure 5 The range of pen movement speed shown determines the corresponding speed mode. The smoothing processing unit 112 stores the mode information representing the determined speed mode in the mode information storage unit 42. Furthermore, the smoothing processing unit 112 performs the process of changing the speed mode each time a movement speed Vt is generated, and therefore performs it in units of groups of detected position data (in units of a predetermined number of samples, for example, every 4 samples).

[0083] Furthermore, whenever the smoothing processing unit 112 acquires samples of detection position data (first detection position data) from the pen input buffer unit 311, it acquires the pattern information stored in the pattern information storage unit 42 and performs smoothing processing corresponding to the speed pattern shown in the acquired pattern information. That is, the smoothing processing unit 112 generates (calculates) the movement speed in units of a predetermined number of samples of multiple detection position data (first detection position data), and switches between smoothing processing algorithms with different sample delay numbers in units of a predetermined number of samples. The smoothing processing unit 112 outputs the smoothed detection position data (second detection position data) to the application 130, for example, via the OS.

[0084] Furthermore, when changing the speed mode, the smoothing processing unit 112 performs the speed mode change during a specified sample number transition period. (See also: [link to relevant documentation]). Figure 6 The details of the speed mode change process from low speed mode (first smoothing process) to medium speed mode (second smoothing process) are explained.

[0085] Figure 6 This diagram illustrates an example of the speed mode change process in this embodiment.

[0086] exist Figure 6 In the middle, from top to bottom, are (a) the detection position data before processing (first detection position data), (b) the processing result of low speed mode, (c) the processing result of medium speed mode, and (d) the detection position data after processing (second detection position data). Each circle represents a sample.

[0087] In addition, Figure 6 In the low-speed mode, the sample delay number for smoothing is "2", while in the medium-speed mode, the sample delay number for smoothing is "1".

[0088] In addition, during the speed mode change process, the smoothing processing unit 112 sets a transfer period CT1 with a number of samples equal to the number of samples in the group (4 samples).

[0089] First, during the low-speed mode LST1, the smoothing processing unit 112 outputs (b) the low-speed mode processing result as (d) the processed detection position data.

[0090] Additionally, during the transfer CT1, the smoothing processing unit 112 outputs a weighted average of (b) the low-speed mode processing result and (c) the medium-speed mode processing result as (d) the processed detection position data. Furthermore, the processed detection position data POT in sample T under this condition is represented by the following equation (2).

[0091] Formula 2

[0092] PO T =w·P1 T +(1-w)·P2 T …(2)

[0093] Here, the detection location data P1 T This is the result of low-speed mode processing; the detection location data is P2. T This is the result of processing in medium-speed mode. Additionally, the variable w represents the weight parameter, which has a value between 0 and 1.

[0094] During the transfer CT1, the smoothing processing unit 112 uses the above-described formula (2) to generate a weighted average of the processing results of the low-speed mode and the processing results of the medium-speed mode as the processed detection position data PO. T Furthermore, as the transfer proceeds, the smoothing unit 112 changes the weight w from 1 to 0, and outputs a weighted average value that increases the weight of the medium-speed mode as the detection position data PO of the smoothing result. T .

[0095] Next, during the medium-speed mode period MST1 after the transfer, the smoothing processing unit 112 outputs (c) the medium-speed mode processing result as (d) the processed detection position data. Furthermore, the detection position data immediately after CT1 during the transfer period has two values ​​due to the reduced sample delay. Figure 6 Sample P2 shown T+3 and sample P2 T+4 Therefore, the smoothing unit 112 can also output either one of the two samples or the average value as the detection position data after (d) processing.

[0096] Next, refer to Figure 7 The details of the speed mode change process from medium speed mode (second smoothing process) to low speed mode (first smoothing process) are explained.

[0097] Figure 7 This diagram illustrates an example of the speed mode change processing in this embodiment.

[0098] exist Figure 7 In the middle, from top to bottom, are (a) the detection location data before processing, (b) the processing result of medium speed mode, (c) the processing result of low speed mode, and (d) the detection location data after processing. Each circle represents a sample.

[0099] In addition, Figure 7 In, with Figure 6 Similarly, the sample delay number for smoothing in low-speed mode is "2", and the sample delay number for smoothing in medium-speed mode is "1".

[0100] In addition, during the speed mode change processing, the smoothing processing unit 112 sets the number of samples in the group + "1" (5 samples) during the transfer period CT2.

[0101] First, during the medium speed mode period MST2, the smoothing processing unit 112 outputs (b) the medium speed mode processing result as (d) the processed detection position data.

[0102] Additionally, during the transfer (CT2), the smoothing unit 112 outputs a weighted average of (b) the processing results of the medium-speed mode and (c) the processing results of the low-speed mode as (d) the processed detection position data. Furthermore, the processed detection position data PO in sample T under this condition... T It is represented by the following formula (3).

[0103]

Formula 3

[0104] PO T =w·P2 T +(1-w)·P1 T …(3)

[0105] Here, the detection location data P1 T This is the result of low-speed mode processing; the detection location data is P2. T This is the result of processing in medium-speed mode. Additionally, the variable w represents the weight parameter, which has a value between 0 and 1.

[0106] During the transfer CT2, the smoothing processing unit 112 uses the above-described formula (3) to generate a weighted average of the processing results of the low-speed mode and the processing results of the medium-speed mode as the processed detection position data PO. T Furthermore, as the transfer proceeds, the smoothing unit 112 changes the weight w from 0 to 1, and outputs a weighted average value that increases the weight of the low-speed mode, which serves as the detection position data PO as the smoothing result. T .

[0107] Furthermore, during the transfer process, CT2 shows an increased sample delay number in the smoothing process of low-speed mode compared to medium-speed mode, therefore a setting is provided. Figure 7 The skipped sample SKP1 is shown. As the skipped sample SKP1, the smoothing processing unit 112 does not output the detection position data POT in the initial sample of CT2 during the transfer. In addition, the smoothing processing unit 112 can also output the (b) medium speed mode processing result as the (d) processed detection position data in the skipped sample SKP1.

[0108] Next, during the low-speed mode LST2 after the transfer, the smoothing processing unit 112 outputs (c) the low-speed mode processing result as (d) the processed detection position data.

[0109] Return to Figure 2 As explained, the pen input setting unit 120 is a functional unit implemented by the CPU 11 and the chipset 21. The pen input setting unit 120 can forcibly change the speed mode described above based on a change request from the user, for example.

[0110] Application 130 is a functional unit implemented by CPU 11 and chipset 21. Application 130 is an application that runs on an OS, for example, an application that performs pen input processing (handwriting input processing) using touch screen 20.

[0111] Application 130 acquires detection position data of display unit 14 output by embedded controller 31 via pen input driver 110, and displays the movement trajectory of pen or other operating medium on the screen as it touches and moves on the screen on display unit 14 based on the acquired detection position data. Application 130 includes display processing unit 131.

[0112] The display processing unit 131 displays the movement trajectory of the pen or other operating medium on the screen as it contacts and moves on the screen, based on the detection position data output by the pen input driver 110, on the display unit 14.

[0113] Next, with reference to the accompanying drawings, the operation of the notebook PC1 according to this embodiment will be described.

[0114] Figure 8 This is a flowchart illustrating an example of pen input processing for a notebook PC1 according to this embodiment.

[0115] like Figure 8 As shown, the laptop PC1 first determines whether the pen is touching the screen of the display unit 14 (the panel of the touch sensor unit 35) (step S101). The embedded controller 31 of the laptop PC1 determines whether there is pen contact on the touch sensor unit 35. If there is pen contact on the touch sensor unit 35 (step S101: Yes), the embedded controller 31 causes the process to proceed to step S102. Otherwise, if there is no pen contact on the touch sensor unit 35 (step S101: No), the embedded controller 31 causes the process to return to step S101.

[0116] In step S102, the embedded controller 31 acquires position data. The embedded controller 31 acquires the detected position data detected by the touch sensor unit 35 and stores it in the pen input buffer unit 311. In addition, the embedded controller 31 outputs event information indicating that the detected position data was detected by the touch sensor unit 35 to the pen input driver 110 of the main control unit 10.

[0117] Next, the pen input driver 110 of the notebook PC1 determines whether there is a change in speed mode or whether it is in the process of mode transition (mode change) (step S103). The smoothing processing unit 112 of the pen input driver 110 obtains the mode information from the mode information storage unit 42 and determines whether it is in the process of mode transition based on flag information indicating whether it has changed since the last time or is in the process of mode transition (not shown). If there is a change in speed mode or if it is in the process of mode transition (step S103: Yes), the smoothing processing unit 112 causes the process to proceed to step S107. Otherwise, if there is no change in speed mode or if it is not in the process of mode transition (step S103: No), the smoothing processing unit 112 causes the process to proceed to step S104.

[0118] In step S104, the smoothing processing unit 112 performs smoothing processing corresponding to the speed mode. That is, the smoothing processing unit 112 performs smoothing processing corresponding to the speed mode shown in the acquired mode information. The smoothing processing unit 112 performs smoothing processing based on, for example, the pen's movement speed. Figure 5The smoothing process is shown in one of the low-speed, medium-speed, and high-speed modes.

[0119] Next, the smoothing processing unit 112 outputs the detection position data of the processing result (step S105). That is, the smoothing processing unit 112 of the pen input driver 110 outputs the detection position data of the processing result to the application 130 via the OS.

[0120] Next, the pen input driver 110 determines whether the pen is in contact with the screen (step S106). If the pen is in contact with the screen (step S106: Yes), the pen input driver 110 returns to step S102 to process the next sample. Otherwise, if the pen is not in contact with the screen (step S106: No), the pen input driver 110 returns to step S101.

[0121] Additionally, in step S107, the smoothing processing unit 112 determines whether it is an upward change in speed mode. If it is an upward change in speed mode (step S107: Yes), the smoothing processing unit 112 proceeds to step S108. If it is not an upward change in speed mode (downward change) (step S107: No), the smoothing processing unit 112 proceeds to step S109.

[0122] In step S108, the smoothing processing unit 112 performs a mode-up transition process. The smoothing processing unit 112 performs the above-described... Figure 6 The speed pattern is changed as shown. The smoothing processing unit 112 sets a transition period and generates a weighted average value as the processed detection position data using the above formula (2) during the transition period. In addition, as the transition proceeds, the smoothing processing unit 112 changes the weight w from 1 to 0 and generates a weighted average value that increases the weight of the speed pattern after the transition. After the processing in step S108, the smoothing processing unit 112 causes the processing to proceed to step S105.

[0123] Additionally, in step S109, the smoothing processing unit 112 performs a mode-down transition process. The smoothing processing unit 112 performs the aforementioned... Figure 7 The speed pattern is changed as shown. The smoothing processing unit 112 sets a transition period and generates a weighted average value as the processed detection position data using the above formula (3) during the transition period. In addition, as the transition proceeds, the smoothing processing unit 112 changes the weight w from 1 to 0 and generates a weighted average value that increases the weight of the speed pattern after the transition. After the processing in step S109, the smoothing processing unit 112 causes the processing to proceed to step S105.

[0124] Next, refer to Figure 9The speed mode change process of the notebook PC1 according to this embodiment will be explained.

[0125] Figure 9 This is a flowchart illustrating an example of the speed mode change process of the notebook PC1 according to this embodiment.

[0126] like Figure 9 As shown, the pen input driver 110 of the notebook PC1 first acquires the position data of one set of quantities (step S201). For example, the pen input driver 110 acquires the detection position data of four samples of quantities from the pen input buffer 311.

[0127] Next, the pen input driver 110 groups the detection position data (step S202). The speed detection processing unit 111 of the pen input driver 110 sets the detection position data of the four samples acquired into one group.

[0128] Next, the speed detection processing unit 111 calculates the moving speed Vt (step S203). The speed detection processing unit 111 uses the above formula (1) to calculate, for example, the average moving speed Vt in a group of four samples. The speed detection processing unit 111 stores the calculated moving speed Vt in the speed information storage unit 41.

[0129] Next, the smoothing processing unit 112 of the pen input driver 110 determines whether the movement speed Vt is within the range of 0 to the threshold Vth1 (0 < Vt < Vth1) (step S204). If the movement speed Vt is less than the threshold Vth1 (step S204: Yes), the smoothing processing unit 112 causes the processing to proceed to step S205. Otherwise, if the movement speed Vt is greater than or equal to the threshold Vth1 (step S204: No), the smoothing processing unit 112 causes the processing to proceed to step S206.

[0130] In step S205, the smoothing processing unit 112 sets the smoothing processing to a low-speed mode. The smoothing processing unit 112 stores the mode information representing the low-speed mode in the mode information storage unit 42 and sets the low-speed mode. After the processing in step S205, the smoothing processing unit 112 returns the processing to step S201.

[0131] In step S206, the smoothing processing unit 112 determines whether the moving speed Vt is within the range of threshold Vth1 above and threshold Vth2 (Vth1 ≤ Vt < Vth2). If the moving speed Vt is within the range of threshold Vth1 above and threshold Vth2 (step S206: Yes), the smoothing processing unit 112 proceeds to step S207. Otherwise, if the moving speed Vt is above threshold Vth2 (step S206: No), the smoothing processing unit 112 proceeds to step S208.

[0132] In step S207, the smoothing processing unit 112 sets the smoothing processing to medium speed mode. The smoothing processing unit 112 stores the mode information representing the medium speed mode in the mode information storage unit 42 and sets the medium speed mode. After the processing in step S207, the smoothing processing unit 112 returns the processing to step S201.

[0133] Additionally, in step S208, the smoothing processing unit 112 sets the smoothing processing to high-speed mode. The smoothing processing unit 112 stores mode information representing the high-speed mode in the mode information storage unit 42 and sets the high-speed mode. After the processing in step S208, the smoothing processing unit 112 returns the processing to step S201.

[0134] Next, refer to Figure 10 A variation of the speed mode change processing of the notebook PC1 according to this embodiment will be described.

[0135] Figure 10 This diagram illustrates a variation of the speed mode change processing of the notebook PC1 according to this embodiment.

[0136] Figure 10 The variation shown is a variation in the speed mode change processing where different thresholds are used for upward and downward changes.

[0137] Figure 10 This represents the state machine used for handling changes in speed mode.

[0138] exist Figure 10 In the upper change process from low-speed mode ST1 to medium-speed mode ST2, the smoothing processing unit 112 changes from low-speed mode ST1 to medium-speed mode ST2 when the movement speed Vt is above the threshold Vth1_up (above the first threshold). Conversely, in the lower change process from medium-speed mode ST2 to low-speed mode ST1, the smoothing processing unit 112 changes from medium-speed mode ST2 to low-speed mode ST1 when the movement speed Vt is below the threshold Vth1_dw (the second threshold). Here, the threshold Vth1_up (the first threshold) is greater than the threshold Vth1_dw (the second threshold).

[0139] Furthermore, in the upward change process from medium-speed mode ST2 to high-speed mode ST3, the smoothing processing unit 112 changes from medium-speed mode ST2 to high-speed mode ST3 when the movement speed Vt is above the threshold Vth2_up (above the first threshold). Conversely, in the downward change process from high-speed mode ST3 to medium-speed mode ST2, the smoothing processing unit 112 changes from high-speed mode ST3 to medium-speed mode ST2 when the movement speed Vt is below the threshold Vth2_dw (the second threshold). Here, the threshold Vth2_up (the first threshold) is greater than the threshold Vth2_dw (the second threshold).

[0140] In this way, the smoothing unit 112 can also be used. Figure 10 The state machine, as shown, changes the speed mode. The smoothing processing unit 112 stores the mode information indicating the speed mode changed using the state machine in the mode information storage unit 42.

[0141] As described above, the notebook PC1 (information processing device) according to this embodiment includes a display unit 14, a touch sensor unit 35, a pen input driver 110 (input processing unit), and a display processing unit 131. The touch sensor unit 35 is disposed on the screen of the display unit 14 and detects contact with objects on the screen. The pen input driver 110 performs smoothing processing and outputs detection position data (second detection position data) as a result of the smoothing processing. Here, the so-called smoothing processing is based on the detection position data (first detection position data) of multiple samples on the screen detected by the touch sensor unit 35 at a predetermined detection interval when the pen or other operating medium touches the screen, and performs noise removal to smooth the drawn movement trajectory. In addition, the pen input driver 110 selectively performs smoothing processing with different processing performance and processing latency based on the drawing conditions based on the detection position data (first detection position data) (e.g., pen movement speed). The pen input driver 110 performs, for example, acquisition processing, calculation processing, and selection processing. As an acquisition process, the pen input driver 110 acquires multiple detection position data (first detection position data) detected by the touch sensor unit 35 at predetermined detection intervals. As a calculation process, the pen input driver 110 calculates movement parameters based on the multiple detection position data (first detection position data). As a selection process, the pen input driver 110 selects a specific smoothing algorithm from multiple smoothing algorithms based on the movement parameters and executes it. The multiple smoothing algorithms represent different processing delays between the specific detection position data (first detection position data) and the corresponding smoothed detection position data (second detection position data). The display processing unit 131 displays the movement trajectory on the screen where the operating medium touches and moves on the screen on the display unit 14 based on the detection position data (second detection position data) output by the pen input driver 110.

[0142] Therefore, according to this embodiment, the notebook PC1 selects smoothing processes with varying processing performance and processing latency based on the drawing conditions (e.g., pen movement speed), thus enabling appropriate smoothing while maintaining acceptable input latency. In other words, the notebook PC1 according to this embodiment can achieve a good balance between improving drawing quality and improving input response.

[0143] also, Figure 11 This is a graph showing the relationship between the pen's movement speed and noise in this embodiment.

[0144] Figure 11 The examples shown represent the sample columns Dhs1 (no noise) and Dhs2 (no noise) of the detection position data when the pen moves quickly (high speed), and the sample columns Dls1 (no noise) and Dls2 (no noise) of the detection position data when the pen moves slowly (low speed).

[0145] Comparing the scenarios with fast pen movement speed (high speed) and slow pen movement speed (low speed), noise is minimal at high pen movement speeds, allowing even low-performance smoothing. Conversely, noise is more noticeable at slow pen movement speeds, requiring high-performance smoothing. Therefore, the notebook PC1 according to this embodiment selects a smoothing method with low processing performance and minimal processing latency when pen movement speed is high, thus maintaining acceptable input latency and performing appropriate smoothing. Furthermore, the notebook PC1 according to this embodiment selects a smoothing method with high processing performance and significant processing latency when pen movement speed is slow, maintaining acceptable input latency and performing appropriate smoothing.

[0146] Furthermore, in this embodiment, the depicted conditions (motion parameters) include the movement speed of the pen or other operating medium on the screen. The pen input driver 110 selects and executes a smoothing process (algorithm) with different sample delay numbers based on the movement speed.

[0147] Therefore, the notebook PC1 according to this embodiment can maintain an acceptable input delay and perform smoothing more appropriately by using the simple method of moving the operating medium such as a pen.

[0148] Furthermore, in this embodiment, when the pen input driver 110 moves at a speed (e.g., moving speed vt) that is above a first threshold (e.g., threshold Vth1_up), it switches to a smoothing algorithm with fewer sample delays than the currently selected smoothing algorithm. When the pen input driver 110 moves at a speed less than a second threshold (e.g., threshold Vth2_dw), it switches to a smoothing algorithm with more sample delays than the currently selected smoothing algorithm. Here, the first threshold (e.g., threshold Vth1_up) is greater than the second threshold (e.g., threshold Vth2_dw) (Vth1_up > Vth2_dw).

[0149] Therefore, according to this embodiment, the change threshold (e.g., Vth1_up > Vth2_dw) in the change to smoothing processing when the movement speed is fast and when the movement speed is slow can prevent useless changes to smoothing processing, such as continuous changes to smoothing processing in a short period of time near the threshold.

[0150] In this embodiment, the smoothing process includes a first smoothing process (e.g., smoothing process in low-speed mode) and a second smoothing process (e.g., smoothing process in medium-speed mode) with a smaller number of sample delays than the first smoothing process. When switching from the first smoothing process to the second smoothing process, the pen input driver 110 sets a transition period (e.g., transition period CT1) with a predetermined number of samples (e.g., 4 samples). During this transition period (e.g., transition period CT1), the pen input driver 110 outputs a weighted average of the processing results of the first and second smoothing processes as the detection position data (second detection position data) of the smoothing process result. This weighted average is a weighted average where the weight of the second smoothing process increases as the transition proceeds. Furthermore, when switching from the second smoothing process (e.g., smoothing process in medium-speed mode) to the first smoothing process (e.g., smoothing process in low-speed mode), the pen input driver 110 sets a transition period CT2 that adds one sample to the predetermined number of samples (e.g., 4 samples). During the transition period CT2, which adds one sample to the specified number of samples, the pen input driver 110 outputs a weighted average of the processing results of the second smoothing process and the processing results of the first smoothing process as the detection position data (second detection position data) of the smoothing process result. This weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

[0151] Therefore, by setting the transition period, the notebook PC1 according to this embodiment can reduce the generation of unnatural and discontinuous rendering when switching to smoothing processing.

[0152] Furthermore, the notebook PC1 in this embodiment includes a main control unit 10, which performs OS-based processing. The main control unit 10 includes a pen input driver 110 and a display processing unit 131. The pen input driver 110 is implemented via a device driver attached to the OS.

[0153] Therefore, the notebook PC1 according to this embodiment can maintain an acceptable input delay and perform appropriate smoothing processing during handwriting input without relying on the application 130 running on the OS.

[0154] Furthermore, the control method according to this embodiment is a control method for a notebook PC1 equipped with a display unit 14 and a touch sensor unit 35 disposed on the screen of the display unit 14 and detecting contact with objects on the screen, including an input processing step and a display processing step. In the input processing step, in which the above-described smoothing processing is performed and the detection position data (second detection position data) of the smoothing processing result is output, the pen input driver 110 selectively performs smoothing processing with different processing performance and processing latency based on the state depicted based on the detection position data (first detection position data). In the display processing step, the display processing unit 131 displays the movement trajectory on the screen of the operating medium that contacts and moves on the screen on the display unit 14 based on the detection position data (second detection position data) output by the input processing step.

[0155] Therefore, the control method according to this embodiment achieves the same effect as the notebook PC1 described above, maintaining an acceptable input delay and performing appropriate smoothing during handwriting input.

[0156] Furthermore, the notebook PC1 (information processing device) according to this embodiment can also be in the following form. The notebook PC1 (information processing device) according to this embodiment includes: a display unit 14; a touch sensor unit 35 disposed on the screen of the display unit 14 and detecting contact with objects on the screen; a memory (e.g., main memory 12) for temporarily storing programs; and a processor (e.g., CPU 11 and chipset 21) for executing programs stored in the memory (e.g., main memory 12). The processor performs input processing and display processing by executing programs stored in the memory. Here, the input processing is the input processing that performs the smoothing processing described above and outputs the detection position data (second detection position data) of the smoothing processing result. It is the processing that selectively performs smoothing processing with different processing performance and processing latency based on the conditions depicted based on the detection position data (first detection position data) (e.g., the movement speed of the pen). The display processing is the processing that displays the movement trajectory on the screen of an operating medium such as a pen that contacts and moves on the screen on the display unit 14 based on the detection position data (second detection position data) output by the input processing. Furthermore, input processing includes, for example, acquiring, calculating, and selecting data. Here, the acquiring process acquires multiple detection position data (first detection position data) detected by the touch sensor unit 35 at predetermined detection intervals. The calculating process calculates movement parameters based on the multiple detection position data (first detection position data). The selecting process selects a specific smoothing algorithm from multiple smoothing algorithms based on the movement parameters and executes it. These multiple smoothing algorithms represent different processing delays between the detected specific detection position data (first detection position data) and the corresponding smoothed detection position data (second detection position data).

[0157] Therefore, the notebook PC1 according to this embodiment can maintain an acceptable input delay and perform appropriate smoothing during handwriting input.

[0158] [Second Implementation]

[0159] Next, with reference to the accompanying drawings, the notebook PC1a according to the second embodiment will be described.

[0160] Figure 12 This is a block diagram illustrating an example of the functional structure of the notebook PC1a according to the second embodiment. Furthermore, the main hardware structure of the notebook PC1a according to this embodiment is similar to that described above. Figure 1 The first embodiment shown is the same, so its description is omitted here.

[0161] In addition, Figure 12 In the middle, regarding the above Figure 2The same structure is given the same reference numerals and its description is omitted.

[0162] In this embodiment, a variation of the smoothing process performed by the pen input driver 110 on the embedded controller 31a will be described in the first embodiment.

[0163] like Figure 12 As shown, the notebook PC1a includes a main control unit 10a, a touchscreen 20, an embedded controller (EC) 31a, and a main storage unit 40a. Furthermore, in Figure 12 In this document, only the main functional structures related to the invention of this embodiment are described, as part of the structure of the notebook PC1a.

[0164] The embedded controller 31a includes a pen input buffer 311 and a pen input processing unit 320.

[0165] The pen input processing unit 320 (an example of an input processing unit) is a functional unit that moves the functions of the speed detection processing unit 111, smoothing processing unit 112, speed information storage unit 41, and pattern information storage unit 42 in the first embodiment from the pen input driver 110 and the main storage unit 40 to the embedded controller 31a. The pen input processing unit 320 is a functional unit that executes programs stored in memory by causing the CPU and memory inside the embedded controller 31a to execute the programs stored in memory. The pen input processing unit 320 includes a speed detection processing unit 321, a smoothing processing unit 322, a speed information storage unit 323, and a pattern information storage unit 324.

[0166] Each of the speed detection processing unit 321, smoothing processing unit 322, speed information storage unit 323, and pattern information storage unit 324 corresponds to each of the speed detection processing unit 111, smoothing processing unit 112, speed information storage unit 41, and pattern information storage unit 42 in the first embodiment. Furthermore, the functions of each of the speed detection processing unit 321, smoothing processing unit 322, speed information storage unit 323, and pattern information storage unit 324 are the same as in the first embodiment, and therefore their descriptions are omitted here.

[0167] The pen input processing unit 320 (smoothing processing unit 322) outputs the detection position data (second detection position data) of the smoothing processing result to the main control unit 10a.

[0168] The main control unit 10a is a functional unit that executes programs stored in the main memory 12 through the CPU 11 and chipset 21, and performs various OS-based processing. The main control unit 10a includes a pen input driver 110a, a pen input setting unit 120, and an application unit 130.

[0169] The pen input driver 110a is a functional unit implemented by the CPU 11 and chipset 21, controlling pen input processing (handwriting input processing) based on the touchscreen 20. The pen input driver 110a acquires detection position data (second detection position data) from the embedded controller 31a after processing by the pen input processing unit 320, and outputs it to the application 130. The pen input driver 110a is a device driver attached to the operating system (e.g., Windows).

[0170] The main storage unit 40a is the same as the main storage unit 40 in the first embodiment, except that it does not have the speed information storage unit 41 and the mode information storage unit 42.

[0171] As described above, the notebook PC1a according to this embodiment includes: a main control unit 10a that executes OS-based processing; and an embedded controller 31a, which is an embedded control unit different from the main control unit 10a. A pen input processing unit 320 (input processing unit) is included in the embedded controller 31a (embedded control unit). The pen input processing unit 320 selectively performs smoothing processing with varying processing performance and processing latency based on the conditions described by the detection position data (first detection position data), and outputs the detection position data (second detection position data) of the processing result of the selectively performed smoothing processing to the main control unit 10a. Furthermore, a display processing unit 131 is included in the main control unit 10a. The display processing unit 131 displays the movement trajectory on the screen of an operating medium such as a pen, which is touched and moved on the screen, on the display unit 14 based on the detection position data (second detection position data) output by the pen input processing unit 320 via the pen input driver 110a.

[0172] Therefore, the notebook PC1a according to this embodiment can maintain an acceptable input delay and perform appropriate smoothing during handwriting input without relying on the device driver (pen input driver 110a) and application 130 executed on the OS.

[0173] [Third Implementation Method]

[0174] Next, with reference to the accompanying drawings, the PC system 100 according to the third embodiment will be described.

[0175] In the first and second embodiments described above, the case of having a touch screen 20 inside the notebook PC1 (1a) for handwriting input such as pen input was described. However, in the third embodiment, a modified example of the case of having handwriting input such as pen input through a PC system 100 having an external digitizer 50 with a touch screen 52 and a notebook PC1b is described.

[0176] Figure 13This is a diagram illustrating an example of the main hardware structure of the PC system 100 according to this embodiment.

[0177] like Figure 13 As shown, the PC system 100 (an example of an information processing system) includes a notebook PC 1b and a graphics tablet 50.

[0178] In addition, Figure 13 In the middle, to and Figure 1 The same structure is given the same reference numerals, and their descriptions are omitted.

[0179] The notebook PC1b (an example of an information processing device) has the same hardware structure as the notebook PC1 (1a) described above, except that it does not have the dots of the touch screen 20 (touch sensor unit 35).

[0180] The digitizer 50 is a tablet terminal capable of handwriting input such as pen input, and it has a controller 51 and a touch screen 52.

[0181] The controller 51 (an example of an embedded control unit) is, for example, a processor containing a CPU, which uniformly controls the digitizer 50. When processing handwriting input such as pen input, the controller 51 performs the same processing as the embedded controller 31 (31a) described above. That is, the controller 51 may also have the same functions as the pen input buffer 311 and the pen input processing unit 320 described above.

[0182] Additionally, the controller 51 is connected to the chipset 21 (main control unit 10 (10a)) via the USB connector 24. The controller 51 uses the USB interface to smooth the detection position data (first detection position data) based on the touch sensor unit 522, and outputs the processed detection position data (second detection position data) to the main control unit 10 (10a).

[0183] The touchscreen 52 includes a display unit 521 and a touch sensor unit 522, and functions similarly to the touchscreen 20 described above. The display unit 521 and touch sensor unit 522 in this embodiment correspond to the display unit 14 and touch sensor unit 35 in the first and second embodiments.

[0184] Display unit 521 is connected to main control unit 10 (10a) via, for example, HDMI (High-Definition Multimedia Interface, registered trademark) or DP (Display Port) and via video subsystem 13. Main control unit 10 (10a) displays the movement trajectory of the operating medium on the screen of display unit 521 based on the detection position data output by controller 51 via HDMI (registered trademark) or DP.

[0185] Next, the operation of the PC system 100 according to this embodiment will be described.

[0186] In this embodiment, instead of the embedded controller 31a of the second embodiment, the controller 51 may have the same function as the pen input processing unit 320, performing smoothing processing. Alternatively, the pen input driver 110 may perform smoothing processing in the same manner as in the first embodiment. Furthermore, the details of smoothing are the same as in the first and second embodiments, so their description is omitted here.

[0187] As described above, the PC system 100 (information processing system) according to this embodiment includes a display unit 521, a touch sensor unit 522, an input processing unit (pen input driver 110 or controller 51), and a display processing unit 131. The touch sensor unit 522 is disposed on the screen of the display unit 521 and detects contact with objects on the screen. The input processing unit (pen input driver 110 or controller 51) selectively performs smoothing processing with different processing performance and processing delay based on the conditions depicted based on the detection position data (first detection position data), and outputs the detection position data (second detection position data) after the smoothing processing has been performed.

[0188] Therefore, the PC system 100 according to this embodiment achieves the same effect as the notebook PC 1 (1a) described above, maintaining an acceptable input delay and performing appropriate smoothing. Furthermore, the PC system 100 according to this embodiment can achieve a good balance between improving drawing quality and input response during handwriting input, independent of the application.

[0189] Furthermore, the present invention is not limited to the embodiments described above, and modifications can be made without departing from the spirit of the present invention.

[0190] For example, in the embodiments described above, the information processing device is described as a notebook PC 1 (1a, 1b), but it is not limited to this. For example, it may also be a tablet terminal device, a desktop PC, a smartphone, or other information processing devices. In addition, the information processing system is not limited to the PC system 100 equipped with the notebook PC 1b, but may also be a system equipped with other information processing devices as described above.

[0191] Furthermore, in the above embodiments, as an example of the depicted situation, an example of using movement speed was described, but it is not limited to this. For example, it could also be the movement speed of the pen (e.g., the average speed based on multiple detection position data, etc.), the change in movement speed (movement acceleration, etc.), the change in the movement angle on the screen, the movement distance in a specified time interval, and the depicted shape (curve, straight line, text, etc.).

[0192] For example, when the described situation is a change in movement speed (movement acceleration, etc.), the input processing unit (pen input driver 110, pen input processing unit 320, or controller 51) may perform smoothing with less delay (number of sample delays) when the change in movement speed increases, and perform smoothing with more delay (number of sample delays) when the change in movement speed decreases.

[0193] Additionally, for example, when the depicted situation involves a change in the movement angle on the screen, the input processing unit (pen input driver 110, pen input processing unit 320, or controller 51) may perform smoothing with a greater delay amount (number of sample delays) when the change in movement angle is large, and perform smoothing with a less delay amount (number of sample delays) when the change in movement angle is small.

[0194] Additionally, for example, when the described situation is the distance traveled within a specified time interval, the input processing unit (pen input driver 110, pen input processing unit 320, or controller 51) may perform smoothing with less delay (number of sample delays) when the travel distance is large, and perform smoothing with more delay (number of sample delays) when the travel distance is small.

[0195] Additionally, for example, when the drawing situation involves drawing shapes (curves, straight lines, text, etc.), the input processing unit (pen input driver 110, pen input processing unit 320, or controller 51) may perform smoothing with less delay (number of sample delays) in the case of straight lines, and perform smoothing with more delay (number of sample delays) in the case of curves or text.

[0196] In addition, the drawing conditions can also be used in combination with the pen movement speed and the various drawing conditions mentioned above.

[0197] Furthermore, in the above embodiments, an example of using a pen was described as an operation medium for handwriting input, but it is not limited to this. For example, other operation media such as the user's finger or a dedicated electronic pen can also be used.

[0198] Furthermore, in the above embodiments, the specified number of samples constituting a group is used as an example, and an example of 4 samples is given. However, it is not limited to this. Groups of 3 or fewer samples or 5 or more samples can also be processed.

[0199] Furthermore, in the above embodiments, there are no particular limitations on the smoothing method, as long as the smoothing performance and the amount of processing delay are different.

[0200] Furthermore, in the above embodiments, examples have been described in which the smoothing process of the present invention is performed by the pen input driver 110, the pen input processing unit 320 of the embedded controller 31a, or the controller 51, but it is not limited to this. For example, the smoothing process of the present invention may also be performed in application 130.

[0201] Furthermore, each of the aforementioned notebook PC1 (1a) and PC system 100 has an internal computer system. Moreover, programs for implementing the functions of the aforementioned notebook PC1 (1a) and PC system 100 can be recorded on a computer-readable recording medium, and the processing within the aforementioned notebook PC1 (1a) and PC system 100 can be performed by having the computer system read and execute the program recorded on the recording medium. Here, "having the computer system read and execute the program recorded on the recording medium" includes installing programs in the computer system. The term "computer system" here includes hardware such as the operating system and peripheral devices.

[0202] Furthermore, a "computer system" can also include multiple computer devices connected via networks including the Internet, WAN, LAN, and dedicated lines. Additionally, "computer-readable recording media" refers to portable media such as floppy disks, optical disks, ROMs, and CD-ROMs, as well as storage devices such as hard drives built into computer systems. Thus, recording media storing programs can be non-transitory recording media such as CD-ROMs.

[0203] Furthermore, the recording medium also includes internal or external recording media that can be accessed from a distribution server for distributing the program. Additionally, the program can be divided into multiple parts and downloaded at different times, forming a structure comprised of various components of the laptop PC1 (1a) and the PC system 100, with each part distributed via a different distribution server. Moreover, the term "computer-readable recording medium" also includes structures that retain the program for a certain period, such as a server in the case of sending the program over a network or volatile memory (RAM) within the computer system acting as a client. Furthermore, the program described above can also be a structure used to implement the aforementioned functions. Further, it can also be a so-called differential file (differential program) that can be implemented by combining the aforementioned functions with a program already recorded in the computer system.

[0204] Alternatively, some or all of the above functions can be implemented as integrated circuits such as LSI (Large Scale Integration). The functions described above can be processed independently or partially or completely integrated. Furthermore, the method of integrated circuit implementation is not limited to LSI; it can also be implemented using dedicated circuits or general-purpose processors. Additionally, if advancements in semiconductor technology lead to integrated circuit technologies that replace LSI, integrated circuits based on these technologies can also be used.

Claims

1. An information processing device, comprising: Display section; A touch sensor unit is disposed on the screen of the display unit to detect contact with objects on the screen; The input processing unit performs acquisition processing, calculation processing, and selection processing, among which... In the acquisition process, multiple first detection position data on the screen are acquired by the touch sensor unit at a predetermined detection interval, which are obtained by contacting the screen through an operating medium. In the computational process, based on the plurality of first detection position data, a movement parameter representing the movement of the operating medium during the detection of the plurality of first detection position data is calculated; In the selection process, based on the movement parameters, a specific smoothing algorithm is selected from a plurality of smoothing algorithms and executed. The plurality of smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory. The plurality of smoothing algorithms indicate that the amount of processing delay between the specific first detection position data detected and the corresponding smoothed second detection position data is different. as well as The display processing unit, based on the second detection position data output by the input processing unit, displays the movement trajectory of the operating medium on the screen as it contacts and moves on the screen on the display unit. The motion parameters include the movement speed of the operating medium on the screen. The input processing unit selects and executes smoothing algorithms with different sample delay numbers based on the moving speed. The input processing unit calculates the moving speed using a predetermined number of samples from the plurality of first detection position data, and switches between smoothing algorithms with different sample delay numbers, also using the predetermined number of samples. The smoothing process includes a first smoothing process and a second smoothing process in which the number of sample delays is less than that of the first smoothing process. When the input processing unit switches from the first smoothing process to the second smoothing process, it sets a predetermined sample number transition period. During this predetermined sample number transition period, it outputs a weighted average of the processing results of the first smoothing process and the processing results of the second smoothing process as the second detection position data. This weighted average is a weighted average in which the weight of the second smoothing process increases as the transition proceeds. When the input processing unit changes from the second smoothing process to the first smoothing process, it sets a transition period of adding one sample number to the predetermined number of samples. During the transition period after adding one sample number to the predetermined number of samples, it outputs the weighted average of the processing result of the second smoothing process and the processing result of the first smoothing process as the second detection position data. The weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

2. The information processing apparatus according to claim 1, wherein, If the moving speed is above a first threshold, the input processing unit changes to a smoothing algorithm where the number of sample delays is less than the currently selected smoothing algorithm. If the moving speed is less than the second threshold, the input processing unit changes to a smoothing algorithm whose sample delay number is greater than the currently selected smoothing algorithm.

3. The information processing apparatus according to claim 2, wherein, The first threshold is greater than the second threshold.

4. The information processing apparatus according to any one of claims 1 to 3, wherein, It has a main control unit that performs OS (Operating System) based processing. The main control unit includes the input processing unit and the display processing unit. The input processing unit is implemented through a device driver attached to the OS.

5. The information processing apparatus according to any one of claims 1 to 3, wherein have: The main control unit that executes OS-based processing; and An embedded control unit, different from the main control unit, The input processing unit is included in the embedded control unit. The display processing unit is included in the main control unit. The input processing unit outputs the second detection position data to the main control unit.

6. An information processing device, comprising: Display section; A touch sensor unit is disposed on the screen of the display unit to detect contact with objects on the screen; a memory, temporarily storing a program; as well as The processor executes the program stored in the memory. The processor performs the following processing by executing the program stored in the memory: The input processing includes acquisition processing, calculation processing, and selection processing. In the acquisition processing, multiple first detection position data on the screen are acquired and detected by the touch sensor at predetermined detection intervals when the operating medium contacts the screen. In the calculation processing, based on the multiple first detection position data, movement parameters representing the movement of the operating medium during the detection of the multiple first detection position data are calculated. In the selection processing, based on the movement parameters, a specific smoothing algorithm is selected from multiple smoothing algorithms and executed. These multiple smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory, and the multiple smoothing algorithms represent different processing delay amounts between the detected specific first detection position data and the corresponding smoothed second detection position data. The display processing, based on the second detection position data output through the input processing, displays the movement trajectory of the operating medium on the screen as it contacts and moves on the screen on the display unit. The motion parameters include the movement speed of the operating medium on the screen. In the input processing, the processor Based on the moving speed, select and execute the smoothing algorithm with different sample delay numbers. The moving speed is calculated using a predetermined number of samples from the plurality of first detection position data, and the smoothing algorithms with different sample delay numbers are switched using the predetermined number of samples. The smoothing process includes a first smoothing process and a second smoothing process in which the number of sample delays is less than that of the first smoothing process. In the input processing, the processor When switching from the first smoothing process to the second smoothing process, a specified number of sample transition periods are set. During this specified number of sample transition periods, the weighted average of the processing results of the first smoothing process and the processing results of the second smoothing process is output as the second detection position data. This weighted average is a weighted average in which the weight of the second smoothing process increases as the transition proceeds. When switching from the second smoothing process to the first smoothing process, a transition period of adding 1 sample number to the specified number of samples is set. During the transition period after adding 1 sample number to the specified number of samples, the weighted average of the processing results of the second smoothing process and the processing results of the first smoothing process is output as the second detection position data. This weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

7. An information processing system, comprising: Display section; A touch sensor unit is disposed on the screen of the display unit to detect contact with objects on the screen; The input processing unit performs acquisition processing, calculation processing, and selection processing, among which... In the acquisition process, multiple first detection position data on the screen are acquired by the touch sensor unit at a predetermined detection interval, which are obtained by contacting the screen through an operating medium. In the computational processing, based on the plurality of first detection position data, a movement parameter representing the movement of the operating medium during the detection of the plurality of first detection position data is calculated; In the selection process, based on the movement parameters, a specific smoothing algorithm is selected from a plurality of smoothing algorithms and executed. The plurality of smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory. The plurality of smoothing algorithms indicate that the amount of processing delay between the specific first detection position data detected and the corresponding smoothed second detection position data is different. as well as The display processing unit, based on the second detection position data output by the input processing unit, displays the movement trajectory of the operating medium on the screen as it contacts and moves on the screen on the display unit. The motion parameters include the movement speed of the operating medium on the screen. The input processing unit selects and executes smoothing algorithms with different sample delay numbers based on the moving speed. The input processing unit calculates the moving speed using a predetermined number of samples from the plurality of first detection position data, and switches between smoothing algorithms with different sample delay numbers, also using the predetermined number of samples. The smoothing process includes a first smoothing process and a second smoothing process in which the number of sample delays is less than that of the first smoothing process. When the input processing unit switches from the first smoothing process to the second smoothing process, it sets a predetermined sample number transition period. During this predetermined sample number transition period, it outputs a weighted average of the processing results of the first smoothing process and the processing results of the second smoothing process as the second detection position data. This weighted average is a weighted average in which the weight of the second smoothing process increases as the transition proceeds. When the input processing unit changes from the second smoothing process to the first smoothing process, it sets a transition period of adding one sample number to the predetermined number of samples. During the transition period after adding one sample number to the predetermined number of samples, it outputs the weighted average of the processing result of the second smoothing process and the processing result of the first smoothing process as the second detection position data. The weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

8. A control method is a control method for an information processing device having a display unit and a touch sensor unit, wherein the touch sensor unit is disposed on the screen of the display unit and detects contact with an object on the screen, the control method comprising: The input processing steps include an input processing unit performing acquisition processing, calculation processing, and selection processing. In the acquisition processing, multiple first detection position data on the screen are acquired and detected by the touch sensor unit at predetermined detection intervals when the operating medium touches the screen. In the calculation processing, based on the multiple first detection position data, a movement parameter representing the movement of the operating medium during the detection of the multiple first detection position data is calculated. In the selection processing, based on the movement parameter, a specific smoothing algorithm is selected from multiple smoothing algorithms and executed. The multiple smoothing algorithms are algorithms that perform noise removal to smooth the depicted movement trajectory, and the multiple smoothing algorithms represent different processing delay amounts between the detected specific first detection position data and the corresponding smoothed second detection position data. In the display processing step, the display processing unit displays the movement trajectory of the operating medium on the screen as it contacts and moves on the screen, based on the second detection position data output through the input processing step. The motion parameters include the movement speed of the operating medium on the screen. In the input processing step, The input processing unit selects and executes smoothing algorithms with different sample delay numbers based on the moving speed. The input processing unit calculates the moving speed using a predetermined number of samples from the plurality of first detection position data, and switches between smoothing algorithms with different sample delay numbers, also using the predetermined number of samples. The smoothing process includes a first smoothing process and a second smoothing process in which the number of sample delays is less than that of the first smoothing process. In the input processing step, When the input processing unit switches from the first smoothing process to the second smoothing process, it sets a predetermined sample number transition period. During this predetermined sample number transition period, it outputs a weighted average of the processing results of the first smoothing process and the processing results of the second smoothing process as the second detection position data. This weighted average is a weighted average in which the weight of the second smoothing process increases as the transition proceeds. When the input processing unit changes from the second smoothing process to the first smoothing process, it sets a transition period of adding one sample number to the predetermined number of samples. During the transition period after adding one sample number to the predetermined number of samples, it outputs the weighted average of the processing result of the second smoothing process and the processing result of the first smoothing process as the second detection position data. The weighted average is a weighted average in which the weight of the first smoothing process increases as the transition proceeds.

Images