Embedded Controller Predicts Touch Trajectory to Reduce Display Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing apparatuses with handwriting input devices face significant input-to-display delays due to the need for the operating system to predict and display movement trajectories, which can be inefficient and delay the display of input data.

Innovation Solution

An information processing apparatus is designed with a touch sensor on the screen to detect input positions and an embedded controller that predicts subsequent input positions based on detected positions at predetermined intervals, reducing the need for the OS to predict and thereby minimizing input-to-display delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the operating system predicts and displays movement trajectories for handwriting input, then the display shows input trajectories, but the input-to-display delay increases

Engineering Contradiction:
Improveinput-to-display delayVSAvoidprediction processing complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The prediction function is extracted from the operating system and transferred to the embedded controller. The embedded controller independently predicts subsequent input positions based on detected input positions and generates movement trajectories, while the OS only receives the predicted trajectory data for display. This extraction reduces the OS's processing burden and eliminates the delay caused by OS-level prediction processing.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The embedded controller performs prediction processing in advance by calculating subsequent input positions based on detected input positions before the OS needs to display them. The predicted trajectory data is prepared beforehand and transferred to the OS, allowing the display to show trajectories without waiting for OS-level prediction, thereby reducing input-to-display delay.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the operating system performs prediction processing for handwriting input, then movement trajectories are displayed, but the processing efficiency decreases

Engineering Contradiction:
Improvehandwriting input processing efficiencyVSAvoidinput-to-display delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The handwriting input processing system is segmented into two independent functional modules: the embedded controller handles prediction processing and trajectory generation, while the OS handles display management. This segmentation allows parallel processing where the embedded controller performs prediction independently while the OS prepares display resources, improving overall processing efficiency and reducing delays.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The embedded controller acts as an intermediary between the touch sensor and the OS. It receives raw input position data from the touch sensor, performs prediction processing to generate trajectories, and then transfers the processed trajectory data to the OS for display. This intermediary role improves efficiency by filtering and preprocessing data before it reaches the OS, reducing the OS's processing burden and eliminating delays.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11392240B2Information processing apparatus, information processing system, and control method
Publication Date: 2022.07.19 LENOVO (SINGAPORE) PTE LTD
  • US11392240B2 patent drawing
  • US11392240B2 patent drawing
  • US11392240B2 patent drawing

AI summary

An information processing apparatus includes a display, a touch sensor disposed on a screen of the display unit detects an input position by an input medium on the screen, a main controller, and an embedded controller. The embedded controller predicts a subsequent input position of the input medium based on detected input positions of the input medium detected by the touch sensor at predetermined detection intervals, and output, to the main controller, the predicted subsequent input position as part of the detected input positions detected by the touch sensor. The main controller, based on the plurality of detected input positions received from the embedded controller, display a movement trajectory of the input medium on the screen.