Cursor Detection in Frame Buffer Data for Remote Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile computing devices face challenges in efficiently determining the active input area on a remote environment's display, particularly when users interact with the device while distracted, such as while driving, due to the processing overhead of frame buffer analysis, which can diminish the user experience.

Innovation Solution

The method involves processing frame buffer data to identify the active text input area by detecting a cursor within defined display regions, reducing processing overhead by analyzing only relevant areas and transmitting coordinates and dimensions to the remote environment, allowing the active input area to be highlighted for easier user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If frame buffer analysis is performed to determine the active input area on a remote display, then the accuracy of identifying the active text input area is improved, but the processing overhead increases

Engineering Contradiction:
Improveaccuracy of identifying active text input areaVSAvoidprocessing overhead
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent divides the display into multiple display regions and selectively analyzes only the frame buffer data corresponding to regions where text input is detected, rather than analyzing the entire frame buffer. This segmentation approach reduces processing overhead while maintaining accurate identification of the active input area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different display regions based on whether text input is detected in each region. By focusing analysis only on regions with text input activity, the system optimizes processing resources locally, reducing overall processing overhead while maintaining precision in identifying active input areas.

Inventive Principle:
Principle #3Local quality

2Reliability

If the entire frame buffer is analyzed to detect cursor position, then the completeness of cursor detection is improved, but the processing time increases

Engineering Contradiction:
Improvecompleteness of cursor detectionVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the frame buffer analysis by first identifying display regions containing text input, then analyzing only those specific regions for cursor presence. This approach maintains reliable cursor detection while significantly reducing processing time compared to analyzing the entire frame buffer.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs partial frame buffer analysis by focusing only on the subset of regions where text input is detected, rather than performing complete analysis of the entire display. This partial action approach maintains sufficient reliability for cursor detection while reducing processing time.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If cursor detection is performed on all display regions, then the accuracy of active input area identification is improved, but the computational load increases

Engineering Contradiction:
Improveaccuracy of active input area identificationVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the computational task by first determining which display regions contain text input, then performing cursor detection only in those regions. This segmentation reduces computational load while maintaining accurate identification of active input areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies cursor detection with high computational quality only to local regions where text input is present, rather than uniformly applying analysis across the entire display. This localized approach reduces overall computational load while maintaining precision.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9690599B2Method and apparatus for determining an active input area
Publication Date: 2017.06.27 NOKIA TECHNOLOGIES OY
  • US9690599B2 patent drawing
  • US9690599B2 patent drawing
  • US9690599B2 patent drawing

AI summary

Various methods for determining an active input area are provided. One example method includes acquiring frame buffer data defining an image area that has been refreshed and detecting a cursor within the frame buffer data. Detecting the cursor may include determining that dimensions of the image area match dimensions of a previously acquired image area associated with a successful cursor detection, and the example method may further include directing transmission of coordinates and dimensions of the image area to a remote environment. Similar and related example methods and example apparatuses are also provided.