Universal Inking Support for Computing Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing devices often lack universal support for inking input across various applications, leading to limitations in annotating displayed content, as only a subset of applications natively support inking, and existing solutions fail to dynamically update ink positions with changes in the underlying content, deterring user experience.
Innovation Solution
A computing device with a display, input sensor, and processor that receives inking input and adjusts the presentation of ink based on changes in the displayed content by comparing visual frames, ensuring the ink remains associated with the underlying application features, even during scrolling, zooming, or rotation, allowing users to annotate content spontaneously across any application.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a computing device provides inking support only for applications that natively support inking, then the native inking functionality is maintained, but the versatility of inking across all applications is limited
Solution Approach 1:
The patent implements a universal inking system that works across all applications regardless of whether they natively support inking. The operating system provides a unified inking infrastructure that can annotate any displayed content, making inking functionality universal rather than application-specific. This resolves the contradiction by enabling inking versatility without requiring each application to implement its own inking support.
Solution Approach 2:
The patent introduces an intermediary inking layer between the input sensor and the application content. This intermediary component captures inking input and dynamically associates it with the underlying content through frame comparison, acting as a mediator that translates inking strokes into content-anchored annotations. This resolves the complexity issue by centralizing the inking coordination logic rather than distributing it across multiple applications.
2Reliability
If inking position is fixed relative to the display, then the ink remains visible, but the ink becomes misaligned when the displayed content changes through scrolling or zooming
Solution Approach 1:
The patent implements a feedback mechanism that continuously monitors the displayed content through frame comparison and uses this information to dynamically adjust ink positions. The system compares current display frames with previous frames to detect content changes (scrolling, zooming, panning) and automatically updates ink coordinates to maintain alignment with the underlying content. This feedback loop ensures reliable ink-content alignment without requiring complex manual tracking.
Solution Approach 2:
The patent transforms the static ink positioning model into a dynamic one where ink positions are continuously updated based on content changes. Instead of fixed display coordinates, the system uses relative positioning that adapts to content transformations. The ink annotation dynamically follows the content through scrolling and zooming operations, maintaining alignment while reducing the need for complex position tracking algorithms.
3Ease of operation
If the system requires a separate inking mode to be activated, then inking functionality can be isolated, but spontaneous annotation capability is reduced
Solution Approach 1:
The patent performs preliminary setup by establishing the inking infrastructure and frame comparison mechanism in advance, so that inking can be activated immediately without requiring users to switch modes or configure settings. The system is pre-configured to capture inking input and automatically associate it with displayed content, eliminating the need for separate inking mode activation and enabling spontaneous annotation.
Solution Approach 2:
The patent merges the inking functionality with the general display and input handling systems. Instead of separating inking into a distinct mode or application layer, the system integrates inking capture, frame comparison, and ink positioning into the core operating system functions. This merging allows users to annotate spontaneously during normal application use without mode switching, while the complexity is managed through unified system-level processing.
Data Source
Figure 1
Figure 2A~2B
Figure 3A~3B
AI summary
Examples are disclosed for using and tracking inking input applied to applications of a computing device. An example computing device includes a display, an input sensor configured to receive inking input, a processor, and a storage device storing instructions executable by the processor to receive visual frames from an executing application indicating displayed content for the executing application, and, present displayed ink on a first location of the display based at least on an inking input received via the input sensor. The instructions are further executable to detect a change in the displayed content for the executing application based at least on a comparison of two or more of the visual frames from the executing application, determine a second location of the displayed ink on the display based at least on the change in the displayed content, and present the displayed ink in the second location of the display.