Reflowable Document Inking for Layout-Resilient Annotations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to effectively preserve and display user inking marks on reflowable content when the layout of the content changes, often losing the original context and flexibility of the document.
Innovation Solution
A system that captures and stores user inking inputs as images and ink strokes, allowing them to be displayed inline or as pointer icons in modified contexts, while maintaining the original context and reflowability of the content, even when the layout changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If inking data is stored separately from original document data, then inking marks can be preserved, but the system complexity increases and flexibility is lost
Solution Approach 1:
The patent combines inking data with original document data into a single integrated data structure. The inking input is stored as part of the document's content model, with spatial relationships maintained through coordinate systems that reference the original content. This eliminates the need for separate storage mechanisms while preserving all inking marks through the unified data structure.
Solution Approach 2:
The patent creates a universal data structure that handles both original document content and inking marks through the same system. The content model can represent various types of content (text, images, drawings) and inking inputs (freehand drawing, selection, annotation) using consistent data elements, allowing the system to manage diverse content types without requiring specialized storage for each type.
2Adaptability or versatility
If inking marks are displayed inline with reflowable content, then flexibility is maintained, but the display complexity increases when layout changes
Solution Approach 1:
The patent implements a dynamic display system where inking marks are rendered based on the current layout context. The system continuously monitors layout changes and automatically adjusts the display of inking marks to maintain their spatial relationships with the underlying content. This dynamic approach allows inking marks to remain inline with reflowable content while automatically adapting to layout changes without requiring complex manual intervention.
Solution Approach 2:
The patent changes the parameter of spatial reference from fixed coordinates to relative coordinates that adapt to layout changes. By storing inking mark positions as offsets or relative positions to content elements rather than absolute screen coordinates, the system maintains the flexibility of reflowable content while simplifying the display logic, as the inking marks automatically reposition themselves when the layout changes.
3Manufacturing precision
If inking input is captured as images, then visual fidelity is improved, but the file size and processing requirements increase
Solution Approach 1:
The patent segments inking input data into multiple representation formats stored within the same data structure. The system captures both the visual image data of inking marks and the vector-based stroke data (coordinate points, pressure information, stroke sequences). This segmentation allows the system to use the appropriate representation based on the context - vector data for scalable editing and image data for high-fidelity display - without requiring both formats to be stored at full resolution simultaneously, thus reducing overall data requirements while maintaining visual fidelity.
Data Source
AI summary
Various systems and methods for inking reflowable content are described herein. In an example, the system includes a processor and storage with instructions that in response to execution on the processor cause the processor to identify inking input. In an example, the inking input is identified in a content area of a reflowable document. In an example, the system capture an image of the inking input and the content area indicated by the inking input. In an example, the system may also capture an ink stroke of the inking input. The ink stroke of the inking input and the image of the inking input and content area can be provided for display in response to a detection that the reflowable document is being displayed in a modified context.