Handwritten Formula Editing via Ink-to-Typeset Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional user interfaces for editing mathematical formulas on electronic devices are cumbersome, particularly when dealing with typeset fonts on display devices, as they lack efficient tools for composing and revising symbols.
Innovation Solution
A system that generates a first rendering of symbols in typeset font, allows user selection and handwritten edits, recognizes these edits, and updates the selection, displaying the changes in typeset font, enabling intuitive editing of mathematical formulas using a touchscreen interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a conventional keyboard is used to compose mathematical formulas, then the input method is precise, but the ease of operation deteriorates due to cumbersome typing process
Solution Approach 1:
The patent replaces the mechanical keyboard input system with a touchscreen handwriting recognition system. Users write mathematical formulas directly on the touchscreen using their fingers or stylus, and the system recognizes and converts these handwritten markings into formatted mathematical symbols and equations, eliminating the need for physical keyboard typing.
Solution Approach 2:
The system creates a digital copy of the user's handwritten markings and transforms it into the desired mathematical notation format. The handwriting recognition system captures the essence of the handwritten input and generates the corresponding structured mathematical representation, allowing users to compose formulas intuitively without typing.
2Ease of operation
If typeset font is used to render mathematical formulas on display devices, then the visual quality is improved, but the ease of operation deteriorates due to difficulty in revising the rendered formulas
Solution Approach 1:
The system dynamically switches between two rendering modes: typeset font rendering for high visual quality and ink font rendering for easy editing. When users need to revise a formula, the system converts the typeset rendering into an ink font version that accepts direct handwriting edits, then converts the edits back to typeset format, providing a dynamic adaptation to user needs.
Solution Approach 2:
The ink font rendering acts as an intermediary layer between the typeset font display and the user's editing input. It translates the user's handwritten markings into modifications of the underlying mathematical structure, which are then reflected in the typeset display, bridging the gap between visual quality and editability.
3Ease of operation
If handwritten markings are used to edit rendered symbols, then the ease of operation is improved, but the measurement precision deteriorates due to difficulty in recognizing handwritten edits
Solution Approach 1:
The system performs preliminary actions by first rendering the mathematical formula in ink font rather than typeset font when edits are needed. This preliminary rendering in a more editable format prepares the system to receive and process handwritten markings more effectively, improving the recognition accuracy of the edits before final conversion to typeset format.
Data Source
AI summary
A first rendering of symbols is generated with typeset font, and the first rendering is displayed by a display device. From among the symbols, a selection is received from a user. A second rendering of the selection is generated with ink font, and the second rendering is displayed by the display device. At least one handwritten edit to the second rendering is received from the user, and recognition of the handwritten edit is performed. The selection is updated to incorporate the recognized handwritten edit. A third rendering of the updated selection is generated with typeset font, and the third rendering is displayed by the display device for replacing at least a portion of the first rendering.