Gesture-Based Markup Generation for Irregular Text Flow

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing software requires significant user effort to flow text around irregularly shaped images, as users must manually specify the image boundary or insert tabs and spaces, making the process difficult and time-consuming.

Innovation Solution

A system that uses gesture input to generate markup language code, allowing content elements to be automatically positioned relative to the image contour, with a sensing mechanism processing touch or pointing device data to create HTML div elements with adjusted margins, enabling text to flow naturally around the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a user manually specifies the irregular boundary of an image using a mouse to create curves, then text can flow around the image, but the process becomes very difficult and time-consuming

Engineering Contradiction:
Improvetext positioning accuracyVSAvoidtime to create text flow
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical mouse-drawing system with a gesture-based touch interface. Users draw gestures directly on the screen with their finger or stylus, and the system automatically converts these gestures into text flow boundaries. This substitution eliminates the complexity of manually creating curves with a mouse while maintaining positioning accuracy, significantly reducing the time required to achieve text flow around images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs automatic boundary detection and text flow generation based on user gestures. Instead of requiring users to manually specify every boundary point, the system uses the gesture as a reference and automatically computes the optimal text flow path around the image, reducing manual effort while maintaining precision.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If a user inserts tabs and spaces into text to manually move where each line starts and/or ends, then text positioning can be adjusted, but the process becomes time-consuming

Engineering Contradiction:
Improvetext positioning controlVSAvoidtime to adjust text lines
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the manual tab-and-space adjustment mechanism with a gesture-based system. Users draw a gesture around the image, and the system automatically calculates and applies the appropriate text flow positioning, eliminating the need for repetitive tab and space insertion while maintaining full control over text positioning.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs preliminary calculation of text flow boundaries based on the gesture input before the user needs to see the final result. By pre-computing the optimal text positioning based on the gesture, the system eliminates the iterative process of inserting tabs and spaces to achieve the desired layout.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If contemporary software requires users to perform a lot of work to specify the irregular boundary, then text can flow around images, but the ability to accurately capture user intent is lost

Engineering Contradiction:
Improveboundary specification accuracyVSAvoiduser intent accuracy
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent replaces the indirect mouse-based boundary specification with direct gesture input on the screen. Users draw gestures that naturally follow the image contours, and the system directly interprets these gestures as boundary definitions. This direct mapping between user action and system interpretation accurately captures user intent while maintaining boundary specification accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9201666B2System and method for using gestures to generate code to manipulate text flow
Publication Date: 2015.12.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9201666B2 patent drawing
  • US9201666B2 patent drawing
  • US9201666B2 patent drawing

AI summary

The subject disclosure is directed towards using gesture input to position content elements (e.g., flow text) around an object such as an irregularly shaped image. The gesture input may be used to generate markup language code, which when processed by a renderer, automatically positions the elements based upon the markup language code. For example, div elements may be generated in HTML code, with margins set to values based upon the gesture so as to position the one or more content elements when they are rendered.