Real-Time Visual Feedback for Document Object Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current document authoring systems lack real-time feedback during object repositioning, resizing, or rotating, leading to slow performance, unexpected object movement, and unpredictable interactions with tables, making it difficult for users to achieve the desired layout.

Innovation Solution

Providing real-time feedback through a bounding box display with the user's cursor, semi-transparent object indication for invalid drop locations, and determining attachment points within tables to ensure accurate placement and reduce perceived application hang-ups.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If real-time layout updates are performed during move, resize, or rotate actions, then users receive visual feedback, but application performance becomes slow and may appear to hang

Engineering Contradiction:
Improvevisual feedbackVSAvoidapplication performance
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system performs partial layout updates by only recalculating and rendering the specific region containing the modified object rather than the entire document. This selective updating provides visual feedback for the user's action while significantly reducing the computational overhead and maintaining application responsiveness.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The document layout is segmented into multiple regions, and during move, resize, or rotate actions, only the affected segment (the object and its immediate surroundings) is updated. This segmentation allows the system to provide localized visual feedback without the performance penalty of updating the entire document.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If layout is updated in real-time during object manipulation, then users see current position, but object may unexpectedly jump to another page

Engineering Contradiction:
Improveobject position feedbackVSAvoidobject placement predictability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

Before finalizing the object's new position, the system performs preliminary calculations to determine if the object will fit on the current page. If the object would overflow to another page, the system proactively adjusts the position or provides visual warnings, allowing the user to make informed decisions before the action is completed, thus preventing unexpected jumps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides continuous visual feedback during the drag operation, showing the user the object's current position and any potential page boundaries. This feedback mechanism allows users to understand where the object will land before releasing it, improving predictability while maintaining real-time position information.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If object is dragged into a table during move action, then object may be placed in the table, but table may jump to another page

Engineering Contradiction:
Improveobject-table interactionVSAvoidtable position stability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

When an object is being dragged toward a table, the system performs preliminary layout calculations to determine if placing the object in the table would cause the table to overflow to another page. If so, the system either prevents the operation, adjusts the position, or provides visual feedback to the user, thereby maintaining table position stability while preserving ease of operation.

Inventive Principle:
Principle #10Preliminary action

4Loss of information

If bounding box is displayed throughout slow action, then user receives feedback, but may increase rendering overhead

Engineering Contradiction:
Improveaction progress feedbackVSAvoidrendering complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Instead of rendering a full-quality bounding box, the system uses a simplified representation (such as a wireframe or low-resolution outline) that provides sufficient visual feedback to the user while minimizing rendering overhead. This local quality adjustment maintains usability during slow actions without significantly increasing device complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9223761B2Real time visual feedback during move, resize and/or rotate actions in an electronic document
Publication Date: 2015.12.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9223761B2 patent drawing
  • US9223761B2 patent drawing
  • US9223761B2 patent drawing

AI summary

Real time feedback during move, resize or rotate actions in an electronic document is provided. During live drag actions, the layout shown during the action may be the layout produced when the object is dropped. Detection of slow performance of an application and aborting a redraw action as needed may be provided. A visual indication may be provided for helping users to see that an action is in progress, and thereby removing a perception that the application is failing to respond properly. Determining if a figure will not land in a current cursor/touch point position in a move action and a visual indication to help the user see where and why the figure may jump to a new location may also be provided. In addition, determining an attachment point for an object on a page comprising a table may also be provided.