3D Virtual Object Editing with Dual Route Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operators face challenges in editing three-dimensional virtual objects in mixed reality environments due to the need for precise hand movements and sensor accuracy, leading to unintended intermediate states when undoing edits.

Innovation Solution

An image processing apparatus that displays two routes after an editing operation, allowing operators to select coordinates on either route to determine the intended state of the virtual object, thereby increasing the likelihood of achieving the desired state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If hand interaction is used to edit three-dimensional virtual objects, then the operator can manipulate the object in three-dimensional space, but the operator needs to perform precise hand movements which requires training and affects editing accuracy

Engineering Contradiction:
Improveease of hand interactionVSAvoidediting accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system provides visual feedback by displaying multiple routes (first route based on actual hand locus, second route as straight line connection) during the undo operation. This feedback mechanism helps the operator understand the difference between actual hand movement and intended movement, allowing for more accurate editing without requiring extensive training on precise hand gestures.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary actions by pre-calculating and displaying multiple possible routes before the operator completes the undo operation. The first route is calculated based on the actual hand locus, and the second route is pre-determined as the straight line connection between start and end points. This allows the operator to select the intended state directly without needing to perform precise hand movements.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If the intermediate state is traced back based on hand operation locus, then the historical editing state is displayed, but the displayed candidate may not match the operator's intended state due to sensor accuracy variations

Engineering Contradiction:
Improveinformation accuracy of editing stateVSAvoidreliability of candidate state
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system provides feedback by displaying both the actual hand locus (first route) and the intended straight line path (second route) simultaneously. This visual feedback allows the operator to see the discrepancy between actual hand movement and intended movement, enabling the operator to select the correct candidate state that matches their intention rather than relying solely on sensor-traced hand locus.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system creates a copy of the hand operation locus as the first route, and simultaneously creates another representation (the second route) that represents the intended path. By displaying both copies, the system allows the operator to compare the actual executed path with the intended path and select the appropriate candidate state, compensating for sensor inaccuracies.

Inventive Principle:
Principle #26Copying

3Device complexity

If only one route is displayed after editing operation, then the interface is simple, but the operator cannot easily correct unintended editing states

Engineering Contradiction:
Improveinterface simplicityVSAvoidease of correcting editing mistakes
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system segments the correction process into multiple discrete routes: the first route representing the actual hand locus and the second route representing the straight line connection. By segmenting the correction options into distinct visual paths, the operator can easily identify and select the intended state without confusion, making mistake correction more intuitive while maintaining relatively simple interface elements.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12131001B2Image processing apparatus capable of operating three dimensional virtual object, control method therefor, and storage medium storing control program therefor
Publication Date: 2024.10.29 CANON KK
  • US12131001B2 patent drawing
  • US12131001B2 patent drawing
  • US12131001B2 patent drawing

AI summary

An image processing apparatus capable of increasing a possibility that a three dimensional virtual object after an operation related to editing is transitioned to a state intended by an operator. The image processing apparatus allows the operator to perform an operation related to editing of a three dimensional virtual object. The image processing apparatus includes a memory device that stores instructions, and a processor that executes the instructions to display a first route after the operation, display a second route after the operation, the second route being different from the first route, allow the operator to select any one of coordinates on the first route, allow the operator to select any one of coordinates on the second route, and determine a state of the three dimensional virtual object based on the coordinate selected by the operator on either one of the first route and the second route.