AR Marker System for Intuitive 3D Business Graphic Manipulation

Solution Overview

Problem

Existing computer systems face challenges in effectively presenting and manipulating three-dimensional graphics due to limitations in user interface, particularly with only a keyboard and mouse as input devices, making it difficult for users to intuitively interact with 3D objects.

Innovation Solution

The implementation of Augmented Reality (AR) technology that uses a video stream from a webcam to recognize and respond to user manipulations of a physical marker, allowing for the rendering and interaction of business graphics in three dimensions, enabling users to control and manipulate virtual objects as if they were physical, with actions displayed in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If three-dimensional graphics are implemented to visualize large amounts of data, then data visualization capability is improved, but user interface complexity increases

Engineering Contradiction:

Improvedata visualization capabilityVSAvoiduser interface complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical input devices (keyboard and mouse) with a camera-based marker recognition system. The camera captures video streams and recognizes physical markers to control 3D graphics, substituting mechanical interaction with optical recognition and computer vision technologies.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a physical marker as an intermediary object between the user and the 3D graphics system. The marker serves as a mediator that the user manipulates physically, and the system translates marker movements into corresponding 3D graphic manipulations, bridging the gap between physical interaction and virtual object control.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Device complexity

If keyboard and mouse are used as primary input devices, then device simplicity is maintained, but ease of operation for three-dimensional objects deteriorates

Engineering Contradiction:

Improveinput device simplicityVSAvoidmanipulation ease of three-dimensional objects

Core Design Contradiction:

Device complexityVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical input devices (keyboard and mouse) with a camera-based marker recognition system. The camera captures video streams and recognizes physical markers to control 3D graphics, substituting mechanical interaction with optical recognition and computer vision technologies.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from two-dimensional keyboard/mouse interaction to three-dimensional physical marker manipulation. Users can naturally move markers in three-dimensional space, allowing more intuitive control of 3D graphics by directly mapping physical spatial movements to virtual object manipulations.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Loss of information

If more information is presented to the user at a given time, then data completeness is improved, but display clarity deteriorates

Engineering Contradiction:

Improvedata completenessVSAvoiddisplay clutter

Core Design Contradiction:

Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent transitions from two-dimensional keyboard/mouse interaction to three-dimensional physical marker manipulation. Users can naturally move markers in three-dimensional space, allowing more intuitive control of 3D graphics by directly mapping physical spatial movements to virtual object manipulations.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent merges the physical marker with the virtual 3D graphic representation, creating an augmented reality experience where the physical and virtual are combined. This integration allows the user to interact with comprehensive data visualizations while maintaining clarity through the unified marker-graphic interface.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS9633476B1Method and apparatus for using augmented reality for business graphics

Publication Date: 2017.04.25 INTUIT INC

AI summary

One embodiment provides a system for using Augmented Reality (AR) to facilitate displaying business graphics. The system receives at a computer system a video stream including an image of a marker, the marker being a physical object that is manipulated by the user and is recognizable by the computer system. The system recognizes the marker and receives from the user a selection of a business graphic. Next, the system renders the business graphic over the image of the marker in the video stream such that the image of the marker is obscured by the business graphic. The system then recognizes a manipulation of the marker indicated by a change in the image of the marker in the video stream. Next, the system performs an action on the business graphic that corresponds to the manipulation of the marker. Finally, the system displays the video stream to the user.