3D Virtual Object Scaling for AR Field of View Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality display systems face challenges in presenting three-dimensional virtual objects within a field of view that is smaller than the user's field of view, leading to an incomplete view of the object, and require methods to automatically scale or position virtual objects appropriately within the real world environment.

Innovation Solution

The system acquires image data using outward-facing sensors, compares dimensional information of virtual objects to the display device's field of view, modifies the virtual objects by scaling or positioning them to fit within the view, and allows for user input to adjust their size or position, while also detecting physical hands to trigger the display of menus or interactions with virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If three-dimensional virtual objects are displayed at their original size in augmented reality, then the objects maintain their true scale and proportions, but the objects may extend beyond the display device's field of view and become partially invisible

Engineering Contradiction:
Improvescale accuracyVSAvoidfield of view
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The system dynamically adjusts the scale of virtual objects based on real-time comparison between object dimensions and field of view parameters. The scaling factor is calculated as the ratio of field of view dimensions to object dimensions, allowing the object to be proportionally resized to fit within the visible area while maintaining aspect ratio and spatial relationships.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the display parameter (scale factor) of virtual objects based on the calculated ratio between field of view and object dimensions. By modifying this single parameter, the system ensures objects fit within the constrained field of view while preserving their three-dimensional structure and relative proportions.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If the field of view is increased to show more of the virtual object, then the complete object becomes visible, but the immersion and focus of the augmented reality experience is reduced

Engineering Contradiction:
Improvefield of viewVSAvoidimmersion quality
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

Instead of expanding the field of view to show the entire object, the system applies partial action by displaying a scaled version of the object that fits within the existing field of view boundaries. This provides sufficient visual information for interaction while preserving the immersive AR experience by maintaining the original field of view constraints.

Inventive Principle:
Principle #16Partial or excessive action

3Area of stationary object

If virtual objects are automatically scaled to fit the field of view, then complete visibility is achieved, but manual adjustment capability is lost

Engineering Contradiction:
ImprovevisibilityVSAvoidadjustment flexibility
Core Design Contradiction:
Area of stationary objectVSAdaptability or versatility

Solution Approach 1:

The system implements feedback by detecting user gestures (such as pinching motions) and responding by adjusting the virtual object's scale accordingly. The gesture recognition system provides feedback about user intent, and the scaling operation provides visual feedback about the adjustment result, allowing iterative refinement of object size to balance visibility and user preference.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3433705B1Displaying three-dimensional virtual objects based on field of view
Publication Date: 2021.12.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3433705B1 patent drawingFigure 1
  • EP3433705B1 patent drawingFigure 2A~2B
  • EP3433705B1 patent drawingFigure 3

AI summary

Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display. Another example provides a display device comprising a camera and a display, wherein image data of an environment is acquired, a surface within this environment is detected, and a three-dimensional virtual object is moved within a threshold distance of the surface.