Virtual Camera Linkage Control for AR Object Placement

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing systems struggle to accurately place virtual objects in a real space, leading to inappropriate positioning and usability issues when combining real and virtual environments.

Innovation Solution

An information processing system that uses a processor to control the placement of virtual objects by linking the image capturing direction of a virtual camera with the virtual object's direction, allowing for adjustment based on the image capturing apparatus's direction, and includes features to fix the virtual object at a desired position in the real space, even when the apparatus is tilted beyond certain thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the image capturing direction of the virtual camera is always linked to the image capturing direction of the image capturing apparatus, then the virtual object placement follows the camera movement, but when the apparatus is tilted beyond thresholds, the virtual object is placed at inappropriate positions

Engineering Contradiction:

Improvevirtual object placement adaptabilityVSAvoidvirtual object placement precision

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the linkage level between virtual camera and image capturing apparatus adjustable rather than fixed. The system dynamically changes the linkage strength based on camera tilt thresholds, reducing linkage when tilted beyond thresholds to prevent inappropriate virtual object placement while maintaining flexibility in normal conditions

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of linkage level from a constant value to a variable that depends on camera orientation. By monitoring tilt angles and adjusting the linkage level accordingly (reducing it when thresholds are exceeded), the system adapts the virtual object placement behavior to current camera conditions, resolving the contradiction between adaptability and precision

Inventive Principle:

Principle #35Parameter changes

2Stability of the object's composition

If the virtual object is fixed in a simulated manner at a position in the real space, then the virtual object remains stable, but the system loses flexibility to adjust object placement based on camera direction changes

Engineering Contradiction:

Improvevirtual object position stabilityVSAvoidvirtual object placement flexibility

Core Design Contradiction:

Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent makes the virtual object placement system dynamic by allowing it to switch between two modes: following the camera direction when within thresholds, and maintaining fixed simulated placement when beyond thresholds. This dynamic behavior enables the system to balance stability and flexibility based on real-time camera orientation conditions

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent uses a simulated copy of the real space position for the virtual object. When the camera is tilted beyond thresholds, the virtual object is placed at a simulated fixed position rather than strictly following camera movement, creating a stable reference point that maintains flexibility through the linkage mechanism

Inventive Principle:

Principle #26Copying

3Measurement precision

If the linkage level between virtual camera and image capturing apparatus is high, then the virtual object follows camera direction accurately, but inappropriate positioning occurs when camera is tilted beyond thresholds

Engineering Contradiction:

Improvevirtual object direction accuracyVSAvoidvirtual object placement reliability

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The patent implements feedback by continuously monitoring the image capturing direction and comparing it against predefined tilt thresholds. When the feedback shows the camera is tilted beyond thresholds, the system automatically reduces the linkage level, preventing inappropriate virtual object placement and maintaining reliability while preserving accuracy within acceptable ranges

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11633670B2Information processing system, non-transitory computer-readable storage medium having stored therein information processing program, information processing apparatus, and information processing method

Publication Date: 2023.04.25 NINTENDO CO LTD

AI summary

An example of an information processing system sets an image capturing direction of a virtual camera in accordance with an image capturing direction of a camera, and if the image capturing direction of the camera is within a predetermined range, moves a virtual door in a virtual space in accordance with the image capturing direction of the virtual camera. If the image capturing direction of the camera is directed more upward than a first threshold, the information processing system does not move the virtual door further in the up direction. If the image capturing direction of the camera is directed more downward than a second threshold, the information processing system does not move the virtual door further in the down direction.