Virtual Window Repositioning Using Depth and Feature Point Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality glasses have a limited field-of-view, making it impossible to present all information simultaneously, especially in remote expert assistance scenarios, where users must manually move virtual windows to avoid obscuring the main work area.

Innovation Solution

A virtual window configuration device and method using depth and feature point detection sensors to analyze images and move virtual windows to suitable positions within the field-of-view, reducing shading and manual operation requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple virtual information windows are displayed simultaneously in augmented reality glasses, then information presentation capability is improved, but field-of-view obstruction increases

Engineering Contradiction:
Improveinformation presentation capabilityVSAvoidfield-of-view obstruction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The virtual window automatically adjusts its position dynamically based on real-time detection of depth information and feature points in the real-world scene. The window transitions from static placement to dynamic repositioning, moving to locations that minimize obstruction of the user's field-of-view while maintaining information accessibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously captures depth information from depth detection sensors and feature point data from feature point detection sensors, processes this feedback information to analyze the real-world scene, and automatically repositions virtual windows based on the analyzed configuration blocks. This closed-loop feedback mechanism ensures optimal window placement that reduces field-of-view obstruction.

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If virtual windows are manually repositioned to avoid obstruction, then field-of-view clarity is improved, but user operation complexity increases

Engineering Contradiction:
Improvefield-of-view clarityVSAvoiduser operation complexity
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The virtual window repositioning function operates autonomously without requiring user intervention. The system independently detects depth information, identifies feature points, analyzes suitable configuration blocks, and automatically moves virtual windows to optimal positions. This self-service mechanism eliminates the need for users to manually drag and reposition windows, significantly reducing operational complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical interaction of dragging and dropping virtual windows is replaced by an automated system that uses depth detection sensors and feature point detection sensors to intelligently determine and execute window repositioning. This substitution of mechanical user actions with automated sensing and processing simplifies the user interface and reduces operational burden.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If virtual windows are placed in the main work area, then information visibility is improved, but work area obstruction increases

Engineering Contradiction:
Improveinformation visibilityVSAvoidwork area obstruction
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The system transitions from two-dimensional screen-based window placement to three-dimensional spatial positioning of virtual windows in the augmented reality environment. By utilizing depth information and spatial feature points, the system can place windows in three-dimensional space around the user's field-of-view, effectively separating information display from the two-dimensional work area and reducing obstruction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system segments the augmented reality space into multiple configuration blocks based on depth information and feature point analysis. Virtual windows are assigned to specific configuration blocks that are spatially separated from the main work area, allowing information visibility while minimizing interference with work activities.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12033285B2Object identification device and object identification method
Publication Date: 2024.07.09 WISTRON CORP
  • US12033285B2 patent drawing
  • US12033285B2 patent drawing
  • US12033285B2 patent drawing

AI summary

A virtual window configuration method includes the following steps. A processor generates a virtual window. A depth detection sensor generates depth information based on an image. The processor analyzes the depth information to generate a depth matrix. The processor finds a depth configuration block in the image using the depth matrix. A feature point detection sensor generates feature point information for the image. The processor analyzes the feature point information to generate a feature point matrix. The processor finds a feature point configuration block in the image using the feature point matrix. The processor moves the virtual window to the depth configuration block or the feature point configuration block.