Optical Shutter Device for AR Projection and Capture Separation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generating and processing collaborative Augmented Reality (AR) environments in multiple integrated workplaces with high-resolution content is computationally expensive, as existing technologies struggle to separate projection and capture actions effectively, impacting image processing and resource allocation.

Innovation Solution

An optical shutter device with a projection shutter and an imaging shutter, controlled by a microcontroller, switches between projection and imaging states to prevent the AR image from being captured by the image capturing device, allowing only local content to be captured and processed, thereby reducing the computational load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the projection device projects AR image and the image capturing device captures simultaneously, then the collaboration environment can display and record content, but the captured image contains AR artifacts that require complex processing to remove

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidimage processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the optical path into two separate channels using physical shutters: one channel for projection (displaying AR content) and one channel for capture (recording real-world content). By segmenting the simultaneous operations into sequential time-sliced operations, the system eliminates the need for complex software algorithms to remove AR artifacts from captured images, thereby improving processing efficiency while reducing computational complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by closing the projection shutter before the capture shutter opens, and opening the projection shutter after the capture shutter closes. This pre-coordination of shutter operations ensures that the projection device never projects AR content during the capture phase, preventing AR artifacts from entering the captured image in the first place, thus eliminating the need for post-processing removal algorithms

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If high resolution AR content is processed in collaborative environments with multiple workplaces, then the image quality is improved, but the computational cost increases significantly

Engineering Contradiction:
Improveimage resolutionVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts the AR content projection function from the capture function by using separate optical paths and shutters. The projection shutter blocks the projection light during capture, while the capture shutter blocks the capture path during projection. This extraction allows the system to maintain high-resolution AR content display while capturing only the real-world environment without AR overlays, thereby reducing the computational energy required for processing and transmitting full high-resolution collaborative scenes

Inventive Principle:
Principle #2Taking out (Extraction)

3Ease of operation

If the projection shutter is open during capture, then the AR image can be projected, but the image capturing device captures the AR image along with the local content

Engineering Contradiction:
Improveoptical shutter controlVSAvoidseparation of AR and local content
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent implements periodic action through coordinated shutter cycling: the projection shutter and capture shutter operate in alternating periodic phases. During the capture phase, the projection shutter is closed and the capture shutter is open; during the projection phase, the projection shutter is open and the capture shutter is closed. This periodic switching ensures clean separation of AR content projection and local content capture, preventing mixing of the two optical paths while maintaining simple shutter control mechanisms

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances processing efficiency by eliminating the need for complex algorithms to remove AR artifacts from captured images, improving resource allocation and image quality by directly capturing local content without AR interference.

Implementation Method 1

the projection shutter to the closed state such that the projection device projects the AR image onto the closed projection shutter

Methodology Applied
Scientific EffectLight blocking: Absorption (EM radiation)

Data Source

PatentUS11425310B2Separation of projection and capture in collaboration environment
Publication Date: 2022.08.23 KONICA MINOLTA BUSINESS SOLUTIONS USA INC
  • US11425310B2 patent drawing
  • US11425310B2 patent drawing
  • US11425310B2 patent drawing

AI summary

An optical shutter device includes: a projection shutter disposed in front of a projection device that projects an AR image onto an object surface with a local content; an imaging shutter disposed in front of an image capturing device that captures a local image of the local content; and a controller that electrically drives the projection and imaging shutters and switches the optical shutter device between a projection state and an imaging state. In the projection state, the controller electrically drives: the projection shutter to an open state, and the imaging shutter to a closed state. In the imaging state, the controller electrically drives: the projection shutter to the closed state, and the imaging shutter to the open state.