AR Information Processing Apparatus Mode Switching for Reduced User Load

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality technology, users face a high load while holding a camera-equipped device to capture a marker for displaying composite images, as they need to stabilize the device with one hand and perform operations with the other, making it difficult to maintain the image capture range and recognize the marker consistently.

Innovation Solution

The information processing apparatus switches between two modes: the first mode for capturing images and the second mode for displaying composite images based on past images, allowing the user to perform operations without needing to continuously capture the marker, reducing the user's load by using stored images when a particular operation is detected.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the user holds the information processing apparatus with one hand to perform operations on the composite image, then the operation capability is improved, but the stability of the device becomes poor, making it difficult to maintain the image capture range

Engineering Contradiction:
Improveoperation capabilityVSAvoiddevice stability
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The patent segments the operation process into two distinct modes: a first mode for capturing images and a second mode for performing operations on composite images. This segmentation allows the user to capture the marker image once, then perform multiple operations without needing to maintain device stability continuously, as the system switches between modes rather than requiring simultaneous stability and operation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic mode switching between the first mode (image capture) and the second mode (operation execution). The control unit dynamically transitions between these modes based on operation detection, allowing the device to adapt its functionality to the user's needs at different times, thereby resolving the contradiction between needing stability for capture and mobility for operation.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If the user continuously captures the marker to maintain the composite image display, then the marker recognition accuracy is improved, but the user's load increases due to needing to stabilize the device while operating

Engineering Contradiction:
Improvemarker recognition accuracyVSAvoiduser's load
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies preliminary action by capturing the marker image in advance during the first mode before the user needs to perform operations. The captured image is stored and then used as the basis for the composite image during the second mode, eliminating the need for continuous marker capture while maintaining recognition accuracy. The user performs the capture action once in advance rather than continuously during operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements periodic action through distinct operational modes rather than continuous operation. The system alternates between the first mode (capture) and the second mode (operation), with the control unit detecting operations to trigger mode switches. This periodic structure reduces user load by eliminating the need for continuous device stabilization while maintaining marker recognition through the previously captured image.

Inventive Principle:
Principle #19Periodic action

3Loss of time

If the system requires continuous image capture to maintain composite image display, then the image freshness is improved, but the device complexity increases due to continuous camera operation

Engineering Contradiction:
Improveimage freshnessVSAvoiddevice complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent extracts the continuous image capture function from the operational flow by implementing a mode-based system. The camera operation is extracted and confined to the first mode, while the second mode operates on previously captured images. This extraction eliminates the need for continuous camera operation during user interactions, reducing device complexity while maintaining the ability to display composite images based on captured marker data.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP2866088B1Information processing apparatus and method
Publication Date: 2021.06.23 FUJITSU LTD
  • EP2866088B1 patent drawingFigure 1
  • EP2866088B1 patent drawingFigure 2
  • EP2866088B1 patent drawingFigure 3

AI summary

An information processing apparatus includes: a control unit configured to: detect certain image data corresponding to a reference object from the first image data; control a display to display object data on the first image data when the certain image is detected, the object data being associated with the certain image data and stored in a memory; obtain second image data from the image capture device; control the display to continue displaying the object data on the first image when a certain operation to the image capture device is detected; and control the display to display the second image data when the certain operation is not detected.