AR Content 3D Model Data Replacement via Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D operation manuals in augmented reality (AR) content require complex operations to change display elements, making it cumbersome for creators to update 3D model data when objects are modified.

Innovation Solution

An information processing system that identifies and replaces 3D model data within AR content by comparing captured images with database objects, allowing for simplified updates by generating or retrieving matching 3D model data and correcting associated text data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If new 3D model data is generated manually when display elements are changed, then the accuracy and quality of AR content is maintained, but the operation complexity and time required increase significantly

Engineering Contradiction:
Improvequality of AR contentVSAvoidoperation complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent uses image recognition to automatically capture and copy 3D model data from real-world objects captured in images. When display elements need to be changed, the system automatically extracts 3D model information from captured images rather than requiring manual generation, thereby maintaining quality while reducing operation complexity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs self-service by automatically identifying objects in captured images, extracting their 3D model data, and replacing display elements without human intervention. The AR content creation system serves itself by autonomously completing tasks that would otherwise require manual 3D model generation

Inventive Principle:
Principle #25Self-service

2Measurement precision

If manual operations are used to change display elements in AR content, then precise control over the changes is achieved, but the time and effort required increase

Engineering Contradiction:
Improvecontrol precisionVSAvoidtime required
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical operations with an automated image recognition and processing system. The system uses computer vision technology to automatically identify objects, extract 3D model data, and update display elements, substituting manual control with automated intelligent processing that maintains precision while dramatically reducing time

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If 3D model data is manually created for each object change, then the accuracy of object representation is ensured, but the productivity and efficiency decrease

Engineering Contradiction:
Improveobject representation accuracyVSAvoidcontent creation efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system copies 3D model data directly from real-world objects captured in images, preserving the accuracy of object representation while eliminating the time-consuming manual creation process. This copying approach maintains fidelity to the original object while dramatically improving productivity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces image recognition technology as an intermediary between the real world and AR content creation. This intermediary automatically extracts 3D model information from images, serving as a bridge that maintains accuracy while enabling efficient automated content generation

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240312149A1Information processing system, non-transitory computer readable medium, and information processing method
Publication Date: 2024.09.19 FUJIFILM BUSINESS INNOVATION CORP
  • US20240312149A1 patent drawing
  • US20240312149A1 patent drawing
  • US20240312149A1 patent drawing

AI summary

An information processing system includes one or multiple processors configured to: identify, from display elements of AR content, 3D model data for an object obtained as a result of comparison with one or more objects among objects, each serving as a subject of a captured image; and replace the identified 3D model data with 3D model data for the object serving as the subject.