Timecode-Based 3D Model Selection for User-Controlled AR Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing AR technologies lack the ability for users to easily select and synthesize virtual objects with captured images based on their preferences, with the position and shape of virtual objects often being automatically determined rather than user-controlled.

Innovation Solution

An information processing apparatus and method that allows users to detect identification information for 3D model data corresponding to multiple timecodes, accept user operations to designate a timecode, and record a virtual image to be synthesized with a captured image, enabling user-controlled selection and display of virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the position and shape of virtual objects are automatically determined, then the operation process is simplified, but the user cannot control the selection and configuration of virtual objects according to their preferences

Engineering Contradiction:
Improveoperation process simplificationVSAvoiduser control capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system segments the virtual object selection process into distinct components: automatic detection of candidate objects, temporal variation display through timecode progression, and user confirmation/selection. This segmentation allows the system to provide both automatic convenience and user control by separating the detection function from the selection function.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by automatically detecting and preparing multiple candidate virtual objects with their temporal variations before presenting them to the user. The timecode-based pre-loading and display of object variations allows users to make informed selections without manual searching, combining automation with user agency.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple variations of virtual objects are provided for user selection, then the adaptability and user preference satisfaction are improved, but the operational burden and complexity increase

Engineering Contradiction:
Improveobject variation selectionVSAvoidoperational burden
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system employs periodic action through timecode-based sequential display of object variations. Instead of presenting all variations simultaneously which would overwhelm the user, the system cycles through variations at regular time intervals, allowing users to observe changes over time and select the desired object with reduced cognitive load.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The timecode serves as an intermediary mechanism between the multiple object variations and the user. It mediates the presentation of variations by providing a temporal structure that organizes the information flow, making it easier for users to compare and select among multiple options without being overwhelmed by simultaneous information.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the system stores and manages 3D model data for multiple timecodes, then the object representation accuracy and temporal precision are improved, but the data storage requirements and system complexity increase

Engineering Contradiction:
Improvetemporal precisionVSAvoiddata management complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses copying by storing multiple instances of 3D model data at different timecodes rather than maintaining a single complex temporal model. Each timecode represents a discrete copy of the object state, simplifying data management while preserving temporal precision. This approach trades storage space for computational simplicity and ease of access.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20260065604A1Information processing apparatus, information processing system, information processing method, and medium
Publication Date: 2026.03.05 CANON KK
  • US20260065604A1 patent drawing
  • US20260065604A1 patent drawing
  • US20260065604A1 patent drawing

AI summary

An information processing apparatus is provided. The apparatus detects, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes. The apparatus accepts a user operation to designate a timecode of a display target. The apparatus causes a display to display an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation. The apparatus records, in accordance with a user operation, a virtual image to be synthesized with a captured image. The virtual image includes the image of the object displayed on the display.