AR Marker Tracking Resume Logic for Continuous Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems struggle to maintain continuous playback of content when a marker is temporarily or completely lost from the camera's view, requiring users to restart the content from the beginning, which is inconvenient, especially in crowded environments where maintaining the marker in view is difficult.

Innovation Solution

An information processing device and method that detects a marker within a captured image, allowing playback control to continue even when the marker is temporarily lost, with the option to resume playback from the previous stop position upon re-detection, and stopping both image and sound playback if the marker is not re-detected within a preset threshold time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the playback is controlled to stop when the marker is lost from the captured image, then the system responds accurately to marker visibility, but the user experience deteriorates because playback must restart from the beginning when the marker is re-detected

Engineering Contradiction:
Improvemarker recognition accuracyVSAvoidcontent playback continuity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by detecting marker loss and pausing playback before complete marker disappearance occurs. It also preliminarily records the playback position so that when the marker is re-detected, the system can resume from the recorded position rather than restarting, thus maintaining user convenience while ensuring reliable marker-based control

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides beforehand cushioning by implementing a threshold mechanism that allows for temporary marker occlusion without immediately stopping playback. This cushioning approach prevents overly sensitive responses to brief marker losses while maintaining overall control reliability, balancing both marker recognition accuracy and playback continuity

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Duration of action of moving object

If the user maintains the marker in the captured image for the entire content duration, then complete content playback is achieved, but the operational complexity increases especially in crowded environments

Engineering Contradiction:
Improvecontent playback durationVSAvoidmarker tracking difficulty
Core Design Contradiction:
Duration of action of moving objectVSEase of operation

Solution Approach 1:

The system applies dynamics by transitioning from a static marker-tracking requirement to a dynamic response system that adapts to changing marker visibility conditions. It dynamically adjusts playback state based on real-time marker detection, allowing temporary deviations without requiring continuous perfect tracking, thus reducing operational complexity while maintaining content delivery

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system ensures continuity of useful action by implementing automatic playback resumption when the marker is re-detected after temporary loss. This continuity mechanism ensures that content playback progresses toward completion without requiring the user to manually restart or intervene, maintaining both duration and ease of operation

Inventive Principle:
Principle #20Continuity of useful action

3Device complexity

If the playback restarts from the beginning when the marker is re-detected, then the system maintains simple control logic, but time is wasted by replaying already viewed content

Engineering Contradiction:
Improveplayback control logicVSAvoidcontent replay time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system performs preliminary action by recording and storing the playback position before marker loss occurs. When the marker is re-detected, the system retrieves this recorded position and resumes playback from there, avoiding redundant replay of already viewed content while maintaining relatively simple control logic through straightforward position management

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2860968B1Information processing device, information processing method, and program
Publication Date: 2020.06.24 SONY GROUP CORP
  • EP2860968B1 patent drawingFigure 1
  • EP2860968B1 patent drawingFigure 2(A)~2(B)
  • EP2860968B1 patent drawingFigure 3(a)~3(d)

AI summary

There is provided an information processing device including a data processing section configured to perform processing of playing back content according to a feature image, based on detection of the feature image from a captured image acquired by a capturing of an imaging section, and a specifying section configured to specify a resume point, which is a position of playing back the content, according to a timing at which the detection of the feature image is impossible. The data processing section performs the playback of the content from a position corresponding to the resume point, according to re-detection of the feature image after the detection of the feature image becomes impossible.