Real-Time Object Movement Tracking Without Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining object movements in image streams, such as facial movements, are inefficient and require manual marker placement or non-real-time processing, which is unsuitable for professional applications like video games and cinematographic films.

Innovation Solution

A method that records and processes image streams in parallel using multicore processors, allowing for real-time animation of virtual objects by synchronizing processing units and enabling auxiliary processing to improve image quality and processing speed without the need for markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If marker placement is used for movement determination, then measurement precision is improved, but ease of operation deteriorates due to lengthy and critical positioning requirements

Engineering Contradiction:
Improvemovement determination accuracyVSAvoidoperation complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The invention extracts and eliminates the marker placement step from the movement determination process. By using natural facial features and image processing algorithms, the system achieves accurate movement tracking without requiring physical markers to be placed on the subject's face, thereby simplifying operation while maintaining measurement precision

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The invention replaces the mechanical marker placement system with an optical-digital system using image processing. Instead of physically attaching markers to the face, the system uses computer vision algorithms to detect and track facial features in video streams, substituting mechanical operations with automated digital processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If sequential image processing is used, then processing accuracy is maintained, but productivity deteriorates due to insufficient processing speed for real-time applications

Engineering Contradiction:
Improveprocessing accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The invention segments the image processing task into multiple independent parallel processes that can be executed simultaneously on different cores of a multicore processor. Each core handles a separate image stream or processing stage, allowing the system to maintain high processing accuracy while achieving the computational throughput required for real-time applications

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention transitions from single-threaded sequential processing to multi-threaded parallel processing by utilizing the additional dimension of multiple processor cores. This dimensional expansion in computational architecture allows simultaneous execution of multiple processing streams, dramatically increasing productivity while maintaining the accuracy of individual processing operations

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If parallel processing is implemented, then productivity is improved through faster processing speed, but device complexity increases due to synchronization requirements

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The invention introduces a control unit as an intermediary that manages synchronization between multiple parallel processing cores. This mediator coordinates the parallel operations, handles data exchange between cores, and ensures proper timing, thereby enabling high-speed parallel processing while abstracting the complexity from the overall system architecture

Inventive Principle:
Principle #24Intermediary (Mediator)

4Measurement precision

If marker-based movement capture is used, then measurement precision is improved, but loss of time increases due to lengthy marker placement operations

Engineering Contradiction:
Improvemovement tracking accuracyVSAvoidsetup time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The invention extracts and removes the time-consuming marker placement step from the measurement process. By relying on automatic detection of natural facial features through image processing, the system achieves accurate movement tracking immediately without requiring any preparatory marker application, thereby eliminating setup time while maintaining measurement precision

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9092874B2Method for determining the movements of an object from a stream of images
Publication Date: 2015.07.28 FOGALE NANOTECH SA
  • US9092874B2 patent drawing
  • US9092874B2 patent drawing
  • US9092874B2 patent drawing

AI summary

According to one aspect, the invention relates to a system for determining the movements of an object from a stream of images of said object. The system includes, in particular, a computer having a memory and a central processing unit, said central processing unit including: a reading unit (12) for recording each image of the stream of images in an input buffer memory (22); a processing unit (13) making it possible to determine, for each image, a change in the position and/or in the deformation of said object relative to the image immediately preceding said image in the stream; the reading and processing units being synchronized such that the processing of each of said images of the stream of images is carried out either simultaneously at the time of the reading of an image following said image in the stream of images, and of the recording thereof in the input buffer memory (22).