3D Animal Behavior Tracking via Chronically Attached Reflective Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for tracking animal behavior in three dimensions are limited by the inability to accurately capture long-term patterns due to challenges with marker attachment and the 2D nature of existing automated systems, which struggle with occlusions and diverse animal poses.

Innovation Solution

The development of a method using chronically attached reflective motion capture markers and a trained statistical model to track animal behavior in 3D, enabling long-term behavioral analysis and identification of stereotyped behaviors, even in markerless subjects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If depth cameras are used to track animal movement, then coarse measurements of head and torso can be obtained, but tracking precision and ability to capture detailed behavioral patterns are limited

Engineering Contradiction:
Improvetracking precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from 2D video-based tracking to 3D motion capture by introducing spatial depth information through multiple cameras and reflective markers. This dimensional enhancement enables precise tracking of anatomical landmarks in three-dimensional space, resolving the limitation of coarse 2D measurements while maintaining practical system complexity through established motion capture technology.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If two-dimensional tracking of anatomical landmarks is used, then detailed behavioral snapshots can be captured, but the system struggles with occlusions and diverse animal poses

Engineering Contradiction:
Improvetracking reliabilityVSAvoidadaptability to diverse poses
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

By implementing 3D motion capture with multiple cameras positioned around the animal, the system creates redundant viewing angles that eliminate occlusion problems inherent in 2D tracking. The three-dimensional coordinate system allows anatomical landmarks to be tracked regardless of animal pose or orientation, significantly improving tracking reliability across diverse behavioral contexts.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The motion capture system with multiple cameras and 3D spatial tracking provides universal applicability across different animal species, sizes, and behavioral contexts. The system can track various anatomical landmarks simultaneously and adapt to diverse poses without requiring pose-specific calibration, making it universally applicable to ethological studies.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Duration of action of stationary object

If traditional marker attachment methods are used, then motion capture can be performed, but markers detach over long-term studies

Engineering Contradiction:
Improvemarker attachment durationVSAvoidtracking reliability
Core Design Contradiction:
Duration of action of stationary objectVSReliability

Solution Approach 1:

The patent applies different attachment strategies tailored to specific anatomical locations and study durations. For long-term studies, implantable markers are used at critical anatomical points, while for shorter studies, external markers with specialized attachment methods are sufficient. This localized optimization of marker attachment ensures reliability throughout the required duration without compromising the animal.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system employs hierarchical marker configurations where multiple markers are nested or clustered at key anatomical landmarks. This nested arrangement provides redundancy, ensuring that even if individual markers detach, the anatomical position can still be accurately determined from remaining markers, maintaining tracking reliability over extended periods.

Inventive Principle:
Principle #7Nested doll (Nesting)

4Duration of action of moving object

If 2D automated tracking systems are used, then behavioral patterns can be analyzed, but the systems cannot accurately capture long-term three-dimensional behavioral patterns

Engineering Contradiction:
Improvelong-term tracking capabilityVSAvoidthree-dimensional accuracy
Core Design Contradiction:
Duration of action of moving objectVSMeasurement precision

Solution Approach 1:

The patent implements continuous 3D motion capture using multiple synchronized cameras that track reflective markers throughout the animal's body. This three-dimensional tracking system maintains high measurement precision across extended time periods, enabling accurate reconstruction of complex spatial behavioral patterns that 2D systems cannot capture, such as vertical movements, rotational orientations, and three-dimensional locomotor paths.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for precise, long-term tracking of animal behavior with high accuracy, overcoming issues of marker detachment and the limitations of 2D systems, and extends to various species and environments.

Implementation Method 1

determining a three-dimensional position of the subject using triangulation and the obtained images

Methodology Applied
Scientific EffectTriangulation:

Data Source

PatentUS20230196839A1Three-dimensional landmark tracking in animals
Publication Date: 2023.06.22 DUKE UNIV
  • US20230196839A1 patent drawing
  • US20230196839A1 patent drawing
  • US20230196839A1 patent drawing

AI summary

Systems and methods for performing long-term kinematic tracking of an animal subject are provided. Chronically-affixed motion capture markers including a tissue engaging feature and a reflective marker are described, the motion capture markers enabling long-term motion capture recording of an animal subject. A method of determining a three-dimensional pose of a subject using a trained statistical model configured to generate landmark position data associated with the three-dimensional pose of the animal subject. The method includes using projective geometry to generate three-dimensional image volumes as input to the trained statistical model. Further, a method for profiling a subject’s physical behavior over a period of time by applying clustering to information indicative of movement of the subject over the period of time is described.