Oral Hygiene Device Pose Estimation Using Color-Coded Visual Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motion tracking systems for oral hygiene devices face challenges in accurately tracking motion with limited processing power, particularly in capturing and analyzing the spatial position and direction of toothbrushes using devices like smartphones.

Innovation Solution

A method and system that utilize visual markers and a camera to estimate the pose of an oral hygiene device by receiving image data, identifying regions of interest, segmenting visual markers, and using a perspective-three-point algorithm to validate proposed three-dimensional poses, allowing for accurate tracking even with limited processing power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual markers and image processing algorithms are used to track oral hygiene device motion, then measurement precision of pose estimation is improved, but device complexity and processing power requirements increase

Engineering Contradiction:
Improvepose estimation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The visual marker is divided into multiple colored regions (e.g., red, green, blue, yellow sections) that can be independently detected and tracked. This segmentation allows the system to simplify the marker into discrete, easily identifiable elements, reducing processing complexity while maintaining pose estimation accuracy through the relative positioning of these segmented regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The visual marker utilizes distinct color patterns (red, green, blue, yellow sections) that are captured and analyzed by the imaging device. By relying on color differentiation rather than complex geometric patterns or multiple sensors, the system achieves reliable pose estimation with minimal processing power, as colors are easily distinguishable and can be processed through simple image thresholding and recognition algorithms.

Inventive Principle:
Principle #32Color changes

2Measurement precision

If multiple visual markers and complex algorithms are used for pose estimation, then measurement precision is improved, but processing power requirements worsen

Engineering Contradiction:
Improvespatial position and orientation accuracyVSAvoidprocessing power consumption
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent replaces complex mechanical or sensor-based tracking systems with an optical imaging system that uses simple color-coded visual markers. Instead of requiring multiple sensors, inertial measurement units, or complex mechanical linkages, the system uses a single imaging device (camera) combined with color-coded markers to achieve three-dimensional pose estimation, significantly reducing processing power requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The visual marker transitions from traditional geometric or pattern-based identification to color-based identification. By changing the parameter of marker identification from complex geometry to simple color detection, the computational burden is dramatically reduced. Color detection can be performed through basic image processing techniques like thresholding and color space conversion, which require minimal processing power compared to complex pattern recognition or 3D geometry algorithms.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If detailed pose analysis is performed to provide brushing technique insights, then information quality is improved, but processing time and computational requirements worsen

Engineering Contradiction:
Improvebrushing technique information qualityVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system extracts only the essential pose parameters (position and orientation of the visual marker) from the image data without performing unnecessary complex analyses. By focusing solely on tracking the color-coded marker's movement and calculating its pose relative to a reference frame, the system obtains sufficient brushing technique information efficiently, avoiding time-consuming detailed analysis of brush bristle deformation, pressure distribution, or other complex parameters that would not provide additional actionable insights.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP3672448B1Systems and methods for estimating a three-dimensional pose of an oral hygiene device with visual markers
Publication Date: 2024.09.18 COLGATE PALMOLIVE CO
  • EP3672448B1 patent drawingFigure 1
  • EP3672448B1 patent drawingFigure 2A
  • EP3672448B1 patent drawingFigure 2B~2C

AI summary

A method for estimating a pose of an oral hygiene device including a pattern and a plurality of groups of visual markers relative to a location includes (i) receiving image data reproducible as an image of at least a portion of the oral hygiene device; (ii) analyzing the image data to identify a region of interest within the image; (iii) identifying, using at least one of the one or more processors, all candidate visual markers within the region of interest; (iv) obtaining a first proposed three-dimensional pose of the oral hygiene device; (v) validating the first proposed three-dimensional pose of the oral hygiene device, and (vi) obtaining a second proposed three- dimensional pose of the oral hygiene device based on the validated first proposed three- dimensional pose.