Handheld Device Position Tracking Using Integrated Camera and Displacement Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hand-held devices for treatments like IPL struggle to provide accurate feedback on treated areas, leading to untreated or double-treated regions due to the lack of automatic position and orientation tracking, which is cumbersome and requires additional sensors or external cameras, compromising ergonomics and computing power.

Innovation Solution

A method using an imaging unit and displacement sensor integrated into the hand-held device to determine its position and orientation by switching between three modes based on contact and visibility of body parts, allowing for accurate tracking without external sensors, enabling continuous operation during treatments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If skin mapping with an optical sensor inside the device is used to track position, then position tracking capability is improved, but device complexity and computing power requirements increase significantly

Engineering Contradiction:
Improveposition tracking accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the imaging function from internal sensors to an external imaging device (camera), which captures images of the treatment area. This eliminates the need for complex internal optical sensors and skin mapping algorithms, significantly reducing device complexity while maintaining position tracking capability through image processing of the external camera footage.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary imaging device (camera) that captures visual information of the treatment area and the device position. This intermediary translates physical position into image data, which is then processed to determine device location and orientation, avoiding the need for complex internal sensing systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If an external camera is used for device-to-body part mapping, then position tracking is improved, but ease of operation deteriorates due to requiring two-handed operation

Engineering Contradiction:
Improveposition tracking accuracyVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent merges the imaging function with the treatment device by integrating a camera directly into the handheld device structure. This allows the camera to automatically capture images of the treatment area and device position during single-handed operation, eliminating the need for a separate external camera and maintaining ease of operation while achieving accurate position tracking.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated camera system enables the device to automatically capture and process its own position and orientation data during treatment. The device performs self-monitoring of its location relative to the treatment area without requiring external assistance or two-handed operation, improving ease of use while maintaining tracking accuracy.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If skin mapping procedure is performed before treatment, then position tracking capability is improved, but loss of time increases due to preliminary mapping requirement

Engineering Contradiction:
Improveposition tracking accuracyVSAvoidloss of time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions (capturing reference images of the treatment area and calibration data) automatically during the initial setup phase before treatment begins. These reference images and calibration data are stored and used throughout the treatment process for continuous position tracking, enabling accurate tracking without requiring a separate time-consuming skin mapping procedure.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent enables continuous position tracking throughout the treatment process by continuously capturing images with the integrated camera and comparing them against reference images. This continuous tracking eliminates the need for periodic re-mapping or interruption of treatment for position verification, maintaining both accuracy and treatment continuity.

Inventive Principle:
Principle #20Continuity of useful action

4Measurement precision

If displacement sensor is used to measure device movement, then position tracking is improved, but device complexity increases

Engineering Contradiction:
Improveposition tracking accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces mechanical displacement sensors with an optical/image-based tracking system. The integrated camera captures images that are processed to determine device position and orientation, substituting mechanical sensing with optical field-based measurement. This reduces device complexity by eliminating mechanical sensors while maintaining or improving tracking accuracy through image processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12035978B2Method of determining a position and/or orientation of a hand-held device with respect to a subject, a corresponding apparatus and a computer program product
Publication Date: 2024.07.16 KONINKLIJKE PHILIPS NV
  • US12035978B2 patent drawing
  • US12035978B2 patent drawing
  • US12035978B2 patent drawing

AI summary

According to an aspect, there is provided a method of determining a position and/or orientation of a hand-held device with respect to a subject. The hand-held device is for use on a body of the subject. The method comprises receiving (101) images from an imaging unit arranged in or on the hand-held device; receiving (103) a displacement signal from a displacement sensor that is arranged in or on the hand-held device to measure displacement of the hand-held device along the body when the hand-held device is in contact with the body; processing (105) the received images to determine whether a body part of the subject can be identified in the received images; determining (107) whether the hand-held device is in contact with the body; determining (109) a mode of operation to use to determine a position and/or orientation of the hand-held device based on whether a body part can be identified and whether the hand-held device is in contact with the body; wherein the mode of operation to use is determined as (i) a first mode when a body part can be identified, (ii) a second mode when a body part cannot be identified and the hand-held device is not in contact with the body, and (iii) a third mode when the hand-held device is in contact with the body; and determining (111) the position and/or orientation of the hand-held device with respect to the body of the subject using the received images and/or received displacement signal according to the determined mode of operation.