AR-Guided Smartphone Wound Imaging for 3D Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote medical imaging using conventional mobile devices faces challenges such as improper distance, angle, lighting, and color calibration, leading to suboptimal image quality, which hampers accurate medical diagnosis and treatment.

Innovation Solution

The 'Healthy Selfie' method employs augmented reality (AR) to guide users in capturing high-quality images by displaying AR images on mobile devices, enabling them to adjust distance and angle, and potentially using voice commands or sound patterns to assist in capturing 3D digital models of wounds or lesions for medical diagnosis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional mobile devices are used for remote medical imaging, then accessibility and cost are improved, but image quality and measurement precision deteriorate due to improper distance, angle, and lighting

Engineering Contradiction:
ImproveaccessibilityVSAvoidimage quality
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces fiducial markers as intermediary objects that mediate between the mobile device camera and the body area being imaged. These markers provide known reference points that enable the system to calculate proper distance, angle, and orientation, thereby compensating for the lack of professional imaging equipment while maintaining measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically adjusts imaging parameters (distance, angle, lighting) based on real-time feedback from fiducial marker detection. By changing these parameters adaptively rather than using fixed settings, the system maintains image quality across varying user conditions and environments.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If fiducial markers are introduced to improve calibration and measurement precision, then image accuracy is improved, but device complexity and ease of operation worsen due to additional setup requirements

Engineering Contradiction:
Improvecalibration accuracyVSAvoidsetup complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs automatic fiducial marker detection, validation, and calibration without requiring manual intervention. The mobile device's processor automatically identifies marker positions, calculates imaging parameters, and adjusts settings, thereby reducing the burden on users despite the added complexity of marker-based calibration.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The fiducial markers are pre-positioned on the body area before imaging begins, and the system pre-calculates the optimal imaging parameters based on marker detection. This preliminary setup enables subsequent images to be captured with correct geometry without requiring real-time manual adjustment.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If multiple angles and distances are captured to improve 3D assessment, then diagnostic information is improved, but productivity and time efficiency deteriorate due to multiple positioning requirements

Engineering Contradiction:
Improvediagnostic informationVSAvoidtime efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system transitions from static single-angle imaging to dynamic multi-angle capture, where the mobile device automatically adjusts its position and orientation to capture the body area from multiple perspectives. This dynamic approach comprehensively captures 3D geometric information while maintaining efficiency through automation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses fiducial markers as feedback references to automatically determine optimal positioning for multiple angles and distances. By continuously monitoring marker positions and calculating required adjustments, the system guides the user through efficient multi-angle capture without requiring manual measurement or trial-and-error positioning.

Inventive Principle:
Principle #23Feedback

4Measurement precision

If color calibration references are added to improve body color assessment, then color accuracy is improved, but device complexity and ease of operation worsen

Engineering Contradiction:
Improvecolor accuracyVSAvoiduser simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The fiducial markers serve dual functions: they provide geometric reference points for distance and angle calculation, and they incorporate color reference elements for body color assessment. By merging these two calibration functions into a single integrated marker system, the patent reduces the number of separate components and simplifies the overall setup process.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12014500B2Healthy-Selfie(TM): methods for remote medical imaging using a conventional smart phone or augmented reality eyewear
Publication Date: 2024.06.18 HOLOVISIONS
  • US12014500B2 patent drawing
  • US12014500B2 patent drawing
  • US12014500B2 patent drawing

AI summary

A method for remote medical imaging involves displaying augmented reality (AR) images on a remote patient's smart phone or smart eyewear. The augmented reality images guide the patient concerning how to move their mobile and/or wearable device relative to a wound, injury, lesion, or abnormality on their body in order to capture images of the wound, injury, lesion, and/or abnormality from different distances and angles. These images are then integrated into a 3D digital image for medical diagnosis or treatment.