Smartphone Vein Localization via Computational Depth Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for localizing veins in medical procedures are challenging, especially for young, elderly, dark-skinned, or obese patients, due to difficulties in visualizing small, fragile, or obscured veins, leading to multiple needle insertion attempts and patient discomfort, and existing solutions are either costly or inaccurate.

Innovation Solution

A portable stereo-visual localization system using a pair of stereo image sensors and light sources to capture and align stereo images of veins and needles, allowing for precise alignment in a 3D view, reducing parallax and enhancing accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a stereo-camera based robotic vein finding system is used to determine depth information, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvedepth information accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a smartphone camera to capture 2D vein images and creates a depth map by processing these images through algorithms that simulate stereo vision. Instead of using expensive stereo cameras, the system copies the function of depth sensing through computational methods applied to standard camera images, thereby achieving depth information without the complexity of true stereo imaging hardware.

Inventive Principle:
Principle #26Copying

2Measurement precision

If Near Infrared Light (NIR) is used for depth information and needle tracking, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvedepth information accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex optical systems (NIR cameras and specialized lighting) with a standard smartphone camera and software-based image processing. The system uses algorithms to extract depth information and track needle position from ordinary visible light images, substituting mechanical/optical complexity with computational simplicity while maintaining measurement precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If multiple attempts of needle insertion are performed to locate the blood vessel, then reliability is improved, but loss of time and patient discomfort increase

Engineering Contradiction:
Improvevein localization accuracyVSAvoidprocedure time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary vein localization using smartphone camera imaging and depth map generation before needle insertion begins. By pre-identifying the exact vein location and tracking it in real-time during the procedure, the system enables first-attempt success, eliminating the need for multiple retry insertions and reducing overall procedure time while maintaining high reliability.

Inventive Principle:
Principle #10Preliminary action

4Device complexity

If a smartphone equipped with a camera under NIR and VIS condition is used for finding the vein, then device cost is reduced, but measurement precision deteriorates due to lack of depth information

Engineering Contradiction:
Improvedevice costVSAvoiddepth information accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the parameter of depth information extraction from hardware-based (stereo cameras, NIR) to software-based processing. By applying image processing algorithms that analyze focus blur, edge sharpness, and other optical parameters in standard camera images, the system derives depth information computationally, maintaining measurement precision while using only a standard smartphone camera.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and efficient vein localization, reducing needle insertion attempts and improving patient safety by providing a precise, real-time visualization of veins, even in challenging cases, and can be used with cost-effective smartphone technology.

Implementation Method 1

a pair of light sources situated on a pair of support members configured to illuminate a field of view in which the object is located

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

record a first stereo image of the object in the illuminated field of view from a first view point by a first stereo image sensor of the pair of stereo image sensors and a second stereo image of the object in the illuminated field of view from a second view point by a second stereo image sensor of the pair of stereo image sensors

Methodology Applied
Scientific EffectStereo vision: Parallax

Data Source

PatentUS11647949B2Method and system for stereo-visual localization of object
Publication Date: 2023.05.16 SAMSUNG ELECTRONICS CO LTD
  • US11647949B2 patent drawing
  • US11647949B2 patent drawing
  • US11647949B2 patent drawing

AI summary

Embodiments herein provide a method for stereo-visual localization of an object by a stereo-visual localization apparatus. The method includes generating, by a stereo-visual localization apparatus, a stereo-visual interface displaying the first stereo image of the object and the first stereo image of the subject in a first portion and the second stereo image of the object and the second stereo image of the subject in a second portion. Further, the method includes detecting, by the stereo-visual localization apparatus, a movement of the subject to align the subject in the field of view with the object. Furthermore, the method includes visually aligning, by the stereo-visual localization apparatus, the subject with the object based on the movement by simultaneously changing apparent position of the first and the second stereo images of the subject in each of the first portion and the second portion in the stereo-visual interface.