Webcam-Based Pill Detection for Medication Adherence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medication adherence monitoring systems are inadequate in confirming whether patients properly ingest medications, especially in clinical trials, due to reliance on invasive technologies, high costs, and limited ability to ensure adherence across multiple patients and populations, with no comprehensive system for verifying ingestion or managing complex regimens.

Innovation Solution

A method and apparatus that uses webcam-based face detection and image processing to confirm if a patient has placed a pill in their mouth, providing guidance and classification to ensure accurate adherence, applicable to both low and high computing environments, and includes additional steps for confirming ingestion and pill identification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional methods (pill counting, patient interviews) are used to monitor medication adherence, then the system is simple and low cost, but the measurement precision and reliability of adherence confirmation are inadequate

Engineering Contradiction:
Improveadherence confirmation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical methods (pill counting, physical interviews) with an automated optical system using a camera to capture images of the patient's mouth. This substitution enables non-invasive, automated detection of pill ingestion by analyzing visual features such as mouth opening state, tongue position, and pill presence, thereby improving measurement precision while reducing the need for complex manual monitoring procedures

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables patients to self-monitor their own adherence by capturing images of themselves taking medication. The automated image analysis algorithm independently determines whether the pill is in the mouth or has been swallowed, eliminating the need for external observers or complex verification procedures, thus improving reliability while keeping the system relatively simple

Inventive Principle:
Principle #25Self-service

2Measurement precision

If invasive technologies (RFID chips, smart blister packs, MEMS caps) are used to track medication, then adherence monitoring precision improves, but the ease of operation and patient comfort deteriorate

Engineering Contradiction:
Improveingestion verification accuracyVSAvoidpatient convenience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces invasive mechanical tracking devices (RFID chips embedded in pills, smart blister packs requiring physical attachment, MEMS caps that must be screwed onto bottles) with a non-invasive optical imaging system. The camera captures images of the patient's mouth during medication intake, and automated algorithms analyze these images to verify ingestion, thereby maintaining high measurement precision while dramatically improving ease of operation and patient comfort by eliminating all physical attachments and invasive elements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If comprehensive verification systems are implemented to confirm pill ingestion, then adherence reliability improves, but the computational cost and processing time increase

Engineering Contradiction:
Improveadherence verification confidenceVSAvoidcomputational resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by implementing a hierarchical verification process that does not always perform complete analysis. The system first checks for basic conditions (mouth opening state, presence of tongue), then only performs more computationally intensive pill detection and swallowing analysis when these preliminary conditions are met. This approach maintains high reliability by verifying ingestion only when necessary while reducing overall computational resource consumption by avoiding unnecessary full-analysis cycles

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The verification process is segmented into multiple independent analysis stages: (1) detecting mouth opening state, (2) identifying tongue position, (3) locating the pill, and (4) determining swallowing action. Each stage can be processed independently and contributes incrementally to the overall verification confidence, allowing the system to achieve high reliability through cumulative evidence while managing computational load by processing only the necessary segments for each verification case

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11314964B2Apparatus and method for determination of medication location
Publication Date: 2022.04.26 AICURE CORP
  • US11314964B2 patent drawing
  • US11314964B2 patent drawing
  • US11314964B2 patent drawing

AI summary

A method, apparatus and computer program stored on a non-volatile computer readable storage medium for confirming a pill in the mouth of a user. The computer program causing a general purpose computer to perform the steps of capturing one or more images of a user by an image capture device, confirming the position of the face of the user within the captured image by measuring a size of the face, and setting a predetermined portion of the face of the user to be a region of interest. An open mouth of the user is confirmed within the region of interest, and the open mouth of the user is classified as one of a mouth with a pill therein and a mouth without a pill therein.