Webcam-Based Pill Detection for Medication Adherence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current medication adherence monitoring systems are inadequate in confirming whether patients properly ingest medications, especially in clinical trials, due to reliance on invasive technologies, high costs, and limited ability to ensure adherence across multiple patients and populations, with no comprehensive system for verifying ingestion or managing complex regimens.
Innovation Solution
A method and apparatus that uses webcam-based face detection and image processing to confirm if a patient has placed a pill in their mouth, providing guidance and classification to ensure accurate adherence, applicable to both low and high computing environments, and includes additional steps for confirming ingestion and pill identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional methods (pill counting, patient interviews) are used to monitor medication adherence, then the system is simple and low cost, but the measurement precision and reliability of adherence confirmation are inadequate
Solution Approach 1:
The patent replaces manual mechanical methods (pill counting, physical interviews) with an automated optical system using a camera to capture images of the patient's mouth. This substitution enables non-invasive, automated detection of pill ingestion by analyzing visual features such as mouth opening state, tongue position, and pill presence, thereby improving measurement precision while reducing the need for complex manual monitoring procedures
Solution Approach 2:
The system enables patients to self-monitor their own adherence by capturing images of themselves taking medication. The automated image analysis algorithm independently determines whether the pill is in the mouth or has been swallowed, eliminating the need for external observers or complex verification procedures, thus improving reliability while keeping the system relatively simple
2Measurement precision
If invasive technologies (RFID chips, smart blister packs, MEMS caps) are used to track medication, then adherence monitoring precision improves, but the ease of operation and patient comfort deteriorate
Solution Approach 1:
The patent replaces invasive mechanical tracking devices (RFID chips embedded in pills, smart blister packs requiring physical attachment, MEMS caps that must be screwed onto bottles) with a non-invasive optical imaging system. The camera captures images of the patient's mouth during medication intake, and automated algorithms analyze these images to verify ingestion, thereby maintaining high measurement precision while dramatically improving ease of operation and patient comfort by eliminating all physical attachments and invasive elements
3Reliability
If comprehensive verification systems are implemented to confirm pill ingestion, then adherence reliability improves, but the computational cost and processing time increase
Solution Approach 1:
The patent applies partial action by implementing a hierarchical verification process that does not always perform complete analysis. The system first checks for basic conditions (mouth opening state, presence of tongue), then only performs more computationally intensive pill detection and swallowing analysis when these preliminary conditions are met. This approach maintains high reliability by verifying ingestion only when necessary while reducing overall computational resource consumption by avoiding unnecessary full-analysis cycles
Solution Approach 2:
The verification process is segmented into multiple independent analysis stages: (1) detecting mouth opening state, (2) identifying tongue position, (3) locating the pill, and (4) determining swallowing action. Each stage can be processed independently and contributes incrementally to the overall verification confidence, allowing the system to achieve high reliability through cumulative evidence while managing computational load by processing only the necessary segments for each verification case
Data Source
AI summary
A method, apparatus and computer program stored on a non-volatile computer readable storage medium for confirming a pill in the mouth of a user. The computer program causing a general purpose computer to perform the steps of capturing one or more images of a user by an image capture device, confirming the position of the face of the user within the captured image by measuring a size of the face, and setting a predetermined portion of the face of the user to be a region of interest. An open mouth of the user is confirmed within the region of interest, and the open mouth of the user is classified as one of a mouth with a pill therein and a mouth without a pill therein.


