Augmented Reality Item Recognition for Error-Reduced Medication Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional medication management systems in healthcare facilities face challenges such as human errors in medication selection, increased time consumption, and mental fatigue due to visual matching and manual selection, especially in large storage devices, leading to potential adverse drug events.
Innovation Solution
Utilizing augmented reality (AR) devices for real-time item recognition, which capture images, extract features and words, identify items, access databases for verification, and update inventory, ensuring accurate and efficient medication dispensing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If manual selection and visual matching methods are used for medication retrieval, then users can locate items in storage devices, but the process consumes increased time and leads to mental fatigue and human errors
Solution Approach 1:
The patent replaces manual visual matching and mechanical selection processes with an automated image recognition system using machine learning models. The system captures images of medications, extracts visual features automatically, and identifies items without requiring manual visual search, thereby reducing time consumption and eliminating human error in medication selection.
Solution Approach 2:
The system enables self-service medication identification through automated image capture and analysis. The medication storage device automatically captures images, processes them through machine learning models, and identifies medications without requiring user intervention in the recognition process, freeing users from time-consuming manual search tasks.
2Productivity
If automated image recognition is implemented for item identification, then retrieval accuracy and efficiency are improved, but device complexity increases
Solution Approach 1:
The patent integrates multiple functions into the medication storage device, combining image capture, machine learning-based recognition, inventory management, and automated dispensing guidance into a single system. This multi-functional approach improves productivity while managing complexity through integration rather than separate systems.
Solution Approach 2:
The system introduces an intermediary processing layer that bridges the physical storage device and the user interface. The machine learning model acts as an intermediary that processes images and translates them into actionable identification data, simplifying the overall system architecture by handling complex recognition tasks in a dedicated intermediate stage.
Data Source
AI summary
The present relates to real-time item recognition using augmented reality. This includes a method of item recognition using augmented reality. The method includes capturing a plurality of images with an augmented reality (AR) device, the plurality of images including an item, extracting with the AR device image features from the plurality of images, extracting with the AR device a plurality of words on the item from the plurality of images, identifying the item based on at least some of the image features and at least some of the plurality of words, accessing with the AR device at least one database of information relating to the item, determining to deliver the item based on the information relating to the item, and updating an inventory database upon confirmation of delivery of the item.