Accessibility System for Visually Impaired Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Social networking systems do not effectively assist visually impaired users in understanding their environment, as they lack real-time object and facial recognition capabilities integrated with social networking data to provide relevant information through audible commands.
Innovation Solution
A software application installed on mobile devices with cameras and microphones, utilizing object recognition algorithms to identify faces and objects, and leveraging social networking data to provide audible feedback based on user queries, such as locating friends or identifying objects in the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If social networking systems provide real-time object and facial recognition capabilities integrated with social networking data, then accessibility for visually impaired users is improved, but device complexity increases
Solution Approach 1:
The patent combines object recognition algorithms, facial recognition algorithms, and social networking data into a unified accessibility system. The system merges camera input with social networking API calls to provide comprehensive environmental awareness, combining multiple functions into a single integrated solution that helps visually impaired users understand their surroundings.
Solution Approach 2:
The accessibility system performs multiple functions through a single application: capturing images via camera, recognizing objects using object recognition algorithms, identifying faces using facial recognition algorithms, retrieving social networking data, and providing audible feedback. This multi-functional approach consolidates what would otherwise require separate systems into one unified tool.
2Speed
If the system processes images in real-time to identify faces and objects, then responsiveness is improved, but computational resources consumed increase
Solution Approach 1:
The system performs partial image processing by first detecting faces using facial recognition algorithms, then only processing regions of interest where faces are detected. This selective processing approach reduces overall computational load compared to analyzing every pixel of every image, while still providing comprehensive identification when needed.
Solution Approach 2:
The system pre-loads social networking data and prepares recognition algorithms before actual use. By having social networking APIs pre-configured and recognition models ready, the system can quickly process images without needing to load everything from scratch during real-time operation, reducing instantaneous computational requirements.
Data Source
AI summary
In one embodiment, a method includes capturing one or more images of a physical environment surrounding the first user; determining that one or more of the images comprises a face; generating a facial image by cropping a region of the image comprising the face; sending instructions to perform facial recognition on the facial image; receiving a name associated with a second user of the online social network, wherein the face is associated with the second user, wherein the first user is represented by a first node on a social graph maintained by the social-networking system and the second user is represented by a second node on the social graph, and the first node and the second node are connected by at least one edge; and providing an audible indication of the name associated with the second user.