Assistive Smart Glasses With Bone-Conduction Scene Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing smart glasses for visually impaired individuals are cumbersome, lack effective AI assistance for scene recognition, and suffer from delays and environmental noise interference in real-time image and sound transmission.
Innovation Solution
Integrate a microprocessor, bone conduction headphone, wireless communication module, CCD optical module, DSP image processing module, camera lens, memory, and power supply into smart glasses, enabling real-time image capture, processing, and audio output, with optional cloud or volunteer assistance via a mobile terminal and service terminal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If smart glasses use simple AI MCU or cloud processing for image recognition, then device complexity is reduced, but measurement precision and response time deteriorate
Solution Approach 1:
The system segments the image processing workflow into multiple stages: simple AI MCU for basic processing, mobile terminal for intermediate processing, and cloud server for complex scenarios. This segmentation allows each component to handle appropriate tasks, improving overall recognition precision while maintaining reasonable device complexity.
Solution Approach 2:
The mobile terminal performs preliminary image processing and pre-judgment before cloud submission. By preprocessing images locally and only uploading complex cases to the cloud, the system achieves higher effective recognition precision while reducing cloud dependency and latency for common scenarios.
2Adaptability or versatility
If cloud processing is used for image recognition, then adaptability is improved, but loss of time increases
Solution Approach 1:
The system segments recognition tasks by complexity: simple scenarios are handled locally by the mobile terminal with fast response, while complex scenarios are submitted to the cloud. This segmentation reduces average response time while maintaining adaptability through selective cloud usage.
Solution Approach 2:
The system performs preliminary judgment locally to identify which images require cloud processing. By filtering out simple cases that can be handled locally, the system minimizes cloud communication overhead and reduces overall response time while maintaining high adaptability.
3Ease of operation
If traditional audio transmission is used, then ease of operation is maintained, but object-generated harmful factors increase due to environmental noise
Solution Approach 1:
The system replaces traditional air-conducted audio transmission with bone conduction technology. This substitution eliminates the harmful effect of environmental noise interference by transmitting sound through the skull bones directly to the inner ear, bypassing the external auditory canal where noise enters.
4Ease of operation
If smart glasses are designed to resemble ordinary glasses, then ease of operation improves, but device complexity increases due to integrated components
Solution Approach 1:
The system employs a nested architecture where the glasses body contains the camera and basic processing components, the mobile terminal provides intermediate processing and app functionality, and the cloud server handles complex recognition tasks. This nested structure distributes complexity across multiple levels while keeping the glasses themselves relatively simple and aesthetically pleasing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time image recognition and audio feedback, allowing visually impaired users to navigate scenes and identify objects, with optional volunteer assistance for complex scenarios, enhancing usability and accuracy.
Implementation Method 1
a bone conduction headphone...the microprocessor is electrically connected to the bone conduction headphone
Implementation Method 2
the CCD optical module converts an optical image captured by the camera lens into high-resolution compression data
Data Source
AI summary
The present invention discloses assistive smart glasses for visual impairment, and a system and a control method thereof. The smart glasses include a glasses body, wherein a microprocessor, a bone conduction headphone, a wireless communication module, a CCD optical module, a DSP image processing module, a camera lens, a memory module, a power supply module, a rechargeable battery, and an I/O data port are integrated in the glasses body; the camera lens is disposed at a front end of the glasses body; the CCD optical module converts an optical image captured by the camera lens into high-resolution compression data and sends the high-resolution compression data to the DSP image processing module; the microprocessor is electrically connected to the bone conduction headphone, the wireless communication module, and the DSP image processing module via the I/O data port; the memory module and the power supply module are electrically connected to the microprocessor; and the rechargeable battery is electrically connected to the power supply module. According to the invention, image signals can be read, processed, and identified in real time from a viewpoint of a visual impaired user, and the visual impaired user can be informed by means of audio signals, such that the visual impaired user can be assisted in real time to recognize scenes and objects.