Augmented Reality Lewis Structure Explorer for Blind Students
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital learning platforms for STEM education, particularly in chemistry, often exclude blind or visually impaired students due to their visual and spatial nature, discouraging them from pursuing science careers.
Innovation Solution
An augmented reality system that uses a set of chemical pieces, including atom and bond pieces, recognized by video cameras and a computer device to create and explore chemical structures, providing accessible learning through interactive and audio feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If digital learning platforms use visual and spatial interfaces for chemistry education, then learning effectiveness is improved, but accessibility for blind or visually impaired students deteriorates
Solution Approach 1:
The patent introduces audio feedback and haptic feedback as intermediary elements between the visual chemical structures and blind students. The system uses audio descriptions to convey molecular geometry, bond types, and spatial arrangements, while haptic feedback provides tactile confirmation of student interactions with virtual chemical models, enabling accessible engagement without compromising learning effectiveness
Solution Approach 2:
The system transforms the presentation parameters of chemical information from purely visual/spatial to multi-sensory formats. Chemical structures are rendered with audio annotations describing geometric configurations, bond angles, and molecular orientations. The interface allows dynamic switching between visual display and audio description modes, adapting the information delivery parameters to match different student needs while maintaining scientific accuracy
2Ease of operation
If traditional chemistry teaching materials are converted to digital formats, then interactivity is improved, but accessibility for all students deteriorates
Solution Approach 1:
The digital chemistry platform is designed with universal accessibility features integrated into its core functionality. The system provides multiple interaction modes (visual drag-and-drop, audio-guided assembly, haptic feedback confirmation) that serve both visually impaired students and their sighted peers. All students benefit from the enhanced interactivity, while BVI students additionally gain accessible entry points through audio and tactile feedback mechanisms
Solution Approach 2:
The chemistry learning content is segmented into discrete, independently controllable elements (atoms, bonds, molecular groups) that can be manipulated through multiple sensory channels. Each chemical component can be individually selected, described audibly, and assembled with haptic confirmation, allowing students to engage with complex molecular structures through segmented, manageable interactions that accommodate different learning preferences and abilities
Data Source
AI summary
An augmented reality Lewis structure explorer including a set of chemical pieces to be used to form representations of chemical structures is provided. The set of chemical pieces includes a first plurality of atom pieces and a second plurality of chemical bond pieces. Each atom piece represents an atom, while each chemical bond piece represents a chemical bond. The Lewis structure explorer also includes one or more video cameras configured to view a target area, a display, and a computer device in communication with the one or more video cameras and the display. The computer device is configured to recognize atom pieces and chemical bond pieces placed within the target area. The computer device is also configured to recognize chemical bonds when a selected chemical bond piece is placed between two atom pieces. The computer device further configured to render recognized atom pieces and chemical bond pieces on the display.