Tactile Coding Blocks with AI Image Analysis for Visually Impaired

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

There is a lack of accessible programming resources for visually impaired children, who require hands-on, tactile experiences tailored to their unique needs, and current educational resources are predominantly geared towards sighted children.

Innovation Solution

A method and system using physical toy blocks to perform coding tasks, where each block represents a programming code concept, and an AI-powered system captures images of block arrangements to analyze and determine if the coding structure satisfies task completion criteria, providing non-visual feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If visual-based programming toys are used, then programming education can be provided to children, but visually impaired children cannot access these resources

Engineering Contradiction:

ImproveAccessibility to programming resourcesVSAvoidVisual information required for block arrangement

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent replaces visual-based interaction with tactile-based interaction. Visually impaired children can touch and feel the physical blocks to understand programming concepts, substituting the visual sense with the tactile sense while maintaining the core educational function

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces audio feedback and tactile markers as intermediary elements that bridge the gap between the visual programming interface and the tactile exploration needed by visually impaired children, allowing them to interact with and understand code structures through non-visual senses

Inventive Principle:

Principle #24Intermediary (Mediator)

2Extent of automation

If AI image analysis is used to detect block arrangements, then coding structure can be automatically determined, but the system complexity increases

Engineering Contradiction:

ImproveAutomatic coding structure determinationVSAvoidAI processing system complexity

Core Design Contradiction:

Extent of automationVSDevice complexity

Solution Approach 1:

The patent uses image capture to create a digital copy of the physical block arrangement, which is then analyzed by AI to determine the coding structure. This copying approach allows automatic determination without requiring complex direct sensing of block positions

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent employs a multi-functional system where the imaging sensor serves multiple purposes: capturing block arrangements, providing visual feedback to sighted children, and enabling AI analysis for automatic coding structure determination, thereby managing complexity through shared components

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250142091A1Method and system for using physical toy blocks to preform coding tasks

Publication Date: 2025.05.01 THE GOVERNORS OF THE UNIV OF ALBERTA

AI summary

Embodiments herein generally relate to a method and system using physical toy blocks to perform (e.g., execute) coding tasks. In some examples, the method for performing coding tasks using physical toy blocks involves: capturing one or more images of an assembled arrangement of the toy blocks; analyzing the images to determine one or more arrangement features; based on the determined arrangement features, determining a code structure associated with the block arrangement; determining if the code structure satisfies one or more criteria, associated with a coding task; and if so, generating an output indicating the coding task is completed.