AR Coding Block Recognition via OpenCV Markers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing coding education tools lack a stable recognition system for tangible blocks in an Augmented Reality (AR) environment, making it difficult for low-age learners to accurately recognize and place commands for coding puzzles within a limited time.

Innovation Solution

A coding education block recognition system that utilizes a block recognition algorithm to acquire order information of command blocks with OpenCV-based markers, allowing for accurate placement of commands in an AR environment and providing a reward mechanism to enhance learner interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a block recognition algorithm is implemented to recognize command blocks in AR environment, then the recognition success rate is improved, but the system complexity increases

Engineering Contradiction:
Improverecognition success rateVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The block recognition algorithm is divided into separate functional modules: image acquisition module, marker detection module, coordinate extraction module, and block placement module. Each module handles a specific aspect of the recognition process, making the overall system more manageable and maintainable while achieving high recognition success rates

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

OpenCV-based markers are introduced as intermediary elements attached to the command blocks. These markers serve as recognizable targets that bridge the physical block and the digital AR environment, enabling reliable recognition without requiring complex computer vision algorithms to interpret the blocks directly

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If coordinates are extracted from OpenCV images to determine block placement order, then the placement accuracy is improved, but the processing time increases

Engineering Contradiction:
Improveplacement accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system pre-processes and stores coordinate information from OpenCV images during the image acquisition phase. By preparing coordinate data in advance before the actual block placement operation, the system achieves accurate placement without incurring processing delays during the critical placement moment

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex real-time coordinate calculation mechanisms with pre-computed coordinate data stored from OpenCV image processing. This substitution eliminates the need for repeated complex calculations during block placement, significantly reducing processing time while maintaining placement accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If a reward mechanism is added to motivate learners, then the learner interest is improved, but the device complexity increases

Engineering Contradiction:
Improvelearner interestVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The reward mechanism leverages the existing AR environment and block recognition system to provide rewards. By using the same camera, display, and interaction mechanisms already present in the coding education tool, the system adds motivational functionality without requiring separate dedicated hardware components, thus minimizing the increase in device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12205486B2Recognizing coding education block system
Publication Date: 2025.01.21 HONGIK UNIV IND ACAD COOP FOUND
  • US12205486B2 patent drawing
  • US12205486B2 patent drawing
  • US12205486B2 patent drawing

AI summary

The present disclosure relates to a coding education block recognition system which can stably recognize a plurality of blocks in an AR (Augmented Reality) environment within a limited time through placement of commands for inputting coding puzzles created in the form of tangible blocks that can be directly handled by the learner's hand.