Augmented Reality Coding Training with Virtual Robot
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current coding training methods for beginners, children, and adolescents lack interactive and immersive experiences, as they often rely on block-type commands rather than programming languages, and do not effectively utilize augmented reality to enhance learning.
Innovation Solution
A method using a computing device with a camera to obtain and recognize images, match objects, display a virtual robot, and arrange instruction blocks for controlling its movement, allowing users to interact with virtual objects and receive feedback on mission completion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If block-type commands are used for coding training, then beginners can learn coding more easily, but the training lacks interactivity and immersion
Solution Approach 1:
A virtual robot is introduced as an intermediary between the block-type commands and the user's imagination. The virtual robot visually executes the coded instructions, serving as a mediator that transforms abstract code blocks into concrete, observable actions. This maintains the simplicity of block coding while adding the interactivity and visual feedback that enhances engagement and understanding.
2Device complexity
If traditional coding training methods are used, then the training process is simple, but the learning experience is not immersive
Solution Approach 1:
The training experience is extended from a two-dimensional screen interface to a three-dimensional virtual space. The virtual robot moves and interacts within a 3D environment that users can navigate and explore from multiple angles. This dimensional expansion creates an immersive experience while keeping the coding interface itself relatively simple.
Solution Approach 2:
A virtual copy of a robot is created and programmed to perform tasks. Instead of manipulating physical robots or complex systems, users program a digital replica that can be reset, reproduced, and manipulated without physical constraints. This copying approach simplifies the training setup while enabling rich interactive scenarios.
3Adaptability or versatility
If augmented reality is integrated into coding training, then interactivity and immersion are enhanced, but the system complexity increases
Solution Approach 1:
Physical mechanical systems are replaced with software-based virtual reality environments. Instead of using physical robots, motors, and mechanical components, the system uses computer-generated 3D graphics and software simulations. This substitution reduces physical complexity while maintaining or enhancing interactivity through digital controls and visual feedback.
Data Source
AI summary
Provided is a coding training method using augmented reality as a method performed by a computing device including a camera, the coding training method including: a first step of obtaining coding training content; a second step of selecting one or more points included in the coding training content; a third step of obtaining an image photographed by the camera; a fourth step of recognizing the photographed image and matching one or more objects included in the photographed image with the one or more points; a fifth step of displaying an image and the matched one or more points; a sixth step of displaying a virtual robot on the photographed image; a seventh step of displaying one or more instruction blocks each including one or more instructions for controlling a movement of the virtual robot; an eighth step of arranging the one or more instruction blocks at the one or more points based on user input for the one or more instruction blocks displayed; a ninth step of controlling the virtual robot in order in which the one or more instruction blocks are arranged, moving the virtual robot along the one or more points, and performing instructions corresponding to the instruction blocks arranged at each point; and a tenth step of displaying the movement of the virtual robot according the control result.