AR System for Toy Interaction via Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality systems lack a convenient way for users, especially children, to interact with virtual worlds, as they fail to replicate the sensory experience of the real world, limiting the ability to engage with real-world objects during play.

Innovation Solution

A system that combines physical toys with augmented reality using a user device equipped with a camera and computer system, capable of recognizing objects and rendering augmented reality displays, allowing children to interact with virtual environments while maintaining tactile experience through the use of ID suits, blocks, and libraries for selecting augmented objects, backgrounds, and effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If virtual reality systems are used to create immersive virtual worlds, then the immersive experience is improved, but the ability to interact with real-world objects and maintain tactile experience is lost

Engineering Contradiction:
Improveimmersive experienceVSAvoidinteraction with real-world objects
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent combines virtual reality and augmented reality technologies to create a hybrid system that merges the immersive capabilities of VR with the real-world interaction capabilities of AR. The system uses a head-mounted display to present virtual environments while incorporating physical toys and objects that children can touch and manipulate, allowing simultaneous immersion and tactile interaction.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Physical toys and objects serve as intermediaries between the virtual and real worlds. These tangible objects allow children to interact with virtual environments through physical manipulation, bridging the gap between immersive virtual experience and tactile real-world interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If augmented reality is used to overlay virtual elements on real-world objects, then the ability to interact with real-world objects is maintained, but the immersive experience is reduced compared to full virtual reality

Engineering Contradiction:
Improveinteraction with real-world objectsVSAvoidimmersive experience
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The system merges augmented reality's real-world interaction capabilities with selectively applied virtual elements. Rather than fully overlaying the real world, the system strategically places virtual elements around physical objects to maintain immersion while preserving tactile interaction with real-world toys and objects.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If object recognition technology is used to identify toys in video frames, then the ability to render accurate augmented reality displays is improved, but the system complexity increases

Engineering Contradiction:
Improveobject identification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses simplified digital representations (copies) of physical toys rather than attempting to fully reconstruct or analyze complex object geometries. This approach maintains accurate object identification and tracking while reducing computational complexity by using streamlined digital models for augmented reality rendering.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12059632B2Augmented reality system for enhancing the experience of playing with toys
Publication Date: 2024.08.13 LAMM NICKOLAY
  • US12059632B2 patent drawing
  • US12059632B2 patent drawing
  • US12059632B2 patent drawing

AI summary

The systems and methods disclosed herein relate to play enhanced with augmented reality, the disclosed systems comprising: a user device, the user device comprising, a camera, and a computer system, the computer system further comprising: at least one processor; a graphical user interface and a computer-usable medium embodying computer program code configured for: collecting at least one frame of video with an image capture module; identifying user controlled objects in the at least one frame of video with an object recognition module, and rendering an augmented reality display on the user device with an augmented reality module, the augmented reality display including an augmented background and a rendering of the at least one user controlled object.