Responsive Video Canvas for 2D-to-3D AR Prototyping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional three-dimensional UX tools require advanced programming and 3D modelling skills, while two-dimensional UX tools lack the ability to process three-dimensional AR or VR interactions, limiting collaboration and prototyping efficiency in augmented and virtual reality applications.
Innovation Solution
A responsive video canvas is generated by rendering digital video frames and associating visual transforms with three-dimensional scene data, allowing two-dimensional digital objects to interact with underlying geometry, enabling intuitive and rapid prototyping without the need for extensive technical knowledge.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional three-dimensional UX tools are used, then three-dimensional AR or VR interactions can be processed, but advanced programming and 3D modelling skills are required
Solution Approach 1:
The patent introduces a two-dimensional UX tool as an intermediary that bridges the gap between conventional 2D design tools and 3D AR/VR environments. This intermediary tool processes 3D scene data and automatically generates appropriate visual transforms, allowing designers to work in a familiar 2D environment while still achieving 3D interaction capabilities without requiring advanced 3D modeling skills
Solution Approach 2:
The patent replaces the manual mechanical process of 3D modeling and transform calculation with an automated computational system. The system automatically processes scene data, calculates visual transforms, and applies them to 2D digital objects, substituting the complex mechanical 3D modeling workflow with an automated algorithmic approach
2Ease of operation
If conventional two-dimensional UX tools are used, then ease of operation is improved, but the ability to process three-dimensional AR or VR interactions is lost
Solution Approach 1:
The patent incorporates three-dimensional scene data and visual transforms into a two-dimensional UX tool interface, effectively adding a third dimension of capability to a two-dimensional workflow. The system processes 3D geometry data and applies perspective transforms to 2D digital objects, enabling 3D interaction processing within the familiar 2D tool environment
Solution Approach 2:
The patent enhances the two-dimensional UX tool to perform multiple functions: it maintains its original 2D design capabilities while simultaneously processing 3D scene data, calculating visual transforms, and enabling 3D AR/VR interactions. This multi-functionality allows the same tool to handle both 2D and 3D workflows
3Ease of manufacture
If conventional approaches are used for prototyping, then static digital objects can be created, but collaborative opportunities are limited and prototyping time increases
Solution Approach 1:
The patent performs preliminary processing of 3D scene data by automatically calculating visual transforms and preparing them for use in the 2D UX tool. This preliminary action eliminates the need for designers to manually perform complex 3D calculations during the prototyping process, significantly reducing prototyping time and enabling faster iteration
Data Source
AI summary
Techniques for responsive video canvas generation are described to impart three-dimensional effects based on scene geometry to two-dimensional digital objects in a two-dimensional design environment. A responsive video canvas, for instance, is generated from input data including a digital video and scene data. The scene data describes a three-dimensional representation of an environment and includes a plurality of planes. A visual transform is generated and associated with each plane to enable digital objects to interact with the underlying scene geometry. In the responsive video canvas, an edit positioning a two-dimensional digital object with respect to a particular plane of the responsive video canvas is received. A visual transform associated with the particular plane is applied to the digital object and is operable to align the digital object to the depth and orientation of the particular plane. Accordingly, the digital object includes visual features based on the three-dimensional representation.