VR System for Sketching 3D Geometry on Physical Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual design environments are cumbersome and disconnect users from their natural modes of thinking and interaction, as they require switching between tangible instruments and limited visual perceptions, isolating the design process from the physical environment, which hinders creative expression and quick prototyping.
Innovation Solution
The system integrates physical objects into the design process through a virtual reality interface that allows users to create 3D geometry by drawing on a physical surface, using a hand-held device with SLAM capabilities, and employs interaction modes like inspection, curve, and shape modes, along with projective sketching, curve templates, and GrabCut for extracting outlines, enabling intuitive shape manipulation and texture borrowing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional 2D WIMP design environment is used, then users can access standard interface elements, but users experience fragmented interactions and isolated design context from physical environment
Solution Approach 1:
The patent merges the physical environment and digital design interface by projecting virtual design elements directly onto physical surfaces. Users can sketch and manipulate 3D shapes by drawing on physical objects or surfaces in their environment, combining the tangible physical world with digital design capabilities into a unified interaction space, thereby eliminating the fragmentation between separate input devices and design context.
Solution Approach 2:
The system uses a mobile device with camera and display as an intermediary between the user and the physical environment. The device captures the physical scene, overlays virtual design interfaces, and renders 3D shapes in augmented reality, mediating the interaction to provide continuous, context-aware design capabilities while maintaining simplicity for the user.
2Adaptability or versatility
If virtual design environment isolates from physical context, then digital artifact creation is enabled, but creative expression and design ideation are hindered
Solution Approach 1:
The system performs preliminary actions by automatically capturing the physical environment, identifying suitable surfaces for projection, and pre-configuring the augmented reality interface before the user begins design work. This preparation includes setting up the coordinate systems, lighting conditions, and spatial references, allowing users to immediately start creative expression without setup delays.
Solution Approach 2:
The system enables self-service by allowing users to leverage their existing physical environment and objects as design surfaces and references. The augmented reality interface automatically adapts to the user's workspace, providing contextual tools and information without requiring users to configure separate virtual environments, thereby accelerating design ideation and prototyping.
3Adaptability or versatility
If through-the-screen AR and MR are used, then gap between physical and digital worlds is bridged, but physical environment is used mainly as dormant container rather than source of inspiration
Solution Approach 1:
The system applies local quality by allowing different regions of the physical environment to serve different design functions. Specific surfaces can be designated for sketching, others for displaying reference information, and certain spatial zones for placing 3D models. The interface adapts locally to each area's purpose, enabling the physical environment to actively contribute to design inspiration rather than serving as a uniform container.
Solution Approach 2:
The system implements dynamics by making the augmented reality interface responsive and adaptable in real-time. As users move through their environment or interact with objects, the interface dynamically adjusts the placement, scale, and type of virtual elements displayed. This dynamic behavior transforms the static physical environment into an active participant in the design process, enabling quick prototyping through natural interaction.
Data Source
AI summary
A virtual reality system, comprising an electronic 2d interface having a depth sensor, the depth sensor allowing a user to provide input to the system to instruct the system to create a virtual 3D object in a real-world environment. The virtual 3D object is created with reference to at least one external physical object in the real-world environment, with the external physical object concurrently displayed with the virtual 3D object by the interface. The virtual 3D object is based on physical artifacts of the external physical object.