Virtual Object Manipulation in Extended Reality Planes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current extended reality (XR) systems lack effective techniques for manipulating virtual objects within an XR environment, particularly in moving virtual objects across planes other than those defined by real-world objects in view, limiting user interaction quality.
Innovation Solution
A computer-implemented method using a mobile device with a camera and XR software application that allows users to select virtual objects and move them within a plane parallel to the device's display screen based on user input, enabling manipulation independent of real-world object coordinates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are manipulated only within planes defined by real-world objects in view, then the system maintains simple coordinate mapping, but user interaction flexibility is limited
Solution Approach 1:
The patent introduces a new dimension of manipulation by allowing virtual objects to be moved across different planes (e.g., from a table surface to a wall surface) rather than being constrained to the plane of the detecting real-world object. This dimensional extension enables users to interact with virtual objects on any surface within the field of view, significantly increasing interaction flexibility while the system manages the complexity through coordinate transformation algorithms.
2Ease of operation
If the XR system uses touchscreen input to move virtual objects along detected real-world surfaces, then the interaction is intuitive, but the virtual object is constrained to the coordinate system of the detected object
Solution Approach 1:
The patent makes the coordinate system universal by enabling virtual objects to be manipulated across multiple different planes and surfaces (table, wall, floor, etc.) using the same touchscreen input mechanism. The system detects the target plane the user intends to interact with and transforms the touchscreen coordinates accordingly, allowing one input method to serve multiple functions across different spatial contexts.
Solution Approach 2:
The patent introduces a coordinate transformation intermediary that converts touchscreen coordinates into the appropriate coordinate system for the target plane. This intermediary layer translates user input from the touchscreen domain into the spatial domain of the XR environment, enabling intuitive interaction while allowing manipulation across different planes and coordinate systems.
3Adaptability or versatility
If virtual objects are moved across planes not defined by real-world objects, then user interaction flexibility improves, but the system requires complex coordinate transformation
Solution Approach 1:
The system performs self-service by automatically detecting the user's intended target plane through camera visualization and autonomously performing the coordinate transformation without requiring explicit user specification. The XR system identifies which plane the user wants to interact with based on the visualization feedback and automatically adjusts the coordinate system, eliminating the need for complex manual coordinate specification while enabling manipulation across any plane.
Data Source
AI summary
A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, techniques are performed for manipulating virtual objects in an XR environment. In one technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location, within a plane parallel to a touchscreen of a mobile device, responsive to a displacement determined based on user input detected via the touchscreen.