XR Data Marker Rectilinear Transformation for 3D Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) systems, data markers can be oriented in a way that makes it difficult for the XR system to decode the data encoded in them, leading to incorrect placement and orientation of XR objects, which hinders the user's ability to view these objects accurately within the XR environment.
Innovation Solution
A computer-implemented method is introduced that detects data markers in a 2D image, transforms them into a rectilinear form, and uses this transformation to determine the 3D orientation of associated XR objects, allowing for accurate placement and display of these objects within the XR environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data markers are placed at various locations in the XR environment, then the XR system can locate and generate XR objects, but the data markers may be oriented such that the encoded data is difficult to decode and the correct orientation cannot be accurately determined
Solution Approach 1:
The patent introduces an intermediary coordinate transformation process that mediates between the arbitrary orientation of data markers in the real world and the required orientation for accurate decoding. The transformation matrix acts as a mediator that maps points from the marker's local coordinate system to the camera's coordinate system, enabling accurate orientation determination regardless of the marker's physical placement orientation.
Solution Approach 2:
The patent transitions from 2D image plane coordinates to 3D spatial coordinates through coordinate transformation. By introducing the transformation matrix that operates in 3D space, the system can determine the orientation of XR objects even when data markers are placed at various orientations in the real world, effectively adding a dimensional transformation layer to resolve the orientation ambiguity.
2Ease of manufacture
If data markers are oriented in non-ideal ways, then placement flexibility is maintained, but the XR objects may be generated at incorrect locations and orientations
Solution Approach 1:
The patent changes the parameters of the coordinate transformation by introducing a transformation matrix that accounts for the marker's orientation. This parameter change allows the system to compensate for non-ideal marker placements and correctly determine the orientation and location of XR objects, thereby maintaining placement ease while improving placement precision.
3Productivity
If the XR system decodes data from arbitrarily oriented data markers, then object generation coverage is improved, but decoding accuracy and object orientation correctness deteriorate
Solution Approach 1:
The patent performs preliminary coordinate transformation and orientation calculation before generating XR objects. By pre-computing the transformation matrix and determining the correct orientation in advance, the system ensures accurate decoding and correct object placement, thereby maintaining high decoding accuracy while achieving broad object generation coverage.
Data Source
AI summary
Techniques are disclosed for using tag placement to determine 3D object orientation. An extended reality (XR) system detects, in a two-dimensional image, a data marker associated with an object viewable in an XR environment. The XR system applies a first function to the data marker to generate a rectilinear data marker by transforming a quadrilateral that circumscribes the data marker into a rectangle. The XR system determines a three-dimensional orientation of the object based on transformation of the data marker to the rectilinear data marker. The XR system determines an XR object associated with the data marker. The XR system applies a second function to the XR object, where the second function uses the three-dimensional orientation of the data marker to modify an orientation of the XR object to generate a transformed XR object. The XR system causes the transformed XR object to be displayed within the two-dimensional image.