XR Controller Fusing Optical and Touch Sensing for Handwriting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing controllers in extended reality (XR) applications, such as virtual reality (VR) and augmented reality (AR), cannot accurately simulate handwriting due to their inability to control the movement of virtual cursors effectively, limiting immersive experiences.
Innovation Solution
A control device equipped with an optical sensing component to track movement in a three-dimensional space and a touch sensing component to track movement on a plane, coupled with a controller that generates a handwriting image based on this data for display, allowing for accurate simulation of handwriting in XR environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a traditional controller is used in XR applications, then the device complexity is low, but the handwriting precision and control accuracy are insufficient
Solution Approach 1:
The patent combines multiple sensing components (optical sensing component and touch sensing component) with the controller into an integrated system. The optical sensing component acquires three-dimensional movement data while the touch sensing component acquires two-dimensional touch data, and both are processed by the same controller to generate handwriting images, achieving high precision without requiring separate devices
Solution Approach 2:
The controller is designed to perform multiple functions: it processes both optical sensing data from three-dimensional space and touch sensing data from two-dimensional planes, generates handwriting images, and controls display devices. This multi-functional design achieves high measurement precision while avoiding the need for multiple specialized devices
2Measurement precision
If a controller with multiple sensing components is added to achieve handwriting function, then the handwriting precision is improved, but the device complexity increases
Solution Approach 1:
The patent divides the sensing functions into distinct modules: an optical sensing component for three-dimensional movement detection and a touch sensing component for two-dimensional touch detection. Each component is optimized for its specific function, yet both feed into a unified controller that integrates their data to generate accurate handwriting images
Solution Approach 2:
The patent incorporates an optical sensing component that detects three-dimensional movement data, adding a spatial dimension beyond the traditional two-dimensional touch plane. This dimensional enhancement enables accurate handwriting simulation in immersive XR environments while maintaining controller integration
3Measurement precision
If traditional controller movement control is used, then the ease of operation is maintained, but the virtual cursor control accuracy deteriorates
Solution Approach 1:
The controller uses touch sensing components to detect user input on the touch surface, providing real-time feedback about touch position and pressure. This feedback mechanism enables precise virtual cursor control while maintaining natural interaction, as users can see the cursor respond accurately to their touch gestures
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the accurate simulation of handwriting in immersive experiences by fusing three-dimensional movement data with two-dimensional touch data to generate and display handwriting images, enhancing user interaction in XR applications.
Implementation Method 1
The optical sensing component is configured to acquire optical sensing data of the control device when the control device moves in an environmental space
Implementation Method 2
The touch sensing component is configured to acquire touch data of the control device when the control device moves on a plane
Data Source
AI summary
The present disclosure provides a control device, a control method and a virtual image display system. The control device controls a display. The control device includes an optical sensing component, a touch sensing component and a controller. The optical sensing component is configured to acquire optical sensing data of the control device when the control device moves in an environmental space. The touch sensing component is configured to acquire touch data of the control device when the control device moves on a plane. The controller is configured to generate a handwriting image according to the optical sensing data and the touch data, such that the display displays the handwriting image.