VR Gesture-Based Code Input for Editable Programming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing programming techniques, such as those described in PTL 1, are limited to operating mobile terminals and do not support the creation of editable information expressions, such as computer programs, in a virtual reality space.
Innovation Solution
An information expression creation support device that selects and arranges editable information expressions, like computer programs, based on the movement trajectory of a creator's actions in a virtual reality space, using predefined candidates and a system of motion determination, code addition, and analysis units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If keyboard typing is used for code input, then input accuracy can be maintained, but input speed and efficiency are limited
Solution Approach 1:
The patent replaces the mechanical keyboard typing system with a gesture-based input system using VR controllers. The motion determination unit detects hand movements and translates them into code input operations, eliminating the need for physical keyboard interaction while maintaining input accuracy through gesture recognition patterns.
Solution Approach 2:
The patent introduces a motion determination unit as an intermediary between the user's physical gestures and the code input system. This intermediary translates complex hand movements into meaningful programming operations, allowing users to input code through natural gestures rather than direct keyboard typing.
2Adaptability or versatility
If PTL 1's fingertip trajectory detection is used, then mobile terminal operation can be enhanced, but programming creation work cannot be supported
Solution Approach 1:
The patent extends the gesture recognition system to serve multiple functions: it can detect simple navigation gestures for mobile terminal operation while simultaneously supporting complex programming creation tasks. The motion determination unit is designed to recognize both basic movements and sophisticated coding-related gestures within the same system.
Solution Approach 2:
The patent transitions from two-dimensional screen-based gesture detection to three-dimensional spatial gesture recognition in VR environment. This adds depth and spatial context to gesture detection, enabling more expressive and accurate programming input methods while maintaining compatibility with simpler mobile operations.
3Productivity
If traditional keyboard input is used, then code input accuracy is maintained, but creation efficiency for editable information expressions is reduced
Solution Approach 1:
The patent incorporates feedback mechanisms where the system analyzes detected gestures, provides intermediate recognition results to the user, and allows for correction or confirmation. This feedback loop ensures that even complex gestures are translated into code with high accuracy, maintaining precision while enabling faster input methods.
Solution Approach 2:
The system performs preliminary analysis of gesture patterns and predicts intended code input before final execution. By pre-processing gesture data and anticipating user intent, the system can quickly translate gestures into code while maintaining accuracy through predictive validation against expected programming patterns.
Data Source
AI summary
To support creation of an editable information expression of a predetermined language in a virtual reality space, an information expression creation support device is provided. The device supports creation of an editable information expression source code of the predetermined language in the virtual reality space by tracking a movement trajectory of an action of a creator and selecting an information expression from candidates of the information expression, which are prepared in advance, based on an acquired movement trajectory of an action of the creator, and the selected information expression is arranged at a predetermined position.