Virtual Object Display for Mixed Reality Cursor Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data processing on personal computers is limited to the display area, making it difficult to move objects or windows outside the screen boundaries and requiring additional physical displays or virtual desktops, which are costly and inconvenient.
Innovation Solution
An information processor using mixed reality techniques, including a coordinate processing module, camera, three-dimensional information analysis, and virtual object management, to display virtual objects outside the physical display area, allowing cursor and object movement beyond the screen edges and accessing real-world objects for data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If data processing is limited to the display section area, then the system is simple and easy to operate, but the processing area is insufficient and objects cannot be moved outside the screen
Solution Approach 1:
The patent extends the two-dimensional display area into three-dimensional space by projecting virtual images onto surfaces in the physical environment. The display area is no longer confined to the flat screen but expands into the surrounding spatial environment, allowing objects to be positioned and manipulated in 3D space around the user.
Solution Approach 2:
The patent introduces a camera as an intermediary device that captures the physical environment and overlays virtual images onto it. This mediator bridges the gap between the digital display content and the physical world, enabling seamless interaction between virtual objects and real-world surfaces.
2Area of stationary object
If multiple physical displays are connected to expand the processing area, then the display area increases, but the cost and space requirements increase
Solution Approach 1:
The patent makes the single display section serve multiple functions by projecting its content onto various surfaces in the physical environment. The same display can create multiple virtual display areas at different locations, orientations, and sizes, eliminating the need for multiple physical displays while maintaining expanded workspace.
Solution Approach 2:
The patent creates virtual copies of the display content and places them in the physical environment. Instead of purchasing additional physical displays, the system generates digital replicas that can be positioned anywhere in the user's environment, providing expanded display area without additional hardware.
3Quantity of substance
If windows and objects fill up the screen area, then the information density increases, but the user cannot view underlying windows and must switch between them
Solution Approach 1:
The patent resolves window overlap issues by distributing windows across three-dimensional space rather than forcing them into a two-dimensional plane. Users can position windows at different depths, angles, and locations in the physical environment, allowing simultaneous viewing of multiple windows without overlapping or requiring switching.
4Area of stationary object
If a virtual desktop is set up on a single display, then the display area is expanded, but the user must enter commands or manipulate icons to access areas outside the actual display section
Solution Approach 1:
The patent replaces the mechanical interaction of moving mouse cursors and clicking icons with direct spatial interaction. Users can physically move to different locations in the environment to access different virtual display areas, or use eye-tracking and voice commands, eliminating the need to manually navigate through virtual desktop interfaces.
Data Source
AI summary
The present invention provides a configuration that allows for a cursor or other object that has moved outside the display section to be displayed as a virtual object and observed. A cursor or object lying in an area outside the area of the display section of a PC or other device is displayed as a virtual object. For example, the display of goggles worn by the user displays a display device such as a PC and the area outside the display device. The three-dimensional position of the cursor or object that has probably moved in response to user operation is calculated, after which the cursor or object is displayed as a virtual object at the calculated position. Further, object information for the object specified by the cursor is acquired and presented.