Perspective View Intermediary for Non-Planar Display Drag Operations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-display systems, it is challenging to perform drag operations across non-continuous and non-planar display surfaces, particularly when they are arranged orthogonally, as it complicates the operation of images displayed on each surface.
Innovation Solution
A display method that projects a perspective view of a space from a first display device to a second display device, allowing users to designate positions on the second display, convert those positions to corresponding positions on the first display, and operate images on the first display based on these conversions, using homography matrices for accurate position conversion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If display surfaces are arranged on non-planar surfaces (front and side walls), then the display system can provide immersive spatial coverage, but it becomes more difficult to perform drag operations across the display surfaces
Solution Approach 1:
The patent introduces a perspective view display surface as an intermediary between the user and the actual display surfaces arranged on non-planar walls. This virtual intermediary surface allows users to interact with content as if it were on a conventional planar screen, while the system simultaneously maintains awareness of the actual spatial arrangement of display surfaces to enable accurate position conversion during drag operations.
Solution Approach 2:
The patent transitions from direct interaction with physical display surfaces in 3D space to interaction with a projected perspective view on a virtual 2D plane. By representing the non-planar display arrangement as a perspective projection, the system converts complex 3D spatial coordinates into manageable 2D screen coordinates, simplifying drag operations while preserving spatial awareness through coordinate transformation.
2Adaptability or versatility
If multiple display surfaces are arranged orthogonally, then the system can provide comprehensive spatial coverage, but operating images on each display surface becomes complicated
Solution Approach 1:
The perspective view acts as a unifying intermediary that represents all orthogonally arranged display surfaces in a single coordinated view. Users interact with content through this unified perspective rather than managing each display surface independently, reducing operational complexity while maintaining comprehensive spatial coverage through the projected view.
Solution Approach 2:
The perspective view display serves multiple functions simultaneously: it provides a user-friendly interaction interface, maintains spatial awareness of orthogonally arranged displays, enables drag operations across non-planar surfaces, and coordinates content across multiple display surfaces. This multi-functional approach simplifies operation while preserving comprehensive spatial coverage.
3Adaptability or versatility
If display surfaces are not continuous in a multi-display system, then the system can be flexible in arrangement, but it is difficult to perform drag operations across the display surfaces
Solution Approach 1:
The perspective view serves as a continuous intermediary space that bridges discontinuous display surfaces. Even when physical displays are separated or arranged non-contiguously, the perspective projection creates a visually continuous representation that enables smooth drag operations across the entire virtual space while maintaining flexibility in actual display arrangement.
Solution Approach 2:
By projecting the discontinuous physical display arrangement onto a continuous perspective view plane, the system transforms the discontinuity problem from physical space to virtual space. The coordinate transformation maintains spatial relationships while providing continuous interaction capability across what would otherwise be separated or non-planar display surfaces.
Data Source
AI summary
A disclosed display method includes: projecting data of a space that includes a first display provided by a first display device to a perspective view; causing a second display device to display the perspective view on a second display; accepting a designation of a first position on the second display; converting the first position into a second position on the first display, upon detecting that the first position is inside an area that corresponds to the first display; and operating an image displayed on the first display based on the second position.