Dynamic Projection Mapping via Closed-Loop Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current projection mapping technologies do not allow users to actively interact with or change the projected image, resulting in a lack of realistic experience when attempting to move through a virtual world.
Innovation Solution
A computer apparatus and program that dynamically change the position of a specific point on a projected surface and transmit corresponding images to a projector, enabling users to experience a more immersive virtual environment by altering the projection image based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If projection mapping is used to display images on projected surfaces, then visual presentation is achieved, but user interaction and ability to change the image are lost
Solution Approach 1:
The system captures images of the projected surface using an imaging device, processes these images to detect changes in the projected surface, and uses this feedback to dynamically adjust and re-project updated images. This closed-loop feedback mechanism enables user interaction by allowing users to physically manipulate the projected surface and receive immediate visual feedback through the projector.
Solution Approach 2:
The system automatically captures images, processes them to detect surface changes, generates updated projection images, and re-projects them without requiring external control systems or complex user interfaces. The projection system serves itself by using its own projected images as input for generating new projections, enabling intuitive user interaction through simple physical manipulation of the projected surface.
2Loss of information
If the system only measures real world information to change projection images, then basic interactivity is achieved, but realistic feeling of moving through virtual world is lost
Solution Approach 1:
The system captures images of the projected surface using an imaging device, creating a visual copy of the projected content. This captured image is then processed and used as the basis for generating updated projection images, allowing the system to maintain accurate visual representation of the virtual world while enabling user interaction through physical manipulation of the projected surface.
Solution Approach 2:
The system establishes a feedback loop where captured images of the projected surface are processed to detect changes, and this information is used to generate updated projections. This continuous feedback mechanism maintains immersion in the virtual world by accurately reflecting user interactions with the projected surface while enabling realistic movement experience.
3Productivity
If the projection image remains static, then system simplicity is maintained, but user engagement and realistic movement experience are reduced
Solution Approach 1:
The system dynamically updates projection images based on captured images of the projected surface. By continuously detecting changes in the projected surface and generating updated projections in real-time, the system transforms the static projection into a dynamic, responsive visual experience that adapts to user interactions, thereby enhancing user engagement and creating realistic movement sensations.
Solution Approach 2:
The system maintains continuous operation by repeatedly capturing images, processing them to detect surface changes, generating updated projection images, and re-projecting them without interruption. This continuous cycle of image capture, processing, and re-projection ensures uninterrupted user engagement and maintains the realistic feeling of moving through the virtual world.
Data Source
AI summary
A highly attractive program, a computer apparatus, a program execution method, and a system that allow a user to experience a virtual world full of the realistic feeling are provided. Provided is a program to be executed on a computer apparatus capable of communicating or connecting with a projector that projects a projection image onto a projected surface, the program causing the computer apparatus to function as: a specific point position changer that changes a position of a specific point for specifying the projection image to be projected onto the projected surface; and a transmitter that transmits an image in accordance with the position of the specific point to a projector as the projection image.