Water Surface Projection System with Ripple Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies fail to effectively project and interact with images on the surface of water, particularly in computer games, due to distortion caused by ripples and limitations in using water as an input medium.

Innovation Solution

A system that uses distortion mapping, depth sensing, and de-noising to project images onto water, allowing interaction from above or below the surface, with the ability to layer liquids of different densities and utilize water currents to reduce ripples, and includes a device with a projector, either airborne or waterborne, to correlate user interactions with computer actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images are projected onto water surface, then interactive input method is created, but image distortion occurs due to ripples

Engineering Contradiction:
Improveinteractive input methodVSAvoidimage distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system uses depth sensors and cameras to detect water surface ripples in real-time, then feeds this information back to dynamically adjust the projected image. The distortion mapping process continuously adapts the projected content based on detected surface variations, maintaining image accuracy despite water movement.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the projection parameters dynamically based on water conditions. By adjusting projection angle, focus, and image distortion correction parameters in real-time according to detected ripple patterns, the system maintains clear image projection on the moving water surface.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If water is used as input medium, then immersive interaction is achieved, but reliability of input detection decreases

Engineering Contradiction:
Improveimmersive interactionVSAvoidinput detection
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system introduces an intermediary processing layer that includes depth sensors, cameras, and distortion mapping algorithms. These intermediaries detect and interpret user interactions with the projected image on water, converting physical water interactions into reliable digital input signals that can be accurately processed by the computer system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses multiple sensing modalities (depth sensors, cameras, motion sensors) simultaneously to detect user interactions. This multi-functional approach ensures reliable input detection through redundancy, where multiple sensors can verify and cross-validate interaction signals, maintaining high reliability despite the challenging water medium.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If distortion mapping and depth sensing are used, then image quality is maintained, but device complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system combines multiple functions into integrated components. The projector, depth sensor, camera, and processing unit are merged into a coordinated system where components work together synergistically. This integration reduces overall system complexity compared to having separate systems for each function, while maintaining high image quality through coordinated operation.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless interaction with projected images on water, unaffected by ripples, allowing users to control computer simulations as if using a traditional game controller, enhancing gaming experiences with immersive input methods.

Implementation Method 1

project at least one image onto at least one liquid

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

Liquids of different density can be layered on the surface to create different refraction planes

Methodology Applied
Scientific EffectLight refraction: Refraction

Data Source

PatentUS11632529B2Projecting content onto water to enhance computer simulation
Publication Date: 2023.04.18 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11632529B2 patent drawing
  • US11632529B2 patent drawing
  • US11632529B2 patent drawing

AI summary

Content is projected onto the surface of water such that it can be viewed from either above or below the surface. Using distortion mapping, depth sensing, and de-noising, the image can remain unaffected by ripples and allow the user to interact within the body of liquid and/or use it as input. Liquids of different density can be layered on the surface to create different refraction planes. Water currents and jets can be used to actively reduce ripples from user interaction, as well as actively adding or removing liquid from the container to counteract displacement or create effect.