Digital Artwork Depth Rendering via Display Motion Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for rendering impasto paintings on computing devices provide an inadequate, unrealistic, and unintuitive user experience due to the inability to effectively display depth variations, as 2D representations appear flat and 3D models are cumbersome to manipulate.
Innovation Solution
The technique involves using a motion sensor to detect movements of a display, determining new positions of digital artwork relative to a fixed gaze direction and light direction in a 3D model, and dynamically rendering depth effects such as shadow occlusions and parallax offsets, allowing users to intuitively interact with digital artwork by moving the display to change their viewing perspective.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If 2D representations are used to display digital artwork, then the display is simple and computationally efficient, but the depth variations and thickness effects are lost making the artwork appear flat
Solution Approach 1:
The patent applies dimensionality change by representing 3D artwork depth information in a 2D display through computational techniques. Depth maps and normal maps encode three-dimensional surface information into two-dimensional image formats, allowing the display to show depth variations without requiring actual 3D physical space. This resolves the contradiction by preserving depth information visually while maintaining 2D display simplicity.
Solution Approach 2:
The patent changes visual parameters such as lighting angles, shadow intensity, and highlight positions based on the displayed viewpoint. By dynamically adjusting these rendering parameters according to device orientation sensors, the system simulates depth effects and thickness variations without requiring complex 3D hardware, thus maintaining implementation simplicity while preserving depth information.
2Loss of information
If 3D models are used to represent impasto paintings, then depth variations can be displayed realistically, but the user interface becomes complicated and cumbersome to manipulate
Solution Approach 1:
The system uses the device's built-in motion sensors (accelerometer, gyroscope) to automatically detect viewing angle and orientation. This self-service approach eliminates the need for manual input devices like mice or keyboards to change viewpoints. The artwork automatically updates its rendering based on the device's physical orientation, making interaction as intuitive as physically tilting or rotating a real painting.
Solution Approach 2:
The patent replaces manual mechanical interaction (using mice, trackpads, or keyboard commands to navigate 3D models) with automatic sensor-based detection of device orientation. The motion sensors continuously track the device's physical position and orientation in space, automatically updating the 3D rendering without requiring any manual input from the user. This substitution makes the complex 3D viewing experience as simple as physically moving the device.
3Measurement precision
If manual input devices are used to change viewing perspective in 3D models, then precise control over viewpoint is achieved, but the interaction becomes difficult and non-intuitive
Solution Approach 1:
The system continuously self-monitors device orientation using motion sensors and automatically updates the viewpoint accordingly. This eliminates the need for users to learn complex input device operations while maintaining precise viewpoint control tied to the device's actual physical orientation in space.
Solution Approach 2:
The system provides immediate visual feedback by updating the artwork rendering in real-time as the device orientation changes. This continuous feedback loop between physical device movement and visual output creates an intuitive, responsive interaction that feels natural and direct, unlike discrete steps required by traditional input devices.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables a more realistic and intuitive user experience by simulating the depth variations of real artwork, allowing users to perceive digital artwork from different angles without the need for complex input device interactions, providing a more natural and immersive interaction with variable-depth digital artwork.
Implementation Method 1
a movement of the display is determined based on motion information from a motion sensor associated with the display
Data Source
AI summary
Techniques disclosed herein display depth effects in digital artwork based on movement of a display. In one technique, a first rendering of the digital artwork is displayed on the display. While the first rendering is displayed, a movement of the display is determined based on motion information from a motion sensor associated with the display. Based on the movement of the display, a position of the digital artwork is determined relative to a fixed gaze direction and a fixed light direction in a 3 dimensional (3D) model. A second rendering of the digital artwork is displayed on the display on the artwork. Displaying the second rendering involves displaying a depth effect based on variable depth of the digital artwork and the position of the digital artwork relative to the fixed gaze direction and the fixed light direction in the 3D model.