Normal Map Encoding for View-Angle Dependent Mobile Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional techniques for rendering graphical objects on mobile client computing devices are unable to effectively represent dynamic and view-angle dependent effects similar to prismatic, iridescent, and holographic foil techniques, limiting the creation of immersive three-dimensional visual representations.
Innovation Solution
A method that involves encoding virtual object information, including normal components as color parameters, and modulating these parameters based on the user's viewing angle, using sensors like accelerometers and cameras to simulate real-world optical phenomena such as lenticular and holographic effects, while applying shading and reflective view modifications to enhance the three-dimensional effect.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional rendering techniques are used on mobile devices, then device compatibility and performance are maintained, but the ability to represent dynamic view-angle dependent effects (prismatic, iridescent, holographic) is lost
Solution Approach 1:
The patent transforms three-dimensional normal vector data into two-dimensional color parameters that can be stored in standard image files. By encoding normal components (nx, ny, nz) as color values (RGB), the system enables view-angle dependent rendering using conventional image storage formats, thus achieving dynamic visual effects without increasing device complexity
Solution Approach 2:
The patent creates a simplified representation of three-dimensional surface normals by copying them into a two-dimensional color map format. This normal map serves as a computational copy that enables complex optical effects to be achieved through software processing rather than requiring complex hardware
2Illumination intensity
If normal map encoding is implemented to enable view-angle dependent effects, then visual realism is improved, but computational overhead and processing requirements increase
Solution Approach 1:
The patent pre-computes and encodes surface normal information into color parameters during asset creation or loading phases. This preliminary encoding stores all necessary geometric information in a compact format, allowing runtime rendering to simply sample and modulate these pre-prepared values rather than performing complex geometric calculations during rendering
Solution Approach 2:
The patent applies different encoding strategies to different regions of the normal map based on local surface properties. By modulating color parameters locally according to viewing angle and surface orientation, the system achieves high visual realism only where needed while maintaining efficiency in other areas
3Adaptability or versatility
If sensors and camera processing are added to determine viewing angle, then view-angle dependent effects are achieved, but device hardware requirements and complexity increase
Solution Approach 1:
The patent leverages existing mobile device sensors (accelerometers, gyroscopes, cameras) that serve multiple functions. These sensors are already present for other purposes such as screen orientation, gaming, and augmented reality, so utilizing them for viewing angle detection adds no additional hardware complexity while enabling view-angle dependent rendering
Solution Approach 2:
The system uses the device's own existing sensors and camera to determine viewing angle, making the device self-sufficient. No external sensors or additional hardware are required - the device uses its inherent capabilities to provide the necessary viewing angle information for rendering
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the generation of visually rich, dynamic, and view-angle dependent three-dimensional representations on mobile devices, providing a more immersive experience by simulating real-world optical effects and enhancing color saturation and highlights.
Implementation Method 1
simulating real-world optical phenomena such as lenticular and holographic effects
Implementation Method 2
encoding virtual object information, including normal components as color parameters, and modulating these parameters based on the user's viewing angle
Implementation Method 3
prismatic, iridescent, and holographic foil techniques
Data Source
AI summary
Rendering graphical objects to a display of a mobile client computing device by obtaining virtual object information, obtaining normal components of the virtual object, encoding an image file that describes the normal components of the virtual object, wherein encoding the image file includes encoding dimensional parameters of the normal components into color parameters held by the image file for individual image pixels so that the color information held by the image file describes the surfaces of the virtual object, determining a likely viewing angle of a user associated with the mobile client computing device, and modulating the color parameters in the image file describing the surfaces of the virtual object in response to an indication of a change of the orientation of the mobile client computing device.