3D Interactive Display for Analytics Heatmap Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to effectively capture and present user interaction data from 3D experiences on mobile devices, such as gaze data, to developers for analysis.
Innovation Solution
A method and system for generating a 3D interactive display that superimposes heatmap data on a 3D environment, indicating where users commonly gaze and pause, using gaze data from multiple devices to create weighted heatmap points and pin map data for analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If gaze data is collected from multiple user devices to analyze user interaction with 3D environments, then the quantity and quality of interaction data increases, but the complexity of capturing, processing, and presenting this data increases
Solution Approach 1:
The patent segments the complex data processing task into distinct functional components: gaze data collection from multiple devices, data aggregation server, heatmap generation module, and visualization display. This segmentation allows each component to handle specific aspects of data processing independently, reducing overall system complexity while maintaining the ability to process large volumes of interaction data from multiple users.
Solution Approach 2:
The patent introduces a data aggregation server as an intermediary component that sits between the multiple user devices and the visualization system. This intermediary consolidates gaze data from numerous devices into a unified format, performing preliminary processing and aggregation tasks that would otherwise complexity the direct processing pipeline. The server acts as a mediator that simplifies data flow and prepares it for efficient visualization.
2Ease of operation
If heatmap data is generated and superimposed on 3D environment representations to show user gaze patterns, then the ease of understanding user interaction patterns improves, but the computational resources required for data processing and visualization increase
Solution Approach 1:
The patent applies preliminary action by pre-processing gaze data to generate heatmap representations before the final visualization is created. The system calculates and prepares heatmap data in advance, transforming raw gaze tracking data into meaningful visual patterns that can be directly overlaid on 3D environment representations. This preliminary processing step simplifies the final visualization process and reduces real-time computational requirements.
Solution Approach 2:
The patent utilizes color changes in the heatmap visualization to encode different levels of user engagement and gaze frequency. By varying color intensity and hue to represent different data densities and interaction patterns, the system provides intuitive visual cues that make understanding user interaction patterns easier without requiring complex numerical displays. This color-encoding approach reduces the computational burden of displaying detailed quantitative data while maintaining information richness.
3Measurement precision
If 3D heatmap data is rendered superimposed on 3D environment representations, then the measurement precision of user interaction locations improves, but the device complexity and rendering requirements increase
Solution Approach 1:
The patent implements the nesting principle by overlaying the 2D heatmap data representation within the 3D environment visualization. The heatmap is rendered as a transparent or semi-transparent layer nested within the 3D scene, allowing precise location data to be displayed without completely obscuring the underlying 3D environment. This nested structure maintains measurement precision while reducing rendering complexity compared to fully integrated 3D heatmap representations.
Solution Approach 2:
The patent transitions from raw 3D gaze coordinate data to a 2D heatmap representation that can be superimposed on 3D environment views. By converting the data into a dimensional representation that maps onto the 3D scene surfaces, the system achieves precise location measurement while simplifying the rendering requirements. The heatmap provides a simplified dimensional abstraction that is easier to render and interpret than full 3D point-cloud visualizations.
Data Source
AI summary
A system for generating an analytics display indicative of user interaction with a common 3D environment. A first computer system runs a data processing module. The data processing module is configured to control the first computer system to: receive gaze data indicative of surface locations within the common 3D environment rendered on a plurality of user devices; periodically generate heatmap data from the gaze data including plurality of heatmap points corresponding to surface locations within the common 3D environment and weighted corresponding to a frequency with which users direct their gaze at the corresponding surface location, and communicate the heatmap data to a further computing device with a display, whereupon, a display rendering function is configured to render on the display the heatmap data as a 3D heatmap superimposed on a representation of the common 3D environment, thereby generating a 3D interactive display.