Functional Interface Prototyping With Sensor-Linked Multimedia States
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current prototyping methods for human-machine and machine-machine interfaces face challenges in cost, interactivity, and ease of modification, particularly in assessing ergonomics and user experience, especially when relying on virtual reality or complex programming-based solutions.
Innovation Solution
A method for functional prototyping using a system with calculation units, display devices, and sensors, where logical structures with multimedia content and sensor states enable dynamic selection and execution of elements, allowing for iterative modifications and improvements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If entirely material prototyping (e.g., 3D printing) is used, then the product can be physically manipulated, but cost increases and interactivity is reduced making changes difficult
Solution Approach 1:
The patent implements a dynamic prototyping system where the prototype can switch between physical and virtual states. The system uses sensors to detect user interactions and dynamically updates the virtual model to reflect physical manipulations, allowing the prototype to adapt its representation based on the interaction mode while maintaining ease of modification through software updates.
Solution Approach 2:
The patent introduces a computational model as an intermediary between the physical prototype and the virtual representation. This computational model acts as a mediator that processes sensor data from the physical prototype and generates corresponding virtual representations, enabling changes to be made through software rather than physical reconstruction, thus reducing cost and complexity of modifications.
2Device complexity
If virtual reality prototyping is used, then costs are reduced and exploration of variants is facilitated, but physical handling and ergonomics assessment become more difficult
Solution Approach 1:
The patent merges virtual reality and physical prototyping into a unified system. The virtual prototype is combined with physical sensors and actuators, allowing users to interact with the virtual model while receiving tactile feedback through physical actuators. This combination maintains the cost benefits of virtual prototyping while restoring physical handling capabilities for ergonomics assessment.
Solution Approach 2:
The patent replaces purely mechanical physical prototypes with a hybrid system where virtual models are enhanced with haptic feedback mechanisms. Instead of relying solely on physical materials, the system uses computational models with simulated physics and haptic actuators to provide tactile feedback, reducing material costs while maintaining physical interaction capabilities.
3Adaptability or versatility
If virtual reality or complex programming solutions are used for interface prototyping, then implementation is possible, but the solutions are complex to implement due to high programming requirements
Solution Approach 1:
The patent uses the physical prototype itself as a template to automatically generate the virtual model. Sensors from the physical prototype are mapped to corresponding elements in the virtual model, automatically copying the structure and behavior. This eliminates the need for manual programming of the virtual prototype, reducing programming complexity while maintaining adaptability.
Solution Approach 2:
The patent implements a self-service prototyping system where the physical prototype automatically generates and updates its own virtual representation. The system uses sensor data from the physical prototype to automatically create and synchronize the virtual model without requiring external programming intervention, thereby reducing the programming burden while maintaining full interface prototyping capabilities.
Data Source
Figure 1~2
Figure 3~4
Figure 5~7
AI summary
The invention relates to functional prototyping in an environment comprising a computing unit, a display device, and a sensor. The prototype is executed after obtaining containers, each container comprising ordered elements containing multimedia content and/or a pointer to another element, and after associating each element of a container with a sensor state. Detecting a state selects the associated element. Selecting an element triggers the playback of the corresponding multimedia content and the selection of the pointed-to element. Only one element can be selected in a container at any given time. The step of associating each element of a container with a state is repeated, changing the set of elements or the set of states, and/or the content or the order of elements of a container before repeating the prototype execution.