Handheld Display Relay for Remote Access to Fixed User Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Non-portable user devices with permanently installed interaction components, such as those in vehicles or household appliances, become inaccessible when the user is outside the reach or detection range, and existing solutions like remote controls or API-linked handheld devices face compatibility issues with software updates.
Innovation Solution
A method and system that allow user interaction with non-portable devices by using a handheld device with transmission software to exchange raw data with the user device, enabling operation of interaction components like touchscreens or cameras, without requiring API compatibility, allowing the user to interact from a distance and maintaining functionality through software updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If interaction components are permanently installed in the user device, then the device structure is simplified and reliability is improved, but the user cannot access the interaction components when outside the reach range
Solution Approach 1:
A portable handheld device serves as an intermediary between the user and the permanently installed interaction components. The handheld device captures raw data from its own interaction components (touchscreen, camera) and transmits this raw data to the non-portable user device, enabling the user to access and control the permanently installed components from a distance without requiring physical proximity.
2Adaptability or versatility
If API linking is used between handheld device and infotainment system, then integration is achieved, but software updates cause compatibility issues
Solution Approach 1:
Instead of using API linking that requires software version matching, the system copies the approach of transmitting raw data streams from the handheld device to the infotainment system. The transmission software forwards raw input and output data without interpretation, creating a version-independent communication channel that maintains reliability across software updates.
Solution Approach 2:
The patent replaces the API-based software integration mechanism with a raw data transmission mechanism. This substitution eliminates the dependency on matching software versions and API compatibility, as the transmission software merely forwards raw data streams without requiring knowledge of the infotainment system's internal software architecture or version.
3Ease of operation
If application software independently renders GUI, then control commands can be sent from tablet PC, but software adaptation is still required for updates
Solution Approach 1:
The patent extracts the GUI rendering function from the handheld device application software and leaves it entirely to the infotainment system. The transmission software on the handheld device only handles raw data transmission without rendering or interpreting the graphical user interface, eliminating the need for software adaptation when the infotainment system's software is updated.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a method for operating a non-portable user device (11) with at least one permanently installed interaction component (17) for user interactions with a user (23). The invention provides that the user device (11) operates a communication interface (30) for data exchange with a portable handheld device (25) of the user (23), which has a substitute component (27) corresponding to the interaction component (17) in the form of a display and/or a camera, and that in a remote control mode of the user device (11), a transmission software (28) of the handheld device (25) on the one hand and a processor circuit (12) of the user device (11) on the other exchange raw data for graphical outputs and/or for inputs via the communication interface (30), and the transmission software (28) of the handheld device (25) forwards the raw data between the communication interface (30) and the respective substitute component (27).