Client Terminal Position Scaling for Remote Video Game Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote execution of video games often results in interaction errors due to differences in screen resolution and display window size between the local client terminal and the remote game environment, leading to misalignment of the game character's position.
Innovation Solution
A method of interaction where the client terminal adapts the positional interface's position information based on the ratio between the equipment's resolution and the client's resolution, ensuring accurate interaction by transmitting adapted position information to the equipment, thereby maintaining real-time interaction without distortion or loss of quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the local screen resolution and display window size are used for interaction, then the interaction is simple and direct, but the interaction position does not correspond to the remote game position due to resolution differences
Solution Approach 1:
The patent transforms the raw interaction position coordinates from the local display resolution into scaled coordinates based on the remote equipment's resolution. By dynamically adjusting the coordinate system parameters according to the resolution ratio, the system maintains accurate position mapping between different display environments while preserving the simplicity of local interaction.
Solution Approach 2:
The patent introduces an intermediary coordinate transformation layer between the local display and remote game execution. This transformation mechanism acts as a mediator that converts local interaction positions into corresponding remote positions, resolving the mismatch caused by different resolutions without requiring changes to either the local interface or remote game.
2Measurement precision
If the image including the interaction is transmitted to the remote equipment, then the interaction position accuracy is improved, but the network load increases
Solution Approach 1:
The patent extracts only the essential interaction position data from the complete image transmission approach. Instead of transmitting or processing entire image frames to determine interaction positions, the system extracts and transmits only the scaled coordinate information, significantly reducing network load while maintaining position accuracy.
Solution Approach 2:
The patent applies partial action by transmitting only the necessary position information rather than complete image data. The coordinate transformation provides sufficient precision for interaction purposes without the excessive data transmission required by full image-based approaches, optimizing the balance between accuracy and network efficiency.
3Measurement precision
If the complete image is processed to determine interaction position, then the interaction accuracy is improved, but the computation cost increases
Solution Approach 1:
The patent performs preliminary coordinate scaling based on the known resolution ratio between local and remote displays. By pre-calculating the transformation parameters and applying them directly to interaction positions, the system avoids the need for complex image processing computations during actual interaction, reducing computation cost while maintaining accuracy.
Solution Approach 2:
The patent creates a simplified coordinate copy through mathematical transformation rather than processing the complete image. The scaled position coordinates serve as an accurate representation of interaction points without requiring the computational overhead of analyzing or processing the entire image data.
Data Source
Figure 1a~1b
Figure 1c
Figure 2
AI summary
The invention concerns a method of interaction with an application executed by a piece of equipment separate from a client terminal implementing the method of interaction. In particular, the method of interaction is a method for interaction of a client terminal with an application executed remotely. The application executed remotely is, in particular, a video game broadcast using, for example, a WebRTC communication protocol. One piece of subject matter of the invention is a method of interaction with an application, executed by a piece of equipment, providing a video stream displayed by a client terminal separate from the piece of equipment, the method of interaction comprising a transmission of a piece of position information suitable as an interaction position input parameter of the application, the suitable position information being dependent: • on a client position of a positional interface relative to an image of the video stream, • and proportional to the ratio between a resolution of the piece of equipment and a suitable client resolution. Therefore, interaction errors during the remote execution of an application are avoided, while limiting the network load and calculation costs, and maintaining the real-time character.