Virtual Sensor Image Update for Cloud Gaming Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud gaming and other applications where the server runs without hardware sensors, there is no way to update the picture displayed on the terminal by detecting user actions, as the server lacks the necessary hardware sensors.
Innovation Solution
The implementation of a virtual sensor on the server, which has a structure corresponding to the hardware sensor on the terminal, allows the server to receive and process sensor data from the terminal, enabling the update of multimedia pictures based on user interactions without requiring hardware sensors on the server.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If image data is updated by replacing the entire frame buffer, then the update process is simple and fast, but memory bandwidth is wasted and power consumption increases
Solution Approach 1:
The patent extracts only the changed pixel data from the new image frame and transfers only this differential data to the display device, rather than transferring the entire frame buffer. This extraction of essential changes achieves fast updates while minimizing memory bandwidth consumption and power usage.
Solution Approach 2:
The patent creates a copy of the frame buffer in memory and modifies only the necessary portions before transferring to the display device. This copying approach allows efficient updates by maintaining a working copy that can be selectively modified without affecting the original display output.
2Reliability
If image data is updated by transferring the entire frame buffer, then all pixel data is transmitted, but memory bandwidth is wasted and update efficiency decreases
Solution Approach 1:
The patent extracts only the changed pixel data from the new image frame and transfers only this differential data to the display device, rather than transferring the entire frame buffer. This extraction of essential changes achieves fast updates while minimizing memory bandwidth consumption and power usage.
Solution Approach 2:
The patent performs preliminary comparison between the new image data and the current display data to identify only the changed pixels before transferring data. This preliminary action enables efficient selective updating by pre-determining what needs to be transmitted.
3Reliability
If the display device waits for complete image data transfer, then data integrity is ensured, but response time increases and user experience deteriorates
Solution Approach 1:
The patent performs preliminary comparison between the new image data and the current display data to identify only the changed pixels before transferring data. This preliminary action enables efficient selective updating by pre-determining what needs to be transmitted.
Solution Approach 2:
The patent implements a feedback mechanism where the display device receives notification about which pixels have changed and updates only those pixels. This feedback-driven approach ensures data integrity for changed regions while minimizing wait time for unchanged regions.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An image update method and apparatus, a computer device, and a storage medium. The method comprises: receiving sensor data sent from a terminal, the sensor data being collected by a hardware sensor of the terminal (S202); writing the sensor data into a virtual sensor, the virtual sensor having a structure corresponding to that of the hardware sensor and being used for supporting sensor services (S204); reading the sensor data from the virtual sensor, updating a multimedia image according to the sensor data, and generating corresponding updated multimedia data (S206); returning the updated multimedia data to the terminal to enable the terminal to display, according to the updated multimedia data, a corresponding updated multimedia image (S208).