Cloud Application Feedback Control for Immersive Device Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud applications, such as cloud games, provide limited interaction manners due to the server-based rendering, resulting in a less immersive experience for users.
Innovation Solution
A method and apparatus that enables a server to trigger multimedia feedback, such as vibration, consistent with the application content by establishing a communication connection with a cloud application client and controlling a physical device to execute multimedia feedback operations based on scene recognition and feedback information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If cloud application runs on server with video stream transmission, then user terminal can display application content, but interaction manners are limited and user experience is not immersive
Solution Approach 1:
The patent combines video stream transmission with multimedia feedback transmission through a unified communication architecture. The server transmits both the video stream and multimedia feedback information (vibration, sound, light) to the terminal device, merging traditional video playback with enhanced sensory feedback to create immersive interaction experiences.
Solution Approach 2:
The patent introduces a communication module as an intermediary between the server and terminal device. This module handles the transmission of multimedia feedback information, enabling the server to control physical devices (speakers, vibration motors, lights) on the terminal to provide immersive feedback that complements the video stream.
2Device complexity
If only audio and video stream are transmitted from server, then transmission is simple, but multimedia feedback accuracy is insufficient
Solution Approach 1:
The patent segments the transmission content into distinct components: video stream for visual information and multimedia feedback information for sensory feedback. This segmentation allows each component to be optimized independently while maintaining synchronized delivery to enhance feedback accuracy without overwhelming complexity.
Solution Approach 2:
The patent implements a feedback mechanism where the server analyzes application content and generates corresponding multimedia feedback information. This feedback loop ensures that the vibration, sound, or light effects are precisely synchronized with critical moments in the video stream, significantly improving feedback accuracy.
Data Source
AI summary
This application provides a cloud application-based device control method performed by an electronic device. The method includes: establishing a communication connection with a cloud application server; receiving a video stream corresponding to a cloud application scene transmitted by the cloud application server and multimedia feedback information corresponding to the cloud application scene; and controlling a physical device associated with the cloud application client to execute a multimedia feedback operation in accordance with the multimedia feedback information while the video stream corresponding to the cloud application scene being played.