Handheld Device Video Capture for Interactive Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current portable devices lack the capability to effectively capture and render interactive sessions of applications presented on main displays for spectators, limiting their ability to engage with interactive environments beyond the primary viewer's perspective.
Innovation Solution
A system that enables a handheld device to capture and render an ancillary video stream of an interactive session, allowing spectators to view and interact with the application from different perspectives by tracking the device's position and orientation, and providing input mechanisms to affect the application's state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a handheld device is used to capture video of an interactive session, then spectators can view from different perspectives and engage with the application, but the device complexity and processing requirements increase
Solution Approach 1:
The patent introduces a video capture module and video playback module as intermediary components. The video capture module captures the interactive session from the handheld device's perspective, and the video playback module renders this captured video on a separate display. This intermediary approach allows spectators to view interactive sessions from different perspectives without requiring the handheld device itself to handle all processing complexity, thus resolving the contradiction between enhanced adaptability and increased device complexity
Solution Approach 2:
The system is divided into distinct functional modules: a video capture module that captures the interactive session, a communication module that transmits data, and a video playback module that renders the video. This segmentation allows each module to handle specific tasks independently, reducing the complexity burden on any single device while maintaining the overall capability for multi-perspective spectator engagement
2Adaptability or versatility
If the handheld device tracks position and orientation to provide unique viewpoints, then the viewing experience is enhanced, but the measurement and tracking requirements become more complex
Solution Approach 1:
The handheld device utilizes its own built-in sensors (accelerometers, gyroscopes, magnetometers) to automatically track its position and orientation. The system leverages the device's self-contained sensing capabilities rather than requiring external tracking infrastructure, thus enhancing viewpoint diversity while avoiding the complexity of external measurement systems
Solution Approach 2:
The patent employs universal sensor modules that serve multiple functions: they track both position and orientation, and can be integrated into various handheld devices regardless of manufacturer. This multi-functional approach allows the system to achieve diverse viewpoints using standard, widely-available sensor technology, reducing the difficulty of detection and measurement
3Adaptability or versatility
If spectators can interact with the application through the handheld device, then engagement is enhanced, but the system complexity and input handling requirements increase
Solution Approach 1:
The patent introduces an intermediary processing layer that handles input from the handheld device. Instead of requiring the main application system to directly process all input complexities, the system uses a mediation layer that translates diverse input mechanisms (touchscreen, buttons, motion sensors) into standardized control commands, thus enhancing interactive capability while managing system complexity
Solution Approach 2:
The system implements feedback mechanisms where the application state is continuously updated based on spectator input, and this updated state is reflected back to both the handheld device and the main display. This feedback loop enables natural, intuitive interaction where spectators can affect the application state through their inputs, enhancing engagement without requiring complex proprietary interaction protocols
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods and systems for enabling a handheld device to capture video of an interactive session of an interactive application presented on a main display are provided. An interactive session of the interactive application defines interactivity between a user and the interactive application. An initial position and orientation of a handheld device operated by a spectator are determined. A current state of the interactive application based on the interactivity between the user and the interactive application is determined. The position and orientation of the handheld device are tracked during the interactive session. A spectator video stream of the interactive session based on the current state of the interactive application and the tracked position and orientation of the handheld device is generated. The spectator video stream is rendered on a handheld display of the handheld device.