Immersive Storytelling System Using Camera-Based Physical Environment Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current home entertainment technologies, such as video games, primarily limit user interactions to virtual worlds and do not effectively integrate physical environment interactions, lacking immersive storytelling experiences that incorporate auditory and visual effects responsive to user actions in real-world settings.
Innovation Solution
A system of storytelling devices that produce auditory and visual effects based on user actions in a physical environment, managed by a controller device that adjusts stimuli and responses according to the story context, allowing for dynamic and interactive storytelling experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If video game systems use controllers to interact with virtual worlds, then user interaction capability is improved, but integration with physical environment is limited
Solution Approach 1:
The patent combines virtual and physical worlds by using camera devices to capture real-world images and overlaying virtual game elements onto them. This merging allows users to interact with virtual objects in their physical environment, simultaneously improving ease of operation and adaptability to physical settings.
Solution Approach 2:
The camera device acts as an intermediary between the physical environment and the virtual game world. It captures physical scenes and enables the system to recognize real-world objects and positions, facilitating interaction between users and virtual elements in the physical space.
2Illumination intensity
If hand-held gaming devices capture and display images of physical scenes, then visual integration is improved, but persistence of alterations across multiple images is limited
Solution Approach 1:
The system uses feedback by continuously capturing images with the camera device and comparing them against the virtual environment state. When the user interacts with virtual objects, the system detects changes in subsequent captured images and updates the virtual environment accordingly, ensuring persistent alterations across multiple images through continuous feedback loops.
Solution Approach 2:
The system performs preliminary actions by establishing the virtual environment and placing virtual objects before capturing the first image. This allows the system to pre-establish the state against which subsequent images are compared, ensuring that alterations persist across multiple captured images from different perspectives.
3Ease of operation
If storytelling devices produce effects based on user actions, then user engagement is improved, but system complexity increases
Solution Approach 1:
The controller device serves multiple functions: it manages playback of the story, coordinates multiple storytelling devices, processes camera input, and controls audio-visual effects. This multi-functionality allows a single device to handle complex storytelling operations, improving user engagement while managing system complexity through consolidation.
Solution Approach 2:
The storytelling devices automatically detect user actions through camera input and autonomously produce appropriate audio-visual effects without requiring manual configuration. The system self-manages the coordination between user actions and storytelling responses, reducing operational complexity while maintaining high engagement.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Techniques for providing an immersive storytelling experience using a plurality of storytelling devices. Each of the storytelling devices may be configured to perform one or more actions based on a current context of a story and in response to a stimulus event. The actions include at least one of an auditory and a visual effect. Embodiments also provide a controller device configured to manage a playback of the story, by adjusting the stimulus event and the effect of each of the plurality of storytelling devices, based on the current context of the story, thereby creating an interactive and immersive storytelling experience.