VR AR Service Framework for Multimodal Input Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developing Virtual Reality (VR) and Augmented Reality (AR) applications is time-consuming and challenging due to the need for developers to create programming code for various input devices and graphical models, with ongoing updates required to accommodate changing input devices and environments.
Innovation Solution
A framework that allows VR/AR applications to access services from a service provider network, utilizing graphical recognition, automatic speech recognition, text-to-speech, search, context, and virtual platform services to create and manage virtual environments, process multiple input modes, and generate animations, reducing the need for developers to write extensive code.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If developers create programming code for receiving and processing data from different input devices and for displaying objects in the environment, then the VR/AR application functionality is implemented, but the development time and complexity increase significantly
Solution Approach 1:
The patent introduces a service provider network as an intermediary between the VR/AR application and various services (graphical recognition, speech recognition, text-to-speech, search, context, and virtual platform services). This mediator handles complex processing tasks, allowing the application to access sophisticated functionality without developers needing to write extensive code for each feature.
Solution Approach 2:
The system divides the VR/AR application development into separate modular services. Each service (graphical recognition, speech recognition, animation generation) operates independently and can be accessed by the application through the service provider network. This segmentation allows developers to utilize pre-built services rather than creating everything from scratch.
2Adaptability or versatility
If developers specify graphical models and define the layout of the virtual environment, then the virtual environment is created, but the development time increases
Solution Approach 1:
The service provider network provides pre-configured virtual platform services that include ready-made graphical models and environment layouts. Developers can access these pre-prepared resources and customize them as needed, rather than creating every element from scratch. This preliminary preparation of resources significantly reduces development time while maintaining customization capabilities.
3Adaptability or versatility
If the VR/AR application is updated to accommodate changing input devices, then the application remains compatible with new devices, but the maintenance cycle becomes never-ending
Solution Approach 1:
The service provider network provides universal services that can handle multiple types of input devices and modes through a common interface. The multimodal interface service can process speech, gestures, and other input types through unified services, reducing the need for separate update cycles for each device type. This universal approach allows a single update to accommodate multiple device variations.
4Adaptability or versatility
If developers process input from different devices and create virtual environments, then the application provides comprehensive functionality, but the development process becomes challenging and time-consuming
Solution Approach 1:
The service provider network acts as an intermediary that handles the complexity of processing inputs from multiple devices. The multimodal interface service receives and processes various input types (speech, gestures, physical inputs) through centralized services, shielding developers from the underlying complexity and making the development process easier while maintaining comprehensive input processing capability.
Data Source
AI summary
Functionality is disclosed herein for using a framework for a VR/AR application to utilize different services. In some configurations, a VR/AR application can utilize different services, such as an animation service, a multi-modal disambiguation service, a virtual platform service, a recognition service, an automatic speech recognition (ASR) service, a text-to-speech (TTS) service, a search service, as well as one or more other services. Instead of a developer of the VR/AR application having to develop programming code to implement features provided by one or more of services, the developer may utilize functionality of existing services that are available from a service provider network.