Multidevice Session Management for Multimodal Applications
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users with multiple devices having varying modality capabilities face challenges in utilizing these devices collectively to enhance their multimodal interaction experiences, as existing technologies do not efficiently enable multiple devices to participate in a single session for processing multimodal applications.
Innovation Solution
The system allows multiple devices operated by the same user to establish a single session for processing a multimodal application, distributing the application based on each device's capabilities and user preferences, and enables new devices to join if their capabilities exceed those of existing devices or if user preferences allow it, using an interaction manager, profile manager, and unique ID generator to manage and coordinate the session.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple devices are used to process a multimodal application, then the composite capabilities are enhanced, but the session management complexity increases
Solution Approach 1:
The interaction manager serves as an intermediary component that coordinates between multiple devices and the application server. It manages session establishment, device capability registration, and communication routing, thereby reducing the complexity burden from individual devices while enabling composite capabilities across the device network.
Solution Approach 2:
The session component provides universal session management functionality that works across multiple devices with different capabilities. It handles various input modalities (speech, handwriting, keystrokes) and output modalities (display, speech, audio, tactile) through a unified interface, allowing the system to adapt to diverse device configurations without requiring device-specific management logic.
2Adaptability or versatility
If a new device joins an existing session, then the capabilities are enhanced, but the session coordination difficulty increases
Solution Approach 1:
The session management system is designed to be dynamic, allowing devices to join and leave sessions seamlessly. The interaction manager dynamically updates the device capability profile when new devices join, reconfigures the session as needed, and maintains coordination without requiring manual intervention or complex pre-planning, thus adapting to changing device compositions.
Solution Approach 2:
The system implements feedback mechanisms where devices report their capabilities to the interaction manager, which then uses this information to optimize session configuration. When a new device joins, it provides capability feedback that triggers automatic session reconfiguration, ensuring optimal coordination without manual intervention.
3Adaptability or versatility
If devices with different modality capabilities are combined, then the interaction flexibility is improved, but the system integration complexity increases
Solution Approach 1:
The session component provides a homogeneous interface for managing diverse devices. It standardizes the representation of device capabilities and session state, allowing the interaction manager to handle speech, handwriting, keystroke, display, and tactile modalities through unified operations, thereby reducing integration complexity while maintaining interaction flexibility.
Data Source
AI summary
Systems, methods, apparatuses and computer program products for establishing a single session for processing a multimodal application with multiple devices and for distributing the multimodal application amongst the multiple devices participating in the single session based on the respective capabilities of each device are provided. A system, method and computer program product for allowing new devices operated by the same user to join in the previously established session for processing the multimodal application where the capabilities of the new device exceed that of all devices currently participating in the session are also provided.