Multimedia Thumbnails for Mobile Document Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current solutions for browsing and viewing documents on mobile devices with limited input peripherals and small displays are inadequate, as they require extensive zooming and scrolling due to high resolution and distributed information, and existing technologies primarily focus on static visual representations or audio conversions for visually impaired users, failing to effectively utilize both visual and audio channels for document navigation.
Innovation Solution
The development of Multimedia Thumbnails (MMNails) that automatically analyze and synthesize important visual and audible document elements, optimizing their presentation for both visual and audio channels based on device constraints, allowing users to edit and customize the multimedia representation for efficient navigation on limited displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If document viewing uses high resolution and displays all information on small mobile displays, then information completeness is improved, but user interaction complexity increases due to extensive zooming and scrolling required
Solution Approach 1:
The patent segments the document into multiple thumbnail representations, each showing different portions or aspects of the document content. This allows the system to present comprehensive information across multiple views rather than requiring extensive zooming and scrolling of a single high-resolution view, thereby reducing user interaction complexity while maintaining information completeness.
Solution Approach 2:
The patent introduces a temporal dimension by sequencing multiple thumbnails in a navigable order, transforming the static 2D document view into a dynamic multi-view experience. Users can navigate through the sequence of thumbnails to access different document portions, eliminating the need for continuous zooming and scrolling operations on small displays.
2Device complexity
If static visual representations are used for document browsing, then device complexity is reduced, but information delivery effectiveness deteriorates by failing to utilize audio channels
Solution Approach 1:
The patent makes the document browsing system multi-functional by integrating both visual and audio information delivery channels. The thumbnail sequence can be presented visually while simultaneously providing audio narration or commentary, allowing the system to serve multiple information delivery functions without significantly increasing device complexity, as it leverages existing multimedia capabilities.
Solution Approach 2:
The patent merges visual thumbnails with audio content to create a synchronized multimedia presentation. The audio channel provides additional context, narration, or information that complements the visual thumbnail sequence, creating a unified information delivery system that utilizes both sensory channels effectively without requiring complex additional hardware.
3Loss of information
If audio channel is added to document representation, then information delivery is improved, but device complexity and energy consumption increase
Solution Approach 1:
The patent applies partial action by selectively enabling audio content for specific thumbnails or document sections rather than continuously playing audio throughout the entire document. This allows the system to provide enhanced information delivery where most needed while conserving energy during navigation or when audio is not required, balancing information effectiveness with energy consumption on mobile devices.
Data Source
AI summary
A method, apparatus and article of manufacture for assisting a user with authoring a multimedia representation of documents. In one embodiment, the method comprises displaying one or more visual, audible, or audiovisual document elements from an input document in graphical user interface; and selecting one or more elements and for inclusion in a multimedia representation.