Multimedia Device Storyline Image Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia devices face challenges in providing abundant visual and auditory experiences when playing music, as album covers are insufficient for understanding music, text-based lyrics are hard to recognize, and video files consume disc space and data, leading to inconvenient playback, especially over mobile networks.
Innovation Solution
A method and device that acquire music information, derive a storyline from this information, select relevant images based on keywords, and display them, reducing resource consumption and data burden by using meta-information, audio fingerprinting, and emotion analysis to enhance user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video files are played to provide abundant visual and auditory experiences, then user understanding of music is improved, but disc capacity is wasted due to large file size
Solution Approach 1:
The patent extracts only the essential visual information from video files by extracting still images at specific time points. This allows the system to provide visual content related to music without requiring the entire video file, thus reducing storage space requirements while maintaining user understanding.
Solution Approach 2:
The patent segments the video content into discrete still images that can be displayed independently. By dividing the continuous video stream into individual frames or key moments, the system can store and transmit only the necessary visual information rather than the complete video, reducing data quantity while preserving meaningful content.
2Quantity of substance
If video files are streamed from the Internet, then disc capacity is saved, but data usage increases causing playback issues over mobile networks
Solution Approach 1:
The patent extracts only essential visual information from videos as still images, dramatically reducing the data size that needs to be transmitted over mobile networks. This extraction approach maintains the core visual content needed for user understanding while minimizing data consumption during streaming.
Solution Approach 2:
The patent creates a simplified copy of video content in the form of still images rather than transmitting the complete video file. This copy contains the essential visual information but at a fraction of the data size, enabling smooth playback over mobile networks without excessive data usage.
3Quantity of substance
If album covers are displayed to provide visual experience, then resource consumption is reduced, but user understanding of music is insufficient
Solution Approach 1:
The patent retrieves and displays still images from music videos at predetermined time points before the user needs to understand the music deeply. This preliminary action provides visual context and storytelling elements that enhance music understanding without requiring the user to watch entire videos or consume excessive resources.
Solution Approach 2:
The patent dynamically selects and displays different still images based on the current position in the music playback timeline. Rather than statically showing only album covers, the system adapts the visual content to match the current musical context, providing richer understanding while managing resources efficiently through selective display.
4Quantity of substance
If text-based lyrics are displayed to provide music information, then resource consumption is reduced, but user recognition and understanding is difficult and time-consuming
Solution Approach 1:
The patent converts text-based lyrics into visual representations through still images that depict the music video content. This visual copy of the lyrical narrative provides the same information in a more easily processable format, improving user recognition and understanding while maintaining efficient resource consumption through image-based delivery rather than text processing.
Data Source
AI summary
Provided are a device and a method for acquiring music information about music played in an electronic device, acquiring a storyline of the music based on the music information, and acquiring and displaying one or more images based on the storyline.