Server-Based Video Highlight Generation for Eyewear
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current portable eyewear devices, such as smart glasses, lack efficient automated video processing capabilities to selectively highlight and trim video clips based on user activities and events, resulting in unorganized and lengthy recordings.
Innovation Solution
The eyewear device integrates multiple visible light cameras and an eye movement tracker to capture and process video clips, using a server system that applies computer vision techniques to automatically identify and trim relevant segments, creating video highlights based on user-defined criteria such as human presence, pet appearance, and object recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If automated video processing capabilities are integrated into portable eyewear devices, then video organization and highlight generation are improved, but device complexity increases
Solution Approach 1:
A server system acts as an intermediary between the portable eyewear device and the user. The server receives video clips from the device, performs automated processing including computer vision analysis, event detection, and highlight generation, then returns processed video highlights to the user. This mediator approach enables sophisticated automated video processing without increasing the complexity of the portable device itself.
2Productivity
If computer vision techniques are used to automatically identify and trim video segments, then video organization is improved, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing video clips and pre-generating highlights in advance before the user needs them. Video clips are processed during idle periods or overnight, allowing computationally intensive computer vision analysis and highlight generation to be completed beforehand, so that users receive organized video content without experiencing the processing time delay.
3Measurement precision
If multiple visible light cameras and eye movement trackers are integrated, then video capture quality and user interaction are improved, but device complexity and power consumption increase
Solution Approach 1:
The eye movement tracker and multiple cameras operate periodically rather than continuously. The system activates these components only when needed for specific functions such as detecting user interest in certain video segments or capturing particular moments, rather than running at full capacity continuously. This periodic operation maintains high measurement precision when needed while significantly reducing overall power consumption.
Data Source
AI summary
A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor allows a user of the mobile device to edit and trim the video clips having the identified characteristics to create trimmed video clip segments.