Server-Based Video Highlight Generation for Smart Eyewear

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current portable eyewear devices, such as smart glasses, lack efficient automated video processing capabilities to selectively highlight important moments from recorded video segments, often requiring manual editing and lacking personalized user interface adjustments based on head or eye movements.

Innovation Solution

The integration of multiple visible light cameras and an eye scanner within the eyewear device, coupled with a server system that processes video clips to automatically trim and highlight segments based on characteristics like human presence, emotions, and speech, while adjusting the user interface field of view dynamically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated video processing is implemented to generate video highlights, then content sharing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvecontent sharing efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary component that performs the complex video processing tasks. The eyewear device captures and uploads raw video segments, while the server handles the automated trimming, highlight generation, and editing based on detected characteristics. This mediator approach allows the eyewear device to maintain simplicity while still achieving automated video highlight generation through server-side processing power.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple cameras and eye scanner are integrated, then user interaction capability is improved, but device complexity increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent integrates multiple functional components (visible light cameras, eye scanner, processors) into a single multi-functional eyewear device. These components serve multiple purposes: cameras capture video segments and detect human presence/emotions/speech, the eye scanner tracks user gaze and head movements for interface adjustments, and the processor coordinates all these functions. This universal approach allows one device to perform diverse functions that enhance user interaction without requiring separate dedicated devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If manual video editing is required, then video quality is improved, but loss of time increases

Engineering Contradiction:
Improvevideo qualityVSAvoidloss of time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements automated video processing where the system serves itself by automatically detecting characteristics (human presence, emotions, speech) in video segments and generating highlights without requiring manual user intervention. The server autonomously trims video clips, identifies important moments, and creates compiled highlights, eliminating the time-consuming manual editing process while maintaining quality through algorithmic analysis of video content.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary analysis of video segments by detecting characteristics such as human presence, emotions, and speech patterns during or immediately after capture. This preliminary processing identifies which segments are worth keeping for highlights, so when the video needs to be shared or reviewed, the important content has already been pre-identified and organized, saving significant time compared to manual review and editing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11538499B1Video highlights with auto trimming
Publication Date: 2022.12.27 SNAP INC
  • US11538499B1 patent drawing
  • US11538499B1 patent drawing
  • US11538499B1 patent drawing

AI summary

A server configured to receive video clips from a mobile device, such as eyewear. The server has an electronic processor enabled to execute computer instructions to process the video clips to identify one or more characteristics in the frames of the video clips. The processor selects the video clips having the identified characteristics in the frames and creates a set of the selected video clips having the identified characteristics in the frames. The processor automatically trims the video clips based on frames that have the identified characteristics to create trimmed video clip segments, and then sends the trimmed video clip segments to the mobile device.