Video Buffer Storage for Combined Drawing and Camera Frames

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional approaches to generating and editing media content on computing devices are uninteresting, boring, and not sufficiently interactive, as they require separate storage and processing of videos and drawings, leading to inefficiencies when trying to render them together.

Innovation Solution

A system and method that initiates a video capture mode, detects touch gestures to render drawings overlaying the camera view, combines video image frames with drawings before buffer storage, and stores these combined frames in a video buffer to generate interactive video content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If videos and drawings are stored separately in conventional approaches, then storage and processing can be done independently, but additional processing is required to render them together, reducing efficiency

Engineering Contradiction:
Improverendering efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent combines video frames and drawings into a single composite frame before buffer storage. The video rendering module renders video frames, the drawing rendering module renders drawings, and the frame combining module merges them into unified frames that are then stored in the video buffer. This eliminates the need for separate processing and rendering of video and drawing layers, improving rendering efficiency and reducing processing complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary combining of video and drawing frames before they are stored in the buffer. By pre-combining the frames during the recording phase rather than during playback or post-processing, the system avoids the need for complex real-time composition operations later, thereby improving overall productivity.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If drawings are rendered to overlay camera view in real-time, then interactive media content is created, but additional rendering processing is required

Engineering Contradiction:
Improveinteractive content capabilityVSAvoidrendering processing
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the video rendering function and drawing rendering function into a unified frame composition process. The frame combining module integrates rendered video frames with drawn drawings into single composite frames, allowing interactive content creation without requiring separate complex rendering pipelines for video and drawing overlays.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If video frames and drawings are combined before buffer storage, then rendering efficiency is improved, but frame composition processing is added

Engineering Contradiction:
Improverendering efficiencyVSAvoidframe composition time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The frame composition operation is performed in advance during video recording, not during playback. The frame combining module combines video and drawing frames before they are stored in the video buffer, so that when the video is played back, the composition work is already complete. This preliminary action eliminates time loss during playback while maintaining rendering efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9767848B2Systems and methods for combining drawings and videos prior to buffer storage
Publication Date: 2017.09.19 META PLATFORMS INC
  • US9767848B2 patent drawing
  • US9767848B2 patent drawing
  • US9767848B2 patent drawing

AI summary

Systems, methods, and non-transitory computer-readable media can initiate a video capture mode that provides a camera view. A touch gesture can be detected via a touch display. A drawing can be rendered based on the touch gesture. The drawing can be rendered to appear to overlay the camera view. A first video image frame can be acquired based on the camera view. At least a portion of the first video image frame and the drawing can be combined to produce a first combined frame. The drawing can appear to overlay the first video image frame. The first combined frame can be stored in a video buffer.