Synchronous Front-Back Smartphone Camera Video Superimposition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current smartphone applications utilizing simultaneous recording by front and rear cameras for immersive video content and video conferencing are underdeveloped and require improvements in features such as communication between users viewing the same active content, switching between active videos, and combining content from users in proximity.

Innovation Solution

A system that synchronously records front and back camera video streams, extracts and superimposes presenter images onto the back-camera stream, allowing control of image size, position, and appearance using remote control, eye-tracking, or gesture recognition, and enables video presentation mirroring and teleportation between devices, utilizing GPS and IMU technology for panoramic views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If synchronous recording by front and back cameras is implemented, then immersive video content quality is improved, but device complexity increases

Engineering Contradiction:
Improvevideo content qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system segments the video processing into distinct modules: front camera recording, back camera recording, image extraction from front camera stream, and superimposition onto back camera stream. This modular segmentation allows complex immersive video processing to be managed through independent, manageable components that can be developed and optimized separately.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system merges the extracted presenter image from the front camera stream with the back camera video stream to create a unified immersive video output. This combining of multiple video sources and processing streams into a single cohesive output resolves the complexity by integrating functions rather than managing separate complex systems.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If multiple user videos and content are combined, then interactivity and communication capability are improved, but ease of operation deteriorates

Engineering Contradiction:
Improvecommunication capabilityVSAvoiduser control difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system provides universal controls that work across multiple video sources and user configurations. The same interface mechanisms handle switching between different users' videos, adjusting superimposition parameters, and controlling communication features, making the system adaptable to various communication scenarios without requiring different control methods for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adapts to different communication scenarios by automatically adjusting which video streams are active, how they are combined, and what controls are needed. The interface responds to user actions in real-time, switching between different operational modes (e.g., presenting, viewing, communicating) without requiring manual reconfiguration, thereby maintaining ease of operation despite high versatility.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11792355B1Using synchronous recording by front and back smartphone cameras for creating immersive video content and for video conferencing
Publication Date: 2023.10.17 MMHMM INC
  • US11792355B1 patent drawing
  • US11792355B1 patent drawing
  • US11792355B1 patent drawing

AI summary

Creating a video presentation includes obtaining a first front-camera video stream and a first back-camera video stream that are recorded synchronously using a first device having a front-camera and a back-camera and extracting a first image of a first presenter from the first front-camera video stream. Creating a video presentation also includes obtaining a second front-camera video stream and a second back-camera video stream that are recorded synchronously and extracting a second image of a second presenter from the second front-camera video stream. It is determined whether that the first back-camera video stream and the second back-camera video stream are complimentary views. Creating a video presentation also includes constructing a panoramic view by combining the first back-camera video stream and the second back-camera video stream and superimposing the first image of the first presenter and the second image of the second presenter onto to the panoramic view.