In-Vehicle Panoramic Entertainment System Using Multi-Camera Stitching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current in-vehicle entertainment systems lack the ability to provide immersive, panoramic views and interactive experiences that integrate real-world surroundings with virtual environments, limiting user engagement and information delivery.

Innovation Solution

An entertainment system comprising multiple cameras capturing exterior views, an entertainment module that generates panoramic video, and displays such as HUDs and VR/AR headsets, which stitches images, stabilizes and corrects for shaking, animates objects based on real-world data, and provides interactive features like games, advertisements, and coupons.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are used to capture images around the vehicle exterior, then panoramic view coverage is improved, but device complexity increases

Engineering Contradiction:
Improvepanoramic view coverageVSAvoiddevice complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The panoramic capture system is segmented into multiple independent camera units positioned at different locations (front, rear, left, right) around the vehicle. Each camera captures a specific portion of the environment, and the entertainment module combines these segmented views into a complete panoramic display, resolving the contradiction between coverage area and device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The entertainment module serves multiple functions: it processes images from multiple cameras, performs stabilization, corrects shaking, stitches images together, and displays panoramic views. This multi-functionality consolidates what would otherwise require separate systems, improving panoramic coverage while managing device complexity through functional integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If image stabilization and shaking correction are performed, then image quality is improved, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The entertainment module performs image stabilization and shaking correction as preliminary processing steps before stitching images together to create the panoramic view. By preparing images in advance with stabilization and correction, the system ensures high image quality while managing processing time through efficient pre-processing workflows.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image stabilization and shaking correction operations run continuously alongside other image processing tasks in the entertainment module. This continuous processing allows the system to maintain high image quality without significant delays, as the useful action of image enhancement occurs continuously rather than in discrete batches that would cause time loss.

Inventive Principle:
Principle #20Continuity of useful action

3Adaptability or versatility

If panoramic video is displayed via multiple display devices, then user engagement is improved, but system complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The entertainment module is designed as a universal platform that can output panoramic video to multiple different display devices (head-up displays, VR headsets, AR glasses, conventional displays) through a single integrated system. This multi-functionality allows the system to enhance user engagement across diverse devices without proportionally increasing system complexity, as the core processing remains centralized.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system provides panoramic views across multiple dimensional formats: 2D panoramic displays on conventional screens, 360-degree immersive views in VR headsets, and augmented reality overlays on windshields. By utilizing another dimension of display technology, the system improves user engagement and versatility while managing complexity through a unified entertainment module that handles all output formats.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20220134953A1Panoramic virtual environment for in-vehicle entertainment
Publication Date: 2022.05.05 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US20220134953A1 patent drawing
  • US20220134953A1 patent drawing
  • US20220134953A1 patent drawing

AI summary

An entertainment system of a vehicle includes: a plurality of cameras configured to capture images around an exterior of the vehicle; one or more displays; and an entertainment module configured to: based on the images, generate panoramic video; and display the panoramic video within the vehicle via the one or more displays.