Integrating Video Feeds into Still Images for Context

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current traffic information systems, particularly those using traffic cameras, often provide insufficient context, making it difficult for users to understand the direction and location of traffic conditions due to low-quality images and lack of contextual information.

Innovation Solution

Integrating traffic camera image feeds into existing panoramas, using preprocessing techniques and line matching algorithms to transform and filter the images, allowing them to be displayed within a greater visual context, thereby enhancing user comprehension.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traffic camera image feeds are displayed separately without contextual integration, then access to real-time traffic information is provided, but users experience confusion about direction and location due to lack of contextual information

Engineering Contradiction:
Improvecontextual informationVSAvoiduser comprehension
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent merges traffic camera image feeds with panoramic street-level images to create an integrated display. The traffic camera feed is positioned within the panorama at the correct geographic location and orientation, combining real-time traffic information with contextual environmental data. This allows users to simultaneously see traffic conditions and understand the surrounding environment, direction, and location without confusion.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If traffic cameras are positioned to provide vantage point views of important roads, then traffic monitoring capability is improved, but the images lack contextual information about surrounding environment and direction

Engineering Contradiction:
Improvetraffic monitoring capabilityVSAvoidcontextual information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system makes the traffic camera feed serve multiple functions by integrating it into the panorama context. The same traffic camera image simultaneously provides traffic monitoring information and contextual environmental information. The panorama framework allows the traffic feed to function both as a traffic monitoring tool and as a source of contextual data about direction, location, and surrounding environment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If real-time traffic images are displayed as separate video feeds, then current traffic conditions are visible, but the presentation is contextually different from map interfaces making it difficult to understand direction and location

Engineering Contradiction:
Improvedirection and location contextVSAvoidinterface complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the display into functional zones within the panorama. The traffic camera feed is positioned as a specific segment within the larger panorama framework, maintaining its real-time video characteristics while being contextualized within the static panorama image. This segmentation allows the traffic information to remain prominent while being properly oriented and located within the broader environmental context.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2617007B1Visualizing video within existing still images
Publication Date: 2019.10.02 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2617007B1 patent drawingFigure 1
  • EP2617007B1 patent drawingFigure 2
  • EP2617007B1 patent drawingFigure 3

AI summary

Video from a video camera can be integrated into a still image, with which it shares common elements, to provide greater context and understandability. Pre-processing can derive transformation parameters for transforming and aligning the video to be integrated into the still image in a visually fluid manner. The transformation parameters can then be utilized to transform and align the video in real-time and display it within the still image. Pre-processing can comprise stabilization of video, if the video camera is moveable, and can comprise identification of areas of motion and of static elements. Transformation parameters can be derived by fitting the static elements of the video to portions of one or more existing images. Display of the video in real-time in the still image can include display of the entire transformed and aligned video image, or of only selected sections, to provide for a smoother visual integration.