AR Image Processing for Intuitive Communication Status Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality technologies lack the ability to intuitively represent communication status in real space, relying on simple icons or text, which limits user understanding and engagement.

Innovation Solution

An image processing device and method that builds an environment map using feature data from a real space, generating animation data to display communication status via a communication interface, superimposing animations on input images to simulate real-space communication scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If communication status is displayed using simple icons or text information, then the device complexity is reduced, but the intuitiveness and user understanding of communication status deteriorates

Engineering Contradiction:
Improveintuitiveness of communication status recognitionVSAvoidcomplexity of image processing system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an environment map as an intermediary representation that bridges the real space and the communication status display. The environment map building unit creates a virtual model of the physical environment, and the animation data generation unit uses this map to generate intuitive visual representations of communication status, thereby improving user understanding without directly complicating the core communication functionality

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from two-dimensional icons and text to three-dimensional environment maps with spatial positioning. By mapping communication entities to their actual physical positions in the environment map and generating animations that move through this 3D space, the system provides intuitive spatial awareness of communication status while maintaining manageable complexity through modular architecture

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If communication status is displayed in a virtual space closed in a screen, then the device complexity is reduced, but the user engagement and entertainment value deteriorates

Engineering Contradiction:
Improveuser engagement and entertainment valueVSAvoidcomplexity of animation generation system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the real space environment with the virtual communication representation by superimposing animations on the actual captured image of the physical environment. The image superimposing unit combines the live camera feed with generated animations, creating an augmented reality effect that enhances user engagement by grounding virtual communication entities in the user's actual physical surroundings

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system automatically generates animation data based on communication status information and environment map data without requiring manual configuration. The animation data generation unit autonomously creates appropriate animations by querying communication status from the communication status acquisition unit and positioning entities in the environment map, reducing the burden on users while enhancing engagement

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8994752B2Image processing device, image processing method, and program
Publication Date: 2015.03.31 SONY GROUP CORP
  • US8994752B2 patent drawing
  • US8994752B2 patent drawing
  • US8994752B2 patent drawing

AI summary

There is provided an image processing device including: a data storage unit having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data stored in the data storage unit, the environment map representing a position of a physical object present in the real space; an information generating unit for generating animation data for displaying a status of communication via a communication interface on a screen, using the environment map built by the environment map building unit; and an image superimposing unit for generating an output image by superimposing an animation according to the animation data generated by the information generating unit on the input image.