3D Message Generation from 2D Image Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current messaging systems are limited in their ability to provide a 3D representation of image and video messages due to the need for additional equipment and higher bandwidth, resulting in severe quality losses, and existing methods for expanding 2D avatars to 3D animations are only possible to a limited extent with loss of quality.

Innovation Solution

A method that extracts and processes 2D image messages to create a 3D representation of the message sender by adjusting brightness and color differences, using simultaneous or quasi-simultaneous output of two 2D images for a 3D effect, and utilizes face and speech recognition to verify the sender's identity and generate a 3D model, allowing for the creation of 3D images from 2D or video messages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If additional equipment with more than two cameras is used to create 3D representation, then 3D quality is improved, but device complexity and bandwidth requirements increase

Engineering Contradiction:
Improve3D qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates a virtual 3D speaker by copying and processing 2D image data from existing messages. Instead of using multiple physical cameras, the system generates synthetic 3D representations by duplicating and transforming 2D image information, thereby avoiding additional hardware while achieving 3D visualization效果

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical system of multiple physical cameras with a computational image processing system. By using software-based 3D reconstruction algorithms that process 2D images through brightness and color adjustments, the system substitutes physical hardware with digital processing methods

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If additional equipment with more than two cameras is used to create 3D representation, then 3D quality is improved, but bandwidth requirements increase

Engineering Contradiction:
Improve3D qualityVSAvoidbandwidth requirements
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The system copies 2D image data from existing messages and processes it computationally to generate 3D representations. This approach reuses existing data rather than transmitting additional raw data from multiple cameras, significantly reducing bandwidth requirements while maintaining 3D quality

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces bandwidth-intensive multi-camera data transmission with computationally efficient 2D image processing. By transforming 2D images into 3D representations through software algorithms, the system reduces network bandwidth consumption while achieving the desired 3D effect

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If 2D avatars are expanded to 3D animations using two simultaneously recorded images, then 3D representation is achieved, but quality loss occurs

Engineering Contradiction:
Improve3D representation capabilityVSAvoidquality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary processing of 2D images by adjusting brightness and color characteristics before generating the 3D representation. This pre-processing optimizes the source material quality, ensuring that the subsequent 3D reconstruction maintains high quality without the need for multiple simultaneous camera recordings

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates high-quality 3D representations by copying and transforming 2D image data through computational processing. Instead of relying on two simultaneous camera recordings that may have quality inconsistencies, the system uses software-based copying and transformation of optimized 2D images to generate consistent high-quality 3D output

Inventive Principle:
Principle #26Copying

Data Source

PatentEP2337327B1Method and device for highlighting selected objects in image and video messages
Publication Date: 2013.11.27 DEUTSCHE TELEKOM AG
  • EP2337327B1 patent drawingFigure 1
  • EP2337327B1 patent drawingFigure 2a~2b
  • EP2337327B1 patent drawingFigure 3a~3b

AI summary

The method involves identifying a set of picture regions including one of the faces and persons in digital data of a set of messages on a digital messaging system having same sender address. A set of sender-relevant picture regions in the identified picture regions representing a sender of one of the messages is determined based on frequency of occurrence of the identified picture regions in the messages having the same sender address. The digital data of the messages is modified to emphasize one of the sender-relevant picture regions. Independent claims are also included for the following: (1) a digital messaging system comprising an identifying unit (2) a method for controlling a digital messaging system.