Information Processing Apparatus for AR Collaboration Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current information processing systems fail to effectively superimpose virtual images of speech and action information onto real spaces in a seamless and user-friendly manner, particularly in collaborative environments like conferences, limiting the ability to visualize and manage participant interactions and contributions.

Innovation Solution

An information processing apparatus that generates and displays virtual images of speech and action information based on historical data, using head-mounted display devices to overlay virtual content onto real-world scenes, allowing users to view both virtual and real environments simultaneously, with features like gesture detection and voice recognition for interactive control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual images of speech and action information are superimposed onto real spaces using head-mounted display devices, then users can visualize and manage participant interactions in real-time, but the device complexity and information processing requirements increase

Engineering Contradiction:
Improvevisualization of participant interactionsVSAvoidinformation processing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system segments information processing by dividing tasks between the information processing apparatus (which collects, stores, and manages history information) and the head-mounted display device (which retrieves and displays virtual images). This segmentation reduces the processing burden on individual devices while maintaining comprehensive visualization capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an information processing apparatus as an intermediary between data sources and display devices. This intermediary collects, processes, and manages history information, then provides it to display devices for visualization. The intermediary handles the complexity of information management centrally, allowing display devices to focus on presentation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If history information is collected and processed to generate display images, then user-friendly visualization is achieved, but information processing time and computational resources increase

Engineering Contradiction:
Improveuser-friendly visualizationVSAvoidinformation processing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by collecting and storing history information (speech, action, attribution information) in advance during conferences or meetings. This pre-collected data is organized and ready for rapid retrieval and visualization when needed, reducing processing time during actual use.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The information processing apparatus automatically collects, processes, and manages history information without requiring manual intervention. The system self-services by autonomously gathering data from multiple sources, organizing it according to attribution information, and preparing it for display, thereby reducing both processing time and operational complexity.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If multiple types of information (speech, action, attribution) are integrated into display images, then comprehensive collaboration management is enabled, but the quantity of information to be processed increases

Engineering Contradiction:
Improvecollaboration management capabilityVSAvoidinformation volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The information processing apparatus performs multiple functions: collecting speech information, capturing action information, processing attribution information, generating display images, and managing storage. This multi-functional system handles diverse information types through a unified platform, improving versatility while managing information volume efficiently through integrated processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges multiple information types (speech, action, attribution) into unified display images that present comprehensive participant interaction data. By combining these different information streams into integrated visual representations, the system manages large quantities of information in a consolidated manner, making the data more manageable and actionable.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11194535B2Information processing apparatus, information processing system, and non-transitory computer readable medium storing program
Publication Date: 2021.12.07 FUJIFILM BUSINESS INNOVATION CORP
  • US11194535B2 patent drawing
  • US11194535B2 patent drawing
  • US11194535B2 patent drawing

AI summary

An information processing apparatus includes a generation unit and an instruction unit. The generation unit generates a display image including information on speech or action of a target person, based on history information that the target person has made speech or action. The instruction unit instructs a display device, which displays an image of a virtual space so as to be superimposed in a real space, to display the generated display image as the image of the virtual space.