Automated Comment Generation for Moving Image Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The manual process of adding comments to moving image content is costly and labor-intensive, making it difficult for creators to easily produce commented content.

Innovation Solution

An information processing device and method that acquires information about the relationship between content contributors and viewers to generate comments automatically based on the position and target of a virtual commentator, allowing for dynamic and context-specific commentary.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual editing process is used to add comments to moving image content, then comment quality can be controlled, but production cost and work time increase significantly

Engineering Contradiction:
Improvecomment qualityVSAvoidproduction efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system enables automatic comment generation where the moving image content itself serves as the source material. The comment generation unit extracts events and generates comments autonomously without requiring manual human intervention, allowing the content to essentially comment on itself through automated processing of visual and audio data.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual editing process with an automated information processing system. The comment generation unit uses event extraction from moving image data and automated comment generation algorithms to substitute human editors, dramatically reducing production time while maintaining comment quality through structured processing of content events.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual editing equipment is introduced to create commented content, then comment quality improves, but equipment cost and operation complexity increase

Engineering Contradiction:
Improvecomment qualityVSAvoidequipment complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The comment generation unit serves multiple functions within a single integrated system: it extracts events from moving image content, generates appropriate comments based on extracted events, and outputs formatted comment data. This multi-functional approach eliminates the need for separate specialized equipment for each processing stage, reducing overall system complexity while maintaining comment quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If automated comment generation is implemented, then production cost decreases, but comment quality and appropriateness may deteriorate

Engineering Contradiction:
Improveproduction efficiencyVSAvoidcomment quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system incorporates feedback mechanisms where the event extraction results inform the comment generation process. The comment generation unit receives structured event data including timing, location, and content characteristics, and uses this feedback to generate contextually appropriate comments that match the specific events detected in the moving image content.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies local quality by generating comments specifically tailored to each extracted event rather than using generic comments. Each comment is customized based on the local characteristics of the event it describes, including the event type, location in the content, and relevant contextual information, ensuring high-quality, context-appropriate commentary throughout the entire moving image content.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240346728A1Information processing device, information processing method, and information processing system
Publication Date: 2024.10.17 SONY GROUP CORP
  • US20240346728A1 patent drawing
  • US20240346728A1 patent drawing
  • US20240346728A1 patent drawing

AI summary

To more easily create a commented moving image content. An information processing device according to an embodiment includes: an acquisition unit (10, 110, and 120) that acquires information regarding a relationship between a contributor of a content and a viewer of the content; and a comment generation unit (40) that generates a comment to be uttered by a virtual commentator based on the information regarding the relationship.