Virtual Character Control via Broadcast Event Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current systems fail to automatically drive virtual characters in response to broadcast-type moving picture content, limiting user interaction and engagement.

Innovation Solution

An information processing apparatus and method that receives broadcast-type moving picture content and notifies a second device of data suggesting actions for virtual characters, allowing the virtual character to be autonomously controlled based on events in the content, using triggers like StreamEvent or WebSocket.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If virtual characters are manually controlled, then user interaction is possible, but user engagement and immersion are limited

Engineering Contradiction:

Improveautomatic driving of virtual characterVSAvoidsystem complexity for event detection and character control

Core Design Contradiction:

Extent of automationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by detecting events in the moving picture content before controlling the virtual character. The event detection unit identifies events such as character appearances, dialogues, and action scenes in advance, and this detection results are used to subsequently control the virtual character's behavior, creating a seamless automated interaction experience.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary event detection unit that acts as a mediator between the moving picture content and the virtual character control. This intermediary detects events in the content and translates them into appropriate control signals for the virtual character, enabling automated driving without direct manual intervention while maintaining system manageability.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If virtual character actions are synchronized with content events, then user engagement improves, but system complexity increases

Engineering Contradiction:

Improvesynchronization accuracy between character actions and eventsVSAvoidcomplexity of event detection and control coordination

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system implements feedback by continuously monitoring the moving picture content for events and using this information to adjust and control the virtual character's behavior in real-time. The event detection unit provides feedback about content events, which are then used to synchronize the virtual character's actions with the content, ensuring high synchronization accuracy.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs preliminary event detection and analysis before executing virtual character control actions. By detecting events such as character appearances, dialogues, and action scenes in advance, the system can prepare appropriate control signals, ensuring accurate synchronization between content events and character actions while managing system complexity through structured processing.

Inventive Principle:

Principle #10Preliminary action

3Ease of operation

If manual control interface is provided, then user interaction is enabled, but user experience immersion is reduced

Engineering Contradiction:

Improveuser interaction capabilityVSAvoidautomated character response to content events

Core Design Contradiction:

Ease of operationVSExtent of automation

Solution Approach 1:

The system implements self-service by enabling the virtual character to automatically detect events in the moving picture content and control its own behavior based on these events. The character autonomously responds to content events such as character appearances, dialogues, and action scenes without requiring manual user input, thereby maintaining ease of operation while achieving high automation for enhanced user immersion.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11985390B2Information processing apparatus and information processing method, and information processing system

Publication Date: 2024.05.14 SONY GROUP CORP

AI summary

Provided is an information processing apparatus and an information processing method, and an information processing system, each of which provides a service related to a broadcast-type moving picture content.An information processing apparatus includes: a receiving unit that receives, from a first device, a notice of data including a location or acquisition method of information suggesting an action of a virtual character, the action corresponding to an event that occurs in a broadcast-type moving picture content; an acquisition unit that acquires the information on the basis of the data issued as a notice from the first device; a display unit capable of two-dimensional or three-dimensional display; and a control unit that controls driving of the virtual character, which is to be displayed using the display unit, on the basis of the information acquired by the acquisition unit.