Audience Excitement Heat Map via Dual Imaging Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Performers face challenges in accurately grasping the state of large audiences, especially in crowded venues, which affects their ability to control and enhance the performance experience.

Innovation Solution

An information processing system that includes imaging units for performers and audiences, recognition units for scene and expression analysis, a calculation unit for excitement indices, and a heat map creation unit to visually represent audience excitement levels, allowing for real-time feedback and clustering to optimize performance content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If performers try to directly observe and assess audience reactions in large crowded venues, then they can maintain personal connection with the audience, but it becomes difficult to accurately grasp the overall state and excitement levels of the entire audience

Engineering Contradiction:
Improveaccuracy of grasping audience stateVSAvoidvenue size
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The audience area is divided into multiple predetermined regions, and the audience is further segmented into individuals or groups within each region. Multiple imaging units are positioned to capture images of different regions simultaneously, enabling comprehensive monitoring of large venues while maintaining measurement precision through localized analysis.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary information processing apparatus that acts as a mediator between the audience and performers. This apparatus automatically analyzes audience images, determines excitement levels, and provides feedback to performers, eliminating the need for performers to directly observe and assess large crowds while maintaining accurate measurement of audience state.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If multiple imaging units are deployed to cover large audience areas, then comprehensive audience coverage is achieved, but system complexity increases

Engineering Contradiction:
Improveaudience coverage areaVSAvoidsystem complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The information processing apparatus serves multiple functions: it receives images from multiple imaging units, determines excitement levels of audience members, creates heat maps representing audience state, and provides feedback to performers. This multi-functional design reduces the need for separate systems for each function, thereby managing complexity while achieving comprehensive coverage.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically processes images, determines excitement levels, and generates heat maps without requiring manual intervention. The information processing apparatus self-manages the complex tasks of analyzing multiple images simultaneously and coordinating feedback delivery, reducing operational complexity despite the multi-unit deployment.

Inventive Principle:
Principle #25Self-service

3Productivity

If real-time audience feedback is provided to performers, then performers can adjust performance to maintain engagement, but processing and delivering this information quickly requires significant computational resources

Engineering Contradiction:
Improvereal-time feedback speedVSAvoidcomputational energy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system pre-establishes the framework for feedback delivery, including positioning imaging units to cover predetermined regions and configuring the information processing apparatus to automatically analyze images. By preparing this framework in advance, the system enables rapid real-time processing during performances without requiring complex computational decisions during the actual feedback delivery.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a continuous feedback loop where audience images are captured, excitement levels are determined, heat maps are created, and feedback is provided to performers in real-time. This automated feedback mechanism enables quick response to audience reactions while distributing computational tasks efficiently across the system architecture.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12087090B2Information processing system and information processing method
Publication Date: 2024.09.10 FUJIFILM CORP
  • US12087090B2 patent drawing
  • US12087090B2 patent drawing
  • US12087090B2 patent drawing

AI summary

Provided are an information processing system and an information processing method which can easily grasp a state of a person in a predetermined area. The information processing system includes a first imaging unit that images a performer, a second imaging unit that images a person in a predetermined area, a first recognition unit that recognizes a scene based on an image captured by the first imaging unit, a second recognition unit that recognizes expression of the person based on an image captured by the second imaging unit, a calculation unit that calculates a state index of the person according to the scene based on a recognition result of the scene and a recognition result of the expression of the person, a heat map creation unit that creates a heat map representing the state index of the person in association with a position of the person in the predetermined area, and an output unit that outputs the heat map.