PTZ Camera Control via Reinforcement Learning for Sports Event Coverage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional automatic capturing systems for events like sports require numerous cameras and redundant image regions, leading to high costs and inefficiencies in capturing subjects across an entire field.

Innovation Solution

A control apparatus and learning apparatus that control PTZ cameras by obtaining object positions and orientations, using reinforcement learning to optimize camera orientations for effective subject capture with minimal camera units.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the position of subjects for the entire field is obtained using conventional techniques, then complete field coverage is achieved, but a large number of redundant cameras and image regions are required

Engineering Contradiction:
Improvesubject capture reliabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by making different parts of the field have different capture priorities. The capture priority determination unit assigns higher priorities to regions where subjects are likely to be present (e.g., near goal lines, center circle) and lower priorities to other regions. This allows the system to concentrate camera resources on important areas rather than uniformly covering the entire field, reducing the number of cameras needed while maintaining reliable subject capture.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by capturing only the necessary portions of the field rather than the entire field. The image cutting unit generates cropped images from specific high-priority regions identified by the capture priority determination unit. This partial capturing approach eliminates redundant coverage of low-priority areas, reducing camera requirements and system complexity while maintaining sufficient coverage for reliable subject capture.

Inventive Principle:
Principle #16Partial or excessive action

2Reliability

If more cameras are deployed to cover the entire field, then complete field monitoring is improved, but system cost increases

Engineering Contradiction:
Improvefield coverage reliabilityVSAvoidcamera quantity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system applies local quality by differentiating between high-priority and low-priority regions on the field. The capture priority determination unit identifies specific regions (such as areas near goal lines and the center circle) where subject presence is more likely, and allocates camera resources accordingly. This selective approach allows complete field monitoring reliability to be maintained through strategic camera placement rather than uniform distribution, reducing the total number of cameras required.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements multi-functionality by enabling each camera to serve multiple purposes: capturing subjects in high-priority regions, providing backup coverage for adjacent areas, and contributing to overall field monitoring. The image cutting unit allows a single camera's footage to be processed into multiple cropped views of different high-priority regions, making each camera more versatile and reducing the total camera quantity needed for comprehensive coverage.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If redundant image regions are captured to ensure subject detection, then detection reliability is improved, but data processing load increases

Engineering Contradiction:
Improvesubject detection precisionVSAvoidprocessing energy consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent applies the extraction principle by removing unnecessary image regions from the processing pipeline. The image cutting unit extracts only the high-priority regions identified by the capture priority determination unit, discarding redundant low-priority areas. This extraction maintains subject detection precision by ensuring all critical regions are captured and processed, while significantly reducing the total data volume that requires processing, thereby lowering energy consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system implements partial action by processing only the necessary portions of captured images rather than analyzing entire field views. The image cutting unit generates cropped images focused on high-priority regions where subjects are most likely to be present. This partial processing approach maintains detection precision for critical areas while reducing the overall data processing load and associated energy consumption by eliminating redundant processing of low-priority regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11882363B2Control apparatus and learning apparatus and control method
Publication Date: 2024.01.23 CANON KK
  • US11882363B2 patent drawing
  • US11882363B2 patent drawing
  • US11882363B2 patent drawing

AI summary

A control apparatus controls one or more image capturing units. The apparatus comprises: an obtaining unit configured to, based on an image of a plurality of objects captured by the image capturing units, obtain positions of the plurality of objects; and a generation unit configured to, based on at least the image, the positions of the plurality of objects and the orientation of the image capturing units, generate a control command for changing the orientation of the image capturing units.