Multi-camera gesture control via segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging systems with PTZ cameras struggle to detect gestures intended for camera control when the camera's imaging state captures the subject's face in close-up or objects other than the gesturing subject, leading to incomplete capture of the subject's arms or hands necessary for gesture detection.
Innovation Solution
An information processing apparatus that includes a detection unit to identify gestures based on images from a first imaging apparatus, an acquisition unit to obtain control information associated with the detected gesture, and a control unit to control a second imaging apparatus based on this information, allowing for suitable camera control regardless of the imaging state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the camera captures the subject's face in close-up or objects other than the gesturing subject, then the imaging apparatus can focus on specific targets, but the arms or hands for gesture detection are not included in the captured image
Solution Approach 1:
The patent divides the imaging system into multiple independent imaging apparatuses (first imaging apparatus for gesture detection, second imaging apparatus for controlled imaging). Each apparatus has specialized functions: the first captures gestures regardless of the second camera's field of view, while the second executes controlled imaging based on detected gestures. This segmentation allows each camera to optimize its specific task without compromising the other.
Solution Approach 2:
The patent introduces an information processing apparatus as an intermediary between the imaging apparatuses and control systems. This intermediary receives images from the first imaging apparatus, detects gestures, acquires control information, and controls the second imaging apparatus. This mediator enables decoupled operation where gesture detection and imaging control are separated from the actual imaging capture.
2Extent of automation
If the camera is controlled based on gestures detected from images, then automatic camera control is enabled, but the system fails when the gesturing limbs are not visible in the captured image
Solution Approach 1:
The patent separates the automation function into two independent components: the first imaging apparatus that continuously captures gestures for automatic detection, and the second imaging apparatus that executes controlled imaging. This segmentation ensures that the automation system (first camera + detection unit) operates independently from the controlled imaging (second camera), maintaining reliability even when the second camera's field of view does not include the gesturing subject.
Solution Approach 2:
The first imaging apparatus performs preliminary gesture detection before the second imaging apparatus executes controlled imaging. The detection unit detects gestures in advance using images from the first camera, and the control unit acquires control information based on these pre-detected gestures. This preliminary action ensures that control commands are generated before the second camera needs to capture the gesture, maintaining reliable automatic control.
3Device complexity
If a single camera is used for both gesture detection and imaging control, then the system is simpler, but the camera cannot simultaneously optimize for both functions
Solution Approach 1:
The patent segments the single camera function into two separate imaging apparatuses with distinct roles. The first imaging apparatus is dedicated to gesture detection, while the second imaging apparatus handles controlled imaging. This segmentation allows each camera to be optimized for its specific function, improving overall system adaptability while maintaining manageable complexity through modular architecture.
Solution Approach 2:
The patent achieves multi-functionality at the system level rather than at the camera level. While each individual camera has a specialized function, the combined system performs multiple functions: gesture detection, control information acquisition, and controlled imaging. The information processing apparatus serves as a universal controller that manages both imaging apparatuses, enabling the system to adapt to various imaging scenarios.
Data Source
AI summary
An information processing apparatus includes a detection unit configured to detect, based on images captured by a first imaging apparatus, a gesture performed by a subject, the first imaging apparatus being among a plurality of imaging apparatuses that includes a second imaging apparatus different from the first imaging apparatus, the second imaging apparatus being configured to be controlled based on the gesture performed by the subject, an acquisition unit configured to acquire control information for controlling the second imaging apparatus, the control information being associated with the gesture detected by the detection unit, and a control unit configured to control the second imaging apparatus based on the control information acquired by the acquisition unit.