In-or-Out Judgment Using Audio-Image Signal Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In sports, particularly ball sports, referees often make incorrect decisions due to the high speed of the ball and limited physical capacity, leading to occlusions that complicate accurate judgments about whether an object has landed inside or outside a line, which is exacerbated by the need for expensive ultrahigh-speed cameras to process image information.
Innovation Solution
A method that separates audio and image signals from a sport environment, using a deep learning neural network and Kalman filters to detect the landing point of an object, allowing for accurate judgment of its position relative to a line without requiring high-priced cameras, by analyzing both audio and image signals and applying the Hough Transform algorithm for line detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If ultrahigh-speed cameras are used to minimize occlusions and improve detection accuracy, then measurement precision improves, but device complexity and cost increase significantly
Solution Approach 1:
The patent segments the detection task into multiple components performed by different types of cameras. Standard-speed cameras capture general sport environment images, while ultrahigh-speed cameras are used selectively only when occlusion is detected. This segmentation allows the system to achieve high detection accuracy without requiring all cameras to be ultrahigh-speed models, thereby reducing overall device complexity and cost.
Solution Approach 2:
The patent introduces an intermediary detection mechanism that uses standard-speed cameras to monitor for occlusion conditions. When occlusion is detected, the system activates ultrahigh-speed cameras as needed. This intermediary approach allows the system to maintain high measurement precision when necessary while avoiding the continuous use of expensive equipment, thus reducing device complexity.
2Measurement precision
If ultrahigh-speed cameras are deployed to capture fast-moving objects, then measurement precision improves, but device cost increases
Solution Approach 1:
The patent divides the camera system into two segments: standard-speed cameras for general monitoring and ultrahigh-speed cameras for critical moments. By segmenting the functionality, the system achieves high detection accuracy only when necessary, allowing the use of fewer expensive ultrahigh-speed cameras and reducing overall device cost.
Solution Approach 2:
The patent employs standard-speed cameras as the primary, cost-effective solution for most detection scenarios. These cheaper cameras are used continuously, while expensive ultrahigh-speed cameras are deployed only temporarily when occlusion occurs. This strategy replaces continuous use of expensive equipment with cheaper alternatives, reducing device cost while maintaining detection accuracy when needed.
3Measurement precision
If more ultrahigh-speed cameras are used to process increasing image information, then measurement precision improves, but processing rate decreases
Solution Approach 1:
The patent segments the processing load by having standard-speed cameras handle general image capture and only activating ultrahigh-speed cameras when occlusion is detected. This segmentation ensures that the high processing demands of ultrahigh-speed cameras are not continuously required, maintaining high processing rates while achieving high detection accuracy when needed.
Solution Approach 2:
The patent implements periodic activation of ultrahigh-speed cameras based on occlusion detection events rather than continuous operation. This periodic action allows the system to maintain high processing rates during normal operation while periodically engaging high-precision cameras only when necessary, thus balancing measurement precision with productivity.
4Device complexity
If standard cameras are used to reduce device cost, then device complexity decreases, but measurement precision worsens due to occlusions
Solution Approach 1:
The patent merges the capabilities of standard-speed cameras and ultrahigh-speed cameras into a unified detection system. Standard cameras provide continuous monitoring at low cost, while ultrahigh-speed cameras are integrated to handle occlusion scenarios. This merging allows the system to maintain low device complexity overall while achieving high measurement precision when needed through the combined capabilities of both camera types.
Solution Approach 2:
The patent uses standard-speed cameras as an intermediary layer that detects occlusion conditions and triggers the use of ultrahigh-speed cameras. This intermediary approach allows the cheaper standard cameras to handle most scenarios, reducing device cost, while ensuring high detection accuracy is achieved when occlusions occur through the activated ultrahigh-speed cameras.
Data Source
AI summary
Provided are a method of judgment for in or out, and a recording medium and an apparatus for performing the same. The method performed by the apparatus for judging whether an object landed inside or outside of a line, includes: capturing a sport environment image provided with the line according to a preset rule, wherein the sport environment image includes an audio signal and an image signal; separating the audio signal and the image signal included in the sport environment image; detecting the line by analyzing the image signal; detecting a landing point-in-time of the object by analyzing each of the audio signal and the image signal; and judging whether the object landed inside or outside of the line by comparing the line with a location of the object at the landing point-in-time of the object.