Image Pickup Scoring for Retrieving Desired Video After Specific Sounds
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image pickup technologies struggle to efficiently retrieve desired-state images and sounds after a specific sound is generated, as existing methods rely solely on image information or sound generation direction, leading to difficulties in capturing subjects in desirable states.
Innovation Solution
An image pickup apparatus that integrates sound and image recognition units to detect specific sounds and subjects, calculating a weighted score for attribute information that is added to the image and sound data, allowing for easy retrieval of desired-state portions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If attribute scores are generated only on the basis of image information, then the attribute scores can be calculated, but it is difficult to retrieve a subject after a specific sound is generated from a video
Solution Approach 1:
The patent combines sound information and image information into a unified attribute score system. The sound evaluation unit generates sound attribute scores based on sound signals, while the image evaluation unit generates image attribute scores. These scores are then integrated to comprehensively evaluate whether the subject is in the desired state, enabling accurate retrieval of subjects after specific sounds are generated.
Solution Approach 2:
The patent introduces attribute scores as an intermediary that bridges sound information and image information. The sound attribute scores and image attribute scores serve as mediators that translate raw sound and image data into comparable evaluation metrics, allowing the system to determine whether a subject is in a desired state following specific sound events.
2Measurement precision
If attribute information including evaluation result is added from the start of capturing, then all image and sound data can be evaluated, but it increases data processing load and storage requirements
Solution Approach 1:
The patent performs preliminary evaluation by monitoring sound signals during video capture and only adds attribute information when specific sound conditions are met. The sound recognition unit detects specific sounds in real-time, and only when such sounds are detected does the system generate and attach comprehensive attribute scores to the corresponding video segments, avoiding unnecessary processing of unrelated footage.
Solution Approach 2:
The patent applies evaluation resources selectively to specific portions of video data rather than uniformly to all data. Attribute information is added locally to video segments that contain specific sound events, while other segments remain unprocessed or minimally processed, optimizing the balance between evaluation coverage and processing load.
3Ease of manufacture
If sound evaluation and image evaluation are performed separately, then each can be optimized independently, but it is difficult to determine the desired state of the subject comprehensively
Solution Approach 1:
The patent transforms separate sound and image evaluations into a unified parameter system through attribute scores. Both sound attribute scores and image attribute scores use the same scoring scale and evaluation framework, allowing them to be combined and compared directly. This parameter standardization enables comprehensive determination of subject desired states while preserving the modular structure of separate evaluation units.
Data Source
AI summary
An image pickup apparatus capable of easily retrieving desired-state image and sound portions through attribute information is provided. The image pickup apparatus includes an image pickup circuit, a CPU, and a memory that stores a program that, when executed by the CPU, causes the image pickup apparatus to function as the following units a sound acquisition unit that acquires a sound, a sound recognition unit that recognizes a sound acquired during moving image capturing and detects a specific sound from the sound, an image recognition unit that recognizes a moving image acquired during the moving image capturing and detects a subject from the moving image, and a control unit that calculates an evaluation result by using a score weighted in response to a sound recognition result and an image recognition result and adds the evaluation result to the moving image and the sound as attribute information.