Multimodal Assertion Verification Using Textualized Non-Text Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques are inefficient in automatically determining the authenticity of assertion details in contents, particularly those involving non-text elements such as images and videos, which are time-consuming and costly when relying on human experts.
Innovation Solution
An information processing apparatus that includes a textualizing unit to convert non-text elements into text, an extraction unit to identify assertion details, and an authenticity determination unit to evaluate the extracted details using a large language model (LLM).
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If human experts perform fact checking on content assertion details, then determination accuracy is improved, but time consumption and costs increase
Solution Approach 1:
The patent creates a virtual copy of the expert fact-checking process by training an AI model on expert verification data. The model learns to replicate expert judgment patterns, enabling automated authenticity determination that mirrors human expert accuracy without requiring actual human experts to perform each verification task manually.
Solution Approach 2:
The patent replaces the mechanical human expert verification process with an automated AI-based system. The manual fact-checking mechanism is substituted with an algorithmic approach that processes content assertion details automatically, eliminating the time-consuming human intervention while maintaining determination accuracy through sophisticated NLP and verification algorithms.
2Measurement precision
If human experts perform fact checking on content assertion details, then determination accuracy is improved, but costs increase
Solution Approach 1:
The patent creates a virtual copy of the expert fact-checking process by training an AI model on expert verification data. The model learns to replicate expert judgment patterns, enabling automated authenticity determination that mirrors human expert accuracy without requiring actual human experts to perform each verification task manually.
Solution Approach 2:
The patent replaces the mechanical human expert verification process with an automated AI-based system. The manual fact-checking mechanism is substituted with an algorithmic approach that processes content assertion details automatically, eliminating the time-consuming human intervention while maintaining determination accuracy through sophisticated NLP and verification algorithms.
3Productivity
If automated fact checking is implemented, then time consumption and costs are reduced, but ability to handle non-text elements deteriorates
Solution Approach 1:
The patent implements a universal verification system that handles multiple content types (text, images, videos, audio) through a single integrated AI platform. The system uses multimodal capabilities to process different data formats, extracting assertion details from various non-text elements and verifying their authenticity against corresponding textual content, thereby achieving both high productivity and broad adaptability.
Solution Approach 2:
The patent introduces text as an intermediary element that bridges non-text content and verification processes. The system extracts assertion details from images, videos, and audio, then uses textual representation and comparison to verify authenticity. This intermediary approach enables automated processing of diverse content types while maintaining verification accuracy through consistent text-based validation mechanisms.
Data Source
AI summary
An information processing apparatus includes a textualizing unit for textualizing a non-text element included in a content that is a target for determining authenticity of assertion details, an extraction unit for extracting assertion details of the content from the textualized non-text element, and an authenticity determination unit for determining authenticity of the extracted assertion details. According to this information processing apparatus, it is also possible to avoid making an erroneous determination based on content having erroneous details.


