Information Processing Apparatus for Generative AI Response Filtering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing language models do not adequately address situations where responses should not be generated, leading to potential inappropriate outputs.
Innovation Solution
An information processing apparatus that determines whether to generate a response based on whether a request is related to a non-response target or a response target, using explicit and implicit determination criteria, and employs generative AI to provide appropriate responses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a language model generates responses to user requests without distinction, then response generation speed is improved, but response appropriateness deteriorates
Solution Approach 1:
The patent segments the response generation process into two independent stages: (1) a determination unit that first classifies the user request into target categories and decides whether to generate a response, and (2) a generation unit that only generates responses when the determination unit approves. This segmentation allows the system to maintain high generation speed for approved requests while preventing inappropriate responses through preliminary classification and determination.
2Reliability
If the system adds determination logic to filter inappropriate requests, then response appropriateness is improved, but system complexity increases
Solution Approach 1:
The determination unit serves multiple functions simultaneously: it classifies user requests into target categories, determines whether the requests are appropriate for response generation, and controls the generation unit's operation. By making the determination unit multi-functional, the patent improves response appropriateness without proportionally increasing system complexity, as one component handles multiple tasks rather than adding separate dedicated components for each function.
3Object-affected harmful factors
If the system uses explicit non-response targets, then inappropriate response suppression is improved, but measurement precision of request classification deteriorates
Solution Approach 1:
Instead of trying to precisely classify all possible request types and their appropriate responses (the traditional approach), the patent inverts the logic by explicitly defining non-response targets - categories of requests that should NOT be responded to. The determination unit works by identifying what requests are inappropriate rather than exhaustively determining what requests are appropriate, which simplifies the classification task and improves both inappropriate response suppression and request classification precision.
Data Source
AI summary
An information processing apparatus according to the present application includes a reception unit that receives information indicating a request of a user, a determination unit that determines whether to generate information indicating a response to the request indicated by the received information, and a providing unit that provides the user with response information generated by using a generative AI as the information indicating the response to the request in a case where determining to generate the information indicating the response. The determination unit determines whether to generate the information indicating the response to the request indicated by the information received by the reception unit on the basis of whether the request indicated by the information received by the reception unit is a request related to a first target set as a non-response target and a request related to a second target set as a response target.


