Information processing apparatus, method, and program

The proposed solution enhances image recognition technologies by generating an importance map and using a natural language model to explain the recognition basis, addressing the challenge of providing detailed insights into image recognition results.

JP7682980B1Active Publication Date: 2025-05-26SOFTBANK CORPORATION

Patent Information

Application Number
JP2023200722
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-11-28
Publication Date
2025-05-26
Estimated Expiration
2043-11-28

Smart Images

  • Figure 0007682980000001_ABST
    Figure 0007682980000001_ABST
Patent Text Reader

Abstract

Provided are an information processing apparatus, a method, and a program for facilitating understanding of the basis for an image recognition result. 【Solution means】An information processing apparatus 100 that provides the basis for an image recognition result includes an image recognition result output unit 110 that applies a learned image recognition model to a processing target image to generate a feature map including at least one region of interest, and outputs the feature map and the image recognition result; a map generation unit 120 that generates an importance map from the feature map based on the importance of each of a plurality of pixels constituting the processing target image; a template acquisition unit 130 that acquires a prompt template including an instruction for a natural language model; a prompt generation unit 140 that generates a prompt by fitting the image recognition result, the coordinate values and pixel values of pixels determined to have relatively high importance in the importance map, and the number of pixels to the prompt template; and a prompt output unit 150 that outputs the prompt to the natural language model.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Object recognition system, location information acquisition method, and program

    JP2022079775A

  • Defective point detection device, defective point detection method, and computer program

    JP2022097075A

  • Image processing device and image processing method

    JP2023132481A

  • JPP7370118B

  • JPP7416390B

Cited By

  • Abnormal behavior detection system

    JP7891303B1

  • Abnormal behavior detection system

    JP7894613B1

  • Abnormal behavior detection system

    JP7895584B1

  • Abnormal behavior detection system

    JP7907899B1