Data processing method, device and equipment, and relationship category identification method

By introducing human joint information into the relationship detection model, the problem of mismatching between people, objects and relationships in the existing technology is solved, and the accuracy of relationship detection is improved.

CN114511871BActive Publication Date: 2025-10-03ALIBABA GROUP HOLDING LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202011183357.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-29
Publication Date
2025-10-03
Estimated Expiration
2040-10-29

AI Technical Summary

Technical Problem

Existing technologies have the problem of mismatching people, objects, and relationships when detecting relationships between people and objects. In particular, the one-stage method lacks a semantic representation of relationships with physical meaning, which leads to association errors.

Method used

By inputting the image into the relationship detection model, the human body feature heat map, object feature heat map and effective relationship point feature heat map are output to obtain the candidate center point coordinates and joint point coordinates, and the human body joint point information is used for matching to determine the relationship category.

Benefits of technology

The accuracy of matching between human bodies and objects is improved, the representation ability of relationship semantics is enhanced, and false matching is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114511871B_ABST
    Figure CN114511871B_ABST
Patent Text Reader

Abstract

The present application discloses a data processing method, comprising: inputting an image to be processed into a basic network of a model, outputting a human feature heat map, an object feature heat map, and a valid relationship point feature heat map; obtaining the coordinates of a candidate human center point and a candidate object center point based on the human feature heat map and the object feature heat map, respectively; obtaining the coordinates of a candidate human joint point corresponding to the coordinates of the candidate human center point; obtaining the coordinate estimates of the human joint points and the object center point corresponding to the valid relationship points based on the valid relationship point feature heat map; matching the coordinate estimates of the human joint points and the object center point corresponding to the valid relationship points with the coordinates of the candidate human joint points and the candidate object center point, respectively, to determine the relationship category between the human body and the object in the image to be processed. The above method is used to solve the problem of incorrect matching of people, objects, and relationships in the existing solutions for detecting the relationship between people and objects.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Interactive relationship identification method and device, equipment and storage medium

    CN111325141A