Visual relation detection method, device, visual relation detection training method and device

A detection method and relationship technology, applied in the field of computer vision, can solve problems such as not using the subject feature and the object feature connection

Active Publication Date: 2018-06-29
BEIJING SENSETIME TECH DEV CO LTD
View PDF1 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Moreover, when identifying the predicate relationship, only the category and location information of the subject

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual relation detection method, device, visual relation detection training method and device
  • Visual relation detection method, device, visual relation detection training method and device
  • Visual relation detection method, device, visual relation detection training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The present application will be further described in detail below in conjunction with the accompanying drawings and exemplary implementations. It should be understood that the specific exemplary implementations described herein are only used to explain the present application rather than limit the present application. In addition, it should be noted that, for ease of description, only parts relevant to the present application are shown in the drawings. The present application will be described in detail below with reference to the accompanying drawings and in combination with exemplary embodiments.

[0050] According to the visual relationship detection method and device provided in the exemplary embodiments of the present application, the characteristics of the subject object, the predicate relationship and the object object can be considered together, and the subject object, the predicate relationship and the object object can be detected at the same time, thereby gen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a visual relation detection method, a visual relation detection device, a visual relation detection training method and a visual relation detection training device. The visual relation detection method includes the following steps that: a plurality of candidate regions for object detection are extracted from an image; a plurality of visual relation detection region sets areobtained on the basis of the plurality of candidate regions, wherein the visual relation detection region set contains a subject detection region, an object detection region, and a predicate detectionregion; and a subject item, an object item and a predicate relation are determined on the basis of the subject detection region, the object detection region, and the predicate detection region in each visual relation detection region set. With the methods and devices provided by the present invention adopted, a subject, a predicate and an object in a visual relation can be considered as a whole,the three parts are recognized simultaneously, and therefore, the accuracy of visual relation detection is improved.

Description

technical field [0001] The present application relates to the field of computer vision (CV), in particular to a visual relationship detection method and device, and a visual relationship detection training method and device. Background technique [0002] Visual relationship detection is a method for detecting objects in an image and the relationship between them, where the visual relationship can be represented by the phrase "subject-verb-object". For example, if an image shows a person flying a kite, then the visual relationship of the image can be expressed as a phrase "person flying a kite", where "person", "flying" and "kite" are the subject and predicate in the visual relationship respectively and object. Compared with object detection, visual relationship detection has a larger semantic space and stronger descriptive ability, and can better understand image content. [0003] Conventional visual relationship detection methods separate object detection and predicate re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/46G06N3/04G06N3/08
CPCG06N3/084G06V20/20G06V10/424G06N3/045
Inventor 李怡康欧阳万里王晓刚
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap