Room layout estimation obtaining method and system based on key point heat map correction

An acquisition method and acquisition system technology, which are applied in the field of room layout estimation and acquisition based on key point heat map correction, can solve the problems of the final performance of the model, the number of incorrectly connected areas, etc., to reduce learning difficulty, reduce overlapping areas, Convergence reduction effect

Active Publication Date: 2021-05-25
浙大宁波理工学院
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the key points of the key point heat map obtained by the neural network usually predict the key points that should exist at the boundary of the picture at a distance of tens of pixels from the boundary due to the prediction error of the network and the error of coordinate scaling. Location, if the key point correction is not performed, it will lead to the wrong number of connected regions when obtaining the connection relationship of the key point heat map according to the room type, which has a great impact on the final performance of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Room layout estimation obtaining method and system based on key point heat map correction
  • Room layout estimation obtaining method and system based on key point heat map correction
  • Room layout estimation obtaining method and system based on key point heat map correction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Based on the key point heat map obtained by the current neural network, we can understand that the key point of the boundary usually predicts the position of tens of pixels away from the boundary, resulting in an error when obtaining the connection relationship of the key point heat map according to the room type. The number of connected regions has a great impact on the final performance of the model. Secondly, the data set used when training the neural network is horizontally flipped when the data set is expanded. These operations can lead to The data is not accurate. In order to solve these problems, improve the accuracy of the model, such as figure 1 As shown, the present invention proposes a room layout estimation acquisition method based on key point heat map correction, which is specifically implemented through the following steps:

[0038] The training method of the neural network model specifically includes steps:

[0039] S01: Obtain a data set, the data set ...

Embodiment 2

[0055] Such as figure 2As shown, the present invention proposes a room layout estimation acquisition system based on key point heat map correction, including:

[0056] The training module of the neural network model, including:

[0057] Obtaining a data set, the data set includes key point label maps of multiple types of preset room types, and obtaining an expanded data set by flipping the label maps and reordering the flipped label maps;

[0058] The reordering method is as follows: taking the labeling order of the labeling diagram before flipping as the sorting standard, so that the labeling sequence after flipping is consistent with the sequence of the labeling diagram before flipping.

[0059] It should be noted that, first of all, after reordering the key points of the flipped picture, each point is distributed in a relatively fixed area in the picture. This operation reduces the learning difficulty of the neural network, enables the network to converge faster and To a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a room layout estimation obtaining method and system based on key point heat map correction, and relates to the field of key point heat map correction, and the method comprises the steps: carrying out the overturning of a picture in a data set, carrying out the key point reordering, training a neural network model, obtaining a key point heat map and a room type of a to-be-recognized image through the neural network model, obtaining boundary key points of the key point heat map according to a corresponding relation between the key points of the room type and the key points of the key point heat map, obtaining image coordinates of the boundary key points, and correcting the boundary key points to an image boundary line of the key point heat map according to the image coordinates; finally, obtaining the connection relation of the corrected key point heat map according to the room type, and obtaining the room layout estimation according to the connection relation. According to the method, through key point reordering and boundary key point correction operation, the problem that the number of key point communication areas is wrong due to key point overlapping and pixel errors is solved, and the accuracy of the data set and the model is improved to a great extent.

Description

technical field [0001] The invention relates to the field of key point heat map correction, in particular to a room layout estimation and acquisition method and system based on key point heat map correction. Background technique [0002] At present, the key points of the key point heat map obtained by the neural network usually predict the key points that should exist at the boundary of the picture at a distance of tens of pixels from the boundary due to the prediction error of the network and the error of coordinate scaling. If the key point is not corrected, it will lead to the wrong number of connected regions when obtaining the connection relationship of the key point heat map according to the room type, which has a great impact on the final performance of the model. Secondly, the data set used in the training of the neural network is basically used after the data set is cleaned, such as filtering out the pictures with the wrong order of key points, and the flipped data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/181G06T7/187G06N3/04G06N3/08
CPCG06T7/181G06T7/187G06N3/04G06N3/08G06T2207/20081
Inventor 文世挺王傲鹏高云君庞超逸
Owner 浙大宁波理工学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap