Method for establishing fruit tree canopy feature map in orchard

A feature map and fruit tree technology, applied to the details of image stitching, 3D modeling, image enhancement, etc., can solve the problems of inability to ensure the reliability of orchard operation robots, and the inability to adapt to changes in fruit tree leaf color and growth, etc., to achieve reduction Effects of small interference, saving storage space, and improving accuracy
CN110298914AActive Publication Date: 2019-10-01JIANGSU UNIV
1 Cites 11 Cited by

Patent Information

Authority / Receiving Office
CN Β· China
Patent Type
Applications(China)
Current Assignee / Owner
JIANGSU UNIV
Publication Date
2019-10-01

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a method for establishing a fruit tree canopy feature map in an orchard. The method comprises: using an RGB-D camera for collecting color information and depth information of surrounding environment images in the moving process of a robot in real time, using a semantic segmentation network for segmenting fruit trees and other environment features, reserving information of the fruit trees in the depth images according to the segmented images, and therefore point cloud data of the fruit trees are generated; extracting characteristic angular points in the color image, calculating the motion of the camera of two adjacent frames of images, and fusing the motion with the IMU data so as to estimate the motion state of the camera; constructing an optimization problem for the multi-frame images and the camera pose estimation by adopting a factor graph, and optimizing the pose of the camera; and constructing an octree map of the fruit tree canopy according to the fruit tree point cloud data and the camera pose. Rich environmental information of an orchard is collected, the understanding of the robot to the orchard environment is improved, and the requirement of the robot for completing higher-level operation such as automatic navigation, variable spraying and fruit picking is met.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to visual SLAM technology and semantic segmentation technology, and in particular provides a method for establishing a canopy feature map of fruit trees in an orchard. Background technique

[0002] From soil analysis, to orchard management, to climate detection, and fruit picking, a variety of precision agricultural technologies are being applied to all aspects of orchard production. Precision agriculture is becoming the future of modern orchard development. Orchard autonomous operation robots are gradually replacing humans to complete the complicated labor in the orchard. One of the key technologies of autonomous operation robots is environmental perception technology, which creates digital maps based on collected data to guide robots to move autonomously.

[0003] SLAM (Synchronous Localization and Mapping) is considered to be the key to realize the real autonomous movement of the robot. Most of the traditional orchard SLAM meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More