Assembly guidance method and system based on Hololens depth data
A technology of depth data and standard data, applied in image data processing, 3D modeling, instruments, etc., can solve problems such as changes in assembly stations, and achieve the effects of ensuring consistency, improving timeliness, and good versatility
Active Publication Date: 2021-11-26
XI AN JIAOTONG UNIV
View PDF3 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In the actual assembly process, there are usually requirements for the surface finish of the parts, and the assembly station may change, so there are many limitations in the method of preset markers
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0080] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0081] In the description of the present invention, it should be understood that the terms "comprising" and "comprising" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or more other features, Presence or addition of wholes, steps, operations, elements, components and / or collections thereof.
[0082] It should also be understood that the terminology used in the descriptio...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an assembly guidance method and system based on Hololens depth data. The method comprises the following steps: converting depth data of a real environment collected by Hololens equipment into a point cloud model under a world coordinate system; after labeling, converting the point cloud into a standard data set format; constructing a three-dimensional model of the part to be assembled; converting the constructed part three-dimensional model into a point cloud model; performing space coordinate transformation on the converted part point cloud model, synthesizing the converted part point cloud model with multiple scene point cloud data, and converting the synthesized point cloud into a standard data set format; inputting the data and a synthesized standard data set into an improved Votenet network for training, storing a training result, and carrying out auxiliary calibration in combination with an ICP method; enabling the Hololens equipment to transmit depth data of a real scene to the remote server, input the depth data into the Votenet network and output a detection result; and displaying the image to a user in a holographic image form to realize assembly guidance. The auxiliary assembly information is effectively pushed to assembly personnel in a holographic image form, assembly guidance is realized, and the assembly efficiency is improved.
Description
technical field [0001] The invention belongs to the technical field of intelligent manufacturing and digitalization, and in particular relates to an assembly guidance method and system based on Hololens depth data. Background technique [0002] Assembly refers to a series of operations that assemble parts into complete products according to a certain process flow, and is an important link in the product life cycle. At present, due to the diversity of products and the cumbersomeness of complex product assembly processes, assemblers have to rely on paper instruction manuals or electronic documents for assembly guidance. However, it takes a lot of time to extract effective guidance information from a large amount of text information, and at the same time, there are certain requirements for the understanding and cognitive level of assemblers. Therefore, how to provide a more comprehensible and efficient assembly guidance mode becomes a key issue. [0003] Augmented reality tec...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/11G06K9/46
CPCG06T17/00G06T7/11G06T2207/10028
Inventor 周光辉肖佳诚张超
Owner XI AN JIAOTONG UNIV