Blind person navigation method and device based on auxiliary information
A technology for blind navigation and auxiliary information, applied in navigation computing tools, etc., can solve the problems of reduced feasibility, inability to obtain global information of the scene, use restrictions, etc., and achieve the effect of broadening the application scene
Active Publication Date: 2021-07-09
BEIJING SHENRUI BOLIAN TECH CO LTD +1
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The first solution has the following problems: when the user is in an unfamiliar environment, on the one hand, the global information of the scene cannot be obtained, and on the other hand, accurate positioning information cannot be obtained indoors, which leads to great limitations in the use of such methods
The second solution also has its shortcomings: indoor positioning technology requires the assistance of sensors such as cameras, and it is difficult to meet these hardware conditions when in an unfamiliar scene, which will greatly reduce the feasibility
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0066] In order to make the purpose, technical solution and advantages of the present invention clearer and clearer, the present invention will be further described below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
[0067] figure 1 It is a flowchart of a blind navigation method based on auxiliary information according to an embodiment of the present invention, including the following steps:
[0068] Step 101, acquire video images i in N different directions within a 360-degree range t , t=1,2,...,N;
[0069] Step 102, using the first convolutional neural network to extract features from the video image, and input the extracted ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a blind person navigation method and device based on auxiliary information. The method comprises the following steps: acquiring video images in different directions in a 360-degree range; performing feature extraction and fusion on the video image to obtain an image fusion feature; further obtaining a plurality of possible prediction directions; carrying out feature embedding on the text containing the auxiliary navigation information, fusing to obtain a text fusion feature, and carrying out cross fusion on the text fusion feature and the image fusion feature by utilizing a cross attention mechanism to obtain a cross-modal fusion feature vector; and selecting a plurality of possible prediction directions by using the vector to obtain a final navigation prediction direction. According to the method, navigation prediction can be realized only by depending on auxiliary navigation information provided by other people under the condition that global scene information is lost, and the application scene of the blind person navigation technology is widened.
Description
technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a navigation method and device for blind people based on auxiliary information. Background technique [0002] There are two main types of existing navigation technologies for the blind: one is to rely on global information (such as maps, top views, etc.) A camera and other sensors calculate the exact coordinates of the user for further path planning. The first solution has the following problems: when the user is in an unfamiliar environment, on the one hand, the global information of the scene cannot be obtained, and on the other hand, accurate positioning information cannot be obtained indoors, which leads to great limitations in the use of such methods. The second solution also has its shortcomings: indoor positioning technology requires the assistance of sensors such as cameras, and it is difficult to meet these hardware conditions when in an unfamiliar scene...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G01C21/20
CPCG01C21/20
Inventor 史业民俞益洲李一鸣乔昕
Owner BEIJING SHENRUI BOLIAN TECH CO LTD