Unmanned vehicle and navigation method and device thereof
A navigation method and unmanned vehicle technology, applied in the field of unmanned vehicles and their navigation methods and devices, can solve the problems of unmanned vehicles such as poor driving safety and inability to adapt to actual road conditions
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0049] The embodiment of the present application provides a navigation method for unmanned vehicles, such as figure 1 As shown, the method specifically includes the following steps:
[0050] Step 101: Obtain scene image information and user's multimodal information.
[0051] The executor in this embodiment of the application is an unmanned vehicle, which is equipped with a camera, an acoustic sensor, an electromyographic signal collector, an augmented reality head-mounted display device, and the like. The unmanned vehicle captures the scene image information of the current scene where the unmanned vehicle is located in real time through the camera. The user's multimodal information includes voice information, gesture information, eye movement information, and the like. The unmanned vehicle collects the user's voice information in real time through the sound sensor. The user's gesture information is collected in real time through the myoelectric signal collector, for example...
Embodiment 2
[0085] An embodiment of the present application provides an unmanned vehicle navigation device, which is used to implement the unmanned vehicle navigation method described in the above embodiment, such as Figure 4 As shown, the device includes:
[0086] An acquisition module 100, configured to acquire scene image information and user multimodal information;
[0087] The generating module 200 is configured to generate text instruction information corresponding to the multimodal information according to the multimodal information and the navigation semantic knowledge map;
[0088] The determination module 300 is configured to determine the navigation progress and action track according to the scene image information and the text instruction information.
[0089] The above generating module 200 is configured to convert multimodal information into text information; generate text instruction information corresponding to the multimodal information according to the text information...
Embodiment 3
[0104] The embodiment of the present application proposes an unmanned vehicle, including a memory, a processor, and an executable program stored in the memory; the processor reads the executable program code stored in the memory, and runs the program corresponding to the executable program code The program is used to realize the unmanned vehicle navigation method described in any of the above-mentioned embodiments.
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More