Intelligent travel auxiliary system

Abstract

The invention discloses an intelligent travel auxiliary system, which belongs to the technical field of intelligent travel terminals, and comprises a local data storage module for storing map data, landmark place information, a landmark place image library and a user historical route; the voice interaction module is used for receiving user voice input and analyzing destination information in combination with the landmark place information; the image recognition module is used for collecting an environment image and matching the environment image with a landmark place image library to assist in positioning the current position of the user; the route planning module is used for generating a navigation route according to the current position and destination information of the user in combination with map data; the voice broadcast module is used for broadcasting the navigation route through a voice synthesis technology; and the route recording module stores the current travel route of the user as a historical route of the user to the local data storage module, and generates a return route based on the current travel route of the user. According to the system, the robustness in a complex environment can be improved, and the crossing from general navigation to scene intelligent assistance is realized.

Description

TECHNICAL FIELD

[0001] The application relates to an intelligent travel auxiliary system and belongs to the technical field of intelligent travel terminals. BACKGROUND

[0002] Although existing intelligent travel technologies have popularized voice assistants and online navigation, their core defects lie in high dependence on stable network signals and accurate structured address inputs, which greatly reduces their practicability in real complex scenarios.

[0003] Traditional solutions cannot effectively analyze natural languages such as "the gate of the nearby mall" containing directional pronouns and ambiguous landmarks, which makes user groups such as the elderly who are not good at using accurate addresses face operation obstacles. More importantly, in signal blind areas such as underground parking lots and large transportation hubs, the system often fails completely due to positioning loss and data interruption, and cannot provide continuous navigation services.

[0004] In addition, existing technologies only provide abstract route guidance based on road names, lack recognition and guidance of specific entrances, gates and other micro-locations, and the operation process of recording the return journey is cumbersome, and one-stop seamless experience cannot be achieved. SUMMARY

[0005] The application aims to provide an intelligent travel auxiliary system that can improve robustness in complex environments and realize the leap from general navigation to scenario intelligent assistance.

[0006] To achieve the above-mentioned purpose, the application provides the following technical solutions: In a first aspect, the application provides an intelligent travel auxiliary system, comprising: A local data storage module for storing map data, landmark information, a landmark image library and user historical routes; A voice interaction module for receiving user voice input containing location description and combining landmark information to analyze destination information through natural language processing technology; An image recognition module for collecting environment images and matching the environment images with the landmark image library to assist in positioning the current location of the user; A path planning module for generating a navigation route according to the current location of the user and the destination information in combination with the map data; A voice broadcast module for broadcasting the navigation route through voice synthesis technology; A route recording module for storing the current travel route of the user as a user historical route in the local data storage module and generating a return path based on the current travel route of the user.

[0007] In combination with the first aspect, further, the local data storage module is configured to automatically synchronize to update the map data, landmark information, landmark image library and user historical route in the background when detecting that the system is connected to a wireless network.

[0008] In combination with the first aspect, further, the voice interaction module comprises: a voice recognition unit configured to receive user voice input containing a location description and convert it into text; a semantic understanding unit configured to analyze the text using natural language processing technology, extract destination keywords through contextual association, and parse structured destination information.

[0009] In combination with the first aspect, further, the image recognition module uses computer vision technology to extract feature points of the environment image, matches the feature points of the environment image with the pre-stored feature points of multiple angles in the landmark image library, determines the orientation of the user relative to the landmark, and locates the current position of the user according to the orientation of the user relative to the landmark.

[0010] In combination with the first aspect, further, the image recognition module is configured with a camera for collecting environment images.

[0011] In combination with the first aspect, further, when the path planning module generates a navigation route, it prioritizes routes that pass through the pre-stored entrances and exits with image features in the landmark image library.

[0012] In combination with the first aspect, further, the route recording module is configured with a one-key recording button for storing the current travel route of the user as a user historical route in the local data storage module, and a one-key return button for generating a return path based on the current travel route of the user, and the one-key recording button and the one-key return button are triggered by a single physical button or a single graphical interface element.

[0013] In combination with the first aspect, further, the system further comprises: a positioning fusion module configured to fuse the current position of the user and the GPS / Wi-Fi positioning result in a signal blind area to provide continuous position calibration.

[0014] The second aspect of the present application provides an intelligent travel assistance method, comprising: acquiring and storing map data, landmark information, landmark image library and user historical route; receiving user voice input containing a location description, and combining landmark information to parse destination information through natural language processing technology; collecting environment images and matching them with the landmark image library to assist in locating the current position of the user; According to the current location and destination information of the user, a navigation route is generated in combination with map data; The navigation route is broadcasted through a voice synthesis technology. A return path is generated based on the current travel route of the user, and the current travel route of the user is stored as a historical route of the user.

[0015] In a third aspect, the present application provides a computer device, comprising: A storage medium for storing a computer program; A processor for executing the computer program to implement the intelligent travel assistance method of the second aspect.

[0016] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the intelligent travel assistance method of the second aspect.

[0017] In a fifth aspect, the present application provides a computer program product comprising a computer program, which, when executed by a processor, implements the intelligent travel assistance method of the second aspect.

[0018] Compared with the prior art, the present application has the following advantages: The intelligent travel assistance system provided by the present application combines localized data storage, enhanced voice interaction, environmental image recognition, and intelligent path planning, and can solve the poor practicability of existing navigation technology in complex real scenarios, and improve the reliability of the system in signal blind areas (such as underground garages and large hubs). Through pre-stored local image library and real-time visual matching, continuous accurate positioning is realized without relying on network and satellite signals, which can avoid positioning drift or functional paralysis caused by signal loss in traditional solutions. Through natural language processing, the voice input containing ambiguous references and landmark descriptions can be accurately understood and processed, which can improve the operability of groups such as the elderly. According to the current location and destination information of the user, a navigation route is generated in combination with map data, realizing navigation upgrade from abstract route to micro scenario, and the path planning can actively preferentially select entrances and exits with clear image features, and in combination with the one-key recording and one-key return functions, providing full-range guidance for users in complex places. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 is the intelligent travel assistance method flowchart provided by the embodiments of the present application. DETAILED DESCRIPTION

[0020] The technical solutions of the present application will be further described in detail below in combination with specific embodiments.

[0021] Embodiments of the present application are described below in detail, examples of the embodiments are shown in the drawings, wherein the same or similar notations represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only, for the purpose of explanation, and are not to be understood as limiting the present application. The embodiments of the present application and the technical features in the embodiments can be combined with each other without conflict.

[0022] The embodiment of the present application provides a kind of intelligent travel auxiliary method, comprising: Obtain map data, landmark information, landmark image library and user historical route and store; Receive user voice input containing place description, and destination information is parsed by natural language processing technology in combination with landmark information; Collect environmental image, and environmental image is matched with landmark image library, and the current location of user is assisted positioning; According to user current location and destination information, generate navigation route in combination with map data; Navigation route is broadcasted by voice synthesis technology; Based on user current travel route, generate return path, and user current travel route is stored as user historical route.

[0023] The intelligent travel auxiliary method provided by the embodiment of the present application synchronizes data to local, reduces the influence caused by network signal and positioning signal, for example, underground garage network signal is poor, positioning is inaccurate, leading to many navigation and positioning are unstable, the auxiliary method provided by the embodiment can more accurately guide traveler when being close to destination. Support image recognition, for old people, illiterate groups, image recognition can more accurately inform the position of traveler, especially in unfamiliar area.

[0024] Figure 1 It is the flow chart of intelligent travel auxiliary method provided by the embodiment of the present application, the logical order of the method of the embodiment is only shown, and the steps shown or described can be completed in different order from Figure 1 The order shown in the figure.

[0025] The intelligent travel auxiliary method provided by the embodiment of the present application can be applied to terminal, and can be executed by intelligent travel auxiliary system, which can be realized by software and / or hardware, and the system can be integrated in terminal, for example: any tablet computer or computer equipment with communication function.

[0026] In one possible embodiment, the intelligent travel auxiliary method specifically includes the following steps: Step S10: start intelligent voice assistant; Specifically, the user wakes up the intelligent voice assistant through voice, the system collects the user's voice input in real time, and analyzes the user's intention through natural language processing (NLP) technology. The voice interaction module converts the voice into text for subsequent processing.

[0027] Step S20: User voice input destination; Specifically, the system analyzes the text of the user's voice input and extracts key information (such as destination name, nearby landmark, etc.). Through semantic understanding technology, the system can process ambiguous or unstructured voice descriptions, such as "I want to go to the nearby mall."

[0028] Step S30: Local data synchronization and verification; Specifically, the system retrieves destination information from local storage first, reducing dependence on the network. If local data is insufficient, the system obtains the latest data through the network and synchronizes it to the local. This step is particularly suitable for signal blind areas (such as underground garages).

[0029] Step S40: Image recognition assisted positioning; Specifically, for elderly or illiterate users, the system supports scanning the surrounding environment image through the camera, and through computer vision (CV) and image matching technology, it matches with the local stored landmark image library to assist in determining the user's current location.

[0030] Step S50: Generate navigation route; Specifically, the system generates the optimal route based on the user's current location and destination information. The path planning algorithm takes into account real-time traffic data, user preferences (such as walking or driving), and special locations (such as mall entrances, stations, etc.).

[0031] Step S60: Voice broadcast navigation information; Specifically, the system uses text-to-speech (TTS) technology to convert navigation information into natural language broadcast through multi-modal interaction, while supporting image and text display. The broadcast content includes distance, direction, and nearby landmarks to help users quickly locate.

[0032] Step S70: One-key recording and return function; Specifically, the user can record the current route with one key, and the system automatically saves the path key points. When returning, the system generates a reverse route based on the recorded data to ensure route consistency.

[0033] The embodiment of the present application provides an intelligent travel assistance system, which comprises: A local data storage module for storing map data, landmark information, landmark image library, and user historical route; The voice interaction module is configured to receive a user voice input containing a location description, and combine the landmark location information to parse the destination information through a natural language processing technology. The image recognition module is configured to collect an environment image, and match the environment image with a landmark location image library to assist in positioning a current location of the user. The path planning module is configured to generate a navigation route according to the current location of the user and the destination information, and in combination with map data. The voice broadcast module is configured to broadcast the navigation route through a voice synthesis technology. The route recording module is configured to store a current travel route of the user as a user historical route in the local data storage module, and generate a return path based on the current travel route of the user.

[0034] The intelligent travel assistance system provided in the embodiment combines localized data storage, enhanced voice interaction, environment image recognition, and intelligent path planning, and can solve the poor practicability of existing navigation technologies in complex real scenarios, improve robustness in complex environments, and realize a leap from general navigation to scenario intelligent assistance.

[0035] In one possible embodiment, the local data storage module is configured to automatically update the map data, the landmark location information, the landmark location image library, and the user historical route in the background in synchronization when it is detected that the system is connected to a wireless network.

[0036] Specifically, storing key data related to intelligent travel in the local data storage module can reduce dependence on a network and positioning signals, and is particularly suitable for signal blind areas such as underground garages.

[0037] In one possible embodiment, the voice interaction module includes: The voice recognition unit is configured to receive a user voice input containing a location description and convert it into text. The semantic understanding unit is configured to analyze the text by using a natural language processing technology, extract destination keywords through a context association relationship, and parse structured destination information.

[0038] Specifically, the voice interaction module supports natural language interaction, and the user can obtain real-time navigation suggestions by describing a destination through voice.

[0039] In one possible embodiment, the image recognition module uses a computer vision technology to extract feature points of an environment image, match the feature points of the environment image with pre-stored feature points of multiple angles in a landmark location image library, determine a position of the user relative to a landmark location, and position a current location of the user according to the position of the user relative to the landmark location.

[0040] In this embodiment, the image recognition module is configured with a camera for collecting environmental images.

[0041] Specifically, for the elderly or illiterate groups, location guidance can be provided by scanning the surrounding environment images.

[0042] In one possible embodiment, when the path planning module generates a navigation route, the route is planned to pass through an entrance with image features pre-stored in the landmark image library.

[0043] In this embodiment, the route recording module is configured with a one-key recording button for storing the current travel route of the user as a historical route of the user in the local data storage module, and a one-key return button for generating a return path based on the current travel route of the user, and the one-key recording button and the one-key return button are triggered by a single physical button or a single graphical interface element.

[0044] In one possible embodiment, the intelligent travel assistance system further comprises: The positioning fusion module is configured to fuse the current position of the user and the GPS / Wi-Fi positioning result in a signal blind area to provide continuous position calibration.

[0045] The intelligent travel assistance system provided by the embodiment of the present application deeply integrates localized storage, enhanced voice interaction, visual positioning and intelligent path planning, processes ambiguous voice descriptions through semantic understanding, realizes visual feature matching and fusion positioning in a signal blind area by using a pre-stored landmark image library, and preferentially plans a route passing through an entrance with clear image features, so as to finally realize route recording and return through one-key operation, improve the robustness of the system in a complex environment, the friendliness to special groups and the fluency of overall operation, and realize the leap from general navigation to scene intelligent assistance. Through the positioning fusion module, the pre-stored local image library is matched with real-time vision to realize continuous and accurate positioning without relying on network and satellite signals, so that the positioning drift or functional paralysis caused by signal loss in the traditional scheme can be avoided.

[0046] By using the intelligent travel assistance system provided by the embodiment of the present application, the user can recognize the surrounding environment when going out by using a voice assistant combined with image scanning, which provides convenience for the user's travel. According to the distance and direction of the nearby landmark with high popularity relative to the user, the user can quickly understand the position of the user. The entrances of special marked shopping malls, stations and underground garages can save time for the user. One-key recording of the route and one-key return of the original route can avoid inconsistency of the to-and-fro routes, and simple operation can provide better user experience.

[0047] The intelligent travel assistance system provided by the embodiment of the present application can execute the intelligent travel assistance method provided by the embodiment of the present application, and has the corresponding function modules and beneficial effects of the execution method.

[0048] The embodiment provides a computer device, comprising: A storage medium: used for storing a computer program; A processor: used for executing the computer program to realize the intelligent travel assisting method provided by the embodiment of the present application.

[0049] The embodiment provides a computer readable storage medium, which has a computer program stored thereon, and the computer program is executed by a processor to realize the intelligent travel assisting method provided by the embodiment of the present application.

[0050] The embodiment provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to realize the intelligent travel assisting method provided by the embodiment of the present application.

[0051] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage etc.) containing computer-usable program code.

[0052] The present application is described with reference to flowcharts and / or block diagrams of the method, device (system) and computer program product according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be realized by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing devices to produce a machine, so that the instructions executed by the computer or other programmable data processing devices produce a device implemented in the flowcharts and / or block diagrams. Figure 1 The function specified in one flow or multiple flows and / or blocks Figure 1 The function specified in one block or multiple blocks.

[0053] These computer program instructions can also be stored in a computer readable memory capable of guiding the computer or other programmable data processing devices to work in a specific way, so that the instructions stored in the computer readable memory produce a manufactured product including instruction devices, which realize the functions specified in the flowcharts and / or block diagrams. Figure 1 The function specified in one flow or multiple flows and / or blocks Figure 1 The function specified in one block or multiple blocks.

[0054] These computer program instructions can also be loaded into a computer or other programmable data processing devices, so that a series of operational steps are performed on the computer or other programmable data processing devices to generate a computer-implemented process, so that the instructions executed on the computer or other programmable devices provide a process for implementing the flowchart Figure 1 one flow or a plurality of flows and / or the functions specified in the block Figure 1 one flow or a plurality of flows and / or the functions specified in the block

[0055] The above is only the preferred embodiment of the present application, it should be noted that for those skilled in the art, without departing from the technical principles of the present application, can also make a number of improvements and variations, these improvements and variations should also be considered as the protection scope of the present application.

Claims

1. An intelligent travel assistance system, characterized in that, include: The local data storage module is used to store map data, landmark information, landmark image library, and user historical routes; The voice interaction module is used to receive user voice input containing location descriptions and, combined with landmark location information, parse out destination information using natural language processing technology. The image recognition module is used to acquire environmental images and match them with a database of landmark images to help locate the user's current position. The route planning module is used to generate navigation routes based on the user's current location and destination information, combined with map data; The voice broadcast module is used to broadcast the navigation route using voice synthesis technology; The route recording module is used to store the user's current route as the user's historical route in the local data storage module, and generate a return route based on the user's current route.

2. The intelligent travel assistance system according to claim 1, characterized in that, The local data storage module is configured to automatically update map data, landmark information, landmark image library, and user historical routes in the background when the system is detected to be connected to a wireless network.

3. The intelligent travel assistance system according to claim 1, characterized in that, The voice interaction module includes: A speech recognition unit is used to receive user speech input containing a location description and convert it into text; The semantic understanding unit is used to analyze text using natural language processing technology, extract destination keywords through contextual relationships, and parse out structured destination information.

4. The intelligent travel assistance system according to claim 1, characterized in that, The image recognition module uses computer vision technology to extract feature points from the environmental image and matches these feature points with feature points from multiple angles pre-stored in the landmark image library to determine the user's orientation relative to the landmark. Based on this orientation, the module locates the user's current position.

5. The intelligent travel assistance system according to claim 1, characterized in that, The image recognition module is equipped with a camera for capturing environmental images.

6. The intelligent travel assistance system according to claim 1, characterized in that, When generating navigation routes, the route planning module prioritizes routes that pass through entrances and exits with image features pre-stored in the image library of landmark locations.

7. The intelligent travel assistance system according to claim 1, characterized in that, The route recording module is equipped with a one-click record button for storing the user's current route as the user's historical route to the local data storage module, and a one-click return button for generating a return route based on the user's current route. The one-click record button and the one-click return button are triggered by a single physical button or a single graphical interface element.

8. The intelligent travel assistance system according to claim 1, characterized in that, Also includes: The positioning fusion module is used to fuse the user's current location with GPS / Wi-Fi positioning results in signal blind spots, providing continuous position calibration.

9. A smart travel assistance method, characterized in that, include: Acquire and store map data, landmark information, landmark image library, and user historical routes; It receives user voice input containing location descriptions and combines it with landmark location information to parse out destination information using natural language processing technology; Collect environmental images and match them with a database of landmark images to help locate the user's current position; Based on the user's current location and destination information, and combined with map data, a navigation route is generated; Navigation routes will be announced using voice synthesis technology; A return route is generated based on the user's current travel route, and the user's current travel route is stored as the user's historical route.

10. A computer device, comprising: Storage medium: used to store computer programs; Processor: Used to execute the computer program to implement the intelligent travel assistance method of claim 1.

Images