Offline navigation method and apparatus for moving carrier, and moving carrier

Abstract

The present application provides an offline navigation method and apparatus for a moving carrier, and a moving carrier. The method comprises: acquiring an offline map, wherein the offline map comprises information of a set of places; acquiring information of a place of interest to a user; when the place of interest to the user is not in the set of places, adding the place of interest to the user to the set of places; when the moving carrier is in an offline state, acquiring a navigation instruction, wherein the navigation instruction comprises at least part of text content corresponding to the place, or the navigation instruction comprises at least part of voice information corresponding to the text content; and on the basis of the navigation instruction, controlling a display apparatus to display a search result by means of the offline map, wherein the search result comprises the place of interest to the user. Embodiments of the present application can be applied to an intelligent vehicle or an electric vehicle, facilitating improvement of the navigation experience of the user when the moving carrier is in an offline state.

Description

Offline navigation method and device for mobile carrier and mobile carrier

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on August 25, 2023, with application number 202311087043.3 and application name “Offline navigation method, device and mobile carrier for mobile carrier”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of navigation technology, and more particularly, to an offline navigation method and device for a mobile carrier, and a mobile carrier. Background Art

[0003] While driving, users often encounter situations where their vehicle is offline (or disconnected from the internet). Because the physical data capabilities of in-vehicle map applications' navigation services are deployed on cloud servers, in some cases, users may be unable to use navigation services in offline scenarios, thus affecting their navigation experience.

[0004] Summary of the Invention

[0005] The present application provides an offline navigation method, device, and mobile carrier for a mobile carrier, which help to improve the navigation experience of a user when the mobile carrier is in an offline state.

[0006] In a first aspect, an offline navigation method for a mobile carrier is provided, the method comprising: obtaining an offline map, the offline map including information of a place set; obtaining a first place, the first place being a place of interest to a user; when the first place is not in the place set, adding the first place to the place set; when the mobile carrier is in an offline state, obtaining a first navigation instruction, the first navigation instruction including at least part of the text content corresponding to the first place, or the first navigation instruction including at least part of the voice information corresponding to the text content; according to the first navigation instruction, controlling a display device to display a first search result through the offline map, the first search result including the first place.

[0007] Based on the above technical solution, if a user's location of interest is not included in the location collection corresponding to the offline map, the location of interest can be added to the location collection. This allows users to search for more locations when the mobile carrier is offline, and the search results can include the location of interest to the user, which helps improve the user's navigation experience.

[0008] In some possible implementations, obtaining the first navigation instruction includes: obtaining text input by the user in a text input box of the offline map, where the text input includes at least part of the text content corresponding to the first location.

[0009] In some possible implementations, obtaining the first navigation instruction includes: obtaining a voice navigation instruction of the user, where the voice navigation instruction includes at least part of the voice information corresponding to the text content.

[0010] In some possible implementations, the mobile carrier is in an offline state, including: the mobile carrier is located in a scenario lacking wireless and global navigation satellite system (GNSS) coverage, such as an underground garage or a tunnel.

[0011] In some possible implementations, adding the first place to the place set includes adding attribute information such as the name, address, coordinates, and category of the first place to the place set.

[0012] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: establishing a first matching relationship between at least part of the text content corresponding to the first location, and / or at least part of the voice information corresponding to the text content, and the first location; wherein, according to the first navigation instruction, controlling the display device to display the first search result through the offline map includes: according to the first navigation instruction and the first matching relationship, controlling the display device to display the first search result through the offline map, the first search result including the first location and the second location, wherein the priority of the first location is higher than the priority of the second location.

[0013] Based on the above technical solution, when the user uses the offline navigation function, the vehicle can prioritize the places of interest to the user based on the user's input and the previously established matching relationship, which helps to improve the accuracy of voice recognition and offline location search in the offline state, and helps to enhance the user's navigation experience in offline scenarios.

[0014] In some possible implementations, the first location is a location that the user is interested in and may also be understood as a location that the user has used.

[0015] For example, the first location is a location that the user has searched for through an application (application, app) when the mobile carrier is online.

[0016] For another example, the first location is a location that the user has successfully navigated to through a map application when the mobile carrier is online.

[0017] For another example, the first location is a location that the user has used on a mobile terminal (eg, a mobile phone), and the first location is sent to the mobile carrier via the mobile terminal.

[0018] The above technical solution, by integrating personalized user data, helps improve the accuracy of offline voice recognition and location search, enhancing the user's navigation experience in offline scenarios. Furthermore, by prioritizing the first location, users can quickly select it from multiple search results, improving driving safety while the mobile vehicle is in motion.

[0019] In some possible implementations, the location set includes a first subset and a second subset. The first subset in the location set initially acquired by the mobile carrier may be an empty set, and the second subset may include multiple locations. Adding the first location to the location set includes: adding the first location to the first subset; wherein, establishing at least part of the content in the text content corresponding to the first location with the first location includes: establishing a priority matching relationship between the text content input by the user and the locations in the above-mentioned first subset.

[0020] The first subset mentioned above can also be called a hot word set (or a POI dataset on the mobile carrier side), and the second subset can also be called a general point of interest (POI) dataset. After the mobile carrier obtains the offline map from the map server, the data in the general POI dataset can remain unchanged.

[0021] By establishing a priority matching relationship between the text content input by the user and the places in the above-mentioned first subset, the matching priority of the text content input by the user and the places in the above-mentioned hot word set can be higher than the matching priority of the text content input by the user and the places in the above-mentioned general POI data set, thereby ensuring that the places of interest to the user can be detected first.

[0022] In some possible implementations, a matching relationship is established between at least part of the information in the voice information corresponding to the text content and the first location, including: optimizing the terminal-side automatic speech recognition (ASR) module through the location in the above-mentioned hot word set, so that when the mobile carrier obtains at least part of the information in the voice information corresponding to the text content, it can preferentially match the at least part of the information to the text content corresponding to the first location.

[0023] Based on the above embodiment, by combining the user's personal data, it can be ensured that the places that the user is interested in are detected first, which helps to improve the accuracy of voice recognition and offline place search in offline state, and helps to enhance the user's navigation experience in offline scenarios.

[0024] The second location may be a location in the general POI dataset, and the second location may be associated with the at least part of the content or the at least part of the information.

[0025] In combination with the first aspect, in certain implementations of the first aspect, the information of the first location includes remark information of the first location, and the method further includes: establishing a second matching relationship between at least part of the content in the remark information, and / or at least part of the information in the voice information corresponding to the remark information, and the first location; when the mobile carrier is in an offline state, obtaining a second navigation instruction, the second navigation instruction including at least part of the content in the remark information, or the second navigation instruction including at least part of the information in the voice information corresponding to the remark information; according to the second navigation instruction and the second matching relationship, controlling the display device to display a second search result through the offline map, the second search result including the first location and a third location; wherein the priority of the first location is higher than the priority of the third location.

[0026] Based on the above technical solution, the mobile carrier can also establish a matching relationship between the text content or voice information corresponding to the note information and the first location. In this way, when the mobile carrier is offline and detects that the navigation instruction issued by the user includes text content or voice information corresponding to the note information, the first location can be matched to the user first. This helps to increase the flexibility of users when searching for the first location through offline maps in offline scenarios, thereby helping to improve the user's navigation experience.

[0027] In combination with the first aspect, in some implementations of the first aspect, obtaining the information of the first place includes: upon detecting input by a user searching for the first place through an application, obtaining the information of the first place.

[0028] Based on the above technical solution, by the user inputting the location search in the application, the locations included in the location set corresponding to the offline map can be expanded, so that the user can search for more location information when the mobile carrier is offline, which helps to improve the user's navigation experience.

[0029] In some possible implementations, the application includes a food application and a travel application.

[0030] In combination with the first aspect, in certain implementations of the first aspect, when it is detected that a user searches for a first location through an application, information of the first location is obtained, including: when it is detected that a user searches for the first location through a map application, information of the first location is obtained.

[0031] In combination with the first aspect, in certain implementations of the first aspect, upon detecting input of a user searching for the first location through a map application, obtaining information about the first location includes: upon detecting input of a user navigating to the first location through the map application, obtaining information about the first location.

[0032] Based on the above technical solution, when the mobile carrier detects the user's input of searching and navigating to a first location in the map application, it can obtain information about the first location. In this way, the accuracy of determining the location of interest to the user can be improved by searching and navigating to the first location in the map application.

[0033] In combination with the first aspect, in some implementations of the first aspect, obtaining the information of the first location includes: receiving the information of the first location sent by a mobile terminal.

[0034] Based on the above technical solution, by sharing locations between devices, the locations included in the location set corresponding to the offline map can be expanded, so that users can search for more location information when the mobile carrier is offline, which helps to improve the user's navigation experience.

[0035] In some possible implementations, the account logged in on the mobile terminal is associated with the account logged in on the mobile carrier.

[0036] For example, the account logged in on the mobile terminal is the same as the account logged in on the mobile carrier.

[0037] For another example, the account logged in on the mobile terminal and the account logged in on the mobile carrier are in the same family group.

[0038] For another example, the account logged in on the mobile terminal is an account authorized by the account logged in on the mobile carrier.

[0039] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: when the residence time of the mobile carrier in the first area is greater than or equal to a preset time, controlling the prompt device to prompt the user to download the offline map, where the offline map includes a map of the first area.

[0040] Based on the above technical solution, when the preset conditions are met, the mobile carrier can prompt the user to download the offline map to ensure that the user can continue to use the offline map to search for locations or use the offline map navigation service when the mobile carrier is offline, which helps to improve the user's navigation experience.

[0041] In combination with the first aspect, in certain implementations of the first aspect, before the control prompting device prompts the user to download the offline map, the method further includes: determining that the mobile carrier is in a parking state.

[0042] Based on the above technical solution, before prompting the user to download the offline map, it can be determined whether the mobile carrier is in the parked state. This helps to ensure the driving safety of the user when downloading the offline map.

[0043] In a second aspect, a training method is provided, which includes: obtaining information of a first location, where the first location is a location of interest to the user and is not in a location set on an offline map; and training a voice interaction module on the vehicle side or an offline POI search module on the vehicle side based on text content corresponding to the first location and voice information corresponding to the first location.

[0044] In combination with the second aspect, in certain implementations of the second aspect, the voice interaction module includes an ASR module, and the voice interaction module on the vehicle side is trained based on the text content corresponding to the first location and the voice information corresponding to the first location, including: establishing in the ASR module a priority matching relationship (or, a priority recognition relationship) between at least part of the information in the voice information corresponding to the first location and at least part of the content in the text content corresponding to the first location.

[0045] Taking the first location as an example where the first location is in Chinese, the voice information corresponding to the first location may be the voice information corresponding to the full Chinese name of the first location.

[0046] Taking the first location as an example where the language is a foreign language (eg, English, Spanish, German, Japanese, Korean, Portuguese, etc.), the voice information corresponding to the first location may be the voice information corresponding to the full foreign language name of the first location.

[0047] During the model inference phase, when an offline vehicle receives a navigation instruction including voice information corresponding to a first location, it can input the navigation instruction into the trained ASR module to obtain the corresponding text content, which includes the text content corresponding to the first location. The semantic understanding (NLU) module analyzes the user's intent (e.g., the intent is "navigate to the destination") and the slot (e.g., the destination is "the first location"). The vehicle-side voice interaction module can send the intent and slot to the vehicle-side map application. The map application can determine from the intent that the user wants to navigate to the destination and, based on the slot, search the location in the location set using the offline POI search module to obtain information about the first location (e.g., attribute information such as name, address, coordinates, and category). The offline POI search module can then send the first location information to the offline route planning module. The offline route planning module can plan one or more navigation routes based on the vehicle's current location and the location of the first location. After planning one or more navigation routes, the vehicle can control the display device to display the one or more navigation routes.

[0048] In combination with the second aspect, in certain implementations of the second aspect, the offline POI search module on the vehicle side is trained based on the text content corresponding to the first location and the voice information corresponding to the first location, including: establishing a priority matching relationship between at least part of the text content corresponding to the first location and the first location in the offline POI search module on the vehicle side.

[0049] Taking the first location as an example where the first location is in Chinese, the text content corresponding to the first location may be the full Chinese name corresponding to the first location, or the text content corresponding to the first location may be the Chinese pinyin corresponding to the full Chinese name.

[0050] Taking the first location as an example where the location is in a foreign language, the text content corresponding to the first location may be the full name of the foreign language.

[0051] In a third aspect, an offline navigation device for a mobile carrier is provided, the device comprising: an acquisition unit for acquiring an offline map, the offline map including information of a set of locations; the acquisition unit further for acquiring a first location, the first location being a location of interest to a user; a data processing unit for adding the first location to the set of locations when the first location is not in the set of locations; the acquisition unit further for acquiring a first navigation instruction when the mobile carrier is in an offline state, the first navigation instruction including at least part of the text content corresponding to the first location, or the first navigation instruction including at least part of the voice information corresponding to the text content; and a control unit for controlling a display device to display a first search result through the offline map according to the first navigation instruction, the first search result including the first location.

[0052] In combination with the third aspect, in certain implementations of the third aspect, the device further includes: a matching relationship establishing unit, used to establish a first matching relationship between the at least partial content, and / or the at least partial information, and the first location; the control unit, used to: according to the first navigation instruction and the first matching relationship, control the display device to display the first search result through the offline map, the first search result including the first location and the second location, wherein the priority of the first location is higher than the priority of the second location.

[0053] In combination with the third aspect, in certain implementations of the third aspect, the matching relationship establishing unit is further used to establish a second matching relationship between at least part of the content in the remark information, and / or at least part of the information in the voice information corresponding to the remark information, and the first location; the acquisition unit is further used to acquire a second navigation instruction when the mobile carrier is in an offline state, the second navigation instruction including at least part of the content in the remark information, or the second navigation instruction including at least part of the information in the voice information corresponding to the remark information; the control unit is further used to control the display device to display a second search result through the offline map according to the second voice navigation instruction and the second matching relationship, the second search result including the first location and the third location; wherein the priority of the first location is higher than the priority of the third location.

[0054] In combination with the third aspect, in some implementations of the third aspect, the device further includes a detection unit, and the acquisition unit is used to: acquire information of the first place when the detection unit detects input from the user searching for the first place through an application.

[0055] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is configured to: acquire information of the first location when the detection unit detects input by the user searching for the first location through a map application.

[0056] In combination with the third aspect, in certain implementations of the third aspect, the acquisition unit is configured to: acquire information of the first location when the detection unit detects input by the user navigating to the first location through the map application.

[0057] In combination with the third aspect, in some implementations of the third aspect, the acquiring unit is used to: receive the information of the first location sent by the mobile terminal.

[0058] In combination with the third aspect, in certain implementations of the third aspect, the control unit is further used to control the prompt device to prompt the user to download the offline map when the residence time of the mobile carrier in the first area is greater than or equal to a preset time, and the offline map includes a map of the first area.

[0059] In combination with the third aspect, in certain implementations of the third aspect, the device further includes: a determination unit, configured to determine that the mobile carrier is in a parking state before the control unit controls the prompting device to prompt the user to download the offline map.

[0060] In a fourth aspect, a training device is provided, which includes: an acquisition unit for acquiring information of a first location, which is a location of interest to the user and is not in the location set of the offline map; a module training unit for training a voice interaction module on the vehicle side or an offline POI search module on the vehicle side based on the text content corresponding to the first location and the voice information corresponding to the first location.

[0061] In combination with the fourth aspect, in certain implementations of the fourth aspect, the voice interaction module includes an ASR module, and the module training unit is used to: establish a priority matching relationship in the ASR module between at least part of the information in the voice information corresponding to the first location and at least part of the content in the text content corresponding to the first location.

[0062] In combination with the fourth aspect, in certain implementations of the fourth aspect, the module training unit is used to: establish a priority matching relationship between at least part of the text content corresponding to the first location and the first location in the offline POI search module on the vehicle side.

[0063] In a fifth aspect, an offline navigation device for a mobile carrier is provided, the device comprising a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to perform any possible method in the first aspect.

[0064] In a sixth aspect, a training device is provided, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to perform any possible method in the second aspect.

[0065] In a seventh aspect, a system is provided, comprising a display device and a computing platform, wherein the computing platform comprises any possible device in the third aspect or the fifth aspect.

[0066] In the eighth aspect, a mobile carrier is provided, which includes any possible device in the third aspect, or includes the device described in the fourth aspect, or includes the device described in the fifth aspect, or includes the device described in the sixth aspect, or includes the system described in the seventh aspect.

[0067] In a ninth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute any possible method in the first or second aspect.

[0068] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or separately packaged with the processor, and the embodiments of the present application do not specifically limit this.

[0069] In a tenth aspect, a computer-readable medium is provided, wherein the computer-readable medium stores a program code, and when the computer program code is run on a computer, the computer executes any possible method in the first aspect or the second aspect.

[0070] In the eleventh aspect, an embodiment of the present application provides a chip system, which includes a processor for calling a computer program or computer instructions stored in a memory so that the processor executes any possible method in the first or second aspect above.

[0071] In combination with the eleventh aspect, in a possible implementation, the processor is coupled to the memory through an interface.

[0072] In combination with the eleventh aspect, in a possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] FIG1 is a functional block diagram of a mobile carrier provided in an embodiment of the present application.

[0074] FIG2 is a set of graphical user interfaces GUI provided by an embodiment of the present application.

[0075] FIG3 is another set of GUIs provided in an embodiment of the present application.

[0076] FIG4 is another set of GUIs provided in an embodiment of the present application.

[0077] FIG5 is a schematic diagram of the system architecture provided in an embodiment of the present application.

[0078] FIG6 is a schematic flow chart of an offline navigation method for a mobile carrier provided in an embodiment of the present application.

[0079] FIG7 is another schematic flowchart of the offline navigation method of the mobile carrier provided in an embodiment of the present application.

[0080] FIG8 is a schematic block diagram of an offline navigation device for a mobile carrier provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a way to describe the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. "At least one" means one or more. For example, "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that there can be three kinds of relationships, for example, at least one of A and B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0082] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a restriction on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction. In addition, in the description of this embodiment, unless otherwise specified, the meaning of "plurality" is two or more.

[0083] FIG1 is a functional block diagram of a mobile carrier 100 provided in an embodiment of the present application. The mobile carrier 100 may include a perception system 110, a computing platform 120, and a display device 130, wherein the perception system 110 may include one or more sensors for sensing information about the environment surrounding the mobile carrier 100. For example, the perception system 110 may include a positioning system, which may be a global positioning system (GPS), a BeiDou system, or other positioning systems. For another example, the perception system 110 may include one or more of an inertial measurement unit (IMU), a laser radar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0084] Some or all functions of the mobile carrier 100 can be controlled by the computing platform 120. The computing platform 120 may include one or more processors, such as processors 121 to 12n (n is a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 120 may also include a memory for storing instructions, and some or all of the processors 121 to 12n may call the instructions in the memory to implement corresponding functions.

[0085] The display devices 130 in the cockpit are mainly divided into two categories: the first is the vehicle-mounted display screen; the second is a projection display screen, such as a head-up display (HUD). The vehicle-mounted display screen is a physical display screen and a key component of the in-vehicle infotainment system. The cockpit can be equipped with multiple displays, such as the digital instrument panel, the central control screen, the display in front of the front passenger (also known as the front passenger), the display in front of the left rear passenger, and the display in front of the right rear passenger. Even the vehicle windows can serve as display screens. A head-up display, also known as a head-up display system, is primarily used to display driving information such as speed and navigation on a display device in front of the driver (such as the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by the driver's gaze shift, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD), windshield-HUD (W-HUD), and augmented reality HUD (AR-HUD). It should be understood that other types of HUD systems may appear as technology evolves, and this application is not limited to this.

[0086] The above display device 130 is described by taking a vehicle-mounted display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device 130 can also be a light display screen or a projection screen.

[0087] The mobile carrier in the embodiments of the present application may include road vehicles, water vehicles, air vehicles, industrial equipment, agricultural equipment, or entertainment equipment. For example, the mobile carrier may be a vehicle, which is a vehicle in a broad sense, and may be a vehicle (such as a commercial vehicle, a passenger car, a motorcycle, a flying car, a train, etc.), an industrial vehicle (such as a forklift, a trailer, a tractor, etc.), an engineering vehicle (such as an excavator, a bulldozer, a crane, etc.), agricultural equipment (such as a lawn mower, a harvester, etc.), amusement equipment, a toy vehicle, etc. The embodiments of the present application do not specifically limit the type of vehicle. For another example, the mobile carrier may be a vehicle such as an airplane or a ship.

[0088] FIG2 is a set of exemplary graphical user interfaces (GUIs) provided in an embodiment of the present application.

[0089] As shown in FIG2(a), the vehicle displays an in-vehicle map application interface 213 and a function bar 214 on the central control screen. This interface 213 includes an avatar 2131 of the user account logged into the vehicle, a Bluetooth icon 2132, a Wi-Fi icon 2133, a cellular network signal icon 2134, an in-vehicle map application search box 2135, a card 2136 displaying all installed vehicle applications, a card 2137 displaying in-vehicle music applications, a card 2138 displaying the vehicle's remaining battery life and remaining range, and a card 2139 displaying the vehicle's 360-degree surround view function. The in-vehicle map application search box 2135 includes user-configured controls for going home 21351 and going to work 21352. The function bar 214 includes an icon 2141 for switching to the desktop display, a vehicle internal circulation icon 2142, a driver's seat heating function icon 2143, a driver's area air-conditioning temperature display icon 2144, a passenger area air-conditioning temperature display icon 2145, a passenger seat heating function icon 2146 and a volume setting icon 2147.

[0090] Vehicle 1 includes an offline map of city 1 , which includes a POI dataset. The POI dataset includes location A, location B, and location D, wherein location A, location B, and location D include keywords with the same pronunciation or similar pronunciations.

[0091] As shown in Figure 2(b), the vehicle is now online. Upon detecting the user's voice command "Search for location A," the vehicle can interpret the voice command. For example, the vehicle includes an ASR module and an NLU module. The ASR module primarily recognizes the user's voice as text, while the NLU module primarily understands the user's intent and performs slot parsing.

[0092] For example, the ASR module converts speech into text to obtain the following information: Search for location A. From this sentence, the NLU module can parse and obtain the content shown in Table 1.

[0093] Table 1

[0094] After obtaining the user's intent and the corresponding slot information, the NLU module can send this information to the in-vehicle map application. Based on the intent and slot, the in-vehicle map application can add "Place A" to the search box 2135 and obtain the search list 216 corresponding to "Place A". As shown in Figure 2(b), the search list 216 includes four search results, namely "Place A", "Place B", "Place C", and "Place D" located in City 1. When the user clicks on the third search result "Place C", the vehicle can display the location of "Place C" and other information on the central control screen; at the same time, if Place C is not in the POI dataset of the offline map, the vehicle can also add Place C to the POI dataset of the offline map. For example, the vehicle can add Place C to the hot word set in the POI dataset.

[0095] In (b) of FIG2 , the vehicle can send the user's location (e.g., location A) to the map server. Based on location A, the cloud server can retrieve locations with the same or similar pronunciation as location A, such as location A, location B, location C, and location D. The cloud server can send information about location A, location B, location C, and location D to the vehicle. Based on the received information, the vehicle can display the search list 216. Upon detecting that the user has selected location C and that location C is not in the POI dataset of the offline map, the vehicle can add the information about location C to the POI dataset.

[0096] At least part of the voice information corresponding to the above locations A, B, C, and D is the same, or at least part of the text content corresponding to locations A, B, C, and D is the same.

[0097] For example, location A is "Jingdong Community", location B is "Jingdong Community", location C is "Jingdong Community", and location D is "Jingdong Building". All of these locations carry content that is pronounced "jingdong".

[0098] For another example, location A is "B restaurant", location B is "B street", location C is "bee restaurant", and location D is "bee community". The above locations carry the same pronunciation or similar keywords, "B" and "bee".

[0099] For example, the vehicle can optimize its voice interaction module based on the updated POI dataset. For example, the next time a user's voice navigation instruction is detected to include at least part of the voice information "Location A," the vehicle can prioritize matching "Location C" for the user.

[0100] As shown in (c) in Figure 2, the vehicle is currently offline (the cellular network signal icon 215 shows that the vehicle is currently offline). When the user's voice command "Navigate to Location A" is detected, the vehicle can parse the voice command. Since the hot word set in the POI dataset includes the hot word "Location C", the information obtained by converting the voice into text through the ASR module is: Navigate to Location C. After obtaining the user's intent and the corresponding slot information, the NLU module can send the information to the in-vehicle map application. Based on the intent and slot, the in-vehicle map application can add "Location C" to the search box 2135 and obtain the search list 217 corresponding to "Location C", where the search list 217 includes 4 search results, namely "Location C", "Location A", "Location B", and "Location D".

[0101] In one embodiment, when it is detected that the user clicks on the first search result "Location C", the vehicle can display one or more navigation routes from the vehicle's current location to Location C through the central control screen.

[0102] In an embodiment of the present application, when a vehicle obtains a location of interest to a user (or a previously used location) that is not already in the POI dataset of an offline map, the vehicle can add the location of interest to the POI dataset of the offline map. This allows the user to see more search results that better meet their expectations in the search list by issuing navigation commands when the vehicle is offline, thereby improving the user's navigation experience.

[0103] The vehicle can also train its voice interaction module based on the user's locations of interest, establishing a prioritized match between the voice information corresponding to the user's locations of interest. This allows the optimized voice interaction module to recognize voice navigation commands issued while the vehicle is offline, prioritizing the display of locations that best meet the user's expectations through the offline map. This helps improve the accuracy of voice recognition and offline search in offline scenarios, ultimately enhancing the user's navigation experience.

[0104] FIG3 is a set of exemplary GUIs provided in an embodiment of the present application.

[0105] As shown in Figure 3(a), the vehicle is offline and has an offline map of City 1 saved. When the user enters "Content 1" in search box 2135, a search list 301 of locations saved in the offline map is displayed on the central control screen. Search list 301 includes three search results: "Location E," "Location F," and "Location G."

[0106] For example, content 1 may be "Cuihua", location E may be "Cuihua Community", location F may be "Cuihua Mountain", and location G may be "Cuihua Restaurant".

[0107] For example, content 1 may be "B", location E may be "B restaurant", location F may be "B street", and location G may be "bee restaurant".

[0108] The POI dataset of the offline map of City 1 may include multiple POIs, each of which may include attribute information such as the name, address, coordinates, and category of the location. For example, the POI dataset of City 1 may include information on "Location E," "Location F," and "Location G."

[0109] As shown in Figure 3(b), the account logged into the phone is associated with the account logged into the vehicle. When the phone detects that the user is searching for a navigation route from the current location to location H using a map application, the phone can save the information about location H in the phone's POI dataset. When the phone and vehicle are connected, the phone can send the information about location H to the vehicle. If location H is not included in the POI dataset of the vehicle's offline map, the vehicle can save the information about location H in the POI dataset of the offline map of city 1. For example, location C can be added to the hotword set of the POI dataset.

[0110] At least part of the voice information corresponding to the above locations E, F, G, and H is the same, or at least part of the text content corresponding to the above locations E, F, G, and H is the same.

[0111] For example, the location H may be "Cuihua Kindergarten." The locations "Cuihua Community," "Cuihua Mountain," "Cuihua Restaurant," and "Cuihua Kindergarten" all carry content pronounced "cuihua."

[0112] For example, the location H may be "B school." The locations "B restaurant," "B street," "bee restaurant," and "B school" carry the same pronunciation or similar keywords, "B" and "bee."

[0113] In one embodiment, the account logged in on the mobile phone is associated with the account logged in on the vehicle, which can be understood as the account logged in on the mobile phone and the account logged in on the vehicle are the same, or the account logged in on the mobile phone and the account logged in on the vehicle are in the same family group, or the account logged in on the mobile phone is an account authorized by the account logged in on the vehicle.

[0114] In one embodiment, the mobile phone can send the information of the location H to the vehicle by touching the devices together. For example, the mobile phone can send the information of the location H to the vehicle by using near field communication (NFC) technology.

[0115] As shown in Figure 3(c), the vehicle is offline. When the user enters "Content 1" in search box 2135, because the hot word set in the POI dataset includes the hot word "Location H," Location H can be prioritized in the search list. For example, the vehicle can display search list 302 on the central control screen, where search list 302 includes four search results, namely, "Location H," "Location E," "Location F," and "Location G."

[0116] In one embodiment, when it is detected that the user clicks on the first search result "Location H", the vehicle can display one or more navigation routes from the vehicle's current location to Location H through the central control screen.

[0117] In an embodiment of the present application, the vehicle can obtain the user's places of interest (or places that have been used) from the mobile phone. If the place is not in the POI dataset of the vehicle's offline map, the place can be added to the POI dataset of the offline map. In this way, when the vehicle is offline, the user can issue navigation commands and see more search results in the search list that better meet the user's expectations, which helps to improve the user's navigation experience.

[0118] The vehicle can also train its voice interaction module based on the user's locations of interest, thereby establishing a prioritized matching relationship between the voice information corresponding to the user's locations of interest. This allows the optimized voice interaction module to recognize voice navigation commands issued while the vehicle is offline, prioritizing the display of locations close to the user's desired destination on the offline map. This helps improve the accuracy of voice recognition and offline search in offline scenarios, thereby enhancing the user's navigation experience.

[0119] The scenario shown in FIG3 above is explained by taking the example of a mobile phone sending information about location H to a vehicle, but the embodiments of the present application are not limited to this. For example, the vehicle may also send information about places of interest to the user that the vehicle has acquired to the mobile phone. For example, after the vehicle detects location H in city 1 searched by the user, it may send information about location H to the mobile phone logged into the same account as the vehicle. When the POI dataset of the offline map of city 1 saved by the mobile phone does not include information about location H, the mobile phone may add the location H to the POI dataset of the offline map of city 1. In this way, when the mobile phone is offline and detects that the user has entered at least part of the content 1 in the search box of the offline map, or when it detects that the user has sent at least part of the voice message corresponding to content 1, the information about location H may be displayed preferentially in the search results.

[0120] FIG4 is a set of exemplary GUIs provided in an embodiment of the present application.

[0121] As shown in FIG4 (a), the mobile phone displays a navigation interface from the current location to the location H, which includes a collection control 401. When the user clicks the control 401, the mobile phone may display a GUI as shown in FIG4 (b).

[0122] As shown in (b) of FIG4 , the mobile phone may display a prompt box 402, wherein the prompt box 402 may prompt the user to add a note for location H. For example, the note added by the user is "children's school". After the mobile phone establishes a connection with the vehicle, it may send the information of location H (including its note "children's school") to the vehicle. After receiving the information, the vehicle may optimize the voice interaction module. For example, the next time it detects that the user issues a voice navigation instruction corresponding to "Content 1" or a voice navigation instruction corresponding to "children's school", it may prioritize matching "location H" for the user.

[0123] As shown in (c) of Figure 4 , the vehicle is currently offline. Upon detecting the user's voice command "Navigate to the child's school," the vehicle can parse the voice command. Since the note information corresponding to "Place H" in the POI dataset includes "child's school," the information obtained by converting the voice into text via the ASR module is: "Navigate to the child's school." After obtaining the user's intent and the corresponding slot information, the NLU module can send this information to the in-vehicle map application. Based on the intent and slot, the in-vehicle map application can add "child's school" to the search box 2135 and obtain a search list 403 corresponding to "child's school." Search list 403 includes two search results, namely "Place H" and "Place I." For example, Place I can be a location that is at least partially associated with the voice information corresponding to "child's school."

[0124] In one embodiment, when it is detected that the user clicks on the first search result "Location H", the vehicle can display one or more navigation routes from the vehicle's current location to Location H through the central control screen.

[0125] In an embodiment of the present application, the vehicle can record the places of interest to the user and their notes. The names and notes (or aliases) of the places of interest can be used to optimize the vehicle's voice interaction module. In this way, when the vehicle is offline and a voice navigation instruction including the notes is issued, the optimized voice interaction module can output a place that better meets the user's expectations, which helps improve the accuracy of voice recognition and offline search in offline scenarios, thereby helping to improve the user experience in offline scenarios.

[0126] Figure 5 shows a schematic diagram of the system architecture provided by an embodiment of the present application. As shown in Figure 5, the system architecture includes a cloud server and a vehicle. The cloud server includes a navigation cloud service and a voice cloud service. The navigation cloud service includes an online POI search module and an online path planning module. The voice cloud service includes an online ASR module, an online NLU module, and an online dialogue manager (DM) module. The online POI search module is used to implement address search in the cloud engine, and the online path planning module is used to implement point-to-point path planning in the cloud engine. The online ASR module is used by the cloud engine to implement speech-to-text recognition, the online NLU module is used by the cloud engine to implement semantic understanding, and the online DM module is used by the cloud engine to implement dialogue management.

[0127] The vehicle includes a navigation application (or map application), a voice interaction module, and other applications. The navigation application includes an offline POI search module and an offline route planning module. The voice interaction module includes an end-side ASR module, an end-side NLU module, an end-side DM module, and a voice assistant. The offline POI search module is used by the vehicle-side engine to implement address search, and the offline route planning module is used by the vehicle-side engine to implement point-to-point route planning. The end-side ASR module is used by the vehicle-side engine to implement speech-to-text recognition, the end-side NLU module is used by the vehicle-side engine to implement semantic understanding, and the end-side DM module is used by the vehicle-side engine to implement dialogue management. Other applications may include travel applications, video applications, social applications, etc.

[0128] In one embodiment, a docking module may also be included between the navigation application and the voice interaction module. For example, a vehicle includes multiple navigation applications. When the voice interaction module recognizes the user's intention and slot information, it can send this information to the docking module, and the docking module selects to send this information to the corresponding navigation application.

[0129] FIG6 shows a schematic flow chart of an offline navigation method 600 for a mobile carrier according to an embodiment of the present application. The method 600 may be executed by the mobile carrier 100, or the computing platform 120, or the system consisting of the computing platform 120 and the display device 130, or the system-on-a-chip (SoC) in the computing platform 120, or the processor, chip, or circuit in the computing platform 120. The method 600 includes:

[0130] S610: Acquire an offline map, where the offline map includes information about a location set.

[0131] Optionally, the method 600 further includes: when the mobile carrier resides in the first area for a period of time greater than or equal to a preset period of time, controlling the prompting device to prompt the user to download the offline map, wherein the offline map includes a general POI dataset. The general POI dataset in the offline map initially obtained by the mobile carrier from the cloud server includes information on multiple locations.

[0132] For example, the universal POI dataset includes information about Location A, Location B, and Location D. When the mobile carrier is offline and detects that a user enters "Location A" in the search box of the offline map, the offline POI search module can search for information about Location A using the universal POI dataset and display the information about Location A, Location B, and Location D in a search list when Location A is found. At least some of the voice information corresponding to Location A, Location B, and Location D is identical, or at least some of the text content corresponding to Location A, Location B, and Location D is identical. Upon detecting the user's input selecting Location A, the offline route planning module can plan one or more navigation routes from the user's current location to Location A.

[0133] Illustratively, the first region may be a province, a state, or a city.

[0134] For example, if the mobile carrier is a vehicle, upon detecting that the vehicle has been in City 1 for 48 hours, it can prompt the user to download an offline map of City 1 through a notification device. For example, the vehicle can issue a voice message stating, "We have detected that you have been in City 1 for more than 48 hours. To ensure the vehicle's offline navigation capabilities, would you like to download an offline map of City 1?" Upon detecting the user's voice command to "download the offline map of City 1," the vehicle can request the map information of City 1 from the cloud server. Upon receiving the vehicle's request, the cloud server can send the offline map of City 1 to the vehicle.

[0135] Optionally, before the control prompting device prompts the user to download the offline map, the method 600 further includes: determining that the mobile carrier is in a parking state.

[0136] For example, taking the mobile carrier as a vehicle, when the vehicle detects that the vehicle has been stationed in city 1 for 48 hours and the vehicle's gear is the parking gear (P gear), the prompt device can prompt the user to download the offline map of city 1.

[0137] S620: Obtain information of a first location, where the first location is a location that the user is interested in.

[0138] The above places of interest to the user may also be understood as places that the user has used, or places that the user has searched for via a mobile carrier or a mobile terminal.

[0139] Optionally, obtaining the information of the first place includes: obtaining the information of the first place when detecting input of a user searching for the first place through an application.

[0140] For example, the vehicle includes a travel app. When detecting that a user searches for a scenic spot 1 in a city 1 through the travel app, the vehicle can obtain attribute information such as the name, address, coordinates, and category of the scenic spot 1.

[0141] For example, the vehicle includes a food app. When detecting that a user searches for restaurant 1 in city 1 through the food app, the vehicle can save attribute information such as the name, address, coordinates, and category of restaurant 1.

[0142] Optionally, when it is detected that the user searches for the first place through the application, obtaining the information of the first place includes: when it is detected that the user searches for the first place through a map application, obtaining the information of the first place.

[0143] For example, the vehicle includes a map app. When detecting that a user searches for a location H in city 1 through the map app, the vehicle can obtain attribute information of the location H, such as its name, address, coordinates, and category.

[0144] Optionally, when detecting user input for searching for the first place through a map application, obtaining the information of the first place includes: when detecting user input for navigating to the first place through the map application, obtaining the information of the first place.

[0145] For example, when it is detected that the user has searched for a navigation route from the current location to location H through a map app, the vehicle can obtain attribute information of location H, such as the name, address, coordinates, and category.

[0146] Optionally, obtaining the information of the first location includes: receiving the information of the first location sent by a mobile terminal.

[0147] For example, as shown in (b) of FIG3 , when the mobile phone detects that the user has searched for information about location H in the map app, the mobile phone may send the information about location H to the vehicle associated with the account logged in on the mobile phone.

[0148] S630: When the first location is not in the location set, add the first location to the location set.

[0149] For example, the mobile carrier may include a device-side POI dataset (or a hot word dataset), wherein the first location may be added to the device-side POI dataset. The device-side POI dataset can be integrated into the offline map via the map app's software development kit (SDK). In this way, the device-side POI dataset and the general POI dataset together constitute the POI dataset of the offline map.

[0150] For example, the general POI dataset of the offline map initially acquired by the mobile carrier does not include information about Scenic Spot 1, Restaurant 1, and Location H. Once the mobile carrier acquires information about Scenic Spot 1, Restaurant 1, and Location H, it can be added to the client-side POI dataset. This allows users to search for information about Scenic Spot 1, Restaurant 1, and Location H using the offline map when the mobile carrier is offline.

[0151] For example, Table 2 shows information of the terminal-side POI dataset and the general POI dataset stored in the mobile carrier.

[0152] Table 2

[0153] The above description uses the example of a device-side POI dataset and a general POI dataset being two independent POI datasets, but the embodiments of this application are not limited to this. For example, an offline map may include a POI dataset that includes two subsets, one of which may be the device-side POI dataset described above, and the other may be the general POI dataset described above. The device-side POI dataset initially obtained by the vehicle from the cloud server is an empty set.

[0154] Optionally, the device-side POI dataset may be further divided. For example, the device-side POI dataset may include a location set A used by users through map applications and a location set B used by users through non-map applications.

[0155] For example, Table 3 shows information of the terminal-side POI dataset and the general POI dataset stored in the mobile carrier.

[0156] Table 3

[0157] For example, after obtaining information about Scenic Spot 1, Restaurant 1, Location A, Location B, and Location H, the vehicle can first determine whether these locations are already in the general POI dataset. If Location A and Location B are already in the general POI dataset, but Scenic Spot 1, Restaurant 1, and Location H are not, the vehicle can add the information about Scenic Spot 1, Restaurant 1, and Location H to the device-side POI dataset.

[0158] Optionally, before adding the first location to the location set, the method further includes: determining whether the number of times the first location is acquired is greater than or equal to a preset number.

[0159] For example, the vehicle may record the method of obtaining the first location. If the first location is a location that the user has navigated to using a map app, the preset number of times may be 1; or if the first location is a location that the user has used using a non-map app, the preset number of times may be 2.

[0160] There is no actual order between S610 and S620 above. For example, after obtaining the offline map of city 1, if it is detected that the user has navigated to location C through the map application and the location C is not in the POI dataset of the offline map, the vehicle can add the information of location C to the end-side POI dataset. For another example, before obtaining the offline map of city 1, if it is detected that the user has navigated to location C through the map application, the vehicle can add the location C to the end-side POI dataset. After obtaining the offline map of city 1, the vehicle can update (or expand) the POI data of the offline map according to the locations in the end-side POI dataset. For example, if the end-side POI dataset includes location C and the POI dataset of the offline map does not include location C, the information of location C can be added to the POI dataset of the offline map.

[0161] The above example illustrates adding locations from a device-side POI dataset to an offline map's POI dataset. The present invention is not limited to this example. For example, the offline map a vehicle retrieves from a map server includes a general POI dataset. The vehicle can combine the vehicle-side POI dataset and the general POI dataset to form the POI dataset for the offline map.

[0162] S640, when the mobile carrier is in an offline state, obtain a first navigation instruction, where the first navigation instruction includes at least part of the text content corresponding to the first location, or the first navigation instruction includes at least part of the voice information corresponding to the text content.

[0163] Exemplarily, the first navigation instruction is text input by the user in a search box of a map application, and the text input instruction may include at least part of the content of "Tsui Wah Kindergarten" (eg, "Tsui Wah").

[0164] Exemplarily, the first navigation instruction may be a voice navigation instruction issued by a user, and the voice navigation instruction may be “A, dao hang qu cui hua” or “A, show me the path to B”, where the name of the vehicle's voice assistant is A.

[0165] S650: According to the first navigation instruction, control the display device to display a first search result through the offline map, where the first search result includes the first location.

[0166] Optionally, the method 600 also includes: establishing a first matching relationship between at least part of the text content corresponding to the first location, and / or at least part of the voice information corresponding to the text content, and the first location; wherein, according to the first navigation instruction, controlling the display device to display the first search result through the offline map, the first search result includes the first location, including: according to the first navigation instruction and the first matching relationship, controlling the display device to display the first search result through the offline map, the first search result includes the first location and a second location, the second location being associated with the at least part of the content or the at least part of the information; wherein the priority of the first location is higher than the priority of the second location.

[0167] The above process of establishing the first matching relationship can also be understood as a process of training the vehicle-to-vehicle offline POI search module and voice interaction module.

[0168] Optionally, establishing a first matching relationship between at least part of the text content corresponding to the first location and the first location includes: establishing a priority matching relationship between the text content input by the user and the locations in the terminal-side POI dataset.

[0169] The above establishment of a priority matching relationship between the text content input by the user and the locations in the above-mentioned terminal-side POI dataset can also be understood as the matching priority between the text content input by the user and the locations in the above-mentioned terminal-side POI dataset is higher than the matching priority between the text content input by the user and the locations in the above-mentioned general POI dataset.

[0170] When searching for POIs, the matching priority of locations in the device-side POI dataset is higher than that of locations in the general POI dataset, ensuring that locations of interest to the user are found first. The above matching priority of locations in the device-side POI dataset is higher than that of locations in the general POI dataset. This can also be understood as prioritizing the display of search results for locations in the device-side POI dataset in the offline map based on user input.

[0171] For example, as shown in (c) of Figure 3 , location H is in the device-side POI dataset, and locations E, F, and G are in the general POI dataset. The text content corresponding to locations E, F, G, and H all includes Content 1. When the vehicle is offline and detects that the user has entered "Content 1" in the search box, the offline POI search module can prioritize searching the locations in the device-side POI dataset, thereby finding location H associated with "Content 1." It then searches the general POI dataset to find locations E, F, and G associated with "Content 1." In this way, the vehicle can display locations H, E, F, and G in that order in search list 302.

[0172] For example, when a user enters the text "Cuihua" in the search box, the offline POI search module can first search the user-entered text "Cuihua" in the client-side POI dataset to obtain the location "Cuihua Kindergarten". It then searches the general POI dataset to obtain the locations "Cuihua Community", "Cuihua Mountain", and "Cuihua Restaurant". The search results can display "Cuihua Kindergarten", "Cuihua Community", "Cuihua Mountain", and "Cuihua Restaurant" in that order.

[0173] For example, when a user enters the text "B" in the search box, the offline POI search module can first search the device-side POI dataset based on the user-entered text "B" to obtain the location "B school." It then searches the general POI dataset to obtain the locations "B restaurant," "B street," and "bee restaurant." The search results can display "B school," "B restaurant," "B street," and "bee restaurant" in that order.

[0174] Optionally, the method further includes establishing, in the client-side POI dataset, a priority matching relationship between the text content input by the user and locations in the location set A. In this way, the matching priority between the text content input by the user and locations in the location set A can be higher than the matching priority between the text content input by the user and locations in the location set B.

[0175] Optionally, establishing a first matching relationship between at least part of the voice information corresponding to the text content and the first location can be understood as optimizing the device-side ASR module according to the data in the device-side POI dataset.

[0176] For example, as shown in Figure 3(b), when a mobile phone detects that a user has searched for information about location H in a map app, it can send this information to the vehicle associated with the account logged in on the mobile phone. The vehicle can then add this information to the on-device POI dataset and optimize the on-device ASR model based on this information.

[0177] Taking location H as the above-mentioned "Cuihua Kindergarten" as an example, during the model training phase, the vehicle can establish a priority matching relationship between at least part of the voice information "cui hua you er yuan" and the text content "Cuihua Kindergarten" in the end-side ASR model. For example, the end-side ASR model can establish a priority matching relationship between the voice information "cui hua" and the text content "Cuihua" (or, the location "Cuihua Kindergarten"), or, it can establish a priority matching relationship between the voice information "you er yuan" and the text content "kindergarten". At the same time, in the offline POI search module, a priority matching relationship is established between at least part of the content in the text content "Cuihua Kindergarten" and the location "Cuihua Kindergarten". For example, a priority matching relationship is established between the text content "Cuihua" and the location "Cuihua Kindergarten", or, a priority matching relationship is established between the text content "kindergarten" and the location "Cuihua Kindergarten".

[0178] Taking location H as the aforementioned "Jingdong Residential Area" as an example, during the model training phase, the vehicle can establish a priority matching relationship between at least part of the voice information "jing dong xiao qu" and the text content "Jingdong Residential Area" in the end-side ASR model. For example, the end-side ASR model can establish a priority matching relationship between the voice information "jing dong" and the text content "Jingdong", or it can establish a priority matching relationship between the voice information "xiao qu" and the text content "residential area". At the same time, in the offline POI search module, a priority matching relationship is established between at least part of the text content "Jingdong Residential Area" and the location "Jingdong Residential Area". For example, a priority matching relationship is established between the text content "Jingdong" and the location "Jingdong Residential Area", or it can establish a priority matching relationship between the text content "residential area" and the location "Jingdong Residential Area".

[0179] For example, during the model inference phase, when a user issues the voice navigation command "dao hang qu jing dong xiao qu," the trained on-device ASR model already establishes a preferential matching relationship between the voice information "jing dong xiao qu" and the text content "Jingdong Community." Therefore, the trained on-device ASR model can directly convert the voice navigation command into text content: "Navigate to Jingdong Community." The on-device NLU module analyzes the user's intent and slot information to determine that the user's intent is "Navigate to the destination" and the slot information is "Destination = Jingdong Community." The on-device NLU module sends the user's intent and slot information to the navigation application. The offline POI search module first searches the on-device POI dataset to obtain the location "Jingdong Community." It then searches the general POI dataset to obtain locations similar in pronunciation to "Jingdong Community," including "Jingdong Community," "Jingdong Community," and "Jingdong Building." The search results display "Jingdong Community," "Jingdong Community," "Jingdong Community," and "Jingdong Building" in that order.

[0180] Taking the location H as the above-mentioned "B school" as an example, during the model training phase, the vehicle can establish a priority matching relationship between at least part of the information in the voice information "B school" and the text content "B school" in the end-side ASR model. For example, the end-side ASR model can establish a priority matching relationship between the voice information "B" and the text content "B school", or it can establish a priority matching relationship between the voice information "school" and the text content "B school". At the same time, in the offline POI search module, a priority matching relationship is established between at least part of the content in the text content "B school" and the location "B school". For example, a priority matching relationship is established between the text content "B" and the location "B school", or a priority matching relationship is established between the text content "school" and the location "B school".

[0181] For example, during the model inference phase, when a user issues the voice navigation command "show me the path to B school," the trained on-device ASR model already establishes a preferential matching relationship between the voice information "B school" and the text content "B school." Therefore, the trained on-device ASR model can directly convert the voice navigation command into the text content: "show me the path to B school." The on-device NLU module analyzes the user's intent and slot information to determine that the user's intent is "navigate to destination" and the slot information is "destination = B school." The on-device NLU module sends the user's intent and slot information to the navigation application. The offline POI search module first searches the on-device POI dataset to obtain the location "B school." It then searches the general POI dataset to obtain locations similar in pronunciation to "B school," including "bee school," "B restaurant," and "bee restaurant." The search results display "B school," "bee school," "B restaurant," and "bee restaurant" in that order.

[0182] Optionally, the information of the first location includes remark information about the first location, and the method 600 further includes: establishing a second matching relationship between at least part of the content in the remark information, and / or at least part of the information in the voice information corresponding to the remark information, and the first location; when the mobile carrier is in an offline state, obtaining a second navigation instruction, the second navigation instruction including at least part of the content in the remark information, or the second navigation instruction including at least part of the information in the voice information corresponding to the remark information; according to the second navigation instruction and the second matching relationship, controlling the display device to display a second search result through the offline map, the second search result including the first location and the third location; wherein the priority of the first location is higher than the priority of the third location.

[0183] For example, if the user adds the note "Children's School" to a map app and adds the note "Children's School," the name, location, coordinates, category, and notes for "Cuihua Kindergarten" can be added to the on-device POI dataset. The vehicle can then train the on-device ASR model based on the data in this on-device POI dataset.

[0184] Exemplarily, in the model training stage, the vehicle can establish a preferential matching relationship between at least part of the information in the voice message "xiao peng you de xue xiao" and the text content "小朋友的学校" in the on-device ASR model. For example, the on-device ASR model can establish a preferential matching relationship between the voice message "xiao peng you" and the text content "小朋友", or can establish a preferential matching relationship between the voice message "xue xiao" and the text content "学校", or establish a preferential matching relationship between the voice message "xiao peng you de xue xiao" and the text content "小朋友的学校". At the same time, in the offline POI search module, a preferential matching relationship is established between at least part of the content in the text content "小朋友的学校" and the location "翠华幼儿园". For example, a preferential matching relationship is established between the text content "小朋友" and the location "翠华幼儿园", or a preferential matching relationship is established between the text content "学校" and the location "翠华幼儿园", or a preferential matching relationship is established between the text content "小朋友的学校" and the location "翠华幼儿园".

[0185] Exemplarily, as shown in (c) of Figure 4, in the model inference stage, when it is detected that the user issues a voice navigation instruction "dao hang qu xiao peng you de xue xiao", since the preferential matching relationship between the voice message "xiao peng you de xue xiao" and the text content "小朋友的学校" has been established in the above-mentioned trained on-device ASR model, the trained on-device ASR model can directly convert this voice navigation instruction into the text content: Navigate to 小朋友的学校. Through the on-device NLU module, the user's intention and slot information can be analyzed, so that it can be obtained that the user's intention is "Navigate to the destination" and the slot information is "Destination = 小朋友的学校". The on-device NLU module can send the user's intention and slot information to the navigation application. The offline POI search module first searches the on-device POI dataset, so that the corresponding note information for "翠华幼儿园" can be obtained as "小朋友的学校", and then searching the general POI dataset can obtain a location "小朋友之家" that sounds similar to "小朋友的学校". "翠华幼儿园" and "小朋友之家" can be displayed in sequence in the search results.

[0186] For example, during the model training phase, when it is detected that a user has added "B school" to the favorites on the map app and added the note "children's school" to "B school", the name, location, coordinates, category, and note information of "B school" can be added to the end-side POI dataset. The vehicle can train the end-side ASR model based on the data in the end-side POI dataset. For example, the vehicle can establish a priority matching relationship between at least part of the voice information "B school" and the text content "B school" in the end-side ASR model, and establish a priority matching relationship between the voice information "children's school" and the text content "children's school".

[0187] For example, during the model inference phase, when a user issues the voice navigation command "show me the path to children's school," the trained on-device ASR model already establishes a preferential matching relationship between the voice information "children's school" and the text information "children's school." Therefore, the trained on-device ASR model can directly convert the voice navigation command into the text content: "show me the path to children's school." The on-device NLU module analyzes the user's intent and slot information to determine that the user's intent is "navigate to destination" and the slot information is "destination = children's school." The on-device NLU module sends the user's intent and slot information to the navigation application. The offline POI search module first searches the on-device POI dataset to determine that the annotation corresponding to "school B" is "children's school." It then searches the general POI dataset to find "children's home," a place with a similar pronunciation to "children's school." "School B" and "children's home" are displayed in the search results, respectively.

[0188] FIG7 shows a schematic flow chart of an offline navigation method 700 for a mobile carrier provided in an embodiment of the present application. The method 700 can be executed by the mobile carrier 100, or the computing platform 120, or the system consisting of the computing platform 120 and the display device 130, or the SoC in the computing platform 120, or the processor, chip, or circuit in the computing platform 120. The method 700 includes:

[0189] S710: Detecting that a mobile carrier satisfies a preset condition in a first area.

[0190] Exemplarily, the preset condition includes that the residence time of the mobile carrier in the first area is greater than or equal to a preset time period (eg, 48 hours).

[0191] Exemplarily, the preset condition also includes that the vehicle is currently in a state where an account is logged in, and / or that the vehicle is currently in parking gear (P gear).

[0192] S720: When a preset condition is met, prompt the user to download an offline map of the first area.

[0193] For example, the mobile carrier may control the display device to display a prompt message such as "It has been detected that your stay in City A has reached 48 hours. Do you want to download the offline map of City 1?" Alternatively, the mobile carrier may control the voice device to emit a voice message such as "It has been detected that your stay in City A has reached 48 hours. Do you want to download the offline map of City 1?"

[0194] 730. When it is detected that the user determines to download the offline map of the first area, request the offline map of the first area from the cloud server.

[0195] For example, when detecting that the user issues a voice command “download the offline map of city 1”, the mobile carrier may request the offline map of the first area from the cloud server.

[0196] S740: Receive an offline map of the first area sent by a cloud server, where the offline map includes a general POI dataset.

[0197] S750: Obtain information of the first location.

[0198] S760: Add the first location to the device-side POI dataset. The device-side POI dataset and the general POI dataset together constitute the POI dataset of the offline map.

[0199] By adding the first location to the terminal-side POI dataset, the scope of the POI dataset in the offline map can be expanded, which helps to expand the POI search capability of the offline map.

[0200] The above S750 can refer to the description in the above S620 and will not be repeated here.

[0201] There is no specific order between S750-760 and S710-S740 above. For example, after the mobile carrier obtains the offline map of the first area from the cloud server, if the mobile carrier obtains information about the first location and the first location is not included in the general POI dataset contained in the offline map of the first area, the first location can be added to the device-side POI dataset, where the device-side POI dataset and the general POI dataset together constitute the POI dataset of the offline map.

[0202] For another example, S750-760 may also occur before S710. Before the mobile carrier obtains the offline map of the first area from the cloud server, if the mobile carrier obtains the information of the first location, the first location may be added to the end-side POI dataset. After the mobile carrier obtains the offline map of the first area from the cloud server, the locations in the end-side POI dataset and the general POI dataset may be judged. If the first location in the end-side POI dataset is not in the general POI dataset, it may continue to be retained in the end-side POI dataset; if the second location in the end-side POI dataset is already in the general POI dataset, the second location may be removed from the end-side POI dataset.

[0203] S770: Establish a priority matching relationship between at least a portion of the text content corresponding to the first location and the first location.

[0204] S780: Establish a priority matching relationship between at least a portion of the voice information corresponding to the text content and the first location.

[0205] The above process of S770-S780 can refer to the description in the above embodiment and will not be repeated here.

[0206] FIG8 shows a schematic block diagram of an offline navigation device 800 for a mobile carrier according to an embodiment of the present application. As shown in FIG8 , the device 800 includes: an acquisition unit 810 for acquiring an offline map, the offline map including information about a set of locations; the acquisition unit 810 also for acquiring information about a first location; a data processing unit 820 for adding the first location to the set of locations if the first location is not already in the set; the acquisition unit 810 also for acquiring a first navigation instruction when the mobile carrier is offline, the first navigation instruction including at least a portion of text content corresponding to the first location, or the first navigation instruction including at least a portion of voice information corresponding to the text content; and a control unit 830 for controlling a display device to display a first search result including the first location via the offline map based on the first navigation instruction.

[0207] Optionally, the device 800 also includes: a matching relationship establishing unit, used to establish a first matching relationship between the at least part of the content, and / or, the at least part of the information, and the first location; the control unit 830, used to: according to the first navigation instruction and the first matching relationship, control the display device to display the first search result through the offline map, the first search result includes the first location and the second location, wherein the priority of the first location is higher than the priority of the second location.

[0208] Optionally, the matching relationship establishing unit is further used to establish a second matching relationship between at least part of the content in the remark information, and / or at least part of the information in the voice information corresponding to the remark information, and the first location; the acquisition unit 810 is further used to acquire a second navigation instruction when the mobile carrier is in an offline state, the second navigation instruction including at least part of the content in the remark information, or the second navigation instruction including at least part of the information in the voice information corresponding to the remark information; the control unit 830 is further used to control the display device to display a second search result through the offline map according to the second navigation instruction and the second matching relationship, the second search result including the first location and the third location; wherein the priority of the first location is higher than the priority of the third location.

[0209] Optionally, the device 800 further includes a detection unit, the acquisition unit 810, configured to acquire information of the first location when the detection unit detects input by the user searching for the first location through an application.

[0210] Optionally, the acquisition unit 810 is configured to: acquire information of the first location when the detection unit detects input by the user searching for the first location through a map application.

[0211] Optionally, the acquisition unit 810 is configured to: acquire information of the first location when the detection unit detects input by the user navigating to the first location through the map application.

[0212] Optionally, the acquiring unit 810 is configured to receive information about the first location sent by a mobile terminal.

[0213] Optionally, the control unit 830 is further configured to control the prompting device to prompt the user to download the offline map when the mobile carrier's residence time in the first area is greater than or equal to a preset time, where the offline map includes a map of the first area.

[0214] Optionally, the device 800 further includes: a determining unit, configured to determine that the mobile carrier is in a parking state before the control device controls the prompting device to prompt the user to download the offline map.

[0215] For example, the acquisition unit 810 may be the computing platform in FIG1 , or a processing circuit, processor, or controller within the computing platform. For example, if the acquisition unit 810 is the processor 121 within the computing platform, the processor 121 may acquire the offline map information and the first location information. For another example, the acquisition unit 810 may also acquire navigation instructions issued by a user.

[0216] For another example, the data processing unit 820 may be the computing platform in FIG1 or a processing circuit, processor, or controller in the computing platform. For example, if the data processing unit 820 is the processor 122 in the computing platform, the processor 122 may determine the locations in the location set included in the offline map obtained by the processor 121 and the first location. If the first location is not in the location set, the first location may be added to the location set.

[0217] For another example, the matching relationship establishing unit may be the computing platform in FIG1 or a processing circuit, processor, or controller in the computing platform. For example, if the matching relationship establishing unit is processor 123 in the computing platform, processor 123 may establish a priority matching relationship between at least a portion of the text content corresponding to the first location and the first location, and / or establish a priority matching relationship between at least a portion of the voice information corresponding to the text content and the first location.

[0218] For another example, control unit 830 may be the computing platform in FIG1 or a processing circuit, processor, or controller within the computing platform. For example, if control unit 830 is processor 124 within the computing platform, processor 124 may control the display device to display search results including the first location on an offline map based on the navigation instructions acquired by processor 121. Alternatively, processor 124 may control the display device to preferentially display information about the first location on an offline map based on a matching relationship established by processor 123 with the navigation instructions acquired by processor 121.

[0219] The functions implemented by the above-mentioned acquisition unit 810, the functions implemented by the data processing unit 820, the functions implemented by the matching relationship establishment unit and the functions implemented by the control unit 830 can be implemented by different processors, or some functions can be implemented by the same processor, or they can also be implemented by the same processor. The embodiments of the present application do not limit this.

[0220] It should be understood that the division of the various units in the above device is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or they may be physically separated. Furthermore, the units in the device may be implemented in the form of a processor calling software; for example, the device includes a processor connected to a memory storing instructions, and the processor calls the instructions stored in the memory to implement any of the above methods or the functions of the various units in the device, where the processor is, for example, a general-purpose processor such as a CPU or a microprocessor, and the memory is a memory within the device or a memory external to the device. Alternatively, the units in the device may be implemented in the form of hardware circuits, and the functions of some or all of the units may be implemented through the design of the hardware circuits. The hardware circuits may be understood as one or more processors. For example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units may be implemented through the design of the logical relationships between the components within the circuits. In another implementation, the hardware circuit may be implemented using a PLD, such as an FPGA, which may include a large number of logic gate circuits, and the connections between the logic gate circuits may be configured using a configuration file to implement the functions of some or all of the above units. All units of the above apparatus may be implemented entirely in the form of software called by a processor, or entirely in the form of hardware circuits, or partially in the form of software called by a processor and the rest in the form of hardware circuits.

[0221] In an embodiment of the present application, a processor is a circuit with the ability to process signals. In one implementation, the processor may be a circuit with the ability to read and execute instructions, such as a CPU, a microprocessor, a GPU, or a DSP. In another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit may be fixed or reconfigurable, such as a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the configuration of the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, DPU, etc.

[0222] It can be seen that each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0223] In addition, the various units in the above apparatus may be fully or partially integrated together, or may be implemented independently. In one implementation, these units are integrated together and implemented in the form of a system-on-chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the various units of the apparatus. The at least one processor may be of different types, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0224] An embodiment of the present application also provides a device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the device executes the method or steps performed by the above embodiment.

[0225] Optionally, if the device is located in a mobile carrier, the processing unit may be the processor 121 - 12n shown in FIG. 1 .

[0226] An embodiment of the present application further provides a control system, which may include a computing platform and a display device, and the computing platform may include the above-mentioned control device 800.

[0227] The embodiment of the present application further provides a mobile carrier, which may include the above-mentioned control device 800 or control system.

[0228] Optionally, the mobile carrier may be a vehicle.

[0229] An embodiment of the present application further provides a computer program product, which includes: computer program code, which enables the computer to execute the method in the above embodiment when the computer program code is run on a computer.

[0230] An embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code is run on a computer, the computer executes the method in the above embodiment.

[0231] An embodiment of the present application further provides a chip, which includes a circuit, and the circuit is used to execute the method in the above embodiment.

[0232] During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor or by instructions in the form of software. The method disclosed in conjunction with the embodiments of the present application can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.

[0233] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0234] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0235] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0236] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0237] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0238] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0239] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0240] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0241] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be covered and fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. An offline navigation method for a mobile carrier, characterized in that: include: Obtaining an offline map, wherein the offline map includes information of a location set; Acquire information of a first location, where the first location is a location that the user is interested in; When the first location is not in the location set, adding the first location to the location set; When the mobile carrier is in an offline state, obtaining a first navigation instruction, wherein the first navigation instruction includes at least part of the text content corresponding to the first location, or the first navigation instruction includes at least part of the voice information corresponding to the text content; According to the first navigation instruction, the display device is controlled to display a first search result through the offline map, where the first search result includes the first location.

2. The method according to claim 1, characterized in that The method further comprises: Establishing a first matching relationship between at least part of the text content, and / or at least part of the voice information corresponding to the text content, and the first location; The controlling the display device to display the first search result through the offline map according to the first navigation instruction includes: According to the first navigation instruction and the first matching relationship, controlling a display device to display the first search result through the offline map, where the first search result includes the first location and the second location; The priority of the first location is higher than the priority of the second location.

3. The method according to claim 2, characterized in that The first navigation instruction includes the at least part of the information, and the controlling the display device to display the first search result through the offline map according to the first navigation instruction and the first matching relationship includes: According to the first navigation instruction and the first matching relationship, identifying at least part of the information as first text content, where the first text content includes at least part of the text content corresponding to the first location; The display device is controlled to display the first text content through the text input box of the offline map, and the display device is controlled to display the first search result through the offline map.

4. The method according to any one of claims 1 to 3, characterized in that The information of the first location includes remark information of the first location, and the method further includes: Establishing a second matching relationship between at least part of the content in the remark information, and / or at least part of the information in the voice information corresponding to the remark information, and the first location; When the mobile carrier is in an offline state, obtaining a second navigation instruction, where the second navigation instruction includes at least part of the content in the remark information, or the second navigation instruction includes at least part of the information in the voice information corresponding to the remark information; According to the second voice navigation instruction and the second matching relationship, controlling the display device to display a second search result through the offline map, where the second search result includes the first location and a third location; The priority of the first location is higher than the priority of the third location.

5. The method according to any one of claims 1 to 4, characterized in that The obtaining of the information of the first location includes: When detecting a user input for searching the first place through an application, information of the first place is acquired.

6. The method according to claim 5, characterized in that When it is detected that a user searches for a first place through an application, obtaining information of the first place includes: When detecting a user input for searching for the first location through a map application, obtaining information of the first location.

7. The method according to claim 6, characterized in that The acquiring information of the first location when detecting an input of a user searching for the first location through a map application includes: When an input of a user navigating to the first location through the map application is detected, information of the first location is acquired.

8. The method according to any one of claims 1 to 4, characterized in that The obtaining of the information of the first location includes: Receive the information of the first location sent by the mobile terminal.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: When the residence time of the mobile carrier in the first area is greater than or equal to a preset time, the control prompting device prompts the user to download the offline map, where the offline map includes a map of the first area.

10. The method according to claim 9, characterized in that Before the control prompting device prompts the user to download the offline map, the method further includes: It is determined that the mobile carrier is in a parking state.

11. An offline navigation device for a mobile carrier, characterized in that: include: An acquisition unit, configured to acquire an offline map, wherein the offline map includes information of a location set; The acquisition unit is further used to acquire information of a first location, where the first location is a location that the user is interested in; a data processing unit, configured to add the first location to the location set when the first location is not in the location set; The acquisition unit is further configured to acquire, when the mobile carrier is in an offline state, a first navigation instruction, wherein the first navigation instruction includes at least part of the text content corresponding to the first location, or the first navigation instruction includes at least part of the voice information corresponding to the text content; A control unit is used to control a display device to display a first search result through the offline map according to the first navigation instruction, wherein the first search result includes the first location.

12. The device according to claim 11, characterized in that The device also includes: a matching relationship establishing unit, configured to establish a first matching relationship between at least part of the text content corresponding to the first location, and / or at least part of the voice information corresponding to the text content, and the first location; a control unit, configured to control a display device to display the first search result through the offline map according to the first navigation instruction and the first matching relationship, wherein the first search result includes the first location and the second location; The priority of the first location is higher than the priority of the second location.

13. The device according to claim 12, characterized in that The first navigation instruction includes at least part of the information, and the apparatus further includes: a speech recognition unit, configured to recognize, according to the first navigation instruction and the first matching relationship, the at least part of the information as first text content, wherein the first text content includes at least part of the text content corresponding to the first location; The control unit is used to control the display device to display the first text content through the text input box of the offline map, and control the display device to display the first search result through the offline map.

14. The device according to any one of claims 11 to 13, characterized in that The information of the first location includes remarks information of the first location, characterized in that: The matching relationship establishing unit is further used to establish a second matching relationship between at least part of the content in the remark information and / or at least part of the voice information corresponding to the remark information and the first location; The acquisition unit is further configured to acquire, when the mobile carrier is in an offline state, a second navigation instruction, wherein the second navigation instruction includes at least part of the content in the remark information, or the second navigation instruction includes at least part of the information in the voice information corresponding to the remark information; The control unit is further configured to control the display device to display a second search result through the offline map according to the second voice navigation instruction and the second matching relationship, wherein the second search result includes the first location and the third location; The priority of the first location is higher than the priority of the third location.

15. The device according to any one of claims 11 to 14, characterized in that The device further includes a detection unit, and the acquisition unit is configured to: When the detection unit detects an input of a user searching for the first place through an application, information of the first place is acquired.

16. The device according to claim 15, characterized in that The acquisition unit is used to: When the detection unit detects an input by a user searching for the first place through a map application, information of the first place is acquired.

17. The device according to claim 16, characterized in that The acquisition unit is used to: When the detection unit detects an input of a user navigating to the first location through the map application, information of the first location is acquired.

18. The device according to any one of claims 11 to 14, characterized in that The acquisition unit is used to: Receive the information of the first location sent by the mobile terminal.

19. The device according to any one of claims 11 to 18, characterized in that The control unit is further configured to control the prompting device to prompt the user to download the offline map when the residence time of the mobile carrier in the first area is greater than or equal to a preset time, and the offline map includes a map of the first area.

20. The device according to claim 19, characterized in that The device also includes: A determination unit is used to determine the mobile map before the control unit controls the prompt device to prompt the user to download the offline map. The vehicle is in park.

21. An offline navigation device for a mobile carrier, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 10.

22. A control system, characterized in that: It comprises a display device and a computing platform, wherein the computing platform comprises the device as claimed in any one of claims 11 to 21.

23. A mobile carrier, characterized in that: Comprising an apparatus as claimed in any one of claims 11 to 21, or comprising a control system as claimed in claim 22.

24. The mobile carrier according to claim 23, characterized in that: The mobile carrier is a vehicle.

25. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a computer, the method according to any one of claims 1 to 10 is implemented.

26. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method according to any one of claims 1 to 10.

Images