Navigation interaction method, device, automobile and storage medium

By identifying the facial feature information of the current driver and passengers and matching historical travel information, and automatically determining the navigation route, the problem of low efficiency of existing navigation interaction methods is solved, intelligent navigation without manual input or voice control is realized, and the efficiency and accuracy of navigation interaction is improved.

CN115388908BActive Publication Date: 2025-04-04SAIC GM WULING AUTOMOBILE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211050563.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-30
Publication Date
2025-04-04
Estimated Expiration
2042-08-30

AI Technical Summary

Technical Problem

The existing vehicle navigation system has low navigation interaction methods, and manual operation or voice control can easily lead to recognition errors and interaction failures in noisy environments or inappropriate pronunciation.

Method used

By obtaining the image information of the current driver and passenger, identifying their facial feature information, matching historical travel information, and automatically determining the current navigation route, realizing intelligent navigation without manual input or voice control.

Benefits of technology

It improves the efficiency of navigation interaction, avoids navigation failures caused by noisy environment or unstandard pronunciation, and provides convenient and accurate navigation services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115388908B_ABST
    Figure CN115388908B_ABST
Patent Text Reader

Abstract

The present application discloses a navigation interaction method, device, automobile and storage medium, belonging to the field of intelligent navigation interaction technology. The method comprises the following steps: obtaining image information of the current driver and passenger, wherein the current driver and passenger include at least one, and the image information includes facial feature information of the current driver and passenger; identifying the identity information of each of the current driver and passenger according to the image information; and determining the current navigation route corresponding to the current driver and passenger according to the historical travel information corresponding to all the identity information. The present application solves the problem of low efficiency in the existing navigation interaction method.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent navigation interaction technology, and in particular to a navigation interaction method, device, automobile and storage medium. Background Art

[0002] In the existing in-vehicle navigation system, two navigation interaction methods are mainly used: one is that the driver manually operates the navigation interface to select the navigation address and start the vehicle's navigation system to work. This method is a traditional navigation method and does not achieve the purpose of convenient navigation, that is, the navigation interaction efficiency is low; the second is that the driver interacts with the navigation system through voice, but this method is not suitable for noisy environments or driver pronunciation is not standard. It is easy to cause interaction failures caused by recognition errors, which in turn leads to low navigation interaction efficiency.

[0003] Therefore, the existing navigation interaction method has the problem of low efficiency.

[0004] Application Contents

[0005] The main purpose of the present application is to provide a navigation interaction method, device, automobile and storage medium, aiming to solve the problem of low efficiency of existing navigation interaction methods.

[0006] To achieve the above objectives, the present application provides a navigation interaction method for use in a vehicle host device, the method comprising:

[0007] Acquiring image information of a current driver and passenger, wherein the current driver and passenger includes at least one, and the image information includes facial feature information of the current driver and passenger;

[0008] According to the image information, identifying the identity information of each of the current drivers and passengers;

[0009] Based on the historical travel information corresponding to all the identity information, a current navigation route corresponding to the current driver and passenger is determined.

[0010] Optionally, the vehicle host device is connected to an external camera of the vehicle, and the obtaining of image information of the current driver and passenger includes:

[0011] When it is detected that the distance between the current driver and the vehicle is less than a first preset distance, the external camera is controlled to obtain the image information of the current driver and the image information is sent to the vehicle host device so that the vehicle host device obtains the image information of the current driver.

[0012] Optionally, before the method of controlling the external camera to acquire the image information of the current driver and occupant when it is detected that the distance between the current driver and occupant and the vehicle is less than a first preset distance and sending the image information to the vehicle host device so that the vehicle host device acquires the image information of the current driver and occupant, the method further includes:

[0013] Controlling the external camera to measure the real-time distance between the approaching person and the vehicle;

[0014] If the real-time distance between the approaching person and the vehicle is less than a second preset distance, determining whether the approaching person is a preset driver or passenger, wherein the second preset distance is greater than the first preset distance;

[0015] If the approaching person is the preset driver and passenger, the approaching person is taken as the current driver and passenger, and when it is detected that the distance between the current driver and passenger and the vehicle is less than a first preset distance, the external camera is controlled to obtain the image information of the current driver and passenger, and the image information is sent to the vehicle host device, so that the vehicle host device obtains the image information of the current driver and passenger.

[0016] Optionally, identifying the identity information of each of the current drivers and passengers according to the image information includes:

[0017] Extracting facial feature information of the current driver or passenger in the image information;

[0018] Filtering target facial feature information that matches the facial feature information from existing facial feature information in a face information database;

[0019] The identity information corresponding to the target facial feature information is used as the identity information of the current driver or passenger.

[0020] Optionally, before acquiring the image information of the current driver and passenger, wherein the current driver and passenger includes at least one, the method further includes:

[0021] Obtain facial feature information of all drivers and passengers;

[0022] The travel information of all the drivers and passengers is recorded to obtain the historical travel information, wherein the historical travel information includes: a destination and a travel route to the destination.

[0023] Optionally, determining the current navigation route corresponding to the current driver and passenger according to the historical travel information corresponding to all the identity information includes:

[0024] The destination that appears most frequently in the historical travel information corresponding to all the identity information and the driving route corresponding to the destination are used as the current navigation route corresponding to the current driver and passenger.

[0025] Optionally, after determining the current navigation route corresponding to the current driver and passenger according to the historical travel information corresponding to all the identity information, the method further includes:

[0026] Outputting the current navigation route;

[0027] If a confirmation operation of the current driver and passenger on the current navigation route is detected, navigation is performed according to the current navigation.

[0028] In addition, to achieve the above-mentioned purpose, the present application also provides a navigation interaction device, the device comprising:

[0029] An image acquisition module, used to acquire image information of a current driver and passenger, wherein the current driver and passenger includes at least one, and the image information includes facial feature information of the current driver and passenger;

[0030] An information recognition module, used to recognize the identity information of each of the current drivers and passengers based on the image information;

[0031] The route generation module is used to determine the current navigation route corresponding to the current driver and passenger based on the historical travel information corresponding to all the identity information.

[0032] The present application also provides a car, the car includes a vehicle host device, the vehicle host device includes: a processor, a memory and a navigation interaction program stored in the memory, the navigation interaction program implements the steps of the above-mentioned navigation interaction method when executed by the processor.

[0033] The present application also provides a computer-readable storage medium having a navigation interaction program stored thereon, wherein the navigation interaction program, when executed by a processor, implements the various steps described in any possible implementation manner of the implementation manner of the first aspect.

[0034] A navigation interaction method proposed in an embodiment of the present application includes: obtaining image information of current drivers and passengers, wherein the current drivers and passengers include at least one; identifying identity information of each of the current drivers and passengers based on the image information; and determining a current navigation route corresponding to the current drivers and passengers based on historical travel information corresponding to all the identity information.

[0035] This application uses facial feature information in image information to identify the identity information of the current driver and passenger, obtains historical travel information matching the current driver and passenger based on the identity information of the current driver and passenger, and then obtains the current navigation route corresponding to the current driver and passenger based on the analysis of the historical travel information. Therefore, this application automatically recommends corresponding navigation routes for different current driver and passenger through differentiated identification of the current driver and passenger, without the need for manual input or voice control by the driver for navigation, thus solving the problem of low efficiency in existing navigation interaction methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic diagram of the structure of a navigation interaction device in the hardware operating environment involved in this application;

[0037] Figure 2 This is a flowchart of the first embodiment of the navigation interaction method of the present application;

[0038] Figure 3 This is a flowchart of the second embodiment of the navigation interaction method of the present application;

[0039] Figure 4 This is a flowchart of the third embodiment of the navigation interaction method of the present application;

[0040] Figure 5 This is a flowchart of a fourth embodiment of the navigation interaction method of the present application;

[0041] Figure 6 This is a schematic diagram of the functional modules of the navigation interaction device involved in this application.

[0042] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0043] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0044] In the existing navigation system, navigation is mainly performed by manual operation or voice control by the driver, which fails to achieve the purpose of convenient navigation and the efficiency of navigation interaction is low.

[0045] To this end, the present application proposes a navigation interaction method, which obtains the identity information of the current driver and passenger and the historical travel information corresponding to the identity information by identifying the image information of the current driver and passenger, and obtains the current navigation route corresponding to the driver and passenger based on the historical travel information analysis, thereby solving the problem of low efficiency of existing navigation interaction methods.

[0046] Reference Figure 1 , Figure 1A schematic diagram of the structure of a car in the hardware operating environment involved in the embodiment of the present application.

[0047] like Figure 1 As shown, the car may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0048] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the vehicle, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0049] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module, and a navigation interaction program.

[0050] like Figure 1 As shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the server of the present invention can be set in the server, and the server calls the navigation interaction program stored in the memory 1005 through the processor 1001, and executes the navigation interaction method provided by the embodiment of the present invention.

[0051] As an embodiment, the car further includes an external camera 1005 and a built-in camera 1006. The external camera 1005 may be a front-view main camera, a front-view narrow-angle camera, a front-view wide-angle camera, or a front-view camera, a surround-view camera, or a rear-view camera on the car. The external camera 1005 may send the image of the vehicle's surroundings captured to a processor or a memory for recognition processing. Similarly, the built-in camera 1006 may send the image of the vehicle's interior captured to a processor or a memory for recognition processing.

[0052] Based on the above hardware structure but not limited to the above hardware structure, the present invention provides a first embodiment of a navigation interaction method. Figure 2 , Figure 2 FIG. 4 is a flow chart of a first embodiment of a navigation interaction method according to the present invention.

[0053] Reference Figure 2 The first embodiment of the present application provides a navigation interaction method, the method comprising:

[0054] S100: Acquire image information of the current driver and passenger, wherein the current driver and passenger includes at least one, and the image information includes facial feature information of the current driver and passenger;

[0055] It should be noted that the method execution subject of this embodiment is a vehicle host device, which is arranged in the car to realize interaction with the driver and passengers.

[0056] Among them, the current driving and passengers are the driver and the passengers riding in the current vehicle. It can be understood that the number of passengers can be 0, that is, the current driving and passengers include at least one, that is, only the driver.

[0057] The image information is the image information of the current driver and passenger, and the image information at least includes the facial feature information of the current driver and passenger, wherein the facial feature information may include information such as eyes, lips, eyebrows, and nose, so as to facilitate face recognition of the image information. It is worth mentioning that the image information can be obtained by taking pictures with a vehicle-mounted camera, which can be a vehicle-mounted external camera, or a vehicle-mounted built-in camera, or can be image information sent in advance by the driver and passenger to the vehicle host device through a mobile terminal.

[0058] S200: Identifying identity information of each current driver and passenger according to the image information;

[0059] The vehicle host device performs face recognition on the acquired image information to identify the name, gender and other identity information of each current driver and passenger. The identity information can be input into the vehicle host device manually or through a mobile terminal such as a mobile phone in advance.

[0060] S300: Determine a current navigation route corresponding to the current driver and passenger based on historical travel information corresponding to all identity information;

[0061] The historical travel information is the travel information of all current drivers and passengers recorded by the vehicle host device before starting the current driving.

[0062] It is worth mentioning that in this embodiment, the historical travel information corresponding to all identity information is the travel information corresponding to the combination of the driver and the passenger in the current driving and passenger stored locally or in the server of the vehicle host device. If the current driving and passenger only includes driver A, the destination that driver A drove to the vehicle before and the navigation route to the destination are obtained, and the destination and the navigation route to the destination are used as the historical travel information of driver A; if the current driving and passenger include driver A and passenger B, the destination that the combination of driver A and passenger B drove or took the vehicle to and the navigation route to the destination are obtained, and the historical travel information of the combination of driver A and passenger B is obtained. Based on the acquired identity information, the vehicle host device queries and counts the historical travel information of the current driving and passenger in the past driving or riding the vehicle, and analyzes the historical travel information by the current driving date, time period or the frequency of occurrence in the historical travel information, and determines the current navigation route matching the driving and passenger.

[0063] This embodiment obtains image information of the current driver and passenger, and identifies the identity information of each driver and passenger based on the image information, matches the historical travel information of the current driver and passenger driving the vehicle based on the identity information of all drivers and passengers, and obtains the current navigation route that matches the current driver and passenger by analyzing the historical travel information. This embodiment realizes intelligent and convenient navigation interaction through differentiated personnel identification, and does not require manual operation of the navigation system for navigation. There is no need for navigation through voice control, which avoids navigation failure caused by noisy environment or non-standard driver pronunciation, and solves the problem of low efficiency of existing navigation interaction methods.

[0064] Reference Figure 3 , Figure 3 This is a flowchart of the second embodiment of the navigation interaction method of the present application, based on the above Figure 2 The illustrated embodiment provides a second embodiment of the navigation interaction method of the present invention.

[0065] In this embodiment, the method includes the following steps:

[0066] In this embodiment, step S100 includes:

[0067] S101: Controlling an external camera to measure the real-time distance between an approaching person and a vehicle;

[0068] It should be noted that the method of acquiring image information in this embodiment is to shoot through an external camera, which is only limited to this embodiment and is not limited in this application.

[0069] The peripheral camera may be a camera installed outside the vehicle, and used to obtain image information of people approaching the vehicle. For example, the peripheral camera may be a front-view main camera, a front-view narrow-angle camera, a front-view wide-angle camera, or a front-view camera, a surround-view camera, or a rear-view camera on the vehicle.

[0070] The real-time distance can be the distance between the person approaching the vehicle and the vehicle in the image information obtained by the external camera. For example, the vehicle host device controls the external camera to obtain image information of the person approaching the vehicle every millisecond, that is, returns an image of the person approaching the vehicle every millisecond, and measures the distance between the person approaching the vehicle and the vehicle in the returned image to obtain the real-time distance between the person approaching the vehicle and the vehicle. The vehicle host device can control the external camera to take an image of the person approaching the vehicle once every millisecond, and return the image information to the vehicle host device for analysis. The vehicle host device measures the distance between the person and the vehicle. This process is performed once every millisecond to obtain the real-time distance between the person approaching the vehicle and the vehicle.

[0071] S102: If the real-time distance between the approaching person and the vehicle is less than a second preset distance, determining whether the approaching person is a preset driver or passenger, wherein the second preset distance is greater than the first preset distance;

[0072] The first preset distance and the second preset distance are data pre-set in the vehicle host device, which are used to provide a conditional basis for executing the next operation in the vehicle host device. The driver and passenger can manually input the preset distance on the display screen of the vehicle host device for storage, or transmit the preset distance to the vehicle host device through a mobile terminal for storage, and the second preset distance is greater than the first preset distance. For example, the driver and passenger input the first preset distance as 2 meters and the second preset distance as 4 meters on the display screen of the vehicle host device in advance. When the vehicle host device detects that the distance between the person approaching the vehicle and the vehicle is less than 4 meters, one operation is performed, and when the distance is detected to be less than two meters, another operation is performed.

[0073] The preset drivers and passengers are drivers or passengers who have stored their facial feature information in the vehicle host. The drivers and passengers can directly obtain the image information of the current drivers and passengers through the camera of the vehicle host device to store the facial feature information, or they can also transmit the facial feature information to the vehicle host device through a mobile terminal for storage. When the vehicle host device measures that the distance between the current approaching person and the vehicle is less than the second preset distance, the facial feature information of the approaching person is identified to determine whether it is consistent with the preset driver and passenger information stored in the vehicle host. For example, the second preset distance set by the driver and passenger in advance on the vehicle host device is 4 meters. When the vehicle host device detects that a person is approaching the vehicle, it controls the external camera to obtain image information of the current driver and passenger every millisecond, and the external camera transmits back an image of the current driver and passenger every millisecond. After receiving the image, the vehicle host device measures the distance between the current driver and passenger and the vehicle. If it is detected that the distance between the current driver and passenger and the vehicle is less than 4 meters, the vehicle host device again controls the external camera to obtain image information of the current driver and passenger, where the image information is facial feature information. The vehicle host device will obtain the facial feature information of the approaching person and match it with the facial feature information in the face information library stored in the vehicle host device. If the match is successful, the approaching person is determined to be the preset driver and passenger.

[0074] S103: If the approaching person is a preset driver or passenger, the approaching person is regarded as the current driver or passenger;

[0075] S104: when it is detected that the distance between the current driver and the vehicle is less than a first preset distance, controlling the peripheral camera to obtain image information of the current driver and the vehicle host device, and sending the image information to the vehicle host device, so that the vehicle host device obtains the image information of the current driver;

[0076] S200: Identify personal information of each current driver and passenger based on the image information;

[0077] It should be noted that a mapping relationship table between identity information and facial feature information is set in the vehicle host device, and each piece of identity information corresponds to each piece of facial feature information one by one and they are related to each other.

[0078] When the vehicle host device measures that the distance between the current driver and the vehicle is less than a first preset distance, that is, the current driver is approaching continuously, the external camera is controlled to capture image information of the current driver, so that the external camera sends the image information to the vehicle host device, and the vehicle host device obtains the identity information corresponding to the facial feature information based on the facial feature information in the image information. For example, when the vehicle host device measures that the distance between the current driver and the vehicle is less than 2 meters, the external camera is controlled to capture the image of the current driver, and the image information is returned to the vehicle host device. The vehicle host device queries the database for the identity information such as name, gender and age that the driver has manually entered in advance through the display screen of the vehicle host device based on the acquired facial feature image, and finds the identity information that matches the facial feature information as the identity information of the current driver.

[0079] In this embodiment, step S300 includes:

[0080] S301: taking the destination that appears most frequently in the historical travel information corresponding to all identity information and the driving route corresponding to the destination as the current navigation route corresponding to the current driver and passenger;

[0081] It should be noted that a mapping relationship table between identity information and historical travel information is set in the vehicle host device, so that the vehicle host device can query the corresponding historical travel information according to the identity information of the current driver and passenger.

[0082] It can be understood that by analyzing the historical travel information corresponding to all current drivers and passengers, the destinations in all historical travel information and the navigation routes of the destinations are obtained, and the destination that appears most frequently is used as the destination that the current driver and passenger is most likely to go to, and the navigation route that the current driver and passenger selects most frequently to reach the destination is used as the navigation route that the current driver and passenger is most likely to select to reach the destination. The most likely destination and the most likely navigation route to reach the destination are combined to obtain the current navigation route. For example, driver A and passenger B are the current drivers and passengers, and the vehicle host device obtains the historical travel information of the combination of driver A and passenger B, wherein the number of times they arrived at location C is 4, the number of times they arrived at location D is 6, the number of times the navigation route to location C is route E is 4, the number of times the navigation route to location D is route F is 4, and the number of times the navigation route to location D is route G is 2. It is found that the combination of driver A and passenger B arrives at destination D the most times, and the navigation route selected to reach location D is route F the most times, so the destination is location D and the navigation route is route F as the current navigation route.

[0083] This embodiment measures the distance between a person approaching a vehicle and the vehicle, and when it is detected that the distance is less than a second preset distance, it identifies whether the current person is a preset driver or passenger; when it is detected that the distance is less than the first preset distance, the image information acquired by the camera is returned to the vehicle host device, and the vehicle host device matches the facial feature information in the image information with the facial feature information in the face information database to obtain the target facial feature information, and obtains the identity information and historical travel information corresponding to the current driver or passenger based on the target facial feature information, and obtains the current navigation route matching the current driver or passenger based on the analysis of the historical travel information, and obtains the identity information and historical travel information of the approaching person through the recognition of two levels of preset distances, and can determine the current navigation route provided to the driver based on the acquired image information during the process of the driver approaching the vehicle, thereby further improving the probability of identifying the driver's driving intention, saving the driver's time in starting navigation, and achieving more convenient navigation interaction.

[0084] Reference Figure 4 , Figure 4 This is a flowchart of the third embodiment of the navigation interaction method of the present application, based on the above Figure 2 The illustrated embodiment provides a third embodiment of the navigation interaction method of the present invention.

[0085] In this embodiment, before step S100, the following steps are included:

[0086] S000: Obtaining facial feature information of the driver and passengers;

[0087] S001: Recording the travel information of the driver and passengers to obtain historical travel information, wherein the historical travel information includes the destination and the travel route to the destination;

[0088] It can be understood that the vehicle host device can control the camera to shoot the driver and attendants in the vehicle, obtain the facial information features of all drivers and passengers for storage, and record the destination reached by the driver and passengers while driving or riding the vehicle and the navigation route selected to reach the destination, so as to obtain the historical travel information of the driver and passenger combination. For example, when the vehicle host device detects that driver A and passenger B are driving or riding the vehicle, the camera is controlled to obtain image information of driver A and passenger B, and record that driver A and passenger B have arrived at location D according to navigation route C. Based on the facial feature information in the image information, the identity information of the current driver and passenger is determined, and the above-mentioned destination D and navigation route C are stored in the historical travel information of the driver A and passenger B according to the identity information.

[0089] This embodiment obtains the facial feature information of all drivers before the current time, records the travel information of all drivers and passengers, obtains the historical travel information of each driver and passenger combination, and provides a basis for the subsequent acquisition of the historical travel information of the current driver and passenger. The historical travel information is obtained by statistically analyzing the travel information of different driver and passenger combinations for multiple times, and the current navigation route obtained by analyzing the historical travel information of different driver and passenger combinations will be more differentiated, further improving the probability of identifying the driver's driving intention and improving the user experience.

[0090] Reference Figure 5 , Figure 5 This is a flowchart of the fourth embodiment of the navigation interaction method of the present application, based on the above Figure 2 The illustrated embodiment provides a fourth embodiment of the navigation interaction method of the present invention.

[0091] In this embodiment, after step S300, the method further includes:

[0092] S400: outputting the current navigation route;

[0093] S401: If a confirmation operation of the current driver and passenger on the current navigation route is detected, navigation is performed according to the current navigation route;

[0094] The current navigation route may be output as a voice prompt or by a pop-up window prompt on the vehicle's display panel.

[0095] It is understandable that after receiving the output of the current navigation route, the driver and passengers can confirm whether the current navigation route meets their current needs according to their current needs. When it meets the requirements, the confirmation operation is performed. The current confirmation operation of the driver and passengers for the current navigation route can be performed by voice confirmation or manual confirmation. For example, the destination C and the navigation route D are output through the voice system of the vehicle host device, and the voice output can be "whether to choose to reach the destination C via the navigation route D". When the voice recognition system detects that any of the driver and passengers replies with an affirmative response such as "yes" or "right", navigation is performed according to the current navigation route.

[0096] After the vehicle host device determines the current navigation route, this embodiment outputs the current navigation route through voice output or other output methods, and identifies the confirmation operation of the current driver and passenger for the current navigation route, and navigates according to the current navigation route based on the confirmation operation. Confirming whether the driver and passenger intend to navigate according to the current navigation route enhances the performance of interaction and improves the user experience.

[0097] Based on the same inventive concept, refer to Figure 6 , Figure 6This is a schematic diagram of the structure of a navigation interaction device provided by the present application, the device specifically includes:

[0098] An image acquisition module, used to acquire image information of the current driver and passenger, wherein the current driver and passenger includes at least one, and the image information includes facial feature information of the current driver and passenger;

[0099] The information recognition module is used to identify the identity information of each current driver and passenger based on the image information;

[0100] The route generation module determines the current navigation route corresponding to the current driver and passenger based on the historical travel information corresponding to all identity information.

[0101] The technical solution of this embodiment, through the mutual cooperation between various functional modules, realizes the identification of the current driver and passenger by acquiring the image information of the current driver and passenger, and deriving the historical travel information of the current driver and passenger combination based on the identity information, and deriving the current navigation route matching the current driver by analyzing the historical travel information, thereby solving the problem of low efficiency of existing navigation interaction methods.

[0102] In addition, the embodiment of the present application also proposes a computer storage medium, on which a navigation interaction program is stored, and when the navigation interaction program is executed by the processor, the steps of the navigation interaction method as described above are implemented. Therefore, it will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the program instructions can be deployed to be executed on one computing device, or on multiple computing devices located at one location, or on multiple computing devices distributed at multiple locations and interconnected by a communication network.

[0103] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be realized by instructing the relevant hardware through a navigation interaction program, and the above-mentioned program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The above-mentioned storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0104] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the accompanying drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines. A person of ordinary skill in the art may understand and implement it without paying any creative effort.

[0105] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method of each embodiment of the present application.

[0106] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A navigation interaction method, characterized in that: Used in a vehicle host device, the method includes: Acquire image information of current drivers and passengers, wherein the current drivers and passengers include the driver and passengers riding in the current vehicle, and the image information includes facial feature information of the current drivers and passengers; According to the image information, identifying the identity information of each of the current drivers and passengers; Determine the current navigation route corresponding to the current driver and passenger based on the historical travel information corresponding to all the identity information; wherein the historical travel information includes the destinations reached by the driver and the passengers in the current vehicle driving or riding in the vehicle and the driving routes corresponding to reaching the destinations; The determining, based on the historical travel information corresponding to all the identity information, the current navigation route corresponding to the current driver and passenger includes: The destination that appears most frequently in the historical travel information corresponding to all the identity information and the driving route corresponding to the destination are used as the current navigation route corresponding to the current driver and passenger.

2. The navigation interaction method according to claim 1, characterized in that: The vehicle host device is connected to an external camera of the vehicle, and the image information of the current driver and passenger is obtained, including: When it is detected that the distance between the current driver and the vehicle is less than a first preset distance, the external camera is controlled to obtain the image information of the current driver and the image information is sent to the vehicle host device so that the vehicle host device obtains the image information of the current driver.

3. The navigation interaction method according to claim 2, characterized in that: Before the method of controlling the external camera to obtain the image information of the current driver and occupant when it is detected that the distance between the current driver and occupant and the vehicle is less than the first preset distance and sending the image information to the vehicle host device so that the vehicle host device obtains the image information of the current driver and occupant, the method further includes: Controlling the external camera to measure the real-time distance between the approaching person and the vehicle; If the real-time distance between the approaching person and the vehicle is less than a second preset distance, determining whether the approaching person is a preset driver or passenger, wherein the second preset distance is greater than the first preset distance; If the approaching person is the preset driver and passenger, the approaching person is taken as the current driver and passenger, and when it is detected that the distance between the current driver and passenger and the vehicle is less than a first preset distance, the external camera is controlled to obtain the image information of the current driver and passenger, and the image information is sent to the vehicle host device, so that the vehicle host device obtains the image information of the current driver and passenger.

4. The navigation interaction method according to claim 1, characterized in that: The identifying of the identity information of each current driver and passenger according to the image information includes: Extracting facial feature information of the current driver or passenger in the image information; Filtering target facial feature information that matches the facial feature information from existing facial feature information in a face information database; The identity information corresponding to the target facial feature information is used as the identity information of the current driver or passenger.

5. The navigation interaction method according to claim 1, characterized in that: Before acquiring the image information of the current driver and passenger, wherein the current driver and passenger includes at least one, the method further includes: Obtaining facial feature information of drivers and passengers; The travel information of the driver and passenger is recorded to obtain the historical travel information, wherein the historical travel information includes the destination and the travel route to the destination.

6. The navigation interaction method according to claim 1, characterized in that: After determining the current navigation route corresponding to the current driver and passenger based on the historical travel information corresponding to all the identity information, the method further includes: Outputting the current navigation route; If a confirmation operation of the current driver and passenger on the current navigation route is detected, navigation is performed according to the current navigation route.

7. A navigation interaction device, characterized in that: Configured in a vehicle host device, the device comprises: An image acquisition module, used to acquire image information of current drivers and passengers, wherein the current drivers and passengers include the driver and passengers riding in the current vehicle, and the image information includes facial feature information of the current drivers and passengers; An information recognition module, used to recognize the identity information of each of the current drivers and passengers based on the image information; A route generation module, configured to determine a current navigation route corresponding to the current driver and passenger based on historical travel information corresponding to all the identity information; wherein the historical travel information includes a destination reached by the driver and the passenger in the current vehicle driving or riding the vehicle in combination and a driving route corresponding to the destination; The route generation module is further used to use the destination that appears most frequently in the historical travel information corresponding to all the identity information and the driving route corresponding to the destination as the current navigation route corresponding to the current driver and passenger.

8. A car, characterized in that: The automobile comprises a vehicle host device, and the vehicle host device comprises: a processor, a memory, and a navigation interaction program stored in the memory, and the navigation interaction program, when executed by the processor, implements the steps of the navigation interaction method as claimed in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a navigation interaction program, and when the navigation interaction program is executed by a processor, the navigation interaction method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Automatic navigation method based on face recognition, terminal and system

    CN109241931A

  • Vehicle unlocking method and device based on panoramic camera and storage medium

    CN113815562A