Multi-point navigation aided driving method, device and equipment and storage medium

Abstract

The invention discloses a multi-point navigation aided driving method, device and equipment and a storage medium, relates to the technical field of automatic driving control, and discloses a multi-point navigation aided driving method comprising the following steps: obtaining user travel data, and determining target travel data based on the user travel data; when a travel confirmation instruction is received, acquiring a corresponding target path setting information table from the target travel data according to the travel confirmation instruction, and determining passing point information of the current road section according to the target path setting information table; and when a target vehicle runs on the current road section, identifying a current scene to obtain a scene identification result, and switching to an auxiliary driving mode or an autonomous driving mode according to the scene identification result and / or the passing point information to complete multi-point navigation auxiliary driving. According to the scheme, numerous auxiliary driving functions and the multi-point driving path of the user can be combined, and full-automatic point-to-point intelligent driving experience is provided for the user.

Description

Technical Field

[0001] The present application relates to the field of autonomous driving control technology, and in particular to multi-point navigation assisted driving methods, devices, equipment and storage media. Background Art

[0002] As the level of automobile intelligence continues to improve, high-level assisted driving functions have been launched one after another, which can realize assisted driving in different scenarios. However, there are many types of assisted driving functions, and different assisted driving functions are scattered in multi-level options, requiring users to actively trigger these functions and find their entrances, which increases the difficulty for users to understand and master assisted driving functions.

[0003] How to combine numerous assisted driving functions with the user's multi-point driving routes to provide users with a fully automatic point-to-point intelligent driving experience has become a problem to be solved.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a multi-point navigation assisted driving method, device, equipment and storage medium, aiming to solve the technical problem of how to combine numerous assisted driving functions with the user's multi-point driving route to provide the user with a fully automatic point-to-point intelligent driving experience.

[0006] To achieve the above objectives, the present application proposes a multi-point navigation assisted driving method, the method comprising:

[0007] Acquire user travel data, and determine target travel data based on the user travel data;

[0008] When receiving a trip confirmation instruction, obtaining a corresponding target path setting information table from the target trip data according to the trip confirmation instruction, and determining the waypoint information of the current road section according to the target path setting information table;

[0009] When the target vehicle is traveling on the current road section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

[0010] In one embodiment, the waypoint information includes waypoint location information and waypoint parking information;

[0011] The step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information comprises:

[0012] When the position information of the current road segment matches the position information of the waypoint, determining a parking assistance driving result according to the scene recognition result and the parking information of the waypoint;

[0013] The parking assistance driving mode or the autonomous driving mode is switched according to the parking assistance driving result.

[0014] In one embodiment, when the position information of the current road section matches the position information of the waypoint, the step of determining the parking assistance driving result according to the scene recognition result and the parking information of the waypoint includes:

[0015] When the location information of the current road segment matches the location information of the waypoint, determining the parking type information according to the parking information of the waypoint;

[0016] A parking assistance driving result is determined according to the parking type information and the scene recognition result.

[0017] In one embodiment, after the step of switching to the assisted driving mode or the autonomous driving mode according to the parking assisted driving result, the method further includes:

[0018] When switching to the assisted driving mode, determining the parking duration information according to the parking information of the waypoint;

[0019] The target vehicle is switched to an engine-off state or an idling state according to the parking duration information to complete parking of the target vehicle.

[0020] In one embodiment, the step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information includes:

[0021] When the scene recognition result meets the preset conditions of the target scene, switching to the assisted driving mode;

[0022] When the scene recognition result does not meet the preset conditions of the target scene, the mode is switched to the autonomous driving mode, and a vehicle takeover prompt message is sent to the user.

[0023] In one embodiment, the step of determining target travel data based on the user travel data includes:

[0024] Acquire user travel data, and generate an initial path setting information table based on the user travel data;

[0025] Pushing the initial path setting information table to the user terminal, so that the user terminal feeds back a target path setting information table according to the initial path setting information table;

[0026] When the target path setting information table is received, target travel data is determined according to the target path setting information table.

[0027] In one embodiment, when receiving the trip confirmation instruction, before the step of acquiring the corresponding target path setting information table from the target trip data according to the trip confirmation instruction, the method further includes:

[0028] When the current time is the preset reminder time, sending a trip reminder instruction to the user terminal, so that the user terminal feeds back a trip start instruction based on the trip reminder instruction;

[0029] When the trip start instruction is received, the target vehicle is switched from an ignition-off state to an ignition-on state.

[0030] In addition, to achieve the above purpose, the present application also proposes a multi-point navigation assisted driving device, the multi-point navigation assisted driving device comprising:

[0031] A travel data acquisition module, used to acquire user travel data and determine target travel data based on the user travel data;

[0032] a navigation data acquisition module, configured to, upon receiving a trip confirmation instruction, acquire a corresponding target path setting information table from the target trip data according to the trip confirmation instruction, and determine the waypoint information of the current road section according to the target path setting information table;

[0033] The multi-point assisted driving module is used to identify the current scene when the target vehicle is traveling on the current road section, obtain a scene recognition result, and switch to an assisted driving mode or an autonomous driving mode according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

[0034] In addition, to achieve the above-mentioned purpose, the present application also proposes a multi-point navigation assisted driving device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the multi-point navigation assisted driving method as described above.

[0035] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the multi-point navigation assisted driving method described above are implemented.

[0036] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the multi-point navigation assisted driving method described above.

[0037] One or more technical solutions proposed in this application have at least the following technical effects:

[0038] The user's travel data is obtained, and the target travel data is determined based on the user's travel data. When a travel confirmation instruction is received, the corresponding target path setting information table is obtained from the target travel data according to the travel confirmation instruction, and the waypoint information of the current section is determined according to the target path setting information table. When the target vehicle is traveling on the current section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information. In the process of multi-point navigation assisted driving, a variety of assisted driving functions are combined with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience, thereby improving the convenience of the user's daily car use. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 A flowchart of the first embodiment of the multi-point navigation assisted driving method of the present application is provided;

[0042] Figure 2 A flowchart of the second embodiment of the multi-point navigation assisted driving method of the present application is provided;

[0043] Figure 3 A schematic diagram of a simplified process of the multi-point navigation assisted driving method provided in the second embodiment of the present application;

[0044] Figure 4 This is a schematic diagram of the module structure of the multi-point navigation assisted driving device according to an embodiment of the present application;

[0045] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the multi-point navigation assisted driving method in the embodiment of the present application.

[0046] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0048] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0049] Since there are many types of assisted driving functions, and different assisted driving functions are scattered among multi-level options, users are required to actively trigger these functions and find their entrances, which increases the difficulty for users to understand and master the assisted driving functions.

[0050] The present application provides a solution, which obtains user travel data and determines target travel data based on the user travel data. When a travel confirmation instruction is received, a corresponding target path setting information table is obtained from the target travel data according to the travel confirmation instruction, and the waypoint information of the current section is determined according to the target path setting information table. When the target vehicle is traveling on the current section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information. In the process of multi-point navigation assisted driving, a plurality of assisted driving functions are combined with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience, thereby improving the convenience of the user's daily car use.

[0051] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a multi-point navigation assisted driving device, etc. The following takes a multi-point navigation assisted driving device as an example to illustrate this embodiment and the following embodiments.

[0052] Based on this, the embodiment of the present application provides a multi-point navigation assisted driving method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the multi-point navigation assisted driving method of the present application.

[0053] In this embodiment, the multi-point navigation assisted driving method includes steps S10 to S40:

[0054] Step S10, obtaining user travel data, and determining target travel data based on the user travel data;

[0055] It should be noted that user travel data refers to the travel data of the user within a period of time, which can be the travel data entered by the user himself, or the travel data collected by the target vehicle from the user's previous travel data. The target travel data can be the user travel data within a preset period. For the user travel data entered by the user himself, the corresponding travel data of the preset period will be directly generated based on the user travel data. For the user travel data collected from the user's previous travel data, the user needs to delete and confirm it according to the travel preference to obtain the target travel data.

[0056] Step S20, when receiving the trip confirmation instruction, obtaining a corresponding target path setting information table from the target trip data according to the trip confirmation instruction, and determining the waypoint information of the current road section according to the target path setting information table;

[0057] It should be understood that the target trip data reflects the user trip data within a preset period, including multiple target path setting information tables, each of which represents a continuous navigation path for a certain period of time within the preset period, and the user may pass through multiple waypoints that require temporary parking in this navigation path. The target path setting information table contains multiple waypoint information in this section of the trip, and the waypoint information includes waypoint time information, waypoint location information, and waypoint parking information. When the user gets on the vehicle, the trip can be confirmed on the central control screen of the target vehicle or the application on the mobile phone. After the control center of the target vehicle receives the trip confirmation instruction, it will obtain the corresponding target path setting information table, from which the next waypoint information is determined, that is, the waypoint information of the current section. The waypoint information specifically needs to include the waypoint location information, that is, the navigation coordinates of the waypoint, so as to navigate the target vehicle to the next waypoint. When the target vehicle reaches the next waypoint, the next waypoint reached will be updated to the current waypoint, and the new next waypoint will be obtained from the target path setting information table for navigation.

[0058] Step S30, when the target vehicle is traveling on the current road section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

[0059] It should be understood that when the target vehicle is driving on the current road section, the vehicle's perception system will collect environmental information around the vehicle in the current scene, such as lane lines, road signs, traffic signs, other vehicles, pedestrians, etc., through sensors such as cameras, radars, and lidars. By identifying this environmental information, the feature information of the current scene, i.e., the scene recognition result, will be obtained.

[0060] It should be noted that when the vehicle has not reached the waypoint, it will switch to assisted driving mode or autonomous driving mode based on the scene recognition results; when the vehicle reaches the waypoint, it will switch to assisted driving mode or autonomous driving mode based on the scene recognition results and the waypoint information. When the vehicle switches to assisted driving mode, it will determine the appropriate high-level assisted driving function based on the characteristic information of the current scene, and remind the user through voice to perform corresponding operations to activate the corresponding high-level assisted driving function such as ACC (Adaptive Cruise Control), ICA (Intelligent Cruise Assist), NOA (Navigation on Autopilot), CNOA (City Navigation on Autopilot), HPP (Home Zone Parking Pilot), AVP (Automated Valet Parking), etc., to improve the user's driving comfort. While the target vehicle is navigating according to the waypoint information in the target path setting information table, the current scene will be continuously identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode will be switched according to the scene recognition result and / or the waypoint information until the target vehicle reaches the end point in the target path setting information table, that is, the last waypoint, to complete multi-point navigation assisted driving.

[0061] In addition, it should be understood that there are currently many high-level assisted driving functions. Although ACC, ICA, NOA, CNOA, HPP, AVP, etc. realize assisted driving functions in different scenarios, there are many professional terms corresponding to many high-level assisted driving functions. It is difficult for ordinary users to figure out the definitions and usage boundaries of these functions, which brings great inconvenience to users. It is even necessary to develop special introductions to train users on the functions. Moreover, many high-level assisted driving functions require users to actively trigger and find the entrance to the function, and some functions are hidden in the 2nd level menu or even the 3rd level menu, which also causes troubles for users' daily driving use. The solution of the present application switches to assisted driving mode or autonomous driving mode according to the scene recognition results and / or waypoint information, realizing interactive and intelligent multi-point navigation high-level assisted driving functions.

[0062] In a feasible implementation manner, the step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information in step S30 may include steps S311 to S312:

[0063] Step S311, when the scene recognition result meets the preset conditions of the target scene, switching to the assisted driving mode;

[0064] It should be understood that the target scene preset condition refers to the scene feature information in the current scene recognition result that meets the conditions for turning on the high-order assisted driving function. When the target vehicle is driving on the current road section in autonomous driving mode, if the scene recognition result meets the target scene preset condition, the target vehicle will switch to the assisted driving mode. Specifically, taking ACC and NOA as examples, this embodiment does not impose specific restrictions on the high-order assisted driving function. ACC can automatically adjust the vehicle speed to maintain a safe distance from the vehicle in front. NOA can provide automatic driving assistance during navigation, automatically changing lanes and entering and exiting ramps on the highway according to the navigation route. When it is recognized that the lane line of the current scene is clear, the distance to the vehicle in front is at least 2 meters, and the speed is between 15 and 130 km / h, it will be determined that the scene recognition result meets the conditions for turning on ACC. At this time, the target vehicle will switch to the assisted driving mode and guide the user to click the corresponding option in the central control screen through voice reminders to turn on the ACC function. When it is recognized that the lane lines in the current scene are clear and identifiable, and the target vehicle is on a highway or elevated road, and the weather conditions are good, it will be determined that the scene recognition results meet the conditions for turning on NOA. At this time, the target vehicle will switch to assisted driving mode and guide the user through voice reminders to click the corresponding option in the central control screen to turn on the NOA function.

[0065] Step S312, when the scene recognition result does not meet the preset conditions of the target scene, switch to the autonomous driving mode and send a vehicle takeover prompt message to the user.

[0066] It should be understood that when the target vehicle is traveling on the current road section in assisted driving mode, when the scene recognition result does not meet the preset conditions of the target scene, that is, the scene feature information in the current scene recognition result does not meet the conditions for enabling any high-order assisted driving function, the target vehicle will switch to autonomous driving mode and send a vehicle takeover prompt to the user, that is, informing the user through voice that it has switched to autonomous driving mode and reminding the user to pay attention to driving safety.

[0067] In another feasible implementation manner, the waypoint information includes the waypoint location information and the waypoint parking information; the step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information in step S30 may include steps S321 to S322:

[0068] Step S321, when the position information of the current road section matches the position information of the waypoint, determining a parking assistance driving result according to the scene recognition result and the parking information of the waypoint;

[0069] It should be noted that when the location information of the current road section matches the location information of the waypoint, it means that the user needs to temporarily park at this location. At this time, it will determine whether to turn on the corresponding parking assisted driving function based on the scene recognition results and the parking information of the waypoint. Specifically, the parking assisted driving function may include HPP and AVP. HPP can store, record and learn the user's more commonly used parking locations and parking routes. When the user drives to these locations again, automatic parking can be achieved. AVP allows the vehicle to automatically find a parking space and park without human intervention. The user only needs to instruct the vehicle through a mobile phone application or the vehicle system.

[0070] In a feasible implementation, step S321 may include steps A11 to A12:

[0071] Step A11, when the location information of the current road section matches the location information of the waypoint, determining the parking type information according to the parking information of the waypoint;

[0072] It should be noted that the parking type information can be determined based on the parking information of the waypoints. The parking types include temporary roadside parking and parking lot parking. The parking type information can further determine the specific parking assist driving function to be enabled. Temporary roadside parking corresponds to enabling the HPP function, and parking lot parking corresponds to enabling the AVP function.

[0073] Step A12: determining a parking assistance driving result according to the parking type information and the scene recognition result.

[0074] It should be noted that when the target vehicle arrives at a waypoint, it will first obtain the parking information of the waypoint, determine the parking type information based on the parking information of the waypoint, and obtain the parking type of the waypoint. When the parking type of the waypoint is parking in a parking lot and the scene recognition result is a parking lot scene, or when the parking type of the waypoint is temporary roadside parking and the scene recognition result is that there is a roadside parking space, the parking assisted driving result is determined to be the activation of the parking assisted driving function.

[0075] Step S322: switching to an assisted driving mode or an autonomous driving mode according to the parking assisted driving result.

[0076] It should be understood that when the parking assistance driving result is to turn on the parking assistance driving function, the target vehicle will switch to the assisted driving mode and guide the user to turn on the corresponding parking assistance driving function through voice reminders based on the scene recognition result. When the parking assistance driving result is not to turn on the parking assistance driving function, the target vehicle will switch to the autonomous driving mode and remind the user to control the vehicle to park.

[0077] In a feasible implementation, after step A12, it also includes: when the parking assisted driving result is to turn on the parking assisted driving function, determining the parking duration information according to the parking information of the waypoint; switching the target vehicle to an off state or an idle state according to the parking duration information to complete the parking of the target vehicle.

[0078] It should be understood that when the parking assistance driving result is to turn on the parking assistance driving function, the parking time information will be determined based on the parking information of the waypoint, and the parking time information is used to control the operating state of the target vehicle after parking. Specifically, a parking time threshold can be set. When the parking time is long, that is, greater than the parking time threshold, the vehicle is switched to the off state to reduce emissions and reduce engine wear; when the parking time is short, that is, less than or equal to the parking time threshold, the vehicle is switched to the idle state to ensure that the target vehicle continues to operate the air conditioner, the in-vehicle entertainment system, etc., to ensure the comfort of the user.

[0079] It should be understood that when the parking time is long, that is, greater than the parking time threshold, if the parking time of the target vehicle at the waypoint is about to reach the parking time, a trip continuation reminder message will be sent to the user end in advance, and the trip will be continued or the parking will continue according to the trip continuation instruction or parking confirmation instruction fed back by the user end.

[0080] The present embodiment provides a multi-point navigation assisted driving method, which obtains user travel data and determines target travel data based on the user travel data. When a travel confirmation instruction is received, the corresponding target path setting information table is obtained from the target travel data according to the travel confirmation instruction, and the waypoint information of the current road section is determined according to the target path setting information table. When the target vehicle is traveling on the current road section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information. In the process of multi-point navigation assisted driving, many assisted driving functions are combined with the user's multi-point driving path to provide the user with a fully automatic point-to-point smart driving experience, thereby improving the convenience of the user's daily car use.

[0081] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 2 , step S10 may include steps S11 to S13:

[0082] Step S11, obtaining user travel data, and generating an initial path setting information table based on the user travel data;

[0083] It should be noted that the user travel data of this embodiment may be the user's historical travel data, including the user's travel data for multiple preset periods. By analyzing the user's navigation locations in the user travel data, the user's high-frequency navigation paths in different time periods can be statistically analyzed, and the itinerary information of multiple time periods is automatically generated in the form of a table and recommended to the user, that is, the initial path setting information table. The initial path information setting table contains information on multiple waypoints in the trip, and the waypoint information includes waypoint time information, waypoint location information, and waypoint parking information.

[0084] Step S12, pushing the initial path setting information table to the user terminal, so that the user terminal feeds back a target path setting information table according to the initial path setting information table;

[0085] It should be understood that the multiple initial path setting information tables obtained through data analysis may not completely meet the user's daily travel preferences, so the multiple initial path setting information tables generated need to be pushed to the user interface of the user end. The user end can be a mobile phone APP or other user portable smart device. After the user deletes or adds multiple initial path setting information tables in the user interface, multiple target path setting information tables will be obtained and fed back to the vehicle end.

[0086] Step S13, when the target path setting information table is received, determining the target travel data according to the target path setting information table.

[0087] It should be noted that the target trip data includes multiple target path setting information tables within a preset period, each of which represents a continuous navigation path, in which the user may pass through multiple waypoints where temporary parking is required. After receiving the multiple target path setting information tables confirmed and named by the user, the multiple target path setting information tables will be added to the trip management database to obtain the target trip data.

[0088] For example, this embodiment will be described with one week as the preset period. Table 1 is a smart itinerary management data table generated by high-frequency statistics based on the user's itinerary data. The smart itinerary management data table will be pushed to the user end. After receiving the smart itinerary management data table, the user can click on the specific information of the navigation path for each time period, that is, the target path setting information table. The user can also name the path, such as daily commuting to work. Table 2 is the path setting information table corresponding to the daily commuting scene. Home, breakfast shop, school, wife's company and own company are the waypoints that the user needs to pass through in sequence in this path. The time attribute corresponds to the time information of the waypoint, that is, the estimated start time of this path. Generally, only the starting point of this path needs to set the time attribute specifically. The location attribute corresponds to the location information of the waypoint, and the navigation coordinates of the waypoint are stored. When the user starts this trip, the navigation system will read the target path setting information table corresponding to this trip, obtain the location attribute of the next waypoint from it, and navigate the target vehicle from the current position to the next waypoint. Parking duration, roadside temporary parking and roadside temporary parking corresponding to the waypoint parking information.

[0089] Table 1

[0090] Specific time Monday Tuesday Wednesday Thursday Friday Saturday Sunday 7.30 Daily commute to work Path 3 Path 5 Path 7 Path 9 Path 11 Path 13 Time period 2 Path 2 Path 4 Path 6 Path 8 Path 10 Path 12 Path 14

[0091] Table 2

[0092]

[0093] In a feasible implementation manner, before step S10, steps S01 to S02 are also included:

[0094] Step S01, when the current time is the preset reminder time, sending a trip reminder instruction to the user terminal, so that the user terminal feeds back a trip start instruction based on the trip reminder instruction;

[0095] It should be understood that the preset reminder time is a reminder time set by the system by default or by the user in advance, and needs to be earlier than the time information of the waypoint corresponding to the starting point in the target path setting information table. When the preset reminder time is reached, the system will automatically send a trip reminder instruction to the user terminal. The trip reminder instruction can be a notification SMS or a notification message in the application to inform the user when and what trip will be started. After receiving the trip reminder instruction, the user needs to confirm the trip and send a trip start instruction to the target vehicle through the user terminal.

[0096] Step S02, when receiving the trip start instruction, switching the target vehicle from the off state to the start state.

[0097] It should be understood that when the target vehicle receives the trip start command, the vehicle's remote control system will start the target vehicle, switch the vehicle from an off state to a started state, and automatically adjust various settings in the vehicle according to the user's habits, such as the user's preferred temperature, wind speed or air circulation mode.

[0098] This embodiment obtains user travel data, generates an initial path setting information table based on the user travel data, and pushes the initial path setting information table to the user terminal, so that the user terminal feeds back a target path setting information table according to the initial path setting information table. When the target path setting information table is received, the target travel data is determined according to the target path setting information table, and the target travel data is generated by combining the user travel data and the user feedback, thereby providing travel data that conforms to the user's habits for multi-point navigation assisted driving, and improving the user's daily travel experience.

[0099] For example, in order to help understand the implementation process of the multi-point navigation assisted driving method obtained by combining this embodiment with the above-mentioned embodiment 1, please refer to Figure 3 , Figure 3 A brief flowchart of a multi-point navigation assisted driving method is provided, specifically:

[0100] Assume that the target path setting information table corresponds to the daily commuting scenario in Table 2. The daily commuting has been added to the itinerary management database. It is 7:30 a.m. on Monday. User A will take his children to a familiar breakfast shop for breakfast, then send his children to school, send his wife to work, and then go to work himself. The preset reminder time is 10 minutes earlier than the time information of the waypoint corresponding to the starting point. When the time reaches 7:20 a.m., the system sends a reminder message to the user's mobile phone, indicating that the daily commuting task is about to start, and the user confirms whether to start the trip. After the user clicks to confirm, the trip start instruction is received. When the trip task is started, the vehicle will start in advance, turn on the air conditioner and other habitual settings recorded by the user. When the user gets in the car, after clicking to confirm to start the trip immediately on the car-machine interaction interface, the trip confirmation instruction is received, and the vehicle will navigate from the starting point to point A. Starting from the starting point, the intelligent scene judgment and switching module will determine which function needs to be automatically started in the entire path based on the surrounding road environment. If there is no corresponding intelligent driving function, the user will be reminded to take over the vehicle. When the vehicle arrives at point A, according to the parking type information at point A, it can be known that the parking type at point A is temporary roadside parking. When the scene recognition result shows that there is a parking space at point A, the HPP function is turned on to complete automatic parking. After the vehicle is parked, it will switch the vehicle to the off state or idle state according to the set parking time. When the parking time is reached, the navigation task will continue to be automatically executed until it reaches the end point and ends the trip.

[0101] This application provides users with a convenient, easy-to-operate, interactive, and intelligent multi-point navigation high-level assisted driving solution, providing users with a service like a private itinerary butler and private driver, without the need for users to memorize and perform complex operations on numerous function entrances, thus eliminating the learning cost and cognitive bias of users for various high-level assisted driving functions.

[0102] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the multi-point navigation assisted driving method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0103] This application also provides a multi-point navigation assisted driving device, please refer to Figure 4 , the multi-point navigation auxiliary driving device comprises:

[0104] A travel data acquisition module 10 is used to acquire user travel data and determine target travel data based on the user travel data;

[0105] The navigation data acquisition module 20 is used to acquire the corresponding target path setting information table from the target path data according to the trip confirmation instruction when receiving the trip confirmation instruction, and determine the waypoint information of the current road section according to the target path setting information table;

[0106] The multi-point assisted driving module 30 is used to identify the current scene when the target vehicle is traveling on the current road section, obtain a scene recognition result, and switch to an assisted driving mode or an autonomous driving mode according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

[0107] The multi-point navigation assisted driving device provided by the present application adopts the multi-point navigation assisted driving method in the above-mentioned embodiment, which can solve the technical problem of how to combine numerous assisted driving functions with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience. Compared with the prior art, the beneficial effects of the multi-point navigation assisted driving device provided by the present application are the same as the beneficial effects of the multi-point navigation assisted driving method provided by the above-mentioned embodiment, and the other technical features in the multi-point navigation assisted driving device are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.

[0108] In one embodiment, the multi-point assisted driving module 30 is further used to determine the parking assisted driving result according to the scene recognition result and the parking information of the waypoint when the position information of the current road section matches the position information of the waypoint; and switch to the assisted driving mode or the autonomous driving mode according to the parking assisted driving result.

[0109] In one embodiment, the multi-point assisted driving module 30 is further used to determine the parking type information according to the waypoint parking information when the position information of the current road section matches the waypoint position information; and determine the parking assisted driving result according to the parking type information and the scene recognition result.

[0110] In one embodiment, the multi-point assisted driving module 30 is also used to determine the parking duration information according to the parking information of the waypoints when switching to the assisted driving mode; and switch the target vehicle to an off state or an idle state according to the parking duration information to complete the parking of the target vehicle.

[0111] In one embodiment, the multi-point assisted driving module 30 is also used to switch to the assisted driving mode when the scene recognition result meets the preset conditions of the target scene; when the scene recognition result does not meet the preset conditions of the target scene, switch to the autonomous driving mode and send a vehicle takeover prompt message to the user.

[0112] In one embodiment, the travel data acquisition module 10 is also used to acquire user travel data and generate an initial path setting information table based on the user travel data; push the initial path setting information table to the user end so that the user end feeds back a target path setting information table according to the initial path setting information table; and when receiving the target path setting information table, determine the target travel data according to the target path setting information table.

[0113] In one embodiment, the trip data acquisition module 10 is also used to send a trip reminder instruction to the user terminal when the current time is a preset reminder time, so that the user terminal can feedback a trip start instruction based on the trip reminder instruction; when the trip start instruction is received, the target vehicle is switched from an off state to a start state.

[0114] The present application provides a multi-point navigation assisted driving device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the multi-point navigation assisted driving method in the above-mentioned embodiment one.

[0115] Reference below Figure 5, which shows a schematic diagram of the structure of a multi-point navigation assisted driving device suitable for implementing an embodiment of the present application. The multi-point navigation assisted driving device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The multi-point navigation assisted driving device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0116] like Figure 5 As shown, the multi-point navigation assisted driving device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the multi-point navigation assisted driving device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the multi-point navigation assisted driving device to communicate wirelessly or wired with other devices to exchange data. Although the multi-point navigation assisted driving device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or provided alternatively.

[0117] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0118] The multi-point navigation assisted driving device provided by the present application adopts the multi-point navigation assisted driving method in the above embodiment, which can solve the technical problem of how to combine numerous assisted driving functions with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience. Compared with the prior art, the beneficial effects of the multi-point navigation assisted driving device provided by the present application are the same as the beneficial effects of the multi-point navigation assisted driving method provided by the above embodiment, and the other technical features in the multi-point navigation assisted driving device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0119] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0120] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0121] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the multi-point navigation assisted driving method in the above-mentioned embodiment.

[0122] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0123] The computer-readable storage medium may be included in the multi-point navigation assisted driving device; or may exist independently without being assembled into the multi-point navigation assisted driving device.

[0124] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the multi-point navigation assisted driving device, the multi-point navigation assisted driving device: obtains user travel data, and determines target travel data based on the user travel data; when receiving a travel confirmation instruction, obtains the corresponding target path setting information table from the target travel data according to the travel confirmation instruction, and determines the waypoint information of the current road section according to the target path setting information table; when the target vehicle is traveling on the current road section, identifies the current scene to obtain a scene recognition result, and switches to an assisted driving mode or an autonomous driving mode according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

[0125] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0126] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0127] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0128] The readable storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned multi-point navigation assisted driving method, and can solve the technical problem of how to combine numerous assisted driving functions with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the multi-point navigation assisted driving method provided in the above-mentioned embodiment, and will not be repeated here.

[0129] The present application also provides a computer program product, including a computer program, which implements the steps of the multi-point navigation assisted driving method as described above when executed by a processor.

[0130] The computer program product provided by this application can solve the technical problem of how to combine numerous assisted driving functions with the user's multi-point driving path to provide the user with a fully automatic point-to-point intelligent driving experience. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the multi-point navigation assisted driving method provided by the above embodiment, and will not be repeated here.

[0131] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A multi-point navigation assisted driving method, characterized in that: The multi-point navigation assisted driving method comprises: Acquire user travel data, and determine target travel data based on the user travel data; When receiving a trip confirmation instruction, obtaining a corresponding target path setting information table from the target trip data according to the trip confirmation instruction, and determining the waypoint information of the current road section according to the target path setting information table; When the target vehicle is traveling on the current road section, the current scene is identified to obtain a scene recognition result, and the assisted driving mode or the autonomous driving mode is switched according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

2. The method according to claim 1, characterized in that The waypoint information includes waypoint location information and waypoint parking information; The step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information comprises: When the position information of the current road segment matches the position information of the waypoint, determining a parking assistance driving result according to the scene recognition result and the parking information of the waypoint; The parking assistance driving mode or the autonomous driving mode is switched according to the parking assistance driving result.

3. The method according to claim 2, characterized in that The step of determining the parking assistance driving result according to the scene recognition result and the parking information of the waypoint when the position information of the current road section matches the position information of the waypoint includes: When the location information of the current road segment matches the location information of the waypoint, determining the parking type information according to the parking information of the waypoint; A parking assistance driving result is determined according to the parking type information and the scene recognition result.

4. The method according to claim 2, characterized in that After the step of switching to the assisted driving mode or the autonomous driving mode according to the parking assisted driving result, the method further includes: When switching to the assisted driving mode, determining the parking duration information according to the parking information of the waypoint; The target vehicle is switched to an engine-off state or an idling state according to the parking duration information to complete parking of the target vehicle.

5. The method according to claim 1, characterized in that The step of switching to the assisted driving mode or the autonomous driving mode according to the scene recognition result and / or the waypoint information comprises: When the scene recognition result meets the preset conditions of the target scene, switching to the assisted driving mode; When the scene recognition result does not meet the preset conditions of the target scene, the mode is switched to the autonomous driving mode, and a vehicle takeover prompt message is sent to the user.

6. The method according to claim 1, characterized in that The step of determining target travel data based on the user travel data comprises: Acquire user travel data, and generate an initial path setting information table based on the user travel data; Pushing the initial path setting information table to the user terminal, so that the user terminal feeds back a target path setting information table according to the initial path setting information table; When the target path setting information table is received, target travel data is determined according to the target path setting information table.

7. The method according to any one of claims 1 to 6, characterized in that Before the step of acquiring the corresponding target path setting information table from the target trip data according to the trip confirmation instruction when the trip confirmation instruction is received, the method further includes: When the current time is the preset reminder time, sending a trip reminder instruction to the user terminal, so that the user terminal feeds back a trip start instruction based on the trip reminder instruction; When the trip start instruction is received, the target vehicle is switched from an ignition-off state to an ignition-on state.

8. A multi-point navigation assisted driving device, characterized in that: The device comprises: A travel data acquisition module, used to acquire user travel data and determine target travel data based on the user travel data; a navigation data acquisition module, configured to, upon receiving a trip confirmation instruction, acquire a corresponding target path setting information table from the target trip data according to the trip confirmation instruction, and determine the waypoint information of the current road section according to the target path setting information table; The multi-point assisted driving module is used to identify the current scene when the target vehicle is traveling on the current road section, obtain a scene recognition result, and switch to an assisted driving mode or an autonomous driving mode according to the scene recognition result and / or the waypoint information to complete multi-point navigation assisted driving.

9. A multi-point navigation assisted driving device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the multi-point navigation assisted driving method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the multi-point navigation assisted driving method as described in any one of claims 1 to 7 are implemented.

Images