Parking guiding method and device, vehicle and storage medium

Abstract

The invention relates to a parking guiding method and device, a vehicle and a storage medium. The method comprises the steps of entering a parking learning interface in response to a trigger operation for a parking learning entrance, and displaying a plurality of identified parking spaces in the parking learning interface; in response to a first selection operation for the target available parking space, generating a corresponding parking route, and displaying the parking route in a parking learning interface; wherein the target parking space is any one of the plurality of parking spaces; operation guiding information is generated according to the parking route, the operation guiding information is broadcasted through voice, and the operation guiding information is used for guiding a user to execute corresponding parking operation in the parking process. According to the scheme provided by the invention, the problems of excessive dependence on others, insufficiency in standardization, insufficiency in intuition, insufficiency in efficiency and the like in an autonomous parking scene can be solved.

Description

Technical Field

[0001] The present application relates to the field of parking technology, and in particular to a parking guidance method, device, vehicle and storage medium. Background Art

[0002] In daily driving scenarios, the biggest headache for novice drivers is the problem of autonomous parking. Although the automatic parking function can solve this problem, it also has some disadvantages. For example, the automatic parking function cannot help novice drivers master parking skills, which makes it difficult for novice drivers to improve their parking skills and is not conducive to the autonomous parking experience of novice drivers. Therefore, novice drivers need to learn parking skills on their own to better achieve autonomous parking.

[0003] In the related art, there are two main ways for novice drivers to learn parking skills. One way is to find experienced coaches or family and friends to teach parking skills and experience. The other way is to watch teaching videos online through the Internet. However, these two ways have problems such as being too dependent on others and not being standardized, intuitive, or efficient enough, which affects the safety of autonomous parking for novice drivers, causing the scratch accident rate in autonomous parking scenarios to become very high, thereby causing a poor autonomous parking experience for novice drivers. Summary of the invention

[0004] In order to solve or partially solve the problems existing in the related technologies, the present application provides a parking guidance method, device, vehicle and storage medium, which can solve the problems of over-reliance on others, lack of standardization, lack of intuitiveness, and lack of efficiency in autonomous parking scenarios, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in autonomous parking scenarios, and thus improving the user's autonomous parking experience.

[0005] A first aspect of the present application provides a parking guidance method, comprising:

[0006] In response to a trigger operation on a parking learning entry, entering a parking learning interface, and displaying the identified plurality of available parking spaces in the parking learning interface;

[0007] In response to a first selection operation for a target available parking space, a corresponding parking route is generated, and the parking route is displayed in the parking learning interface; wherein the target available parking space is any one of the plurality of available parking spaces;

[0008] Operation guidance information is generated according to the parking route and the operation guidance information is announced by voice, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

[0009] In one embodiment, the generating operation guidance information according to the parking route includes:

[0010] determining a target driving direction of the vehicle according to the parking route;

[0011] Identifying the parking space type of the target parking space;

[0012] Operation guidance information is generated according to the target driving direction and the parking space type.

[0013] In one embodiment, the operation guidance information includes a plurality of guidance steps; and the voice broadcasting of the operation guidance information includes:

[0014] Voice broadcast of the guidance steps of the current sequence;

[0015] Acquire a current parking operation performed by the user according to the guidance steps in the current sequence;

[0016] Determining whether the current parking operation matches the guidance steps of the current sequence;

[0017] If the current parking operation matches the guidance steps of the current sequence, the guidance steps of the next sequence are voice broadcasted until the voice broadcast completes the guidance steps of the last sequence.

[0018] In one embodiment, in response to the first selection operation for the target parking space, generating a corresponding parking route includes:

[0019] In response to a first selection operation for a target parking space, obtaining vehicle position information, parking space position information of the target parking space, and obstacle information;

[0020] A corresponding parking route is generated based on the vehicle position information, the parking space position information and the obstacle information.

[0021] In one embodiment, the method further comprises:

[0022] When it is detected that the vehicle gear is switched to the target gear, it is determined that the user has successfully parked;

[0023] Displaying the current parking record in an application interface; the application interface includes a learning progress of different parking space types; the parking space type includes at least one of a perpendicular parking space, a parallel parking space, and a diagonal parking space;

[0024] The learning progress corresponding to the parking space type of the target parking space is updated.

[0025] In one embodiment, the application program interface further includes instructional videos of different parking space types; and the method further includes:

[0026] Based on the parking space type of the target available parking space, recommend a corresponding teaching video to the user and play it; or,

[0027] Based on the learning progress of the various parking space types, recommending and playing a teaching video with a relatively slow learning progress to the user; or,

[0028] In response to a second selection operation on any of the teaching videos, the teaching video targeted by the second selection operation is played to the user.

[0029] In one embodiment, the method further comprises:

[0030] Monitoring whether the learning progress of each parking space type reaches the corresponding learning number threshold;

[0031] When the learning progress of each of the parking space types reaches the corresponding learning times threshold, completion prompt information of the parking learning task is generated, and the completion prompt information is displayed in the application interface.

[0032] A second aspect of the present application provides a parking guidance device, comprising:

[0033] a parking learning interface entry module, for entering the parking learning interface in response to a trigger operation on the parking learning entry, and displaying the identified multiple parking spaces in the parking learning interface;

[0034] an interface guidance module, configured to generate a corresponding parking route in response to a first selection operation for a target available parking space, and display the parking route in the parking learning interface; wherein the target available parking space is any one of the plurality of available parking spaces;

[0035] A voice guidance module is used to generate operation guidance information according to the parking route and to voice broadcast the operation guidance information, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

[0036] A third aspect of the present application provides a vehicle, comprising:

[0037] Processor; and

[0038] The memory stores executable codes thereon, and when the executable codes are executed by the processor, the processor is caused to execute the method as described above.

[0039] A fourth aspect of the present application provides a computer-readable storage medium having executable code stored thereon. When the executable code is executed by a processor of a vehicle, the processor is caused to execute the method as described above.

[0040] The technical solution provided by this application may have the following beneficial effects:

[0041] The solution provided by the present application, in response to the trigger operation for the parking learning entrance, enters the parking learning interface, and displays the identified multiple parking spaces in the parking learning interface; in response to the first selection operation for the target parking space, generates a corresponding parking route, and displays the parking route in the parking learning interface; wherein the target parking space is any one of the multiple parking spaces; generates operation guidance information according to the parking route, and voice broadcasts the operation guidance information, and the operation guidance information is used to guide the user to perform the corresponding parking operation during the parking process. The present application conducts in-car parking teaching through interface guidance and voice guidance, so that the user can complete the parking learning process alone without relying on others, and combined with the actual parking scene, it can allow users to learn and master autonomous parking skills in a more standardized, intuitive and efficient way, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in the autonomous parking scene, and thus improving the user's autonomous parking experience.

[0042] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The above and other objects, features and advantages of the present application will become more apparent by describing in more detail the exemplary embodiments of the present application in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments of the present application.

[0044] Figure 1 is a flow chart of a parking guidance method according to an embodiment of the present application;

[0045] Figure 2 is another flow chart of the parking guidance method shown in the embodiment of the present application;

[0046] Figure 3A to Figure 3D is a flow chart of a newly added parking learning entry shown in an embodiment of the present application;

[0047] Figure 4A to Figure 4E is a flowchart of parking guidance shown in an embodiment of the present application;

[0048] Figure 5A to Figure 5E is a schematic diagram of relevant data of different parking space types in the APP interface shown in an embodiment of the present application;

[0049] Figure 6 is a schematic structural diagram of a parking guidance device shown in an embodiment of the present application;

[0050] Figure 7 It is a schematic diagram of the structure of a vehicle shown in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0052] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0053] It should be understood that although the terms "first", "second", "third", etc. may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0054] In the related art, there are two main ways for novice drivers to learn parking skills:

[0055] Method 1: Find an experienced instructor or family and friends to teach parking skills and experience, which can help novice drivers master parking skills.

[0056] Method 2: Watch instructional videos online. There are many instructional videos on parking skills on the Internet. You can learn different parking methods by watching these videos and observe the parking operations of professional drivers.

[0057] However, these two approaches have the following problems:

[0058] 1. Over-reliance on others and lack of standardization: Over-reliance on experienced coaches or family and friends to teach parking skills leads to the inability to complete learning independently. In addition, due to different driving habits and teaching methods for each person, the learning results vary from person to person, and there is a lack of standardized and systematic teaching.

[0059] 2. Not intuitive enough: Although watching teaching videos online through the Internet can provide theoretical guidance, there is a lack of opportunities for actual operation and the learning process is not intuitive enough, making it difficult to transform theoretical knowledge into practical skills.

[0060] 3. Not efficient enough: Whether listening to the guidance of others or watching teaching videos online, novice drivers cannot get immediate feedback and correction when they encounter problems in actual operation, which affects their learning efficiency.

[0061] These problems will affect the safety of autonomous parking for novice drivers, causing the rate of scratch accidents in autonomous parking scenarios to become very high, thus resulting in a poor autonomous parking experience for novice drivers.

[0062] In response to the above problems, the embodiments of the present application provide a parking guidance method, which conducts in-vehicle parking teaching through interface guidance and voice guidance, so that users can complete the parking learning process independently without relying on others. In combination with actual parking scenarios, users can learn and master autonomous parking skills in a more standardized, intuitive and efficient manner, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in autonomous parking scenarios, and thus improving the user's autonomous parking experience.

[0063] The technical solution of the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0064] Figure 1 It is a flowchart of the parking guidance method shown in an embodiment of the present application.

[0065] See also Figure 1 The parking guidance method of the present application includes:

[0066] S110 , in response to a triggering operation on a parking learning entry, entering a parking learning interface, and displaying the identified multiple parking spaces in the parking learning interface.

[0067] In the embodiment of the present application, it can be applied to a parking system, wherein a parking learning entrance is pre-set in the home page of the central control screen of the vehicle, wherein the home page can be a navigation interface, a music playing interface, etc. When a user (especially a novice driver) wants to learn parking skills, the parking learning entrance can be triggered by a click operation, or the parking learning entrance can be triggered by a voice command, so that the parking system responds to the triggering operation for the parking learning entrance and directly enters the parking learning interface from the home page.

[0068] The parking system can use various sensors configured on the vehicle to perceive the environment around the vehicle in real time. The sensors may include at least one of millimeter-wave radar, ultrasonic radar, lidar and high-definition camera.

[0069] In one example, when the vehicle is traveling at a low speed, the parking system can use the lateral ultrasonic radar to send out radar waves along the way. When the surrounding vehicle A enters the detection envelope of the lateral ultrasonic radar, the lateral ultrasonic radar can receive the echo reflected by the surrounding vehicle A for the radar wave. At this time, the lateral ultrasonic radar detects a boundary of the surrounding vehicle A as a1; the vehicle continues to travel in the driving direction. When the surrounding vehicle A leaves the detection envelope of the lateral ultrasonic radar, the lateral ultrasonic radar cannot receive the echo reflected by the surrounding vehicle A for the radar wave. At this time, the lateral ultrasonic radar detects another boundary of the surrounding vehicle A as a2. The vehicle continues to travel in the driving direction. When the surrounding vehicle B enters the detection envelope of the lateral ultrasonic radar, the lateral ultrasonic radar can receive the echo reflected by the surrounding vehicle B for the radar wave. At this time, the lateral ultrasonic radar detects a boundary of the surrounding vehicle B as b1; the vehicle continues to travel in the driving direction. When the surrounding vehicle B leaves the detection envelope of the lateral ultrasonic radar, the lateral ultrasonic radar cannot receive the echo reflected by the surrounding vehicle B for the radar wave. At this time, the lateral ultrasonic radar detects another boundary of the surrounding vehicle B as b2. The target area between the surrounding vehicle A and the surrounding vehicle B may be a gap area between the two, or may be a parking space between the two. The parking system can calculate the width of the target area according to the distance between the boundary a2 and the boundary b1, and then determine whether the width of the target area is greater than or equal to a preset width threshold. If the width of the target area is greater than or equal to the width threshold, the parking system can determine that the target area is a parking space; if the width of the target area is less than the width threshold, the parking system can determine that the target area is not a parking space. In this way, the parking system can identify multiple parking spaces around the vehicle.

[0070] In another example, assuming that the front, left, right and rear positions of the vehicle are all equipped with high-definition cameras, the parking system can obtain the vehicle's exterior environment images from the front, left, right and rear perspectives, respectively, and then splice the exterior environment images from these four perspectives to obtain a bird's-eye view (BEV). The parking system can detect the center point of each parking space in the bird's-eye view, so as to obtain the target probability value of each parking space being occupied based on the center point of each parking space, and then determine whether the target probability value of each parking space is less than a preset probability threshold; if the target probability value of a parking space is less than the preset probability threshold, the parking system can determine that the parking space is a parking space; if the target probability value of a parking space is greater than or equal to the preset probability threshold, the parking system can determine that the parking space is not a parking space. In this way, the parking system can identify multiple parking spaces around the vehicle.

[0071] The above examples are only used to help those skilled in the art better understand the embodiments of the present application, and the present application does not limit this.

[0072] In order to improve recognition accuracy, the parking system can fuse multiple sensor data so that it can accurately identify multiple parking spaces around the vehicle.

[0073] After identifying multiple available parking spaces around the vehicle, the parking system can display these available parking spaces in the parking learning interface, allowing users to easily select the target parking space they want to park in.

[0074] S120, in response to a first selection operation on a target available parking space, generating a corresponding parking route, and displaying the parking route in a parking learning interface; wherein the target available parking space is any one of a plurality of available parking spaces.

[0075] The user can select any one of the multiple available parking spaces displayed on the parking learning interface as a target available parking space, so that the parking system generates a parking route corresponding to the target available parking space in response to a first selection operation on the target available parking space.

[0076] The parking system can display the parking route in the parking learning interface so as to guide the user through the interface to drive the vehicle into the target parking space according to the parking route.

[0077] S130, generating operation guidance information according to the parking route, and announcing the operation guidance information by voice, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

[0078] In addition to providing an interface guidance function, the embodiment of the present application also provides a voice guidance function. In a specific implementation, the parking system can generate operation guidance information based on the parking route, and then can use the speakers in various positions in the car to broadcast the operation guidance information in an all-round voice, so as to guide the user to perform parking operations step by step according to the instructions of the operation guidance information during the parking process through voice. That is to say, while a novice driver can park according to the parking route displayed on the parking learning interface, the parking system is equivalent to an AI (Artificial Intelligence) coach, which combines the parking route and the environment around the vehicle to tell the novice driver how to park through voice.

[0079] As can be seen from this example, the solution provided by this application, in response to the trigger operation for the parking learning entrance, enters the parking learning interface, and displays the identified multiple parking spaces in the parking learning interface; in response to the first selection operation for the target parking space, generates a corresponding parking route, and displays the parking route in the parking learning interface; wherein the target parking space is any one of the multiple parking spaces; generates operation guidance information according to the parking route, and voice broadcasts the operation guidance information, and the operation guidance information is used to guide the user to perform the corresponding parking operation during the parking process. This application conducts in-car parking teaching through interface guidance and voice guidance, so that users can complete the parking learning process alone without relying on others, and combined with actual parking scenarios, it can allow users to learn and master autonomous parking skills in a more standardized, intuitive and efficient manner, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in autonomous parking scenarios, and thus improving the user's autonomous parking experience.

[0080] Figure 2 It is another flowchart diagram of the parking guidance method shown in the present application.

[0081] See also Figure 2 The parking guidance method of the present application includes:

[0082] S210: In response to a trigger operation on a parking learning entry, a parking learning interface is entered, and the identified plurality of available parking spaces are displayed in the parking learning interface.

[0083] In order to provide a parking learning entrance to quickly enter the parking learning interface, users can select it in the settings page of the vehicle's central control screen. Figure 3A As shown, the setting page provides controls for different types of vehicle functions, including a "Novice Parking Learning" control. The user can click the "Novice Parking Learning" control to immediately trigger a function pop-up window on the setting page, such as Figure 3B As shown. The function pop-up window displays a prompt message "Do you want to enable parking learning for novice drivers?" If the user does not want to enable it, he can click the "Do not enable it yet" control B, and the function pop-up window will automatically close; if the user wants to enable it, he can click the "Confirm" control A. Whenever the user wants to enable the parking learning function for novice drivers, this method can be used. Since this method requires multiple operation steps, in order to quickly enable the parking learning function for novice drivers, the function pop-up window also provides a selection box C for "Enable the parking learning function for novice drivers by default in the future". The user can check the selection box C and then click the "Confirm" control A to trigger the success prompt bar, as shown. Figure 3C As shown in the figure, the success prompt bar disappears automatically after 2 seconds, and then a parking learning entrance is added to the vehicle's home page (such as the navigation interface), such as Figure 3D shown.

[0084] When a user (especially a novice driver) wants to learn parking skills, he can directly trigger the parking learning entrance to quickly enter the parking learning interface, such as Figure 4A The parking system can use various sensors configured in the vehicle to perceive the environment around the vehicle in real time, so as to identify multiple parking spaces around the vehicle, and then display these parking spaces in the parking learning interface, so that the user can select the target parking space he wants to park in. In addition, Figure 4A As shown in the figure, the parking learning interface can also display the vehicle's rearview mirror image, so that during the parking process, the user can clearly observe the blind spot behind the vehicle through the interface without adjusting the vehicle's rearview mirror. Figure 4A As shown, the parking learning interface can also display a bird's-eye view, allowing users to observe the environment around the vehicle in all directions through the bird's-eye view.

[0085] S220, in response to a first selection operation on a target available parking space, generating a corresponding parking route, and displaying the parking route in a parking learning interface; wherein the target available parking space is any one of a plurality of available parking spaces.

[0086] like Figure 4A As shown, the user can select any one of the multiple available parking spaces displayed in the parking learning interface as the target available parking space, and then trigger the "Start" control, so that the parking system generates a parking route corresponding to the target available parking space in response to the first selection operation for the target available parking space.

[0087] like Figure 4B As shown, the parking system can display the parking route in the parking learning interface so as to guide the user through the interface to drive the vehicle into the target parking space according to the parking route.

[0088] In one embodiment, in response to the first selection operation for the target parking space, generating a corresponding parking route may include:

[0089] In response to a first selection operation for a target available parking space, vehicle position information, parking space position information of the target available parking space, and obstacle information are obtained; and a corresponding parking route is generated based on the vehicle position information, the parking space position information, and the obstacle information.

[0090] In response to the first selection operation for the target parking space, the parking system obtains the vehicle position information from the GPS (Global Positioning System) in real time. In addition, after the fusion processing of the various sensor data of the vehicle, the parking system can accurately identify the parking space information and obstacle information around the vehicle, wherein the parking space information may include at least one of the parking attributes, parking space location information, parking space size information and parking space type of each parking space, and the obstacle information may include at least one of obstacle location information, obstacle shape information and obstacle distance information. The parking system can extract the parking space location information of the target parking space from the parking space information, so as to plan a parking route from the current vehicle position indicated by the vehicle position information to the center point of the target parking space indicated by the parking space location information. In order to improve parking safety, the parking system can adjust the parking route accordingly in combination with the obstacle information to avoid the risk of collision with obstacles in the blind spot when the user drives along the parking route.

[0091] S230, generating operation guidance information according to the parking route, and announcing the operation guidance information by voice, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

[0092] The parking system can generate operation guidance information according to the parking route. The operation guidance information can include a series of guidance steps. The parking system can display these guidance steps in sequence in the parking learning interface, such as Figure 4B and Figure 4C As shown, the operation guidance information includes three guidance steps. The first step is "After turning the steering wheel all the way to the left, reverse the car gradually"; ...; the third step is "After returning the steering wheel to the center, reverse the car to complete parking." The user is guided through the interface to perform parking operations step by step according to the instructions of the operation guidance information during the parking process.

[0093] In addition to providing an interface guidance function, the embodiment of the present application also provides a voice guidance function. Figure 4D As shown, at least one speaker is arranged in each position in the vehicle. The parking system can use these speakers to broadcast the operation guidance information in an all-round manner, so as to guide the user to perform the parking operation step by step according to the instructions of the operation guidance information during the parking process. In other words, the novice driver can park according to the parking route displayed on the parking learning interface. At the same time, the parking system is equivalent to an AI coach. Combining the parking route and the environment around the vehicle, the parking system tells the novice driver how to park by voice, such as voice broadcast: "After turning the steering wheel all the way to the left, reverse gradually";...; "After straightening the steering wheel, reverse backward to complete the parking".

[0094] In addition, during the parking process, when it is detected that the distance between the vehicle and the obstacle in the blind spot is less than the preset safety distance, the parking system can generate a collision warning message, and then use the in-vehicle speakers to voice broadcast the collision warning message to avoid the risk of collision between the vehicle and the obstacle in the blind spot.

[0095] In one embodiment, generating operation guidance information according to the parking route may include:

[0096] The target driving direction of the vehicle is determined according to the parking route; the parking space type of the target available parking space is identified; and operation guidance information is generated according to the target driving direction and the parking space type.

[0097] The parking system can determine the target driving direction of the vehicle based on the parking route, and the target driving direction is the direction in which the vehicle is moving.

[0098] Different parking space types correspond to different parking techniques, wherein the parking space type may include at least one of a perpendicular parking space, a parallel parking space, and a diagonal parking space.

[0099] 1. Vertical parking space

[0100] Feature description: The parking space is perpendicular to the driving lane, and vehicles can drive in directly or reverse in;

[0101] Parking skills: suitable for forward or reverse parking, easy to enter and exit;

[0102] Advantages and disadvantages: It occupies a large area, but parking is easy and suitable for large parking lots.

[0103] 2. Parallel parking

[0104] Feature description: The parking space is parallel to the driving lane, and vehicles need to enter from the side;

[0105] Parking skills: You need to master the parallel parking skills, which usually requires moving the vehicle forward or backward to enter;

[0106] Advantages and disadvantages: Suitable for narrow areas and both sides of the road, but parking is more difficult.

[0107] 3. Diagonal parking spaces

[0108] Feature description: The parking space is at a certain angle to the lane (usually 45° or 60°), and vehicles can enter in the forward direction;

[0109] Parking skills: usually drive forward and drive out in reverse, easy to park;

[0110] Advantages and disadvantages: Suitable for parking lots with high mobility, can improve traffic efficiency, but the space utilization rate is low.

[0111] The parking system may extract the parking space type of the target available parking space from the identified parking space information, so as to generate operation guidance information according to the target driving direction of the vehicle and the parking space type of the target available parking space.

[0112] In one embodiment, the operation guidance information includes a plurality of guidance steps; and the voice broadcasting of the operation guidance information may include:

[0113] Voice broadcast the guidance steps of the current sequence; obtain the current parking operation performed by the user according to the guidance steps of the current sequence; determine whether the current parking operation matches the guidance steps of the current sequence; if the current parking operation matches the guidance steps of the current sequence, voice broadcast the guidance steps of the next sequence until the voice broadcast completes the guidance steps of the last sequence.

[0114] The operation guidance information may include a series of guidance steps, and the parking system may play these guidance steps in sequence by voice through the in-vehicle speakers.

[0115] In a specific implementation, the parking system can use the in-car speaker to voice broadcast the current sequence of guidance steps, such as voice broadcasting the first step "After the steering wheel is fully turned to the left, gradually reverse backwards". After the user hears the voice broadcast content, he can control the steering wheel to the left, and then gradually reverse backwards to complete the current parking operation. Since novice drivers may not be proficient and cause inaccurate parking operations, the parking system can obtain the user's current parking operation and then determine whether the current parking operation matches the current sequence of guidance steps. Among them, each guidance step can include at least one of a steering wheel guidance step, a throttle guidance step, and a gear guidance step, and each parking operation can include at least one of a steering wheel operation, a throttle operation, and a gear operation. The parking system can determine whether the user's current steering wheel operation is consistent with the steering wheel guidance step currently broadcasted by voice, and can determine whether the user's current throttle operation is consistent with the throttle guidance step currently broadcasted by voice, and can determine whether the user's current gear operation is consistent with the gear guidance step currently broadcasted by voice. If the user's current steering wheel operation is consistent with the steering wheel guidance steps currently announced by voice, and the user's current throttle operation is consistent with the throttle guidance steps currently announced by voice, and the user's current gear operation is consistent with the gear guidance steps currently announced by voice, then it can be determined that the current parking operation matches the guidance steps of the current sequence, and then the guidance steps of the next sequence (for example, the second step) can be voice announced until the voice announcement completes the guidance steps of the last sequence (for example, the third step); if the user's current steering wheel operation is inconsistent with the steering wheel guidance steps currently announced by voice, and / or, the user's current throttle operation is inconsistent with the throttle guidance steps currently announced by voice, and / or, the user's current gear operation is inconsistent with the gear guidance steps currently announced by voice, then it can be determined that the current parking operation does not match the guidance steps of the current sequence. In order to ensure parking safety, the parking system can identify the current parking operation as a user parking failure. The learning process of parking failure cannot be used as a parking record. The user needs to re-select the target parking space and start again, that is, return to step S220.

[0116] S240, when it is detected that the vehicle gear is switched to the target gear, it is determined that the user has successfully parked the vehicle.

[0117] The user performs the final parking operation according to the guidance steps at the end of the voice broadcast and successfully parks in the target parking space. After that, the user can control the vehicle gear to switch to the target gear, which can be P gear (parking gear). The parking system can determine that the user has successfully parked, and then the parking learning interface can pop up a success prompt message, such as Figure 4E As shown, the success prompt message is "Successfully passed the parking instruction and parked in the parking space."

[0118] S250, displaying the current parking record in an application program interface; the application program interface includes learning progress of different parking space types; the parking space type includes at least one of a perpendicular parking space, a parallel parking space, and a diagonal parking space.

[0119] The embodiment of the present application can realize the turning on and off of the parking learning function for novice drivers through the interactive operation of the vehicle-computer interface, and can also record the learning progress and related information of the function through the APP (Application) interface.

[0120] As an example, users can install the Xiaopeng Motors APP on the vehicle's central control screen. The parking system can display the current parking records on the APP interface of the central control screen, so that the current parking records can be viewed on the central control screen by logging into the APP interface.

[0121] As another example, a user may install the Xiaopeng Motors APP on a mobile terminal. The types of mobile terminals may include mobile phones, notebooks, tablets, smart watches, etc. The parking system may upload the current parking record and display it on the APP interface of the user's mobile terminal. In this way, the user may view the current parking record on the mobile terminal by logging into the APP interface. Figure 5A The user can trigger the "Novice Parking" control in the APP interface to enter the novice parking learning interface and a prompt window will pop up, such as Figure 5B The user can trigger the "Confirm" control to close the prompt window, as shown in Figure 5C In the novice parking learning interface, there is a sharing control in the upper right corner. If the user wants to share a poster of the current novice parking learning interface, he can complete the sharing steps by clicking the sharing control in the upper right corner and then selecting the sharing channel.

[0122] The first area of ​​the novice parking learning interface is used to display the user's learning progress, the second area is used to display the user's parking record (i.e., parking record), and the third area is used to display parking learning video tutorials. Among them, the user's learning progress can include the learning progress of different parking space types, such as Figure 5CAs shown, the user's learning progress may include the learning progress of perpendicular parking spaces, the learning progress of parallel parking spaces, and the learning progress of diagonal parking spaces, wherein the learning progress of perpendicular parking spaces is "parked 5 / 10", indicating that the parking learning task of perpendicular parking spaces is set to 10 times, and the current user has successfully completed 5 parkings in perpendicular parking spaces; the learning progress of parallel parking spaces is "parked 3 / 10", indicating that the parking learning task of parallel parking spaces is set to 10 times, and the current user has successfully completed 3 parkings in parallel parking spaces; the learning progress of diagonal parking spaces is "parked 8 / 10", indicating that the parking learning task of diagonal parking spaces is set to 10 times, and the current user has successfully completed 8 parkings in diagonal parking spaces.

[0123] It should be noted that the number of parking learning tasks for each parking space type can be set according to actual conditions. As an example, different parking space types correspond to different degrees of parking difficulty, for example: the parking difficulty of parallel parking spaces> the parking difficulty of diagonal parking spaces> the parking difficulty of vertical parking spaces, then the parking learning task for parallel parking spaces can be set to 20 times, the parking learning task for diagonal parking spaces can be set to 15 times, and the parking learning task for vertical parking spaces can be set to 10 times. As another example, considering that in the actual parking process, completing 10 times for different parking space types can actually allow novice drivers to master different parking skills to a certain extent, and setting too many parking learning tasks can easily result in excessive learning costs or usage costs, so the embodiment of the present application preferably sets the parking learning task for each parking space type to 10 times.

[0124] S260: Update the learning progress corresponding to the parking space type of the target parking space.

[0125] The embodiment of the present application can update the learning progress of each parking space type at regular intervals. For example, after the user successfully parks in the target available parking space, the learning progress corresponding to the parking space type of the target available parking space can be updated. For example, assuming that the parking space type of the target available parking space is a vertical parking space, the learning progress of the vertical parking space can be increased by one, and the updated learning progress of the vertical parking space is "parked 6 / 10".

[0126] In one embodiment, the application program interface further includes instructional videos of different parking space types; the method may further include:

[0127] Based on the parking space type of the target available parking space, the corresponding teaching video is recommended to the user and played; or, based on the learning progress of various parking space types, a teaching video with a relatively slow learning progress is recommended to the user and played; or, in response to a second selection operation on any teaching video, the teaching video targeted by the second selection operation is played to the user.

[0128] In one application, in order to consolidate the user's autonomous parking skills, after the user successfully parks in the target available parking space and logs into the APP interface, the embodiment of the present application can recommend to the user a teaching video corresponding to the parking space type of the target available parking space and play it in the APP station. For example, assuming that the parking space type of the target available parking space is a vertical parking space, the embodiment of the present application can recommend to the user a teaching video of a vertical parking space and play it in the APP station.

[0129] In another application, in order to make up for the user's shortcomings in certain autonomous parking skills, the embodiment of the present application can recommend a teaching video with a relatively slow learning progress to the user based on the learning progress of each parking space type after the user logs into the APP interface, and play it in the APP station. Figure 5C As shown, the learning progress of the perpendicular parking space is "parked 5 / 10", the learning progress of the parallel parking space is "parked 3 / 10", and the learning progress of the diagonal parking space is "parked 8 / 10". It can be seen that the learning progress of the parallel parking space is slower than that of the perpendicular parking space and the diagonal parking space. In order to make up for the user's shortcomings in the autonomous parking skills of the parallel parking space, the embodiment of the present application can recommend a teaching video of the parallel parking space to the user and play it on the APP station.

[0130] In another application, after logging into the APP interface, the user can select any type of parking space teaching video, so that the APP interface responds to the second selection operation on the teaching video and plays the teaching video selected by the user. Figure 5C As shown in Figure 1, the user can trigger the parking learning video teaching area and enter the parking learning video teaching interface. Figure 5D As shown, the parking learning video teaching interface includes teaching videos of different parking space types. Assuming that the user wants to watch the teaching video of the diagonal parking space, the user can select the teaching video of the diagonal parking space, so that the APP interface responds to the second selection operation of the teaching video of the diagonal parking space and plays the teaching video of the diagonal parking space to the user.

[0131] In one embodiment, the method may further include:

[0132] Monitor whether the learning progress of various parking space types has reached the corresponding learning number threshold; when the learning progress of various parking space types has reached the corresponding learning number threshold, generate a completion prompt message for the parking learning task, and display the completion prompt message in the application interface.

[0133] The learning number threshold corresponding to each parking space type can be set based on the number of its parking learning tasks, such as Figure 5CAs shown, the learning number threshold for vertical parking spaces is 10 times, the learning number threshold for parallel parking spaces is 10 times, and the learning number threshold for diagonal parking spaces is 10 times. The embodiment of the present application can monitor whether the learning progress of each parking space type has reached the corresponding learning number threshold. When it is monitored that the learning progress of each parking space type has reached the corresponding learning number threshold, it means that the user has successfully completed the parking learning tasks for all parking space types. Therefore, a completion prompt message of the parking learning task can be generated, and the completion prompt message can be displayed in the APP interface, such as Figure 5E As shown, the completion prompt message is "Congratulations, you have successfully completed the novice driver parking learning, mastered the parking skills, and completed the transformation."

[0134] It can be seen from this example that the solution provided by this application conducts in-car parking teaching through interface guidance and voice guidance, so that users can complete the parking learning process independently without relying on others. Combined with actual parking scenarios, it can allow users to learn and master autonomous parking skills in a more standardized, intuitive and efficient manner, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in autonomous parking scenarios, and thus improving the user's autonomous parking experience.

[0135] Furthermore, the solution provided in this application enables novice drivers to turn on and off the parking learning function through interactive operations on the vehicle-computer interface, and records the learning progress, parking records and teaching videos of different parking space types through the APP interface, thereby further enhancing the user's autonomous parking experience.

[0136] Corresponding to the aforementioned application function implementation method embodiment, the present application also provides a parking guidance device, a vehicle, a computer-readable storage medium and corresponding embodiments.

[0137] Figure 6 It is a schematic diagram of the structure of a parking guidance device shown in an embodiment of the present application.

[0138] See also Figure 6 The present application provides a parking guidance device, which may include:

[0139] A parking learning interface entry module 610, for entering a parking learning interface in response to a trigger operation on a parking learning entry, and displaying the identified multiple parking spaces in the parking learning interface;

[0140] The interface guidance module 620 is used to generate a corresponding parking route in response to a first selection operation for a target available parking space, and display the parking route in the parking learning interface; wherein the target available parking space is any one of the multiple available parking spaces;

[0141] The voice guidance module 630 is used to generate operation guidance information according to the parking route and to voice broadcast the operation guidance information. The operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

[0142] In one embodiment, the voice guidance module 630 may include:

[0143] A target driving direction determination submodule is used to determine the target driving direction of the vehicle according to the parking route;

[0144] A parking space type identification submodule, used to identify the parking space type of the target parking space;

[0145] The operation guidance information generation submodule is used to generate operation guidance information according to the target driving direction and parking space type.

[0146] In one embodiment, the operation guidance information includes multiple guidance steps; the voice guidance module 630 may also include:

[0147] The first voice broadcast submodule is used to voice broadcast the guidance steps of the current sequence;

[0148] A current parking operation acquisition submodule is used to acquire the current parking operation performed by the user according to the guidance steps in the current sequence;

[0149] A matching degree judgment submodule is used to judge whether the current parking operation matches the guidance steps of the current sequence;

[0150] The second voice broadcast submodule is used to voice broadcast the guidance steps of the next sequence if the current parking operation matches the guidance steps of the current sequence, until the voice broadcast completes the guidance steps of the last sequence.

[0151] In one implementation, the interface guidance module 620 may include:

[0152] a perception information acquisition submodule, configured to acquire vehicle position information, parking space position information of the target parking space, and obstacle information in response to a first selection operation on the target parking space;

[0153] The parking route generation submodule is used to generate a corresponding parking route based on the vehicle position information, the parking space position information and the obstacle information.

[0154] In one embodiment, the device may further include:

[0155] A parking success determination module is used to determine that the user has successfully parked when detecting that the vehicle gear is switched to the target gear;

[0156] A parking record upload module, used to display the current parking record in an application program interface; the application program interface includes a learning progress of different parking space types; the parking space type includes at least one of a perpendicular parking space, a parallel parking space, and a diagonal parking space;

[0157] The learning progress corresponding to the parking space type of the target available parking space is updated.

[0158] In one embodiment, the application program interface further includes instructional videos of different parking space types; the device may further include:

[0159] A first playback module is used to recommend and play a corresponding teaching video to the user based on the parking space type of the target parking space; or

[0160] The second playback module is used to recommend and play a teaching video with a relatively slow learning progress to the user based on the learning progress of various parking space types; or

[0161] The third playing module is used to respond to the second selection operation on any teaching video and play the teaching video targeted by the second selection operation to the user.

[0162] In one embodiment, the device may further include:

[0163] A learning progress monitoring module, used to monitor whether the learning progress of various parking space types has reached the corresponding learning number threshold;

[0164] The parking learning task completion prompt module is used to generate a parking learning task completion prompt message when the learning progress of various parking space types reaches the corresponding learning number threshold, and display the completion prompt message in the application interface.

[0165] As can be seen from this example, the solution provided by this application, in response to the trigger operation for the parking learning entrance, enters the parking learning interface, and displays the identified multiple parking spaces in the parking learning interface; in response to the first selection operation for the target parking space, generates a corresponding parking route, and displays the parking route in the parking learning interface; wherein the target parking space is any one of the multiple parking spaces; generates operation guidance information according to the parking route, and voice broadcasts the operation guidance information, and the operation guidance information is used to guide the user to perform the corresponding parking operation during the parking process. This application conducts in-car parking teaching through interface guidance and voice guidance, so that users can complete the parking learning process alone without relying on others, and combined with actual parking scenarios, it can allow users to learn and master autonomous parking skills in a more standardized, intuitive and efficient manner, thereby improving the user's autonomous parking ability and safety, reducing the user's scratch accident rate in autonomous parking scenarios, and thus improving the user's autonomous parking experience.

[0166] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated again here.

[0167] Figure 7 It is a schematic diagram of the structure of a vehicle shown in an embodiment of the present application.

[0168] See also Figure 7 , the vehicle 700 includes a memory 710 and a processor 720 .

[0169] The processor 720 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0170] The memory 710 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage. Among them, ROM may store static data or instructions required by the processor 720 or other modules of the computer. The permanent storage may be a readable and writable storage device. The permanent storage may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at run time. In addition, the memory 710 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (such as DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 710 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.

[0171] The memory 710 stores executable codes, and when the executable codes are processed by the processor 720 , the processor 720 can execute part or all of the methods described above.

[0172] In addition, the method according to the present application may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing some or all of the steps in the above method of the present application.

[0173] Alternatively, the present application can also be implemented as a computer-readable storage medium (or non-temporary machine-readable storage medium or machine-readable storage medium) on which executable code (or computer program or computer instruction code) is stored. When the executable code (or computer program or computer instruction code) is executed by the vehicle's processor, the processor executes part or all of the steps of the above-mentioned method according to the present application.

[0174] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A parking guidance method, characterized in that: include: In response to a trigger operation on a parking learning entry, entering a parking learning interface, and displaying the identified plurality of available parking spaces in the parking learning interface; In response to a first selection operation for a target available parking space, a corresponding parking route is generated, and the parking route is displayed in the parking learning interface; wherein the target available parking space is any one of the plurality of available parking spaces; Operation guidance information is generated according to the parking route and the operation guidance information is announced by voice, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

2. The method according to claim 1, characterized in that: The generating operation guidance information according to the parking route includes: determining a target driving direction of the vehicle according to the parking route; Identifying the parking space type of the target parking space; Operation guidance information is generated according to the target driving direction and the parking space type.

3. The method according to claim 1, characterized in that The operation guidance information includes a plurality of guidance steps; the voice broadcasting of the operation guidance information includes: Voice broadcast of the guidance steps of the current sequence; Acquire a current parking operation performed by the user according to the guidance steps in the current sequence; Determining whether the current parking operation matches the guidance steps of the current sequence; If the current parking operation matches the guidance steps of the current sequence, the guidance steps of the next sequence are voice broadcasted until the voice broadcast completes the guidance steps of the last sequence.

4. The method according to claim 1, characterized in that: The generating of a corresponding parking route in response to the first selection operation for the target parking space includes: In response to a first selection operation for a target parking space, obtaining vehicle position information, parking space position information of the target parking space, and obstacle information; A corresponding parking route is generated based on the vehicle position information, the parking space position information and the obstacle information.

5. The method according to claim 1, characterized in that The method further comprises: When it is detected that the vehicle gear is switched to the target gear, it is determined that the user has successfully parked; Displaying the current parking record in an application interface; the application interface includes a learning progress of different parking space types; the parking space type includes at least one of a perpendicular parking space, a parallel parking space, and a diagonal parking space; The learning progress corresponding to the parking space type of the target parking space is updated.

6. The method according to claim 5, characterized in that The application program interface also includes instructional videos of different parking space types; the method further includes: Based on the parking space type of the target available parking space, recommend a corresponding teaching video to the user and play it; or, Based on the learning progress of the various parking space types, recommending and playing a teaching video with a relatively slow learning progress to the user; or, In response to a second selection operation on any of the teaching videos, the teaching video targeted by the second selection operation is played to the user.

7. The method according to claim 5, characterized in that The method further comprises: Monitoring whether the learning progress of each parking space type reaches the corresponding learning number threshold; When the learning progress of each of the parking space types reaches the corresponding learning times threshold, completion prompt information of the parking learning task is generated, and the completion prompt information is displayed in the application interface.

8. A parking guidance device, characterized in that: include: a parking learning interface entry module, for entering the parking learning interface in response to a trigger operation on the parking learning entry, and displaying the identified multiple parking spaces in the parking learning interface; an interface guidance module, configured to generate a corresponding parking route in response to a first selection operation for a target available parking space, and display the parking route in the parking learning interface; wherein the target available parking space is any one of the plurality of available parking spaces; The voice guidance module is used to generate operation guidance information according to the parking route and to voice broadcast the operation guidance information, wherein the operation guidance information is used to guide the user to perform corresponding parking operations during the parking process.

9. A vehicle, characterized in that: include: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having executable codes stored thereon, which, when executed by a processor of a vehicle, causes the processor to execute the method according to any one of claims 1 to 7.

Images