Parking map generation method, parking method, electronic equipment and vehicle
By generating a parking map and judging the vehicle location using electronic fences, the problem that existing automatic parking systems cannot be reused is solved, and automatic parking reuse without parking lines and obstacles is realized, improving user experience and efficiency.
Patent Information
- Application Number
- CN202411259635.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-22
AI Technical Summary
In the scenario where there is no parking line or obstacle, the existing automatic parking system cannot achieve reusable temporary parking spaces, resulting in poor user experience and the inability to automatically identify and reuse custom parking spaces.
By obtaining the vehicle's surrounding environment information, generating a parking map, adding parking spaces to the local map, storing the parking map to realize automatic parking of the vehicle, using electronic fences to determine whether the vehicle enters the parking map area, and ensuring that the vehicle can automatically identify it. And reuse parking spaces.
Automatic parking reuse without parking space lines and obstacles is realized, improving the efficiency and user experience of automatic parking, and avoiding the need to re-customize the parking space every time you park.
Smart Images

Figure CN118991746A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to technical fields such as autonomous driving, and more particularly to a parking map generation method, a parking method, an electronic device, a vehicle, a readable storage medium, and a computer program product. Background Art
[0002] The automatic parking function has become one of the most widely used functions of autonomous driving technology due to its simple scenarios. It solves the problem of users' difficulty in parking to a large extent.
[0003] In the prior art, the condition for the automatic parking function to be activated is that the parking system can search for available parking spaces. Available parking spaces are mainly divided into space parking spaces detected by ultrasonic systems and line parking spaces detected by visual systems.
[0004] The ultrasonic system infers the parking space based on the obstacles in the environment, and the visual system identifies the parking space based on the parking space lines. When the obstacles in the environment do not meet the conditions for constructing a parking space, the ultrasonic system cannot identify the parking space. When there are no parking space lines on the ground, the visual system cannot identify the parking space.
[0005] Therefore, in the scenario where there are no parking space lines and obstacles cannot construct a space parking space, an existing parking system can customize temporary parking spaces. Such parking spaces are temporary and only support single parking. The next time you want to continue parking at this location, you need to customize the parking space again, which is inconvenient to operate and has a poor user experience. Summary of the invention
[0006] In order to solve one of the above technical problems, the present disclosure provides a parking map generation method, a parking method, an electronic device, a vehicle, a readable storage medium and a computer program product.
[0007] According to one aspect of the present disclosure, a parking map generation method is provided, comprising: In response to the map generation instruction, obtaining environmental information of the surrounding environment of the vehicle; generating a local map based on the environmental information; Adding a first parking space to the local map to generate a parking map, wherein the first parking space is generated according to a current position of the vehicle or according to a user selection; The parking map is stored, and the parking map is used for realizing automatic parking of the vehicle after the vehicle enters an area of the parking map.
[0008] According to at least one embodiment of the present disclosure, after responding to the map generation instruction, the method further includes: Obtaining positioning information of the vehicle; Coordinate information is added to the boundary of the local map according to the positioning information to obtain the local map with an electronic fence, and the electronic fence is used to determine whether the vehicle enters the area of the parking map.
[0009] According to at least one embodiment of the present disclosure, after storing the parking map, the method includes: A second parking space is added to the parking map, and a parking map including the first parking space and the second parking space is stored, wherein the second parking space is generated according to the current position of the vehicle or according to user selection.
[0010] According to at least one embodiment of the present disclosure, the first parking space is provided with front orientation information of the vehicle, and the front orientation information is used to adjust the front orientation of the vehicle according to the front orientation information when the vehicle is automatically parked.
[0011] According to at least one embodiment of the present disclosure, after responding to the map generation instruction, the method further includes: The parking map has a mapping path, where the mapping path is a path for the vehicle to be parked from a mapping starting point to the first parking space, wherein the mapping starting point is a position of the vehicle when the map generation instruction is received.
[0012] According to at least one embodiment of the present disclosure, a process of adding a first parking space to the local map according to a user selection to generate a parking map includes: According to the first instruction, a parking space frame is generated at a first position in the local map, wherein the parking space frame is used to allow a user to select a position of the first parking space in the local map, and the first position is a position of an obstacle-free area in the local map; According to a second instruction, the parking space frame at a second position in the local map is added to the local map as the first parking space, wherein the second position is selected by the second instruction at a position of an obstacle-free area in the local map.
[0013] According to another aspect of the present disclosure, there is provided a parking method, comprising: According to the current environment information of the vehicle, matching the current environment information with the parking map generated by the parking map generation method as described above, and determining the current position of the vehicle in the parking map; In response to a parking instruction, the vehicle is controlled to park at the first parking space or the second parking space corresponding to the parking instruction and stored in the parking map according to the current position of the vehicle and the parking map.
[0014] According to at least one embodiment of the present disclosure, before determining the current position of the vehicle in the parking map, the method further includes: Determining whether the vehicle enters an area of the parking map according to the current positioning information of the vehicle and the electronic fence stored in the parking map; If the vehicle enters an area of the parking map, the parking map is displayed so that the user can input the parking instruction.
[0015] According to at least one embodiment of the present disclosure, a process of controlling the vehicle to park at a first parking space corresponding to the parking instruction stored in the parking map according to the current position and current environment information of the vehicle and the parking map includes: According to the current position of the vehicle and the parking map, the vehicle is controlled to park at the first parking space corresponding to the parking instruction stored in the parking map based on the mapping path stored in the parking map.
[0016] According to another aspect of the present disclosure, an electronic device is provided, which is applied to a vehicle and includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following process: In response to the map generation instruction, obtaining environmental information of the surrounding environment of the vehicle; generating a local map based on the environmental information; Adding a first parking space to the local map to generate a parking map, wherein the first parking space is generated according to a current position of the vehicle or according to a user selection; storing the parking map, wherein the parking map is used to realize automatic parking of the vehicle after the vehicle enters an area of the parking map; or according to the current environment information of the vehicle, matching the current environment information with the parking map to determine the current position of the vehicle in the parking map; In response to a parking instruction, the vehicle is controlled to park at the first parking space or the second parking space corresponding to the parking instruction and stored in the parking map according to the current position of the vehicle and the parking map.
[0017] According to another aspect of the present disclosure, a vehicle is provided, comprising the aforementioned electronic device.
[0018] According to another aspect of the present disclosure, a readable storage medium is provided, wherein a computer program is stored in the readable storage medium, and when the computer program is executed by a processor, the computer program is used to implement the parking map generating method and / or parking method of any embodiment of the present disclosure.
[0019] According to another aspect of the present disclosure, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the computer program is used to implement at least the parking map generating method and / or the parking method of any one embodiment of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.
[0021] Figure 1 The figure is a flow chart of a parking map generation method according to an embodiment of the present disclosure.
[0022] Figure 2 It is a schematic diagram of a parking map according to an embodiment of the present disclosure.
[0023] Figure 3 is another schematic diagram of a parking map according to an embodiment of the present disclosure.
[0024] Figure 4 is another schematic diagram of a parking map according to an embodiment of the present disclosure.
[0025] Figure 5 It is a flowchart of another parking map generation method according to an embodiment of the present disclosure.
[0026] Figure 6 The present invention is a schematic diagram of generating a parking space frame position in a parking map according to an embodiment of the present disclosure.
[0027] Figure 7 This is another schematic diagram of generating a parking space frame position in a parking map according to an embodiment of the present disclosure.
[0028] Figure 8 It is a flowchart of a parking method according to an embodiment of the present disclosure.
[0029] Fig. 9 It is a schematic diagram of position matching in a parking map according to an embodiment of the present disclosure.
[0030] Fig.10 is a schematic diagram of a valet parking mode according to an embodiment of the present disclosure.
[0031] Fig.11 It is a flowchart of another parking method according to an embodiment of the present disclosure.
[0032] Fig.12 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0033] The present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is understood that the specific examples described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.
[0034] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0035] In actual application scenarios, many parking areas do not have planned parking space lines, and the surrounding close obstacles, such as walls or green belts, cannot enclose a parking space. For example, the vacant land in old communities, front yards of private homes, or villa areas are relatively open and have no parking space lines. In this case, the existing ultrasonic system detection and visual system detection lose their effectiveness. Even for some self-built garages with larger areas, such as a self-built garage with two parking spaces, although the garage is surrounded by walls on three sides, due to its large area, there is no way to directly use ultrasonic system detection and visual system detection to directly define a standard parking space based on the surrounding walls. It is impossible to define a small area as a parking space from a large space. The only way is to use a custom parking space method to determine the parking space, thereby realizing automatic parking. However, the custom parking space generated in the prior art is a temporary parking space that only supports single parking and cannot be reused. The next time you want to continue parking at that location, you need to customize the parking space again, which is inconvenient to operate and has a poor user experience.
[0036] In order to realize the reuse of customized parking spaces, the vehicle needs to be able to recognize the virtual parking space the next time it comes near the parking space. Since the virtual parking space such as the customized parking space does not exist in the real space, it is necessary to generate a parking map that stores the parking space. In this way, when the vehicle comes to the parking space again, it can find the parking space according to the records on the parking map, thereby realizing automatic parking.
[0037] Figure 1 FIG. 2 is a schematic diagram showing the overall process of a parking map generation method M100 according to an embodiment of the present disclosure. Figure 1 The method shown includes steps S110 to S140. The method can be executed by an electronic device such as a vehicle system.
[0038] S110 . In response to a map generation instruction, obtain environmental information of the vehicle's surrounding environment.
[0039] It is understandable that the selection of the parking space is decided by the user. Therefore, only after receiving the map generation instruction input by the user through an input device such as the touch screen of the vehicle system, will it respond to the map generation instruction and obtain environmental information of the vehicle's surrounding environment to generate a map.
[0040] In order to avoid accidents such as collisions, automatic parking requires precise positioning, and the space that requires a customized parking space is usually not accurately located in common electronic maps. Parking spaces are also prone to change, and existing electronic maps cannot guarantee timeliness. Therefore, it is necessary to obtain environmental information about the vehicle's surroundings to re-establish the parking map instead of using existing electronic maps.
[0041] The environmental information around the vehicle can be obtained through the sensors installed on the vehicle. For example, by using the camera and laser radar installed on the vehicle, the image information of the surrounding environment can be obtained through the camera using image recognition technology, and the environmental information existing in the surrounding environment can be analyzed, such as Figure 2 As shown in the figure, for example, walls, curbs, houses, charging piles and vegetation, the distance and accurate relative position between each scene can be determined by lidar. The surveying basis of position and distance takes the vehicle's current position as the origin.
[0042] In some situations, such as Figure 2 As shown, after responding to the map generation instruction, if the vehicle is far away from the area that the user wants to use as a parking space, the user needs to drive the vehicle to continue moving forward. At this time, the environmental information of the vehicle's surrounding environment is not statically acquired, but dynamically acquired. As the vehicle moves, the entire scene on the vehicle's driving route can be gradually acquired for subsequent map generation. Figure 3 As shown, in response to the map generation instruction, if the vehicle is in the parking space expected by the user, the environmental information around the vehicle at this time can be statically obtained, thereby obtaining the environmental information of a small area near the parking space.
[0043] It should be noted that in order to improve the accuracy of subsequent automatic parking, it is preferred to obtain environmental information that meets the preset range requirements to avoid the inability to locate the vehicle during automatic parking due to too few features in the environmental information, resulting in the inability to achieve automatic parking. For example, it is best to obtain environmental information within a range of 30m around the parking space as the center to ensure the reliability of automatic parking.
[0044] The automatic parking mode can be divided into valet parking mode and normal automatic parking mode. In valet parking mode, the vehicle can park automatically at a location far away from the parking space, while in normal automatic parking mode, the vehicle needs to be near the parking space, that is, the parking space needs to be in a position that can be detected by the vehicle's sensors, such as within the camera's field of view. Therefore, for the two valet modes, the scope of environmental information required to be obtained is different, such as Figure 2 As shown, the valet parking mode needs to obtain a larger range of environmental information when generating the map. After receiving the map generation instruction, the driver needs to obtain all the environmental information of the surrounding environment between the parking spaces that are desired to be the starting point and the end point of the valet parking mode, and it is best to increase the range based on this, so as to improve the reliability of subsequent parking.
[0045] S120: Generate a local map based on the environmental information.
[0046] The environmental information includes the shapes of various scenes, and the distance information between these scenes is obtained based on the vehicle's sensors to determine the location information of each scene. These environmental information can be stored as semantic features, so as to generate a local map corresponding to the vehicle's surrounding environment using these semantic feature information.
[0047] Compared with existing ordinary electronic navigation maps, such as the daily used Amap and Baidu Maps, local maps are more accurate and preserve richer scene details, such as various scenes such as telephone poles, curbs, charging piles, houses and vegetation. Therefore, when generating parking spaces, the accuracy of the parking space’s position in the map can be ensured, which can meet the requirements of automatic parking for position accuracy.
[0048] The environmental information obtained when the vehicle is always static may not include the ground information of the vehicle's location, but the ground information of the vehicle's location can be inferred based on the environmental information that has been obtained. For example, based on the inclination of the surrounding scenery, it can be inferred whether the ground where the vehicle is located is flat, and based on the road surface of the surrounding environment, it can be inferred what kind of road surface the vehicle is, etc. Therefore, it does not affect the generation of a local map when the environmental information is statically obtained.
[0049] S130: Add the first parking space to the local map to generate a parking map.
[0050] The first parking space is generated according to the current position of the vehicle or according to user selection.
[0051] After the local map is generated, the user can add a customized first parking space on the local map. There are two ways to add the first parking space. One is that the vehicle has already been driven into the envisioned first parking space by the user. At this time, when the user inputs to add the first parking space, the environmental information of the vehicle's surrounding environment is obtained with the vehicle's current position as the origin when generating the local map. Therefore, when generating the local map, the vehicle's position in the local map can be known. At this time, the vehicle's current position is displayed on the local map. The area corresponding to the current position can be directly used as the first parking space, and the first parking space is added to the local map, so that the local map including the first parking space, that is, the parking map, is obtained. See Figure 2 As shown, the first parking space is generated according to the current position of the vehicle after the user drives the vehicle into the first parking space from the starting point of the map. In another way, when adding the first parking space, the user does not park the vehicle in the envisioned first parking space. At this time, the user needs to select an area in the local map as the first parking space. The user can select any area without obstacles and with sufficient space in the local map as the first parking space. The semantic features recorded in the local map can be used to determine whether the area selected by the user has obstacles. If there are no obstacles, the user is allowed to add the selected area as the first parking space to the local map, thereby generating a parking map.
[0052] It should be noted that multiple parking spaces can be added to a local map at one time, and multiple first parking spaces can also be saved in the same parking map, and the generation method of each first parking space can be different, that is, multiple first parking spaces generated in different ways can be saved in the parking map, such as Figure 4 As shown, parking spaces 1 and 2 in the parking map are generated based on the current position of the vehicle, and parking space 3 is generated based on user selection.
[0053] S140: Store the parking map.
[0054] Among them, the parking map is used to realize automatic parking of the vehicle after the vehicle enters the area of the parking map.
[0055] By storing the parking map, the next time the vehicle enters the parking map area, it can use the parking map to achieve automatic parking instead of temporarily generating a custom parking space for automatic parking. By storing the parking map, a parking space can be generated once and reused, improving the efficiency of automatic parking and user experience when there is no parking space.
[0056] Whether the vehicle enters the area of the parking map can be determined by matching the current environment information of the vehicle with the parking map, thereby determining whether the vehicle enters the area corresponding to the parking map.
[0057] In an implementation of the present disclosure, after receiving the map generation instruction in step S110, step S150 and step S160 may also be included.
[0058] S150: Acquire vehicle positioning information.
[0059] The vehicle's positioning information can be obtained through a GPS system installed in the vehicle. The positioning information can be coordinates or longitude and latitude and other information that can be used to indicate the vehicle's location.
[0060] S160: Add coordinate information to the boundary of the local map according to the positioning information to obtain a local map with an electronic fence.
[0061] Among them, the electronic fence is used to determine whether the vehicle enters the area of the parking map.
[0062] Because the environmental information stored in the local map includes the relative positions of the scenes, there is a relative coordinate system and scale. Therefore, the coordinate information of the boundary of the local map can be calculated based on the positioning information of the vehicle and the environmental information in the local map, and the boundary with the coordinate information is stored in the local map as an electronic fence. At the same time, when the local map is used to generate a parking map later, the electronic fence continues to be stored in the parking map, so that the electronic fence can be used to determine whether the vehicle enters the area corresponding to the parking map. Figures 2 to 4 The electric fence shown in .
[0063] It is faster and more convenient to use an electronic fence based on coordinate information to determine whether a vehicle has entered the area of the parking map. By comparing whether the vehicle's current positioning information is within the electronic fence, it is possible to quickly determine whether the vehicle has entered the area of the parking map. There is no need to perform multiple feature matching based on the current environmental information and the parking map to determine whether the vehicle has entered the area of the parking map, which greatly improves the judgment speed.
[0064] The electronic fence can be generated based on the boundary of the local map and continue to serve as the boundary between the parking map and the local map. The range of the electronic fence can also be smaller than the boundary between the local map and the parking map. For example, a circular area with a range of 50m around the center point of the local map or the parking map is marked as the electronic fence. In this case, the electronic fence should be entirely within the boundary of the local map and the parking map, thereby ensuring that entering the electronic fence means entering the area of the parking map.
[0065] In some embodiments of the present disclosure, after obtaining the parking map, the user still needs to continue to add parking spaces to the parking map. To this end, a second parking space is added to the parking map, and a parking map including the first parking space and the second parking space is stored, wherein the first parking space is generated according to the current position of the vehicle or according to the user's selection. Since the parking map has been generated before, when adding a parking space again, the same adding method as adding a parking space in a local map can be used to directly add a new parking space to the parking map. Of course, when adding a new parking space, multiple parking spaces can also be added at one time.
[0066] In other embodiments of the present disclosure, the front or rear of the vehicle may be selected for parking according to the convenience of exiting the parking space. In order to guide the direction of the front of the vehicle during subsequent automatic parking, the first parking space is provided with vehicle front direction information, such as Figure 2 and Figure 4 As shown in , the vehicle head orientation information records the orientation of the vehicle head after the vehicle stops steadily in the corresponding parking space. The vehicle head orientation information is used to adjust the orientation of the vehicle head according to the vehicle head orientation information when the vehicle is automatically parked. The vehicle head orientation information saved in the first parking space can be manually input and set by the user, or the vehicle head orientation information can be automatically generated according to the vehicle head orientation at that time when the first parking space is generated according to the current position of the vehicle. The vehicle head orientation information can be obtained through vehicle-mounted sensors, such as an inertial measurement unit (IMU). According to the vehicle head orientation information, in subsequent automatic parking, the automatic parking system will make the vehicle head orientation of the vehicle parked in the parking space consistent with the vehicle head orientation information recorded in the parking space, so as to facilitate the user to drive the vehicle out of the parking space later. For example, the vehicle head orientation information records that the vehicle head orientation in the parking space should be facing south. Then, after automatic parking, the direction of the vehicle head in the parking space should be facing south, which is consistent with the direction recorded in the vehicle head orientation information. It is understandable that each parking space may store corresponding vehicle head orientation information, and the vehicle head orientation information of each parking space is not necessarily the same.
[0067] In one embodiment of the present disclosure, after receiving a map generation instruction, Figure 2As shown, the parking map also includes a mapping path stored therein, and the mapping path is the path of the vehicle from the mapping starting point to the first parking space, so that the vehicle is automatically parked at the first parking space by using the mapping path as a reference, wherein the mapping starting point is the position of the vehicle when the map generation instruction is received. When the vehicle is far away from the first parking space and receives the map generation instruction, the position of the vehicle when receiving the map generation instruction is used as the mapping starting point, and the driver saves the path from the mapping starting point to the first parking space to obtain a parking map storing the mapping path corresponding to the first parking space. When the vehicle is parked at the first parking space in the valet parking mode, the mapping path can be used as a reference path to generate a simulated driving path, guide the vehicle to park at the first parking space, and improve the automatic parking speed.
[0068] Regarding the process of adding the first parking space to the local map according to the user's selection to generate a parking map in step S130, in some embodiments of the present disclosure, the process may include: Figure 5 The steps S1301 and S1302 shown include: S1301. Receive a parking space generation instruction, and generate a parking space frame at a first position in a local map.
[0069] The parking space frame is used to allow the user to select the position of the first parking space in the local map, and the first position is the position of the barrier-free area in the local map.
[0070] Based on the user's choice, a custom parking space generation method is selected. In this method, the user is required to select an area in the local map as the first parking space. According to the parking space generation instruction input by the user through the vehicle-machine interaction system such as the touch screen, a parking space frame is generated at the first position in the local map. The parking space frame is used to simulate the position and area of the parking space in the local map, so that subsequent users can determine the first parking space according to the position of the parking space frame. At this time, the parking space frame can be dragged to adjust the position and angle in the local map, and the size can also be changed by stretching.
[0071] The first position of the parking space frame generation can be set by default to one side of the vehicle's position in the local map, see Figure 6 As shown, if there are obstacles on both sides of the vehicle that block the generation of the parking space frame, the parking space frame can be generated in an obstacle-free area in the nearest local map.
[0072] S1302: According to the parking space determination instruction at the second position of the parking space frame, add the parking space frame as a first parking space to the local map to generate a parking map.
[0073] The second position is selected by the parking space determination instruction in the barrier-free area in the local map.
[0074] The user selects the second position as the first parking space on the local map and inputs it into the vehicle system in the form of a parking space determination instruction. After receiving the instruction, the vehicle system determines the second position where the parking space box should be located in the local map according to the parking space determination instruction, and adds the parking space box located at the second position in the local map as the first parking space to the local map, generates a parking map, and completes the generation of custom parking spaces and parking maps.
[0075] In one case, after the parking space frame is generated at the first position, the parking space frame may not be moved. The first position may be directly used as the second position according to the second instruction, and the parking space frame at the second position may be used as the first parking space. At this time, the second position is equivalent to the first position. The second instruction input by the user is to confirm that the first position is used as the second position, and the parking space frame at this position is used as the first parking space. At this time, the second instruction does not include a moving instruction.
[0076] In another case, the second instruction may include a move instruction and a confirmation instruction, see Figure 7 As shown, the moving instruction is used to move the parking space frame from the first position to the second position on the local map. The moving method includes dragging the parking space frame to move, or directly generating a parking space frame based on a point with this point as the center, obtaining the parking space frame at the second position, and deleting the parking space frame at the first position. This method corresponds to the process in which the user selects a point on the touch screen and then generates a parking space frame based on this point.
[0077] It can be understood that if the user moves the parking space frame to an obstacle, the parking space frame will not be generated on the obstacle, and the parking space frame at the first position may continue to be retained to ignore the movement, or an unobstructed area may be selected near the obstacle to generate a parking space frame at the second position; based on the movement instruction in the second instruction, it can be determined whether the target area corresponding to the movement instruction includes an obstacle. If the target area includes an obstacle, the movement instruction is ignored to retain the parking space frame at the first position, or if the target area includes an obstacle, the parking space frame at the second position is generated in the unobstructed area closest to the center point of the target area.
[0078] In actual application, the size of the parking space frame can be adjusted, and draggable points can be set around the parking space frame. By receiving the size adjustment instruction, the size of the parking space frame is adjusted to the target size corresponding to the size adjustment instruction. The user can adjust the size of the parking space frame by dragging these points. However, according to the current size of the vehicle, the vehicle system will limit the minimum size of the parking space frame. For example, the size of the vehicle is 4.8m long and 1.6m wide. Considering redundancy, the user will be restricted to adjust the size of the parking space frame to not less than 5.4m long and 2m wide to prevent the parking space frame from being too small and making the vehicle unable to park.
[0079] In addition, in order to ensure the accuracy of the first parking space, the first position and the second position can be limited to the perception range of the vehicle sensor. For example, the first position and the second position are within the perception range of the vehicle's visual sensor. When selecting the first parking space, it can be divided into two layers. The bottom layer is the local map, and the surface layer is the real scene picture transmitted by the visual sensor. The parking space frame is generated in the local map and displayed in the real scene picture on the surface layer. From the user's perspective, the position of the first parking space is selected by moving the parking space frame in the real scene picture. The position of the parking space frame is limited to the perception range of the visual sensor. The user can determine the position of the parking space frame according to the real scene to generate the first parking space, instead of generating the first parking space according to the virtual scene in the local map generated by the software. The user can judge whether the position of the parking space frame is appropriate and whether there are obstacles, thereby further improving the reliability of parking space generation.
[0080] Figure 8 FIG. 2 is a schematic diagram showing the overall process of a parking map generation method M200 according to an embodiment of the present disclosure. Figure 8 The method shown includes step S210 and step S220. The method can be executed by an electronic device such as a vehicle system.
[0081] S210 . According to the current environment information of the vehicle, the current environment information is matched with the parking map stored in the aforementioned parking map generation method to determine the current position of the vehicle in the parking map.
[0082] When the user is driving, the vehicle system will automatically obtain the current environmental information around the vehicle, match the current environmental information with the parking map, and automatically determine whether the vehicle has entered the parking map area. When the vehicle enters the parking map area, the vehicle system will match the current environmental information with the parking map saved in the aforementioned parking map generation method based on the vehicle's current environmental information. If the match is successful, the current position of the vehicle in the parking map can be determined, and it is also determined that the vehicle has entered the parking map.
[0083] During the matching process, the parking map records the environmental information, and the relative position between the environmental information in the parking map and the objects in the current environmental information currently collected around the vehicle can be used as features for matching. For example, Fig. 9As shown, the environmental information of the parking map records trees a, tree b and tree c, the relative position interval between tree a and tree b is 5m, and the relative position interval between tree b and tree c is 8m. The current environmental information of the vehicle shows that the vehicle is located between two trees on one side, and the relative position interval between the two trees is 8m. Then, through the current environmental information that the relative position interval between the two trees is 8m, the two trees that meet this interval can be matched in the parking map, namely tree b and tree c, and it can be determined that the vehicle is between one side of tree b and tree c, thereby determining the position of the vehicle in the parking map based on the current environmental information. Of course, in actual scenarios, more data is needed to accurately determine the position of the vehicle in the parking map. This is just an example.
[0084] S220. In response to the parking instruction, control the vehicle to park at a first parking space or a second parking space corresponding to the parking instruction and stored in the parking map according to the current position of the vehicle and the parking map.
[0085] The parking instruction records the first parking space or the second parking space where the vehicle is to be parked. Therefore, the parking space to be parked this time is determined according to the parking instruction, and then the current position of the vehicle in the parking map is determined according to the current environmental information of the vehicle. Based on the current position of the vehicle in the parking map and the position of the first parking space recorded in the parking map and the parking map, a simulated driving path of the vehicle from the current position avoiding obstacles saved in the parking map to the first parking space can be simulated based on the environmental information recorded in the parking map, and the vehicle is controlled to move forward along the simulated driving path, thereby controlling the vehicle to automatically park at the first parking space.
[0086] It can be seen that by utilizing the aforementioned saved parking map including environmental information and parking spaces, when automatically parking in a custom parking space, it is no longer necessary to create a new custom parking space, and the vehicle can be parked directly according to the parking space recorded in the parking map. At the same time, because the parking map records the environmental information around the parking space, after the vehicle enters the parking map, the current position of the vehicle in the parking map can be determined by matching the environmental information, and the vehicle can be automatically parked according to the environmental information recorded in the parking map, thereby improving the parking efficiency in the custom parking space.
[0087] Furthermore, in order to avoid obstacles that may appear temporarily and ensure the safety of automatic parking, the current environmental information of the vehicle's current surrounding environment can be obtained based on the vehicle's current position and the parking map, and the simulated driving path can be corrected at any time according to the current environmental information. For example, see Fig.10As shown, when the vehicle is moving along the simulated driving path, the current environmental information detects that a new ice cream cone has appeared on the simulated driving path. At this time, it is necessary to correct the simulated driving path according to the current environmental information and enter the obstacle avoidance path temporarily generated for obstacle avoidance, avoid the new ice cream cone, and then continue to control the vehicle forward according to the simulated path based on the parking map until it enters the first parking space and completes automatic parking.
[0088] It is understandable that since multiple parking spaces can be saved in the parking map, the parking space where the vehicle is to be parked needs to be clearly stated in the parking instruction. The user can select the parking space to be parked through the vehicle-machine interaction system. For example, through the touch screen, select a parking space from the three parking spaces in the parking map as the first parking space for this parking.
[0089] Multiple parking maps can be saved in a car system, and each parking map corresponds to a different area. For example, a residence needs a corresponding parking map, and a unit needs a corresponding parking map. Of course, multiple parking spaces can be saved in each parking map. The car system will automatically match the vehicle's current environmental information with each parking map, automatically determine which parking map area the vehicle enters, determine the parking map corresponding to the current environmental information, and at the same time determine the vehicle's current position in the parking map.
[0090] Fig.11 FIG. 2 is a schematic diagram showing the overall process of a parking map generation method M300 according to an embodiment of the present disclosure. Fig.11 The method shown includes steps S310 to S340. The method can be executed by an electronic device such as a vehicle system.
[0091] S310: Determine whether the vehicle enters an area of the parking map based on the current positioning information of the vehicle and the electronic fence stored in the parking map.
[0092] After the electronic fence of the aforementioned embodiment is saved in the parking map, the vehicle system can automatically detect whether the vehicle enters the parking map based on the electronic fence stored in the parking map and the current positioning information of the vehicle. For example, it can detect every 5 seconds whether the current positioning information of the vehicle is within the electronic fence of the parking map, thereby ensuring that the vehicle system can respond quickly when the vehicle enters the parking map.
[0093] S320: If the vehicle enters an area of the parking map, the parking map is displayed so that the user can input a parking instruction.
[0094] When it is detected that the vehicle has entered the parking map, the parking map will be automatically displayed and the parking map will be used as the input interface for parking instructions. The user can determine the parking space to be parked this time by clicking on the parking space in the parking map, so as to enter the automatic parking mode. Based on the electronic fence in the parking map, it can quickly determine whether the vehicle has entered the parking map without using environmental information to determine whether it has entered the parking map. The judgment efficiency is higher and the user experience is better.
[0095] S330, matching the current environment information with the parking map generated in the aforementioned parking map generation method according to the current environment information of the vehicle, and determining the current position of the vehicle in the parking map; S340: In response to the parking instruction, control the vehicle to park at a first parking space corresponding to the parking instruction and stored in the parking map according to the current position and current environment information of the vehicle and the parking map.
[0096] The implementation of step S330 and step S340 is consistent with that of steps S210 and S220 in the aforementioned embodiment, and will not be described in detail here.
[0097] In some embodiments of the present disclosure, the process of step S220 may specifically be to control the vehicle to park at the first parking space corresponding to the parking instruction stored in the parking map based on the current position of the vehicle and the parking map and the mapping path stored in the parking map. In the case where the mapping path of the vehicle previously parked from the mapping starting point to the first parking space is stored in the parking map, when automatic parking is performed in the valet parking model, the mapping path in the parking map may be referred to to generate a simulated driving path required for valet parking in the parking map, so as to realize valet parking and improve the efficiency of valet parking.
[0098] The parking map in this embodiment includes the semantic features of the environment, the longitude and latitude of the geographical location, the customized parking space information, etc. When the vehicle generates the map, it needs to rely on the vehicle's sensors, such as GPS (Global Positioning System), IMU (Inertial Measurement Unit), camera, laser radar and other sensors.
[0099] The user triggers the local map generation function through the vehicle system, that is, inputs the map generation command through the vehicle system (or other interactive devices can trigger the map generation function, such as mobile phones, etc.). When the vehicle map generation function is turned on, the longitude and latitude of the vehicle will be obtained as the global positioning of the new map, so that the local map and the electronic fence of the parking map can be generated according to the longitude and latitude of the vehicle. During the map generation process, the sensors installed in the vehicle will identify the semantic features in the surrounding environment, such as walls, curbs, etc., and add this information to the local map.
[0100] When generating a map, users can add custom parking spaces in two ways. The first way is to use the current location of the vehicle as a custom parking space, and the system will generate a parking space based on the current location and direction of the vehicle. The second way is to use the interactive system on the vehicle to drag a custom parking space into the current field of view of the vehicle. For the dragged parking space, the system will determine whether the parking space is reasonable. For unreasonable parking spaces, the system will prompt that the custom parking space failed. For example, if the dragged custom parking space is on the wall, it is considered an unreasonable parking space. The field of view of the vehicle refers to the range currently perceived by the vehicle's visual system, such as the range of 10m in front, behind, left and right of the vehicle body. This field of view can be calibrated.
[0101] The user triggers the generation of the parking map through the vehicle computer system (or other interactive devices trigger the map generation function, such as mobile phones, etc.). The system will save the parking map in the storage module related to the vehicle.
[0102] For example, Figure 2 As shown in the figure, the position of the vehicle is used as the first parking space at the end of the map. The path contains semantic features, houses, walls, and charging piles. The map construction path can be used as an element in the local map, or it can be used as an element of the local map. The electronic fence is determined by the global positioning of the map after the global positioning of the map is determined based on the positioning information of the vehicle. The shape of the electronic fence can be rectangular, circular, or other shapes. The range of the electronic fence can be a calibration value, such as a range of 50m around the local map. It can also be the boundary of the map. Figure 2 Parking space No. 1 in the figure is a custom parking space generated based on the position of the vehicle.
[0103] For example, Figure 4 As shown, parking spaces 1 and 2 are generated based on the positions of the vehicles, and parking space 3 is a custom parking space generated through dragging interaction of the vehicle computer.
[0104] During the parking process, local maps are used for parking. There are two automatic parking modes, one is the normal automatic parking mode, and the other is the valet parking mode.
[0105] Ordinary automatic parking modes may include parallel parking, perpendicular parking, and diagonal parking, which require the vehicle to be located near a parking space. In this mode, when the vehicle enters the electronic fence, the system will match the relative relationship between the vehicle and the parking map in real time. When the vehicle arrives near a custom parking space in the parking map, the custom parking space in the parking map will be displayed on the vehicle computer, which is equivalent to the parking space identified by vision or ultrasound. When the relative relationship between the parking space and the vehicle meets the parking condition, the user can select the custom parking space in the parking map as the target parking space through the vehicle computer, and the system completes the path planning and controls the vehicle to park in the target parking space. The parking condition can be a rule-based one or calculated by path planning.
[0106] In valet parking mode, when the vehicle enters the electronic fence, the system will match the relative relationship between the vehicle's current position and the parking map in real time. When the vehicle's position in the parking map meets the conditions for enabling valet parking, the conditions can be very broad, such as the vehicle being in the parking map. All parking spaces on the parking map will be displayed on the vehicle computer. After the user selects one of the parking spaces as the target parking space through the vehicle computer, the system completes the path planning and controls the vehicle to park in the target parking space.
[0107] The execution subject of the parking map generation method and / or the parking method in the specific implementation manner of the present disclosure may be an electronic device such as a vehicle-mounted computer or a server.
[0108] Therefore, based on any one of the above embodiments, the present disclosure further provides an electronic device, which can execute the parking map generating method and / or parking method of any one of the above embodiments of the present disclosure.
[0109] Fig.12 1 is a schematic block diagram of the structure of an electronic device 1000 according to an embodiment of the present disclosure.
[0110] The hardware structure of the electronic device 1000 can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 1100 connects various circuits including one or more processors 1200, memory 1300 and / or hardware modules together. The bus 1100 can also connect various other circuits 1400 such as peripherals, voltage regulators, power management circuits, external antennas, etc.
[0111] The bus 1100 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the figure only uses one connecting line, but does not mean that there is only one bus or one type of bus.
[0112] The present disclosure also provides a vehicle, the vehicle comprising the electronic device as described above.
[0113] The present disclosure also provides a readable storage medium, in which a computer program is stored, and the computer program is used to implement the above method when executed by a processor. "Readable storage medium" can be any device that can contain, store, communicate, propagate or transmit a program for use in an instruction execution system, device or equipment or in combination with these instruction execution systems, devices or equipment. More specific examples of readable storage media include the following: an electrical connection portion (electronic device) with one or more wirings, a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM), etc.
[0114] The present disclosure also provides a computer program product. The method of the present disclosure can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed, the process or function of the present disclosure is executed in whole or in part.
[0115] A computer program or instruction may be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium, for example, a computer program or instruction may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The readable storage medium may be any available medium that can be accessed or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid state drive. The computer readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.
[0116] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0117] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0118] These computer program instructions may also be stored in a computer readable memory capable of controlling a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0119] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0120] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, or characteristics described may be combined in any one or more embodiments / methods or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and features of different embodiments / methods or examples, unless they are contradictory.
[0121] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0122] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.
Claims
1. A parking map generation method, characterized in that: include: In response to the map generation instruction, obtaining environmental information of the surrounding environment of the vehicle; generating a local map based on the environmental information; Adding a first parking space to the local map to generate a parking map, wherein the first parking space is generated according to a current position of the vehicle or according to a user selection; The parking map is stored, and the parking map is used for realizing automatic parking of the vehicle after the vehicle enters an area of the parking map.
2. The parking map generation method according to claim 1, characterized in that: After responding to the map generation instruction, the method further includes: Obtaining positioning information of the vehicle; Coordinate information is added to the boundary of the local map according to the positioning information to obtain the local map with an electronic fence, and the electronic fence is used to determine whether the vehicle enters the area of the parking map.
3. The parking map generation method according to claim 1, characterized in that: After storing the parking map, the method includes: A second parking space is added to the parking map, and a parking map including the first parking space and the second parking space is stored, wherein the second parking space is generated according to the current position of the vehicle or according to user selection.
4. The parking map generation method according to claim 1, characterized in that: The first parking space is provided with the vehicle's front orientation information, and the vehicle's front orientation information is used to adjust the vehicle's front orientation according to the vehicle's front orientation information when the vehicle is automatically parked.
5. The parking map generation method according to claim 1, characterized in that: After responding to the map generation instruction, the method further includes: The parking map has a mapping path, and the mapping path is a path of the vehicle from a mapping starting point to the first parking space, wherein the mapping starting point is the position of the vehicle when the map generation instruction is received; Optionally, the process of adding the first parking space to the local map according to the user's selection to generate a parking map includes: generating a parking space frame at a first position in the local map according to a first instruction, wherein the parking space frame is used to allow a user to select a position of the first parking space in the local map; According to a second instruction, the parking space frame at a second position in the local map is added to the local map as the first parking space, wherein the second position is selected by the second instruction at a position of an obstacle-free area in the local map.
6. A parking method, characterized in that: include: According to current environment information of the vehicle, matching the current environment information with a parking map generated by the parking map generation method according to any one of claims 1 to 5 to determine a current position of the vehicle in the parking map; In response to a parking instruction, according to a current position of the vehicle and the parking map, controlling the vehicle to park at the first parking space or the second parking space corresponding to the parking instruction stored in the parking map; Optionally, before determining the current position of the vehicle in the parking map, the method further includes: Determining whether the vehicle enters an area of the parking map according to the current positioning information of the vehicle and the electronic fence stored in the parking map; If the vehicle enters an area of the parking map, displaying the parking map so that the user can input the parking instruction; Optionally, the process of controlling the vehicle to park at a first parking space corresponding to the parking instruction stored in the parking map according to the current position and current environment information of the vehicle and the parking map includes: According to the current position of the vehicle and the parking map, the vehicle is controlled to park at the first parking space corresponding to the parking instruction stored in the parking map based on the mapping path stored in the parking map.
7. An electronic device, characterized in that: The electronic device is applied to a vehicle and includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following process: After receiving the map generation instruction, obtaining environmental information of the vehicle's surrounding environment; generating a local map based on the environmental information; Adding a first parking space to the local map to generate a parking map, wherein the first parking space is generated according to a current position of the vehicle or according to a user selection; storing the parking map, wherein the parking map is used to realize automatic parking of the vehicle after the vehicle enters an area of the parking map; or according to the current environment information of the vehicle, matching the current environment information with the parking map to determine the current position of the vehicle in the parking map; In response to a parking instruction, the vehicle is controlled to park at the first parking space or the second parking space corresponding to the parking instruction and stored in the parking map according to the current position of the vehicle and the parking map.
8. A vehicle, characterized in that: The vehicle comprises the electronic device as claimed in claim 7.
9. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, it is used to implement the method according to any one of claims 1 to 6.
10. A computer program product, characterized in that The computer program product comprises a computer program, which is used to implement at least the method according to any one of claims 1 to 6 when executed by a processor.
