Driving guidance method, device, electronic equipment and vehicle for racetrack scene
By using AR technology to project virtual guide lines and operation guidance in track scenes, the problem of professional guidance on driving on the track is solved, driving safety and experience is improved, and driving effect is achieved with ordinary users having racers on the track. .
Patent Information
- Application Number
- CN202211331602.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-27
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2042-10-27
AI Technical Summary
Driving on the track requires training and guidance from professional coaches. There is a lack of a special display area inside the vehicle to guide the driver, which makes it difficult for users without racing experience to have a racer-like driving experience, and driving safety is threatened.
Provide a driving guidance method for track scenes, by determining the vehicle usage scenario as a track scene, determining the driving mode, and constructing data and vehicle control data based on the acquired projection, determining the driving guidance information of virtual display content, and projecting it to AR projection displays virtual images for display.
Through virtual guide lines and operation guidance, users can obtain driving guidance without looking down at the dashboard, reduce driving burden, improve driving safety, and enable users without racing experience to have a racer-like driving experience on the track .
Smart Images

Figure CN115691266B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving technology, and in particular to a driving guidance method, device, electronic equipment and vehicle for a racetrack scene. Background Art
[0002] With the increase in the popularity of sports cars and the number of standard racing tracks and racetracks, and many racetracks currently have regular track open days, people's demand for track driving scenes will gradually increase. However, currently, driving a sports car on a track requires training and guidance from professional coaches to ensure driving experience and driving safety. There is no dedicated display area inside the vehicle to guide the driver to drive in a track scene, and the display on the car dashboard or car screen requires the driver to lower his head to view relevant information. Frequent up and down switching of the focus of the eyes in high-speed driving scenes on the track will bring driving burden to the driver and bring safety hazards, making it difficult for ordinary users without racing experience to have the same driving experience as racing drivers on the track. At the same time, the training and guidance of professional coaches also limits the learning coverage of ordinary people and limits people's driving experience. Summary of the invention
[0003] In view of this, the purpose of the present application is to propose a driving guidance method, device, electronic equipment and vehicle for a racetrack scene, so as to solve the problem that users without driving experience cannot have a racing driving experience.
[0004] Based on the above purpose, the first aspect of the present application provides a driving guidance method for a track scene, comprising:
[0005] In response to the usage scenario of the vehicle being a racetrack scenario, determining a driving mode;
[0006] In response to the driving mode being a track driving mode, determining a target track;
[0007] In response to acquiring the projection construction data, determining virtual display content of the AR projection display virtual image according to the projection construction data;
[0008] determining driving guidance information based on the acquired vehicle control data;
[0009] The virtual display content containing the driving guidance information is projected onto an AR projection display virtual image for display.
[0010] Optionally, determining driving guidance information based on the vehicle control data includes:
[0011] Constructing a coordinate system in a plane parallel to the target track with the center point of the front axle of the vehicle as the origin, the driving direction as the X-axis direction, and the vertical direction of the driving direction as the Y-axis direction, and obtaining historical driving information of the target track;
[0012] Determine a vehicle position of the vehicle on the target track based on the intelligent driving data and the track map information;
[0013] In the coordinate system, the driving guidance information is determined based on the historical driving information, the vehicle position, and the vehicle control data.
[0014] Optionally, the virtual display content includes a virtual guide line, and the driving guidance information includes a guidance direction;
[0015] Determining the driving guidance information in the coordinate system based on the historical driving information, the vehicle position and the vehicle control data includes:
[0016] Obtaining the best driving path in the historical driving information;
[0017] calculating an offset difference between the vehicle position and the optimal driving path in the coordinate system;
[0018] The guiding direction of the virtual guiding line is determined based on the offset difference, and the guiding direction is updated in real time according to the change of the vehicle position.
[0019] Optionally, the determining the driving guidance information based on the historical driving information, the vehicle position and the vehicle control data includes:
[0020] Acquiring optimal control data from the historical driving information;
[0021] determining recommended control information by comparing the vehicle control data with the optimal control data;
[0022] An operation guide for driving the vehicle onto the optimal driving path is determined based on the recommended control information, and the operation guide is updated in real time according to a change in the position of the vehicle.
[0023] Optionally, calculating the offset difference between the vehicle position and the optimal driving path in the coordinate system includes:
[0024] Acquire an optimal driving path in the historical driving information, and calculate a first distance between the optimal driving path and the edge of the track;
[0025] determining a second spacing between the vehicle and the edge of the track based on the vehicle position;
[0026] The offset difference is obtained by calculating the difference between the first distance and the second distance, and the offset difference is updated in real time according to the change of the vehicle position.
[0027] Optionally, performing AR fusion processing on the virtual display elements to obtain virtual display content of an AR projected display virtual image includes:
[0028] The size and angle of the virtual display element are adjusted so that the virtual display element is integrated with the target track to obtain the virtual display content.
[0029] A second aspect of the present application provides a driving guidance device for a racetrack scene, comprising:
[0030] The scene confirmation module is configured to: determine a driving mode in response to the use scene of the vehicle being a track scene;
[0031] A track confirmation module is configured to: determine a target track in response to the driving mode being a track driving mode;
[0032] A display content determination module is configured to: in response to acquiring projection construction data applied to the target track, determine virtual display content of the AR projection display virtual image according to the projection construction data;
[0033] A guidance information determination module is configured to: determine driving guidance information based on the acquired vehicle control data;
[0034] The projection module is configured to project the virtual display content containing the driving guidance information onto an AR projection display virtual image for display.
[0035] The third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method provided in the first aspect of the present application is implemented.
[0036] The fourth aspect of the present application provides a vehicle, including a driving guidance device for a track scene as provided in the second aspect of the present application or an electronic device as provided in the third aspect of the present application.
[0037] From the above, it can be seen that the driving guidance method, device, electronic device and vehicle for the track scene provided by the present application will only provide driving guidance after determining that the use scenario is a track scene, so as to avoid affecting the driving experience of ordinary roads; if the driving mode is a track training mode, the driving methods and operation teaching of professional racing drivers and coaches on different tracks are stored through the cloud platform to form a teaching game scene. Users can download game scenes of different tracks in the cloud through the car system to realize virtual simulation learning on the real car, combined with the guidance of the actual track, and the combination of virtual and real, so that users can adapt to the track scene more quickly; if the driving mode is a track driving mode, it is necessary to first determine the target track, and obtain the vehicle control data, intelligent driving data and the track location of the target track. When the user receives the driving guidance information from the map, the virtual display elements are determined, and then the virtual display elements are AR fused to obtain the virtual display content of the AR projection display virtual image. Finally, the virtual display content containing the driving guidance information is projected onto the AR projection display virtual image for display. In the user's perspective, the virtual display content is attached to the road surface after projection, so that the user does not need to lower his head to see the driving guidance direction and operation guidance ahead, avoiding the driving burden caused by frequent up and down switching of the focus in the high-speed driving scene on the track, thereby improving the safety of driving guidance. By providing users with convenient driving guidance, users can drive safely on the target track more easily, and users without racing experience can have the same driving experience as racing drivers on the track. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0039] Figure 1 This is a flow chart of a driving guidance method for a racetrack scene according to an embodiment of the present application;
[0040] Figure 2 This is a flow chart of performing track scene simulation training in the game scene of an embodiment of the present application;
[0041] Figure 3 It is a schematic diagram of the viewing angle of the embodiment of the present application;
[0042] Figure 4 This is a flow chart of determining a driving guidance signal based on vehicle control data according to an embodiment of the present application;
[0043] Figure 5 A schematic diagram of a racetrack scene in an embodiment of the present application;
[0044] Figure 6A flowchart for determining driving guidance information according to an embodiment of the present application;
[0045] Figure 7 A schematic diagram of a virtual guide line according to an embodiment of the present application;
[0046] Figure 8 A schematic diagram of driving guidance for optimal path into a turn according to an embodiment of the present application;
[0047] Fig. 9 A schematic diagram of an AR projection display virtual image of the best path driving guidance for entering a corner according to an embodiment of the present application;
[0048] Fig.10 Another flowchart for determining driving guidance information according to an embodiment of the present application;
[0049] Fig.11 A schematic diagram of the driving guidance for braking into a corner according to an embodiment of the present application;
[0050] Fig.12 A schematic diagram of an AR projection display virtual image of a driving guide for braking into a corner according to an embodiment of the present application;
[0051] Fig.13 This is a schematic diagram of the structure of a driving guidance device for a racetrack scene according to an embodiment of the present application;
[0052] Fig.14 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application;
[0053] Fig.15 A flowchart of another description method of the driving guidance method for a racetrack scene according to an embodiment of the present application.
[0054] Attached figures: 1. Center point of the front axle of the vehicle; 2. Deceleration and downshifting point before entering a corner; 3. Optimal path for entering a corner; 4. Braking point for entering a corner; 5. Transition path for entering a corner; 6. Balanced throttle and forceful steering point; 7. Transition path for exiting a corner; 8. Point for increasing the throttle; 9. Path for increasing the throttle and shifting up; 10. Maximum throttle point; 11. Edge of the track; 12. Virtual guide line; 13. AR projection displays a virtual image; 14. Human eye position; 15. Virtual braking point. DETAILED DESCRIPTION
[0055] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0056] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0057] In some embodiments, Figure 1 As shown, a driving guidance method for a racetrack scene includes:
[0058] Step 100: In response to the vehicle usage scenario being a racetrack scenario, determining a driving mode.
[0059] In this step, since the racetrack scene is very different from the ordinary municipal road scene, the driving guidance in the ordinary municipal road scene is mainly to avoid traffic accidents such as rear-end collisions, running red lights, and colliding with pedestrians under the constraints of traffic rules, while in the racetrack usage scenario, it is to complete the course at the fastest speed and is not subject to the constraints of conventional traffic rules; and the road conditions in the racetrack scene are also very different from those in the ordinary municipal road scene. The road conditions in the ordinary municipal road scene generally have road traffic signs, traffic lights, etc. to provide guidance functions, and the roads are intertwined and connected with each other, the road conditions are relatively complex, and there are speed limits, while the racetrack road conditions are generally simpler, mostly narrow and winding roads. In order to ensure the flatness and adhesion of the track, there are almost no other guidance instructions on the track. Therefore, the driving guidance method in the municipal road scene in the relevant technology is quite different from the driving guidance method in the racetrack scene, and generally cannot be applied to each other. Therefore, the driving guidance method provided in the embodiment of the present application will only perform driving guidance after determining that the usage scenario is a racetrack scene, so as to avoid affecting the driving of the vehicle on ordinary roads and causing driving hazards.
[0060] Step 200: In response to the driving mode being the track driving mode, determining a target track.
[0061] In this step, after determining that the driving mode is the track driving mode, since the map data of different tracks are not the same, it is first necessary to determine the target track where the user will actually drive the car.
[0062] Step 300: In response to acquiring projection construction data applied to a target track, determining virtual display content of an AR projection display virtual image according to the projection construction data.
[0063] In this step, after determining the target track, it is necessary to determine whether the AR-HUD can obtain projection construction data, such as vehicle control data, intelligent driving data, and track map information of the target track, etc., because driving guidance needs to rely on these data to be established and updated in real time, so only when the vehicle control data, intelligent driving data, and track map information of the target track are obtained at the same time can the virtual projection elements that need to be added to the AR projection display virtual image 13 of the AR-HUD be determined, such as driving guide lines, braking points, turning points, throttle dynamic travel display, steering wheel angle dynamic display, etc. Exemplarily, AR fusion processing is performed on virtual display elements such as driving guide lines, braking points, turning points, throttle dynamic travel display, and steering wheel angle dynamic display to obtain virtual display contents such as virtual guide lines 12, virtual throttle, virtual braking points 15, and virtual steering wheels.
[0064] Step 400: Determine driving guidance information based on the acquired vehicle control data.
[0065] In this step, it is necessary to determine the driving guidance information according to the vehicle control data (data of each ECU of the vehicle). For example, the guidance direction of the virtual guide line 12 is determined according to the current vehicle position of the vehicle, and the user controls the driving direction of the vehicle according to the guidance direction of the virtual guide line 12. After determining the driving direction, the user may not be able to determine how much to turn the steering wheel to drive according to the guidance direction of the virtual guide line 12. At this time, the recommended steering wheel angle that the user needs to increase or decrease can be determined according to the current steering wheel angle of the vehicle. The size of the recommended steering angle can be displayed in the form of a numerical value. When the user turns the steering wheel according to the recommended angle, the recommended angle will be updated in real time. After determining the driving guidance information of the steering wheel It is also difficult to control how much throttle to use for driving, so the user needs to increase or decrease the recommended throttle force based on the vehicle's current throttle force. The force can be displayed in the form of a numerical value. When the user changes the throttle force according to the recommended force, the recommended force will be updated in real time. The position of the braking point is also difficult to control. If the distance between the vehicle position and the braking point is less than the preset first distance threshold, it means that the vehicle is about to enter a section of road where braking is required. At this time, the virtual braking point 15 is displayed in the projection display virtual image of the AR-HUD, and the distance between the vehicle position and the braking point is updated in real time, and the distance is displayed in the form of data. At the same time, the smaller the distance, the larger the display size of the virtual braking point 15 can be.
[0066] Step 500: Projecting virtual display content containing driving guidance information onto an AR projection display virtual image for display.
[0067] In this step, if Figure 3 As shown, after the projection distance and the downward viewing angle are determined, the virtual display content with the driving guidance information is projected into the AR projection display virtual image 13 through the AR-HUD for display, and the AR projection display virtual image 13 is integrated with the target track, that is, from the user's perspective, the virtual display content is on the road surface of the target track. Among them, the projection distance and the downward viewing angle are inherent properties of the vehicle, and the projection distance and the downward viewing angle have different values depending on the vehicle.
[0068] In some embodiments, the driving guidance method for a track scene further includes: in response to the driving mode being a track training mode, downloading a pre-built game scene, and performing track scene simulation training in the game scene after determining the target simulated track.
[0069] After determining that the vehicle usage scenario is a track scenario, it is necessary to determine the vehicle's driving mode. If the driving mode is a track training mode, it means that the user does not need to drive the vehicle on the track for actual driving. In order to ensure the authenticity of the training process and the effectiveness of the training results, Figure 2 As shown, high-precision map data of the track is collected and integrated with the navigation calibration of the whole vehicle, and the driving plans for each bend in the track are sorted out, including the best entry route for turning, brake downshift point, brake entry point 4, turning angle, throttle force, braking force and other information. At the same time, the road edge information stored in the intelligent driving controller and the data of each electronic control unit (Electronic Control Unit, ECU) of the vehicle are obtained: including vehicle speed, brake, throttle, gear, steering wheel angle, vehicle angle and other information. The track game scene is constructed by combining the driver's first-person perspective track scene video in the track scene, and the constructed game scene is stored in the cloud. After determining that the driving mode is the track training mode, the pre-constructed game scene is downloaded from the cloud. After determining the target simulation track, virtual simulation learning will be realized on the real car. The game scene is displayed through an augmented reality head-up display (Augmented Reality-Head Up The AR-HUD is combined with the above-mentioned real car data, so that users can conduct track scene simulation training of real car game scenes in combination with the projection of AR-HUD, so that users can adapt to the real track scene more quickly, avoid the danger of training on the real track, and save training costs and lower the training threshold.
[0070] In summary, the driving guidance method for the track scene provided in the embodiment of the present application will only perform driving guidance after determining that the use scene is a track scene, so as to avoid affecting the driving experience of ordinary roads; if the driving mode is the track training mode, the driving methods and operation teachings of professional racers and coaches on different tracks are stored through the cloud platform to form a teaching game scene. After determining that the driving mode is the track training mode, the pre-built game scene is downloaded from the cloud. After determining the target simulation track, virtual simulation learning will be realized on the real car. The game scene is displayed through an augmented reality head-up display (Augmented Reality-Head Up The AR-HUD is combined with the above-mentioned various real car data, so that the user can combine the projection of the AR-HUD to perform track scene simulation training of the real car game scene, so that the user can adapt to the track scene more quickly; if the driving mode is the track driving mode, after determining the projection distance and the lower viewing angle, the virtual display content containing the driving guidance information is projected to the AR projection display virtual image 13 for display. The lower viewing angle allows the user to see the driving guidance direction and operation guidance in front without lowering his head, avoiding the driving burden caused by frequent up and down switching of the focus of the eyes in the high-speed driving scene on the track, thereby improving the safety of driving guidance. By providing users with convenient driving guidance, users can drive safely on the target track more easily, so that users without racing experience can have the same driving experience as racing drivers on the track.
[0071] In some embodiments, the projection construction data includes vehicle control data, intelligent driving data, and track map information of the target track, such as Figure 4 As shown, the driving guidance information is determined based on the acquired vehicle control data, including:
[0072] Step 410: construct a coordinate system in a plane parallel to the target track with the center point of the front axle of the vehicle as the origin, the driving direction as the X-axis direction, and the direction perpendicular to the driving direction as the Y-axis direction, and obtain historical driving information of the target track.
[0073] In this step, for example, Figure 5 As shown in FIG. 1 , a coordinate system is constructed in a plane parallel to the target track, with the center point 1 of the front axle of the vehicle as the origin, the driving direction as the X-axis direction, and the vertical direction of the driving direction as the Y-axis direction. This can well measure the optimal driving path in the historical driving information (including the driving plans for each curve in the track) and the offset difference of the vehicle, reduce the calculation process, and make the real-time data more accurate. Figure 5 As shown, the historical driving data may contain guiding information such as the deceleration downshift point 2 before entering a curve, the best path for entering a curve 3, the braking entry point 4, the transition path for entering a curve 5, the balanced throttle and force steering point 6, the transition path for exiting a curve 7, the throttle increase point 8, the throttle increase upshift path 9, and the maximum throttle point 10.
[0074] Step 420: Determine the vehicle position on the target track based on the intelligent driving data and the track map information.
[0075] In this step, the AR-HUD controller receives map information, takes the positioning device installed in the vehicle as the positioning mark point, combines the navigation information in the intelligent driving data and the identified track edge information, determines the position of the positioning mark point on the map corresponding to the target track, and determines the vehicle position on the target track based on the position on the map.
[0076] Step 430: Determine driving guidance information based on historical driving information, vehicle position and vehicle control data in the coordinate system.
[0077] In this step, the driving guidance information of the virtual display content is determined in real time according to the historical driving information, the vehicle position and the vehicle control data, and the driving guidance information is updated according to the change of the vehicle position and the change of the vehicle control data.
[0078] In some embodiments, the virtual display content includes a virtual guide line 12, and the driving guidance information includes a guide direction; then step 430: in the coordinate system, determine the driving guidance information based on the historical driving information, the vehicle position and the vehicle control data, such as Figure 6 As shown, including:
[0079] Step 431: Obtain the best driving path in the historical driving information.
[0080] In this step, exemplarily, the best driving path includes the best path for entering a corner 3, the transition path for entering a corner 5, the transition path for exiting a corner 7, and the path for increasing the throttle and shifting up 9, wherein the best path for entering a corner 3, the transition path for entering a corner 5, the transition path for exiting a corner 7, and the path for increasing the throttle and shifting up 9 are the results of subdividing the best driving path for the target track at each turn, so as to provide the user with more detailed driving guidance, for example: the path that the professional racing driver has traveled when entering a corner in the historical driving information can be used as the best path for entering a corner 3, the path that the professional racing driver has traveled when transitioning into a corner in the historical driving information can be used as the transition path for entering a corner 5, the path that the professional racing driver has traveled when transitioning out of a corner in the historical driving information can be used as the transition path for exiting a corner 7, and if the professional racing driver in the historical driving information increases the throttle or shifts up a gear on a certain section of the road, the section can be used as the path for increasing the throttle and shifting up 9, wherein the dividing points of each section can be obtained by consulting the professional racing driver. There is no need to subdivide the straight track section, and users can drive straight on the target track at will. However, when approaching a turn, users are required to follow the best driving path as quickly as possible to ensure that they can pass the turn smoothly and quickly according to the driving guidance information.
[0081] Step 432: Calculate the offset difference between the vehicle position and the optimal driving path in the coordinate system.
[0082] In this step, first, the best driving path in the historical driving information is obtained, and the first distance between the best driving path and the edge 11 of the track is calculated; then, the second distance between the vehicle and the edge 11 of the track is determined based on the vehicle position; finally, the difference between the first distance and the second distance is calculated to obtain the offset difference, and the offset difference is updated in real time according to the change of the vehicle position. Among them, taking the center point of the front axle of the vehicle (positioning mark point) as the origin of the coordinate system, according to the track map information and the vehicle position, when the track edge 11 (for example, the track edge 11 outside the target track) is selected as a calculation reference, the second distance between the vehicle position and the track edge 11 can be easily calculated according to the positioning or navigation software, and for the first distance between the optimal driving path and the track edge 11, the historical vehicle position of the vehicle at the same track edge 11 position in the historical driving information can be obtained, and then the first distance between the vehicle position and the same track edge 11 can be calculated using the positioning or navigation software, or the first distance between the optimal driving path and the track edge 11 can be determined in advance, and the offset difference can be obtained by calculating the difference between the first distance and the second distance. The calculation process is simple, the calculation data speed is guaranteed, the timeliness of the driving guidance information is guaranteed, and the update delay is reduced when the offset difference is updated in real time according to the change of the vehicle position.
[0083] Step 433: Determine the guiding direction of the virtual guiding line based on the offset difference, and update the guiding direction in real time according to the change of the vehicle position.
[0084] In this step, the center point 1 of the front axle of the whole vehicle is the reference point for locating the vehicle position and the AR projection display virtual image 13. Based on this reference point, the deceleration downshift point 2 before entering the corner, the best path for entering the corner 3, the braking entry point 4, the transition path for entering the corner 5, the balanced throttle, the force steering point 6, the transition path for exiting the corner 7, the increase throttle point 8, the increase throttle upshift guide path 9, the maximum throttle point 10 and the center point of the front axle of the vehicle (vehicle position) in the coordinate system can be accurately located to determine the guiding direction of the virtual guide line 12, and then the corresponding relationship with the human eye position 14 and the AR projection display virtual image 13 is established through coordinate transformation, thereby realizing the AR display after the virtual image is fused with the actual track. For example, Figure 7 As shown, if the offset difference is -0.5 meters, it means that the vehicle position (coordinate origin) can be coincident with the optimal driving path by moving 0.5 meters in the reverse direction of the Y axis. The guiding direction of the virtual guide line 12 is a curve that allows the vehicle to drive to the optimal driving path. The curvature of the curve is related to information such as the vehicle speed, and its calculation process is not described in detail here. After determining the guiding direction of the virtual guide line 12, the user can determine the driving direction and driving path of the vehicle according to the guiding direction updated in real time.
[0085] For example, Figure 8 As shown, the AR-HUD controller receives high-precision map information and combines it with navigation information and track edge information recognized by intelligent driving to perform fusion processing to locate the vehicle position, takes the direction perpendicular to the vehicle's driving direction in the horizontal plane as the Y-axis, takes the direction parallel to the vehicle's driving direction in the horizontal plane as the X-axis, and establishes a coordinate system with the center point of the vehicle's front axle as the origin. According to the relationship between the vehicle position and the track edge 11, the coordinates of the best path 3 for turning are determined in the coordinate system, and the corresponding relationship with the human eye position 14 and the AR projection display virtual image 13 is established through coordinate conversion. According to the offset difference between the vehicle position and the best path for turning, the position and angle of the virtual guide line 12 in the AR projection display virtual image 13 are determined. Fig. 9 It can be seen from the figure that the virtual guide line 12 is a straight line at this time, indicating that the vehicle position (coordinate origin) coincides with the optimal path 3 for entering the curve, and no steering operation is required. In actual use, the virtual image 13 displayed by the AR projection is not as Fig. 9 The frame shown here is drawn to reflect the range of the AR projection display virtual image 13; and Fig. 9 It reflects the effect of coordinate transformation. The offset difference is calculated with the center point 1 of the front axle of the whole vehicle as the origin. However, the user controls it with the human eye as the origin. Therefore, although the human eye position 14 does not coincide with the best path for entering the corner 3, the virtual guide line 12 is still a straight line. The display size, display position, display angle, and display shape of the virtual guide line 12 are updated in real time as the vehicle moves. The AR display of the best path for entering the corner 3 and the actual target track are integrated, so that the user can understand the driving direction and route in real time.
[0086] In some embodiments, Fig.10 As shown, driving guidance information is determined based on historical driving information, vehicle position and vehicle control data, including:
[0087] Step 434: Obtaining optimal control data from historical driving information;
[0088] In this step, after the guiding direction of the virtual guide line 12 is determined, the user is clear about the driving direction of the vehicle, but there may be deviations in actual operation, which makes it difficult to drive the vehicle according to the virtual guide line 12. Therefore, it is necessary to guide the user's control of the vehicle to ensure that the user can control the vehicle forward according to the virtual guide line 12. At this time, it is necessary to first obtain the best control data in the historical driving information as a reference for controlling the vehicle.
[0089] Step 435: Determine recommended control information by comparing the vehicle control data with the optimal control data;
[0090] In this step, after the user determines the driving direction according to the virtual guide line 12, the user may not be able to determine how much the steering wheel should be turned to drive according to the guidance direction of the virtual guide line 12. At this time, the current steering wheel angle in the vehicle control data and the optimal steering wheel angle in the optimal control data can be compared. The recommended steering wheel angle that the user needs to increase or decrease is determined by calculating the difference between the current steering wheel angle and the optimal steering wheel angle. The size of the recommended angle can be displayed in the form of a numerical value, and the turning direction can be displayed in the form of a positive or negative value. The closer the displayed value is to zero, the closer the current steering wheel angle is to the optimal steering wheel angle. When the user turns the steering wheel according to the recommended angle, the recommended angle will be updated in real time. After determining the driving guidance information of the steering wheel, it is also difficult to control how much throttle to use for driving. At this time, the current throttle force in the vehicle control data and the optimal throttle force in the optimal control data can be compared. The recommended throttle force that the user needs to increase or decrease is determined by calculating the difference between the current throttle force and the optimal throttle force. The size of the force can be displayed in the form of a numerical value. The closer the displayed value is to zero, the closer the throttle force is to the optimal steering wheel angle. A value of zero indicates that the current throttle force is closer to the optimal throttle force. When the user changes the throttle force according to the recommended force, the recommended force will be updated in real time. The positions of the braking point and the shift point are also difficult to control. If the distance between the vehicle position and the braking point is less than the preset first distance threshold, it means that the vehicle is about to enter a section of road where braking is required to slow down. At this time, a virtual braking point 15 is displayed in the AR-HUD projection display virtual image, and the distance between the vehicle position and the braking point is updated in real time, and the distance is displayed in the form of data. At the same time, the smaller the distance, the larger the display size of the virtual braking point 15 can be. Similarly, for the shift point, if the distance between the vehicle position and the shift point is less than the preset second distance threshold, it means that the vehicle is about to enter a road section where the gear needs to be changed. At this time, the virtual shift point is displayed in the projection display virtual image of the AR-HUD, and the recommended gear (optimal gear) that the vehicle needs to shift to is updated in real time, and the recommended gear is displayed in the form of text or numerical value. At the same time, the smaller the distance between the vehicle position and the shift point, the larger the display size of the virtual shift point can be. The principle is that the farther the distance, the smaller the size of the same object seen by the human eye, and the closer the distance, the larger the size of the same object seen.
[0091] Step 436: Determine the operation guidance for driving the vehicle to the optimal driving path based on the recommended control information, and update the operation guidance in real time according to the change of the vehicle position.
[0092] In this step, for example, Fig.11As shown, taking the braking point as an example, the AR-HUD controller receives high-precision map information and combines it with navigation information and track edge information recognized by intelligent driving to perform fusion processing to locate the vehicle position, and takes the direction perpendicular to the vehicle's driving direction in the horizontal plane as the Y-axis, and the direction parallel to the vehicle's driving direction in the horizontal plane as the X-axis. A coordinate system is established with the center point of the vehicle's front axle as the origin. The braking cornering point 4 is determined in the coordinate system according to the vehicle position and the track turning position. The corresponding relationship with the human eye position 14 and the AR projection display virtual image 13 is established through coordinate conversion. According to the distance between the vehicle position and the braking cornering point 4, the position and size of the virtual braking point 15 in the AR projection display virtual image 13 are determined, wherein the virtual braking point 15 is displayed in the AR projection display virtual image 13 as shown. Fig.12 As shown, in order to inform the user that the point is the virtual braking point 15, a pattern of a foot on the brake is displayed on the right side of the point to prompt that the point is the braking point. As the vehicle moves, the display size and display position of the virtual braking point 15 are converted in real time to achieve an AR display that integrates the braking corner point 4 with the actual target track, so that the user can understand in real time how to control the vehicle to drive according to the virtual guide line 12.
[0093] In some embodiments, performing AR fusion processing on virtual display elements to obtain virtual display content of an AR projected display virtual image includes:
[0094] The size and angle of the virtual display element are adjusted so that the virtual display element is integrated with the target track to obtain virtual display content. For example, as the vehicle gets closer and closer to the optimal turning point, Figure 7 The size of the virtual guide line 12 shown will become larger and larger, which conforms to the rule that the closer the distance to the human eye, the larger the image, so that the user has a better visual experience and avoids visual fatigue. It can also indirectly prompt that the distance to the best turning point is getting closer. The virtual guide line 12 is fitted with the ground in the user's perspective, so in order to ensure that the fitting visual effect can be maintained as the vehicle moves, it is necessary to adjust the angle of the virtual display element, such as the triangular area at the head of the virtual guide line 12. As the vehicle gets closer to the best turning point, the vertex angle of the triangle will become larger and the bottom angle will become smaller.
[0095] Among them, from Figure 8 It can be seen from the figure that the virtual image 13 displayed by the AR projection is perpendicular to the ground. Figure 7 To achieve the desired display effect, you need to adjust the size and angle of the virtual display elements so that the virtual display elements merge with the target track. Figure 7 The virtual display content shown.
[0096] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.
[0097] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0098] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a driving guidance device for a racetrack scene.
[0099] refer to Fig.13 , the driving guidance device for the track scene comprises:
[0100] The scene confirmation module 10 is configured to: determine a driving mode in response to the use scene of the vehicle being a track scene;
[0101] The track confirmation module 20 is configured to: determine a target track in response to the driving mode being the track driving mode;
[0102] The display content determination module 30 is configured to: in response to acquiring the projection construction data applied to the target track, determine the virtual display content of the AR projection display virtual image according to the projection construction data;
[0103] The guidance information determination module 40 is configured to: determine driving guidance information based on the acquired vehicle control data;
[0104] The projection module 50 is configured to project the virtual display content containing the driving guidance information onto the AR projection display virtual image for display.
[0105] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0106] The device of the above embodiment is used to implement the driving guidance method of the corresponding track scene in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0107] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the driving guidance method for the track scene described in any of the above embodiments is implemented.
[0108] Fig.14 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0109] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0110] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0111] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0112] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0113] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0114] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0115] The electronic device of the above embodiment is used to implement the driving guidance method of the corresponding track scene in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0116] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the driving guidance method for the track scene as described in any of the above embodiments.
[0117] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0118] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the driving guidance method for the track scene as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0119] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides a vehicle, including a processing device for frequent wake-up failures as described in the above-mentioned embodiments or an electronic device as described in the above-mentioned embodiments or a computer-readable storage medium as described in the above-mentioned embodiments.
[0120] It should be noted that if Fig.15 As shown, the embodiments of the present application can be further described in the following manner:
[0121] When the vehicle is started, it is first determined that the driving scene is a track scene. If it is not a track scene, no driving guidance is performed; if the track scene is a track training mode, the cloud game scene is retrieved and the target simulation track selection is selected. After the track selection is completed, the real car game track scene simulation training is performed; if the track scene is a real driving mode, the target track is selected, and when the vehicle control data, intelligent driving data and the track high-precision map information of the target track can be obtained at the same time, the virtual display elements of the virtual display content are determined, and the virtual display elements of the virtual display content are AR fused to obtain virtual display content that can be projected, and then the appropriate track position is selected to draw the AR driving guidance information, and the virtual display content is improved. Finally, the virtual display content with the driving guidance information is projected onto the projection surface of the AR projection display virtual image 13 for display. Among them, if the vehicle control data, intelligent driving data and the track high-precision map information of the target track cannot be obtained at the same time, no projection is performed, and there is no driving guidance.
[0122] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0123] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.
[0124] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0125] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.
Claims
1. A driving guidance method for a racetrack scene, characterized in that: include: In response to the usage scenario of the vehicle being a racetrack scenario, determining a driving mode; In response to the driving mode being a track driving mode, determining a target track; In response to acquiring the projection construction data applied to the target track, determining virtual display content of the AR projection display virtual image according to the projection construction data; determining driving guidance information based on the acquired vehicle control data; The virtual display content includes a virtual guide line, and the driving guidance information includes a guide direction; the projection construction data includes the vehicle control data, the intelligent driving data, and the track map information of the target track; and the driving guidance information is determined based on the acquired vehicle control data, including: Acquiring historical driving information of the target track; Determine a vehicle position of the vehicle on the target track based on the intelligent driving data and the track map information; In a pre-constructed coordinate system, the driving guidance information is determined based on the historical driving information, the vehicle position and the vehicle control data: Obtaining the best driving path in the historical driving information; calculating, in the coordinate system, an offset difference between the vehicle position and the optimal driving path; Determining the guiding direction of the virtual guiding line based on the offset difference, and updating the guiding direction in real time according to the change of the vehicle position; Acquiring optimal control data from the historical driving information; determining recommended control information by comparing the vehicle control data with the optimal control data; determining an operation guide for driving the vehicle to the optimal driving path based on the recommended control information, and updating the operation guide in real time according to a change in the position of the vehicle; The virtual display content containing the driving guidance information is projected onto an AR projection display virtual image for display.
2. The method according to claim 1, characterized in that The constructing of the coordinate system comprises: A coordinate system is constructed in a plane parallel to the target track, with the center point of the front axle of the vehicle as the origin, the driving direction as the X-axis direction, and the direction perpendicular to the driving direction as the Y-axis direction.
3. The method according to claim 1, characterized in that Calculating the offset difference between the vehicle position and the optimal driving path in the coordinate system includes: Calculating a first distance between the optimal driving path and the edge of the track; determining a second spacing between the vehicle and the edge of the track based on the vehicle position; The offset difference is obtained by calculating the difference between the first distance and the second distance, and the offset difference is updated in real time according to the change of the vehicle position.
4. The method according to claim 1, characterized in that Perform AR fusion processing on the virtual display elements to obtain the virtual display content of the AR projection display virtual image, including: The size and angle of the virtual display element are adjusted so that the virtual display element is integrated with the target track to obtain the virtual display content.
5. The method according to claim 1, characterized in that Also includes: In response to the driving mode being the track training mode, a pre-built game scene is downloaded, and after a target simulated track is determined, track scene simulation training is performed in the game scene.
6. A driving guidance device for a racetrack scene, characterized in that: include: The scene confirmation module is configured to: determine a driving mode in response to the use scene of the vehicle being a track scene; A track confirmation module is configured to: determine a target track in response to the driving mode being a track driving mode; A display content determination module is configured to: in response to acquiring projection construction data applied to the target track, determine virtual display content of the AR projection display virtual image according to the projection construction data; The guidance information determination module is configured to: determine driving guidance information based on the acquired vehicle control data; The virtual display content includes a virtual guide line, and the driving guidance information includes a guide direction; the projection construction data includes the vehicle control data, the intelligent driving data, and the track map information of the target track; and the driving guidance information is determined based on the acquired vehicle control data, including: Acquire historical driving information of the target track; Determine a vehicle position of the vehicle on the target track based on the intelligent driving data and the track map information; In a pre-constructed coordinate system, the driving guidance information is determined based on the historical driving information, the vehicle position and the vehicle control data: Obtaining the best driving path in the historical driving information; calculating, in the coordinate system, an offset difference between the vehicle position and the optimal driving path; Determining the guiding direction of the virtual guiding line based on the offset difference, and updating the guiding direction in real time according to the change of the vehicle position; Acquiring optimal control data from the historical driving information; determining recommended control information by comparing the vehicle control data with the optimal control data; determining an operation guide for driving the vehicle to the optimal driving path based on the recommended control information, and updating the operation guide in real time according to a change in the position of the vehicle; The projection module is configured to project the virtual display content containing the driving guidance information onto an AR projection display virtual image for display.
7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 5 when executing the program.
8. A vehicle, comprising the driving guidance device for a racetrack scene as claimed in claim 6 or the electronic device as claimed in claim 7.
Citation Information
Patent Citations
Driving maneuver assist on full windshield head-up display
CN103129466A
Virtual object steering direction control method and device, electronic equipment and storage medium
CN108579079A
