Driving information display method, device, equipment and storage medium
Patent Information
- Application Number
- CN202410666178.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-27
- Publication Date
- 2026-08-28
- Estimated Expiration
- 2044-05-27
AI Technical Summary
但是,实际应用中,驾驶教学中很多的点位名称以及驾驶操作较为生僻难懂,驾驶者往往很难理解教学方法,无法将听到的教学方法与实际场景中的点位直接、快速关联,导致驾驶者在通过模拟驾驶进行驾驶练习的过程中频繁犯错,影响模拟驾驶的质量和效率,以及驾驶者的使用体验
[0017]In the driving information display scheme provided in this embodiment of the invention, when a driver is performing a driving simulation, firstly, a simulated driving screen corresponding to the driver's seat perspective is displayed. This simulated driving screen includes a virtual scene corresponding to the currently simulated driving task and a virtual vehicle controlled by the driver within that scene. Then, the driver controls the virtual vehicle to move within the virtual scene. When the virtual vehicle moves to a preset target point in the virtual scene that matches the currently simulated driving task, a point explanation for the preset target point is triggered. Specifically, in response to the virtual vehicle moving to the preset target point in the virtual scene, point explanation information configured for the preset target point is obtained. This point explanation information includes point explanation information from at least one perspective. The simulated driving screen corresponding to the driver's seat perspective is switched to a simulated driving screen corresponding to at least one perspective. In response to the display of the simulated driving screen corresponding to the target perspective, point explanation information for the target perspective is output. The target perspective is any one of the at least one perspectives. Finally, in response to the completion of the output of the point explanation information for at least one perspective corresponding to the preset target point, the simulated driving screen corresponding to the driver's seat perspective is displayed for subsequent driving simulation. In this solution, during the driving simulation, once the virtual vehicle reaches a preset target point, the driver can better understand the driving operation corresponding to that target point by explaining it from different perspectives. This improves the quality and efficiency of the driving simulation and provides a better driving experience for the driver.
Smart Images

Figure CN118658354B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of driving simulation, and more particularly to a method, apparatus, device, and storage medium for displaying driving information. Background Technology
[0002] Driving simulators typically teach drivers by broadcasting driving instructions to help them master driving skills. However, in practice, many of the location names and driving operations used in these tutorials are obscure and difficult to understand. Drivers often struggle to comprehend the teaching methods and cannot directly and quickly connect what they hear with the locations in real-world scenarios. This leads to frequent errors during simulated driving practice, impacting the quality and efficiency of the simulation and the user experience. Summary of the Invention
[0003] This invention provides a driving information display method, apparatus, device, and storage medium to help drivers quickly and correctly understand driving operations and improve the quality and efficiency of driving simulation.
[0004] In a first aspect, embodiments of the present invention provide a method for displaying driving information, the method comprising:
[0005] The simulated driving screen is displayed from the driver's seat perspective. The simulated driving screen includes a virtual scene corresponding to the currently simulated driving project and a virtual vehicle controlled by the driver in the virtual scene.
[0006] In response to the virtual vehicle moving to a preset target point in the virtual scene, point explanation information configured for the preset target point is obtained. The point explanation information includes point explanation information from at least one perspective. The preset target point matches the currently simulated driving project.
[0007] Switch the simulated driving screen corresponding to the driver's seat view to the simulated driving screen corresponding to at least one of the viewpoints;
[0008] In response to the display of the simulated driving screen corresponding to the target viewpoint, the location information of the target viewpoint is output, wherein the target viewpoint is any one of the at least one viewpoints;
[0009] In response to the completion of the point explanation information output from at least one perspective, the simulated driving screen corresponding to the driver's seat perspective is displayed for subsequent driving simulation.
[0010] Secondly, embodiments of the present invention provide a driving information display device, the device comprising:
[0011] The display module is used to display the simulated driving screen corresponding to the driver's seat view. The simulated driving screen includes the virtual scene corresponding to the currently simulated driving project and the virtual vehicle controlled by the driver in the virtual scene.
[0012] The processing module is configured to, in response to the virtual vehicle moving to a preset target point in the virtual scene, acquire point description information configured for the preset target point, the point description information including point description information from at least one perspective, the preset target point matching the currently simulated driving project; switch the simulated driving screen corresponding to the driver's perspective to the simulated driving screen corresponding to the at least one perspective; and, in response to the display of the simulated driving screen corresponding to the target perspective, output the point description information of the target perspective, the target perspective being any one of the at least one perspectives;
[0013] The display module is also used to display the simulated driving screen corresponding to the driver's seat view after the output of the point explanation information of the at least one perspective is completed, so as to carry out subsequent driving simulation.
[0014] Thirdly, embodiments of the present invention provide an electronic device, including: a memory, a processor, and a communication interface; wherein, the memory stores executable code, and when the executable code is executed by the processor, the processor can at least implement the driving information display method as described in the first aspect.
[0015] Fourthly, embodiments of the present invention provide a non-transitory machine-readable storage medium storing executable code, wherein when the executable code is executed by a processor of a computing device, the processor is able to at least implement the driving information display method as described in the first aspect.
[0016] Fifthly, embodiments of the present invention provide a computer program product, comprising: a computer program that, when executed by a processor of an electronic device, enables the processor to at least implement the driving information display method as described in the first aspect.
[0017] In the driving information display scheme provided in this embodiment of the invention, when a driver is performing a driving simulation, firstly, a simulated driving screen corresponding to the driver's seat perspective is displayed. This simulated driving screen includes a virtual scene corresponding to the currently simulated driving task and a virtual vehicle controlled by the driver within that scene. Then, the driver controls the virtual vehicle to move within the virtual scene. When the virtual vehicle moves to a preset target point in the virtual scene that matches the currently simulated driving task, a point explanation for the preset target point is triggered. Specifically, in response to the virtual vehicle moving to the preset target point in the virtual scene, point explanation information configured for the preset target point is obtained. This point explanation information includes point explanation information from at least one perspective. The simulated driving screen corresponding to the driver's seat perspective is switched to a simulated driving screen corresponding to at least one perspective. In response to the display of the simulated driving screen corresponding to the target perspective, point explanation information for the target perspective is output. The target perspective is any one of the at least one perspectives. Finally, in response to the completion of the output of the point explanation information for at least one perspective corresponding to the preset target point, the simulated driving screen corresponding to the driver's seat perspective is displayed for subsequent driving simulation. In this solution, during the driving simulation, once the virtual vehicle reaches a preset target point, the driver can better understand the driving operation corresponding to that target point by explaining it from different perspectives. This improves the quality and efficiency of the driving simulation and provides a better driving experience for the driver. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 A flowchart illustrating a driving information display method provided in an embodiment of the present invention;
[0020] Figure 2 A schematic diagram of a virtual vehicle provided in an embodiment of the present invention;
[0021] Figure 3 A flowchart illustrating the configuration process of location explanation information is provided in an embodiment of the present invention;
[0022] Figure 4 This is a schematic diagram of a point configuration interface provided in an embodiment of the present invention;
[0023] Figure 5 A schematic diagram of visual guidance information from a left front view provided in an embodiment of the present invention;
[0024] Figure 6 A schematic diagram of visual guidance information from a top-down perspective provided in an embodiment of the present invention;
[0025] Figure 7 A schematic diagram illustrating another left-front view of visual guidance information provided in an embodiment of the present invention;
[0026] Figure 8 This is a schematic diagram of the structure of a driving information display device provided in an embodiment of the present invention;
[0027] Figure 9 To and Figure 8 The illustrated embodiment provides a schematic diagram of the electronic device corresponding to the driving information display device. Detailed Implementation
[0028] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0029] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. “Multiple” generally includes at least two, but does not exclude the inclusion of at least one.
[0030] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a product or system comprising a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a product or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the product or system that includes that element.
[0031] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. Furthermore, the timing of the steps in the following method embodiments is merely illustrative and not strictly limiting.
[0032] Figure 1 A flowchart of a driving information display method provided in an embodiment of the present invention, such as... Figure 1As shown, the method may include the following steps:
[0033] 101. Display the simulated driving screen corresponding to the driver's seat view. The simulated driving screen includes the virtual scene corresponding to the currently simulated driving project and the virtual vehicle controlled by the driver in the virtual scene.
[0034] 102. In response to the virtual vehicle moving to a preset target point in the virtual scene, obtain the point description information configured for the preset target point. The point description information includes point description information from at least one perspective. The preset target point matches the currently simulated driving project.
[0035] 103. Switch the simulated driving screen corresponding to the driver's seat view to at least one simulated driving screen corresponding to a different view.
[0036] 104. In response to the display of the simulated driving screen corresponding to the target viewpoint, output the location explanation information of the target viewpoint, where the target viewpoint is any one of at least one viewpoint.
[0037] 105. After the explanation information of at least one viewpoint has been output, display the simulated driving screen corresponding to the driver's seat viewpoint for subsequent driving simulation.
[0038] The driving information display scheme provided in this invention can be adapted to driving simulation training such as driving skills test subject training and safe driving practice, so that drivers, such as novice learners, can quickly understand the driving skills and methods corresponding to various driving items. The driving skills test subject can be Subject 2 or Subject 3, which are part of the motor vehicle driver's license examination; driving items include, but are not limited to, reversing into a parking space, making a right-angle turn, driving on a curved road, parallel parking, and parking at the roadside.
[0039] The driving information display method provided in this embodiment of the invention can be executed by a driving information display device, which can be software running on an electronic device with display capabilities, such as a laptop computer, or a combination of software and hardware. In this embodiment, a driving simulator is used as an example to illustrate the driving information display device.
[0040] A driving simulator is a teaching device used for driving instruction and training. It uses technologies such as Virtual Reality (VR) and virtual simulation to simulate virtual vehicles driving in virtual environments. The virtual vehicle can be any vehicle model capable of driving in a virtual environment, such as a 3D vehicle model. The virtual environment can be any road condition scenario corresponding to a driving exercise, such as a right-angle turn, a curved driving scenario, a reversing into a parking space scenario, a parallel parking scenario, or a hill start scenario.
[0041] A driving simulator includes driving components for simulating driving, which the driver can operate to control a virtual vehicle. The driving simulator responds to the driver's simulated driving operations on the driving components, controlling the virtual vehicle's driving state within a virtual environment for simulated driving. These driving components may include, but are not limited to: clutch (excluding automatic transmissions), brake, accelerator, steering wheel, gear shift, handbrake, lights, wipers, ignition switch, etc.; simulated driving operations may include, but are not limited to: turning the steering wheel, depressing the clutch, releasing the handbrake, shifting gears, turning on the turn signal, or turning off the wipers, etc.; the virtual vehicle's driving state within the virtual environment may include, but is not limited to: driving straight, turning, braking, accelerating, decelerating, reversing, or going uphill, etc. For example, when the driver operates the accelerator component on the driving simulator, the simulator can respond to the acceleration operation and control the vehicle model to accelerate; similarly, when the driver turns the steering wheel to the left, the simulator can respond to the turning operation and control the vehicle model to turn.
[0042] In practical applications, when using driving simulators and other driving simulation technologies, driving instruction is typically conducted by broadcasting driving methods to drivers to help them master driving skills. However, many of the reference points and driving operations used in driving instruction are obscure and difficult to understand. Drivers often struggle to comprehend the instruction methods and cannot directly and quickly connect what they hear with the reference points in the virtual scenario. This leads to frequent errors during simulated driving practice, affecting the quality and efficiency of the simulation and the user experience.
[0043] To solve at least one of the above-mentioned technical problems, embodiments of the present invention provide, as follows: Figure 1 The driving information display method is illustrated below. In summary, during driving simulation using driving simulation technology, when the virtual vehicle moves to a preset target point matching the currently simulated driving task, the driver learns the location of the preset target point from at least one perspective. This allows the driver to understand the relative position of the virtual vehicle and the virtual scene, comprehend the principles behind the operations described in the teaching method at the preset target point, preview the effects of performing the driving operations described in the teaching method, and observe the relative relationships between reference objects on the virtual vehicle and reference objects in the virtual scene from the driver's perspective. This enables the learner to deeply understand the content of the teaching method displayed or broadcast by the driving simulator, improving the quality and efficiency of driving simulation training and the driver's driving training experience.
[0044] In practical applications, when a driver wants to learn a specific driving skill, they can trigger a driving simulation training request for that skill. In response to this request, the driving simulator loads a simulated driving screen into its interface. This screen includes the virtual scene corresponding to the driving skill, as well as a virtual vehicle within that scene.
[0045] Understandably, driving simulation is actually a simulation of the driver's real driving experience. Therefore, while the driver is controlling the virtual vehicle to move in the virtual scene, the driving simulation interface of the driving simulator displays the simulated driving screen corresponding to the driver's seat view.
[0046] Driving instruction in driving simulators, simply put, involves guiding drivers to perform corresponding driving operations at designated points in a driving exercise. For example, in the reverse parking maneuver, when the driver aligns the virtual vehicle with the control line in the virtual scene on their left shoulder, they perform the operation of "stopping and engaging reverse gear." In practical applications, the points and corresponding driving operations differ between different driving exercises. For instance, the points and operations for reverse parking and right-angle turns are different. Furthermore, even for the same driving exercise, different driving instruction programs may use different points and corresponding operations. For example, different driving schools may employ different teaching methods for the reverse parking maneuver.
[0047] In this embodiment, for different driving projects, corresponding points, i.e., preset target points, are pre-configured according to the adopted driving teaching scheme. To help the driver better understand the driving operations corresponding to the preset target points, as the driver controls the virtual vehicle to move in the virtual scene, the driving simulator responds by pausing the simulated driving screen when the virtual vehicle moves to the preset target point in the virtual scene corresponding to the currently simulated driving project, and obtains the point explanation information configured for the preset target point, so as to explain the driving operations at the preset target point through the point explanation information. In this embodiment, the output process of the point explanation information corresponding to the preset target point is explained first; the configuration process of the point explanation information corresponding to the preset target point will be explained in detail in later embodiments.
[0048] The explanation information for the preset target points includes explanation information from at least one perspective. That is, this solution provides a comprehensive and multi-angle explanation of the driving operation corresponding to the preset target points by outputting explanation information from at least one perspective corresponding to the preset target points, so that the driver can fully understand the driving operation corresponding to the preset target points.
[0049] Figure 2This is a schematic diagram of a virtual vehicle's perspective provided in an embodiment of the present invention, such as... Figure 2 As shown, at least one of the above-mentioned perspectives includes, but is not limited to: a top-down view facing the roof, a left-side view facing the left side of the vehicle body, a right-side view facing the right side of the vehicle body, a left-rear view facing the left rear of the vehicle, a right-rear view facing the right rear of the vehicle, a left-front view facing the left front of the vehicle, a right-front view facing the right front of the vehicle, and a driver's seat view, etc.
[0050] Different perspectives correspond to different simulated driving screens, which display information about different spatial dimensions corresponding to preset target points. For example, a top-down view of the simulated driving screen can fully display the virtual vehicle and the virtual scene, allowing the driver to understand the relative positional relationship between the virtual vehicle as a whole and the reference objects (such as reference points and reference lines) corresponding to the driving task in the virtual scene at the predicted target point. For instance, when the current simulated driving task is reversing into a parking space, the top-down view of the simulated driving screen corresponding to the preset target point can be used to show the relative positional relationship between the virtual vehicle as a whole and the edge line of the parking space in the virtual scene. Similarly, a left-front view of the simulated driving screen can be used to show the relative positional relationship between the left front wheel of the virtual vehicle and the reference objects corresponding to the driving task in the virtual scene.
[0051] Optionally, point explanation information for at least one viewpoint can be customized according to the point explanation requirements of the preset target points corresponding to the driving project. Thus, after the virtual vehicle reaches the preset target point, the simulated driving screen corresponding to the driver's seat viewpoint is switched to the simulated driving screen corresponding to at least one viewpoint. Furthermore, in response to the display of the simulated driving screen corresponding to at least one viewpoint, point explanation information for at least one viewpoint can be output.
[0052] In an optional embodiment, if the number corresponding to the at least one viewpoint is greater than or equal to 2, then the simulated driving screen corresponding to the driver's seat viewpoint is switched to the simulated driving screen corresponding to at least one viewpoint. This includes: according to the output order of the pre-configured point location explanation information for at least one viewpoint, the simulated driving screen corresponding to the driver's seat viewpoint is sequentially switched to the simulated driving screen corresponding to at least one viewpoint. For example, if the point location explanation information corresponding to the preset target pointpoint includes point location explanation information from a top-down view and point location explanation information from a left-front view, and it is pre-set that when outputting point location explanation information, the point location explanation information from the top-down view is output first and then the point location explanation information from the left-front view is output, then the simulated driving screen corresponding to the driver's seat viewpoint is first switched to the simulated driving screen corresponding to the top-down view, and the point location explanation information corresponding to the top-down viewpoint is output; after the point location explanation information from the top-down viewpoint is output, the simulated driving screen corresponding to the top-down viewpoint is then switched to the simulated driving screen corresponding to the left-front viewpoint, and the point location explanation information corresponding to the left-front viewpoint is output.
[0053] In another optional embodiment, for any target view among the above at least one view, the driving simulator responds to the display of the simulated driving screen corresponding to the target view by outputting point explanation information of the target view, including: responding to the display of the simulated driving screen corresponding to the target view by displaying visual guidance information corresponding to the target view in the simulated driving screen corresponding to the target view, and outputting explanation information matching the visual guidance information.
[0054] The visual guidance information indicates to the driver the reference points and / or reference lines located within the virtual vehicle and virtual scene that need to be observed at preset target points, as well as the relative positional relationships of the reference points and / or reference lines. The accompanying explanatory information explains the visual guidance information, such as explaining the name of the virtual vehicle's location in the driving instruction, or explaining the target state that the reference points and / or reference lines marked in the visual guidance information need to achieve in the driving exercise (e.g., the right side of the vehicle being within 30 centimeters of the right edge of the road). Through the synchronized output of the visual guidance information and the accompanying explanatory information, the preset target points and their corresponding driving operations can be explained in a visually and intuitive way, allowing drivers to understand the relevant content in the driving instruction in a more vivid and intuitive manner, thereby enhancing the driver's simulated driving experience.
[0055] Optionally, the visual guidance information includes at least one of the following: highlighting the target vehicle structure of the virtual vehicle, such as highlighting the left front wheel, right front wheel, left rear wheel, or right rear wheel; highlighting the left rearview mirror or the right rearview mirror; highlighting the door handle of the virtual vehicle, etc.; highlighting reference lines in the virtual scene, such as highlighting the left edge line of the garage or the right edge line of the garage, etc.; displaying a line of sight from the driver's seat to a reference point or reference line in the virtual scene, that is, displaying a line of sight from the driver's seat to a point on the virtual vehicle or a point on the driver's body and extending to a reference point or reference line in the virtual scene, such as displaying a line of sight from the driver's seat to the driver's shoulder and extending to the control line in the reversing parking exercise, etc.; identifying the virtual vehicle. The distance between the vehicle and reference lines or points in the virtual scene, such as: indicating the distance between the right side of the virtual vehicle and the right edge of the road in the virtual scene, for example, indicating that the distance between the right side of the virtual vehicle and the right edge of the road in the virtual scene is 1.5 meters, 30 to 50 centimeters, or less than 30 centimeters, etc.; or indicating the distance between the left side of the virtual vehicle and the left edge of the road in the virtual scene, for example, indicating that the distance between the left side of the virtual vehicle and the left edge of the road in the virtual scene is 1.5 meters, etc.; displaying the predicted driving trajectory of the virtual vehicle, which is also the preview trajectory of the virtual vehicle, is a preview line of the virtual vehicle's driving trajectory, and the predicted driving trajectory of the virtual vehicle changes as the steering wheel of the virtual vehicle is turned.
[0056] The target vehicle structure, reference lines, and reference points are matched with the currently simulated driving task. This means that there are differences in the target vehicle structure, reference points, and reference lines involved in the visual guidance information corresponding to different driving tasks. The selection of the target vehicle structure, reference lines, and reference points can be determined according to the driving requirements corresponding to the driving task. For example, in the driving task of parallel parking, if the vehicle body is required to be within 30 centimeters of the right edge of the road or the edge of the sidewalk, then the target vehicle structure can be the right side of the virtual vehicle, and the reference line can be the right edge of the road, etc.
[0057] Optionally, the visual guidance information corresponding to the target viewpoint of the preset target point can be customized. For example, you can choose to configure at least one of the above-mentioned visual guidance information for the target viewpoint, or you can choose not to configure any visual guidance information for the target viewpoint. When you choose not to configure any visual guidance information for the target viewpoint, you can still configure corresponding explanatory information for the target viewpoint. This explanatory information is similar to the explanatory information corresponding to the visual guidance information and is used to explain the teaching plan corresponding to the preset target point from the target viewpoint.
[0058] In practical applications, the way the target perspective outputs explanatory information matching the visual guidance information when it is configured is the same as the way it outputs the explanatory information corresponding to the configured target perspective when it is not configured with visual guidance information. The following example illustrates this using the output of explanatory information matching the visual guidance information. Optionally, outputting explanatory information matching the visual guidance information includes: displaying text explanatory information matching the visual guidance information in the simulated driving screen corresponding to the target perspective, and / or, outputting voice explanatory information matching the visual guidance information.
[0059] It should be noted that in practical applications, the location explanation information for at least one viewpoint corresponding to the preset target point may also only include the location explanation information from the driver's seat viewpoint. If the location explanation information for the preset target pointpoint is from the driver's seat viewpoint, then in response to the virtual vehicle moving to the preset target pointpoint in the virtual scene, after obtaining the location explanation information from the driver's seat viewpoint, the visual guidance information corresponding to the driver's seat viewpoint is directly displayed in the simulated driving screen corresponding to the driver's seat viewpoint, and explanation information matching the visual guidance information is output; after the explanation information is output, the visual guidance information is cleared, that is, the simulated driving screen corresponding to the driver's seat viewpoint that does not contain visual guidance information is displayed.
[0060] After the explanation information of at least one viewpoint corresponding to the preset target point is output, the driving simulator will re-display the simulated driving screen corresponding to the driver's seat viewpoint in order to continue the subsequent driving simulation.
[0061] Optionally, before reaching the preset target point, a driving instruction plan corresponding to the preset target point can be output in advance. After the virtual vehicle reaches the preset target point, the driving instruction plan corresponding to the preset target point can be further explained by outputting point explanation information from different perspectives corresponding to the preset target point.
[0062] In summary, this solution provides a vivid and intuitive explanation of the driving operations corresponding to the preset target point during the driving simulation. This is achieved by outputting location explanation information from different perspectives corresponding to the target point and displaying corresponding visual guidance information in the simulated driving interface for each perspective, while simultaneously outputting explanation information matching the visual guidance information. This allows the driver to better understand the driving operations involved in the driving instruction for the target point, thereby improving the quality and efficiency of the driving simulation and providing a better driving experience for the driver.
[0063] The above describes the output process of the location explanation information of the preset target point in the driving information display method of the present invention. The preset target point will be explained in detail below.
[0064] Figure 3 A flowchart of a point-of-sale information configuration process is provided as an embodiment of the present invention, such as... Figure 3 As shown, the method may include the following steps:
[0065] 301. In response to the point explanation configuration operation triggered by the preset target point, display the point explanation configuration interface.
[0066] 302. Based on at least one viewpoint configured in the point-of-sight configuration interface, the visual guidance information corresponding to at least one viewpoint, and the explanation information matching the visual guidance information, determine the point-of-sight explanation information for the preset target point.
[0067] In practical applications, different driving instruction service providers (such as driving schools) have their own driving instruction methods, and the points explained and the corresponding explanation content for each point are different. To adapt to the driving instruction needs of different driving instruction service providers and provide personalized driving instruction services, this embodiment provides a point explanation configuration interface. Driving instruction service providers can trigger the point explanation configuration operation for any preset target point corresponding to a driving project through an external mouse, keyboard, or pre-configured control keys in the driving simulator. In response to the point explanation configuration operation triggered for the preset target point, the driving simulator displays the point explanation configuration interface, allowing the driving instruction service provider to configure the explanation perspective corresponding to the preset target point, the visual guidance information corresponding to the perspective, and the explanation information matching the visual guidance information through interaction with the driving simulator.
[0068] Figure 4 This is a schematic diagram of a point configuration interface provided in an embodiment of the present invention, as shown below. Figure 4 As shown, the point-of-sight explanation configuration interface includes viewpoint configuration items, visual guidance information configuration items, and explanation information configuration items. The viewpoint configuration item determines at least one viewpoint used for explaining a preset target point. Optionally, a new viewpoint can be added to the preset target point using the corresponding "Add Viewpoint" control, or an already configured viewpoint can be deleted using the "Delete" control. For any configured viewpoint, corresponding visual guidance information and matching explanation information can be configured for that viewpoint using the visual guidance information configuration items and explanation information configuration items. Optionally, the configuration content of the visual guidance information can be modified using the corresponding "Add," "Delete," and other spaces in the point-of-sight explanation configuration interface.
[0069] In one optional embodiment, the driving simulator can be pre-configured with various viewpoints and corresponding visual guidance information, including but not limited to visual display effects such as "highlighting" and "visual guidance lines" corresponding to various visual guidance information. The driving teaching service provider can directly select the target viewpoint from the preset viewpoints and select the target visual guidance information corresponding to the preset target point under the target viewpoint from the preset visual guidance information corresponding to the target viewpoint.
[0070] In another optional embodiment, when configuring the explanatory information matching the visual guidance information, considering that vehicle driving has automatic and manual transmissions, to improve the efficiency of the driving instruction service provider's point-of-use explanation configuration, manual transmission explanation information and automatic transmission explanation information matching the visual guidance information can be configured simultaneously at one time. When the driver performs a driving simulation, the explanatory information matching the visual guidance information corresponding to the type of vehicle selected by the driver can be output. For example, when the driver selects a manual transmission vehicle, manual transmission explanation information matching the visual guidance information is output; when the driver selects an automatic transmission vehicle, automatic transmission explanation information matching the visual guidance information is output.
[0071] Figure 4 Taking a preset target point in the driving exercise of reversing into a parking space as an example, the configuration of this preset target point is explained with an illustration. For example... Figure 4 As shown, this location is configured with two viewpoints: a top-down view and a left-side view.
[0072] For the top-down view, two visual guidance messages are provided: "Distance from the left lane line (1.5 meters)" and "View from the main driver's perspective towards the vehicle's location." These are accompanied by accompanying explanations: "When entering the parking space, maintain a distance of 1.5 meters from the left lane line. This ensures sufficient clearance when the vehicle is fully turned into the parking space, and prevents the right side of the vehicle from hitting the corner." Therefore, from the top-down view, these two visual guidance messages indicate the distance between the virtual vehicle and the right edge of the road in the virtual scene. They also provide a visual guide from the driver's seat to the vehicle's location, indicating the direction of observation. Combined with the accompanying explanations, the driver understands that the distance between the virtual vehicle and the right edge of the road in the virtual scene should be approximately 1.5 meters, and that this distance is crucial to prevent the right side of the vehicle from hitting the corner of the parking space when fully turned into the parking space. The "edge line" refers to the edge of the road.
[0073] For the left-hand view, the configured visual guidance information is "Look at the vehicle's position from the driver's perspective," and the accompanying explanation is "From the driver's seat, the top of the steering wheel should always be aligned with the middle of the first and third dotted lines in the driving area." Therefore, from the left-hand view, by marking the line of sight from the driver's seat to the vehicle's position (the top of the steering wheel) and providing the accompanying explanation, the driver understands that the point to observe at that location is the top of the steering wheel, and the desired driving posture is to keep the top of the steering wheel aligned with the middle of the first and third dotted lines in the driving area.
[0074] Based on the above examples, visual guidance information such as "the point of view from the main perspective towards the vehicle" is configured in both the top-down and left-side perspectives. However, since the spatial observation positions corresponding to the top-down and left-side perspectives are different, the corresponding visual guidance information also differs. For example, the top-down perspective shows the observation direction corresponding to the observation point, while the left-side perspective shows the specific location of the observation point. In this embodiment, by configuring different point explanation information corresponding to at least one perspective, the driver can fully and accurately understand the point explanation information of the preset target location from multiple spatial perspectives.
[0075] After the driving instruction service provider completes the configuration of the point explanation information corresponding to the preset point through the point explanation configuration interface, the point explanation information of the preset target point is determined based on at least one viewpoint configured in the point explanation configuration interface, the visual guidance information corresponding to at least one viewpoint, and the explanation information matching the visual guidance information. This information is then stored in a preset storage location so that when the driver moves the virtual vehicle to the preset target point in the virtual scene during simulated driving, the point explanation information configured for the preset target point can be retrieved from the preset storage location.
[0076] It is understandable that, from the perspective of driving instruction service providers, the need for explanations of pre-set target locations varies at different stages of the instruction process. For example, for a specific target location, the service provider needs to provide drivers with explanations of the location during the initial instruction phase; however, during the mock exam phase, the service provider does not need to provide such explanations.
[0077] From a driver's perspective, drivers of different skill levels have varying needs regarding the information provided for preset target points. For example, when a driver is learning to drive a specific target point for the first time, they want to learn and master the explanations provided. However, once a driver has mastered the explanations, they no longer want to learn them. If a driver already knows the explanations for a target point, then in subsequent driving simulations, the explanations are triggered every time the virtual vehicle moves to that point, wasting time learning previously learned information and reducing the driver's efficiency in the simulation.
[0078] To meet the diverse needs of driving instruction service providers and drivers, and to improve the driving experience for drivers during simulated driving, such as Figure 4 As shown, the location explanation configuration interface includes control buttons for location explanation. Driving instruction service providers or drivers can use these control buttons to control whether to output location explanation information corresponding to a preset target location. In response to a location explanation activation operation triggered in the location explanation configuration interface, when the virtual vehicle moves to the preset target location in the virtual scene, the location explanation information configured for the preset target location is retrieved. In response to a location explanation deactivation operation triggered in the location explanation configuration interface, when the virtual vehicle moves to the preset target location in the virtual scene, the location explanation information configured for the preset target location is no longer retrieved, i.e., the location explanation information for the preset target location is no longer output.
[0079] Optionally, the location explanation configuration interface can also be configured with control keys for location explanations corresponding to each viewpoint. For at least one viewpoint corresponding to a preset target location, the driver can use these control keys to control the output of location explanation information corresponding to several viewpoints within that preset viewpoint. For example, assuming that the preset target location is configured with location explanation information corresponding to viewpoints 1, 2, and 3 respectively, if the driver finds it easier to understand the driving instruction plan corresponding to the preset target location based on the location explanation information corresponding to viewpoints 1 and 2 during simulated driving, then the driver can use the control keys for location explanations corresponding to viewpoints 1, 2, and 3 in the location explanation configuration interface to control the output of location explanation information corresponding to viewpoints 1 and 2, but not the output of location explanation information corresponding to viewpoint 3.
[0080] In this embodiment, by controlling the preset target points of the location explanation information output during simulated driving, as well as the viewing angle of the location explanation information output at each preset target point, the driving instruction service provider can flexibly set its own driving instruction plan, and the driver can set the location explanation information output that matches their own learning state during simulated driving, thereby effectively improving the driver's simulated driving experience and learning efficiency.
[0081] The above embodiments illustrate the driving information display method provided by the present invention from the perspective of outputting and configuring location information for preset target points. For ease of understanding, the following examples, specifically reversing into a parking space and parallel parking, will be used to illustrate the driving information display method provided by the present invention.
[0082] Assuming that the "Content and Methods of Motor Vehicle Driver's License Examination" requires the test vehicle to meet the requirement that "both front wheels must be outside the control line" when parking for the first time, a driving school's teaching method for the first parking in the reversing parking exercise of Subject Two is: after aligning the left shoulder with the control line, stop the vehicle and engage reverse gear. The alignment of the left shoulder with the control line ensures that the front wheels are outside the control line. Based on this teaching method, top-down and left-front views can be configured to explain the location of the virtual vehicle and the virtual scene, allowing the driver to understand the virtual vehicle's position in the virtual scene when at the preset target point; the left-front view demonstrates the principle of stopping and engaging reverse gear after aligning the left shoulder with the control line.
[0083] Based on the characteristics of the preset target location, the visual guidance information of "highlighting the front wheels of the virtual vehicle" can be configured for the top-down view, along with the explanatory information "When parking at this position, the front wheels are just past the control line, and the left and right relative positions are appropriate, which is a prerequisite for not crossing the line and correctly parking when turning the wheel fully to the right in the next step"; the visual guidance information of "the line of sight from the driver's seat to the vehicle location" can be configured for the left front view, along with the explanatory information "At this time, from the driver's seat, the left shoulder is just aligned with the control line in the middle of the field".
[0084] When a driver is practicing reverse parking, after the virtual vehicle reaches the designated point, the simulated driving screen corresponding to the driver's seat view pauses and retrieves the point explanation information from the top-down view and the left front view, which are configured for the preset target point. Then, the simulated driving screen corresponding to the driver's seat view is switched to the top-down view, and the visual guidance information "the front wheels of the virtual vehicle are prominently displayed" is displayed in the top-down view. Simultaneously, the explanation information is output in the form of voice and / or text: "When you stop at this position, the front wheels have just crossed the control line, and the left and right relative positions are appropriate. This is a prerequisite for the next step of turning the wheel fully to the right without crossing the line and correctly parking the vehicle."
[0085] After the top-down view of the location information is output, the simulated driving screen is switched to the left front view, and the visual guidance information of "the line of sight from the driver's seat to the vehicle location" is displayed in the left front view. Figure 5 This is a schematic diagram of visual guidance information from a left frontal perspective provided in an embodiment of the present invention, such as... Figure 5 As shown, the visual guidance information is a ray emanating from the driver's left shoulder, which intersects with the control lines in the virtual scene. Simultaneously with the visual guidance information, explanatory information is output in the form of voice and / or text: "From the driver's seat, the left shoulder is now aligned with the control lines in the field."
[0086] After the information on the points in the left front view is explained, the simulated driving screen in the left front view is switched to the simulated driving screen corresponding to the driver's seat view, so as to carry out driving simulations of other preset target points.
[0087] In the aforementioned reverse parking exercise, the demonstration and explanation using both overhead and left front views allow drivers to fully understand what it means to look at the left shoulder, where the control lines are, and the meaning and function of "stopping after aligning the left shoulder with the control lines." Furthermore, the experience of switching between different simulated driving views helps drivers better perceive the vehicle's status at different angles, thus enhancing their understanding of the driving instruction program.
[0088] Assuming that the "Motor Vehicle Driver's License Examination Content and Methods" requires that when a test vehicle is parked on the side of the road, "after parking, the vehicle body should be within 30 centimeters of the right edge of the road or the edge of the sidewalk," a driving school's teaching method for the parallel parking exercise in Subject 3 is as follows: Change to the rightmost lane, and stop when the front third of the vehicle is always aligned with the right edge of the road. Specifically, when the front third of the vehicle is always aligned with the right edge of the road, the vehicle body is within 30 centimeters of the right edge of the road. Based on this teaching method, top-down and left-front perspectives can be configured to explain the location of the virtual vehicle at the preset target position. The top-down perspective is used to demonstrate and explain the relative position of the virtual vehicle and the virtual scene, allowing the driver to grasp the position of the virtual vehicle in the virtual scene when at the preset target position. The left-front perspective is used to demonstrate and explain the position of the front third of the vehicle, the right edge of the road, and the principle of parking when the front third of the vehicle and the right edge of the road are always aligned.
[0089] Based on the characteristics of the preset target location, visual guidance information such as "distance from the right edge of the road (less than 30 cm)" can be configured for the top-down view, along with the explanatory information "If you park at this location, the vehicle body will be within 30 cm of the right edge of the road, and no points will be deducted"; visual guidance information such as "the line of sight from the driver's seat to the vehicle location" can be configured for the left front view, along with the explanatory information "At this time, from the driver's seat, the right third of the front of the car coincides with the right edge of the road."
[0090] When a driver is practicing parallel parking, once the virtual vehicle reaches the designated spot, the simulated driving screen corresponding to the driver's seat view pauses and retrieves location information from both the overhead and left front view perspectives. Then, the simulated driving screen from the driver's seat view is switched to an overhead view, displaying visual guidance information indicating the distance from the right edge of the road (less than 30 centimeters). Figure 6 This is a schematic diagram of visual guidance information from a top-down perspective provided in an embodiment of the present invention, such as... Figure 6 As shown, the visual guidance information indicates that the distance between the virtual vehicle and the right edge of the road in the virtual scene is 30 centimeters in the simulated driving screen from a top-down perspective. Simultaneously with the visual guidance information, the explanatory information is output in the form of voice and / or text: "Park at this position, the vehicle body is within 30 centimeters of the right edge of the road, no points will be deducted."
[0091] After the top-down view of the location information is output, the simulated driving screen is switched to the left front view, and the visual guidance information of "the line of sight from the driver's seat to the vehicle location" is displayed in the left front view. Figure 7This is a schematic diagram of another left-front view visual guidance information provided in an embodiment of the present invention, such as... Figure 7 As shown, the visual guidance information is a ray emanating from the driver, passing through the right third of the front of the car, and intersecting with the right edge of the road in the virtual scene. Simultaneously with the visual guidance information, explanatory information is output in the form of voice and / or text: "From the driver's seat, the right third of the front of the car coincides perfectly with the right edge of the road."
[0092] After the information on the points in the left front view is explained, the simulated driving screen in the left front view is switched to the simulated driving screen corresponding to the driver's seat view, so as to carry out driving simulations of other preset target points.
[0093] In the aforementioned parallel parking exercise, the demonstration and explanation using both overhead and left-front perspectives allow drivers to fully understand the position of the right third of the vehicle's hood and the right edge of the road, and to grasp the meaning and purpose of parking when the right third of the vehicle's hood and the right edge of the road always align. The experience of switching between different simulated driving perspectives helps drivers better perceive the vehicle's status at different angles, thus enhancing their understanding of the driving instruction program.
[0094] The following will describe in detail one or more embodiments of the driving information display device of the present invention. Those skilled in the art will understand that these devices can all be configured using commercially available hardware components through the steps taught in this solution.
[0095] Figure 8 This is a schematic diagram of the structure of a driving information display device provided in an embodiment of the present invention, as shown below. Figure 8 As shown, the device includes a display module 11 and a processing module 12.
[0096] The display module 11 is used to display the simulated driving screen corresponding to the driver's seat view. The simulated driving screen includes the virtual scene corresponding to the currently simulated driving project and the virtual vehicle controlled by the driver in the virtual scene.
[0097] The processing module 12 is configured to, in response to the virtual vehicle moving to a preset target point in the virtual scene, acquire point explanation information configured for the preset target point, the point explanation information including point explanation information from at least one perspective, the preset target point matching the currently simulated driving project; switch the simulated driving screen corresponding to the driver's perspective to the simulated driving screen corresponding to the at least one perspective; and, in response to the display of the simulated driving screen corresponding to the target perspective, output the point explanation information of the target perspective, the target perspective being any one of the at least one perspectives.
[0098] The display module 11 is also used to display the simulated driving screen corresponding to the driver's seat view after the output of the point explanation information of the at least one view is completed, so as to carry out subsequent driving simulation.
[0099] In an optional embodiment, the display module 11 is further configured to display the point explanation and configuration interface in response to the point explanation and configuration operation triggered by the preset target point.
[0100] The processing module 12 is further configured to determine the location explanation information of the preset target location based on the at least one view configured in the location explanation configuration interface, the visual guidance information corresponding to the at least one view, and the explanation information matching the visual guidance information.
[0101] In one optional embodiment, in response to the point explanation start operation of the preset target point triggered on the point explanation configuration interface, when the virtual vehicle moves to the preset target point in the virtual scene, the point explanation information configured for the preset target point is obtained.
[0102] In an optional embodiment, the processing module 12 is specifically used to sequentially switch the simulated driving screen corresponding to the driver's seat view to the simulated driving screen corresponding to the at least one view according to the output order of the pre-configured point explanation information of the at least one view.
[0103] In an optional embodiment, the processing module 12 is further specifically configured to respond to the display of the simulated driving screen corresponding to the target viewpoint, display visual guidance information corresponding to the target viewpoint in the simulated driving screen corresponding to the target viewpoint, and output explanatory information matching the visual guidance information.
[0104] In an optional embodiment, the visual guidance information includes at least one of the following: highlighting the target vehicle structure of the virtual vehicle, highlighting reference lines in the virtual scene, displaying a line of sight from the driver's seat to a reference point or reference line in the virtual scene, indicating the distance between the virtual vehicle and the reference line or reference point in the virtual scene, and displaying the predicted driving trajectory of the virtual vehicle; wherein the target vehicle structure, the reference line, and the reference point match the currently simulated driving project.
[0105] In an optional embodiment, the processing module 12 is further configured to display text explanation information matching the visual guidance information in the simulated driving screen corresponding to the target viewpoint, and / or output voice explanation information matching the visual guidance information.
[0106] Figure 8 The device shown can execute the driving information display method in the foregoing embodiments. For details of the execution process and technical effects, please refer to the description in the foregoing embodiments, which will not be repeated here.
[0107] In one possible design, the above Figure 8 The structure of the driving information display device shown can be implemented as an electronic device, such as... Figure 9 As shown, the device may include: a processor 21, a memory 22, and a communication interface 23. The memory 22 stores executable code, which, when executed by the processor 21, enables the processor 21 to at least implement the driving information display method as described in the foregoing embodiments.
[0108] In addition, embodiments of the present invention provide a non-transitory machine-readable storage medium storing executable code, which, when executed by a processor of a network device, enables the processor to at least implement the driving information display method provided in the foregoing embodiments.
[0109] This invention provides a computer program product, including: a computer program that, when executed by a processor of an electronic device, enables the processor to at least implement the driving information display method provided in the foregoing embodiments.
[0110] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separate. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0111] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of a necessary general-purpose hardware platform, or by a combination of hardware and software. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a computer product. The present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0112] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for displaying driving information, characterized in that, include: The simulated driving screen is displayed from the driver's seat perspective. The simulated driving screen includes a virtual scene corresponding to the currently simulated driving project and a virtual vehicle controlled by the driver in the virtual scene. In response to the virtual vehicle moving to a preset target point in the virtual scene, point explanation information configured for the preset target point is obtained. The point explanation information includes point explanation information from at least one perspective. The preset target point matches the currently simulated driving project. Switch the simulated driving screen corresponding to the driver's seat view to the simulated driving screen corresponding to at least one of the viewpoints; In response to the display of the simulated driving screen corresponding to the target viewpoint, visual guidance information corresponding to the target viewpoint is displayed in the simulated driving screen corresponding to the target viewpoint, and explanatory information matching the visual guidance information is output, wherein the target viewpoint is any one of the at least one viewpoints. In response to the completion of the point explanation information output from at least one perspective, the simulated driving screen corresponding to the driver's seat perspective is displayed for subsequent driving simulation.
2. The method according to claim 1, characterized in that, The method further includes: In response to the point explanation configuration operation triggered by the preset target point, the point explanation configuration interface is displayed; Based on the at least one viewpoint configured in the point-of-sight configuration interface, the visual guidance information corresponding to the at least one viewpoint, and the explanation information matching the visual guidance information, the point-of-sight explanation information of the preset target point is determined.
3. The method according to claim 2, characterized in that, The step of responding to the virtual vehicle moving to a preset target location in the virtual scene and obtaining the location description information configured for the preset target location includes: In response to the point explanation start operation triggered by the point explanation configuration interface, when the virtual vehicle moves to the preset target point in the virtual scene, the point explanation information configured for the preset target point is obtained.
4. The method according to claim 1, characterized in that, The step of switching the simulated driving view corresponding to the driver's seat view to the simulated driving view corresponding to at least one view includes: According to the output order of the pre-configured point explanation information of the at least one perspective, the simulated driving screen corresponding to the driver's seat perspective is switched to the simulated driving screen corresponding to the at least one perspective in sequence.
5. The method according to claim 1, characterized in that, The visual guidance information includes at least one of the following: highlighting the target vehicle structure of the virtual vehicle, highlighting reference lines in the virtual scene, displaying a line of sight from the driver's seat to a reference point or reference line in the virtual scene, indicating the distance between the virtual vehicle and the reference line or reference point in the virtual scene, and displaying the predicted driving trajectory of the virtual vehicle; wherein the target vehicle structure, the reference line, and the reference point match the currently simulated driving project.
6. The method according to claim 1, characterized in that, The output of explanatory information that matches the visual guidance information includes: In the simulated driving screen corresponding to the target viewpoint, display text explanation information matching the visual guidance information, and / or output voice explanation information matching the visual guidance information.
7. A driving information display device, characterized in that, include: The display module is used to display the simulated driving screen corresponding to the driver's seat view. The simulated driving screen includes the virtual scene corresponding to the currently simulated driving project and the virtual vehicle controlled by the driver in the virtual scene. The processing module is configured to, in response to the virtual vehicle moving to a preset target point in the virtual scene, acquire point explanation information configured for the preset target point, the point explanation information including point explanation information from at least one perspective, the preset target point matching the currently simulated driving project; and switch the simulated driving screen corresponding to the driver's perspective to the simulated driving screen corresponding to the at least one perspective. In response to the display of the simulated driving screen corresponding to the target viewpoint, visual guidance information corresponding to the target viewpoint is displayed in the simulated driving screen corresponding to the target viewpoint, and explanatory information matching the visual guidance information is output, wherein the target viewpoint is any one of the at least one viewpoints. The display module is also used to display the simulated driving screen corresponding to the driver's seat view after the output of the point explanation information of the at least one perspective is completed, so as to carry out subsequent driving simulation.
8. An electronic device, characterized in that, include: The system includes a memory, a processor, and a communication interface; wherein the memory stores executable code, and when the executable code is executed by the processor, the processor performs the driving information display method as described in any one of claims 1 to 6.
9. A non-transitory machine-readable storage medium, characterized in that, The non-transitory machine-readable storage medium stores executable code that, when executed by a processor of an electronic device, causes the processor to perform the driving information display method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Unmanned aerial vehicle inspection virtual simulation training system and method
CN113362667A
Driving school simulation teaching method, device and system and storage medium
CN114078349A
Teaching method and device for simulated driving, electronic equipment and storage medium
CN117912329A