Virtual driving video teaching method, system, storage medium and device
By obtaining vehicle scene information in real time and comparing it, customized virtual simulation teaching videos are generated, which solves the problem of low learning efficiency of traditional driving technology and achieves more efficient and interesting driving skills improvement.
Patent Information
- Application Number
- CN202210901888.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-28
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2042-07-28
AI Technical Summary
Traditional driving techniques are inefficient in learning and are not targeted, and cannot effectively improve the driving skills of novice drivers.
By obtaining the real-time scene information of the vehicle, using the C3D neural network to extract the scene feature information, and comparing it with the preset scene information database, customized virtual simulation teaching videos are generated, and sent to the in-vehicle entertainment system through OTA wireless upgrades, for user operation commands to control playback.
Customized virtual simulation teaching based on driver's actual driving scenario data is realized, and the efficiency and fun of driving technology learning is improved.
Smart Images

Figure CN115482699B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicle intelligent teaching, and in particular to a virtual driving video teaching method, system, storage medium and equipment. Background Art
[0002] With the rapid development of the automobile industry, cars are becoming more and more popular as a common means of transportation. There are more and more novice drivers. How to improve their driving skills is a concern for many novice drivers. The rapid development of automotive electronics and the application of vehicle networking technology provide them with smarter and more effective choices.
[0003] With traditional cars, drivers can only improve their driving skills based on their own driving experience or by learning from other drivers’ driving skills. This is not only inefficient and not very targeted, but also has poor results, resulting in some drivers driving for a long time without improving their driving skills.
[0004] Based on this, how to generate a customized virtual simulation teaching based on the driver's actual driving scene data and bring users a better experience and more effective learning plan is a technical problem that needs to be solved urgently. Summary of the invention
[0005] The present invention provides a virtual driving video teaching method, system, storage medium and device, which can generate a set of customized virtual simulation teaching based on the driver's actual driving scene data, and bring users a better experience and a more effective learning plan.
[0006] In a first aspect, a virtual driving video teaching method is provided, comprising the following steps:
[0007] Acquire real-time scene information of the vehicle, compare the real-time scene information with a preset scene information library, and obtain a scene information comparison result;
[0008] calling a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and sending the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade;
[0009] Obtain user operation instructions, and control the in-vehicle entertainment system to play the virtual driving video according to the user operation instructions.
[0010] According to the first aspect, in a first possible implementation manner of the first aspect, the step of “obtaining real-time scene information of the vehicle, comparing the real-time scene information with a preset scene information library, and obtaining a scene information comparison result” specifically includes the following steps:
[0011] Acquire real-time scene information of the vehicle, extract scene feature information of the real-time scene information through a C3D neural network, and convert the scene feature information into a real-time scene classification result based on a local training model;
[0012] The preset scene information library includes a variety of different types of preset scene classification results;
[0013] The real-time scene classification result is compared with the preset scene classification result to obtain a preset scene classification result of the same type as the real-time scene classification result.
[0014] According to the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, after the step of “obtaining real-time scene information of the vehicle, and extracting scene feature information of the real-time scene information through a C3D neural network”, the following steps are specifically included:
[0015] Generate a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and construct the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software;
[0016] The traffic road map simulation video is uploaded to a preset scene information library, and the preset scene information library is updated based on a local training model to obtain an updated preset scene information library.
[0017] According to the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the step of “obtaining a user operation instruction, and controlling the in-vehicle entertainment system to play a virtual driving video according to the user operation instruction” specifically includes the following steps:
[0018] The in-vehicle entertainment system includes an in-vehicle full LCD screen central control and an in-vehicle full LCD screen instrument;
[0019] Obtaining user operation instructions, and controlling the vehicle-mounted full LCD screen central control to play the virtual driving video according to the user operation instructions; or,
[0020] Obtain user operation instructions, and control the vehicle's onboard full LCD screen instrument to play the virtual driving video according to the user operation instructions.
[0021] According to the third possible implementation manner of the first aspect, in the fourth possible implementation manner of the first aspect, after the step of “obtaining real-time scene information of the vehicle”, the following steps are specifically included:
[0022] When it is detected that the real-time scene information is in a busy traffic section, suspending the start-up scene information comparison;
[0023] When it is detected that the real-time scene information is not in a busy traffic section, the in-vehicle entertainment system is controlled to play a virtual driving video within a preset time.
[0024] In a second aspect, a virtual driving video teaching system is provided, comprising:
[0025] A real-time scene information acquisition module is used to acquire real-time scene information of the vehicle, compare the real-time scene information with a preset scene information library, and acquire a scene information comparison result;
[0026] A virtual driving video acquisition and transmission module is communicatively connected with the real-time scene information acquisition module, and is used to call a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and send the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade;
[0027] The operating virtual driving video module is communicatively connected with the virtual driving video acquisition and transmission module, and is used to obtain user operation instructions, and control the in-vehicle entertainment system to play the virtual driving video according to the user operation instructions.
[0028] According to the second aspect, in a first possible implementation of the second aspect, the real-time scene information acquisition module is used to acquire real-time scene information of the vehicle, extract scene feature information of the real-time scene information through a C3D neural network, and convert the scene feature information into a real-time scene classification result based on a local training model; the preset scene information library includes different types of preset scene classification results; the real-time scene classification result is compared with the preset scene classification result, and a preset scene classification result of the same type corresponding to the real-time scene classification result is obtained.
[0029] According to the first possible implementation manner of the second aspect, in the second possible implementation manner of the second aspect, it also includes a preset scenario information library update module, which is communicatively connected to the real-time scene information acquisition module, and is used to generate a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and construct the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software; upload the traffic road map simulation video to the preset scenario information library, and update the preset scenario information library to obtain an updated preset scenario information library.
[0030] In a third aspect, a storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the virtual driving video teaching method described above is implemented.
[0031] In a fourth aspect, an electronic device is provided, comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, wherein the processor implements the virtual driving video teaching method as described above when executing the computer program.
[0032] Compared with the prior art, the advantages of the present invention are as follows: first, the real-time scene information of the vehicle is obtained, specifically by using the vehicle's panoramic camera, and then the real-time scene information is compared with a preset scene information library to obtain a scene information comparison result; then, according to the scene information comparison result, a virtual driving video corresponding to the real-time scene information is called, and the virtual driving video is sent to the in-vehicle entertainment system through OTA wireless upgrade; then, a user operation instruction is obtained, and the in-vehicle entertainment system is controlled to play the virtual driving video according to the user operation instruction; the present invention calls the virtual driving video corresponding to the real-time scene information based on the driver's real-time driving scene information, that is, automatically generates a set of customized virtual simulation teaching videos, compares the previous driving technology learning, and creates a new driving technology learning plan, so that the previous rigid and boring learning method becomes vivid and interesting, and improves the fun and efficiency of driving technology learning. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 It is a flow chart of the virtual driving video teaching method of the present invention;
[0034] Figure 2 It is a structural schematic diagram of the virtual driving video teaching system of the present invention. Description of the drawings:
[0036] 100. Virtual driving video teaching system; 110. Real-time scene information acquisition module; 120. Virtual driving video acquisition and transmission module; 130. Virtual driving video operation module; 140. Preset scene information library update module. DETAILED DESCRIPTION
[0037] Reference will now be made in detail to specific embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Although the present invention will be described in conjunction with specific embodiments, it will be understood that it is not intended to limit the present invention to the embodiments described. On the contrary, it is intended to cover changes, modifications and equivalents included in the spirit and scope of the present invention as defined by the appended claims. It should be noted that the method steps described herein can all be implemented by any functional block or functional arrangement, and any functional block or functional arrangement can be implemented as a physical entity or a logical entity, or a combination of the two.
[0038] In order to enable those skilled in the art to better understand the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0039] Note: The example to be introduced below is only a specific example, and is not intended to limit the embodiments of the present invention to the following specific steps, values, conditions, data, sequences, etc. Those skilled in the art can apply the concept of the present invention to construct more embodiments not mentioned in this specification by reading this specification.
[0040] See also Figure 1 As shown, an embodiment of the present invention provides a virtual driving video teaching method, comprising the following steps:
[0041] S100, obtaining real-time scene information of the vehicle, comparing the real-time scene information with a preset scene information library, and obtaining a scene information comparison result;
[0042] S200, calling a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and sending the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade;
[0043] S300, obtaining a user operation instruction, and controlling the in-vehicle entertainment system to play a virtual driving video according to the user operation instruction.
[0044] Specifically, in this embodiment, see Figure 1 As shown, firstly, the real-time scene information of the vehicle is obtained, specifically, the panoramic camera of the vehicle is used to collect the vehicle driving data, such as the reverse parking scene, the panoramic camera is used to collect the video information of the vehicle parking; then, the real-time scene information is compared with the preset scene information library to obtain the scene information comparison result; then, according to the scene information comparison result, the virtual driving video corresponding to the real-time scene information is called, and the virtual driving video is sent to the in-vehicle entertainment system through OTA wireless upgrade; then, the user operation instruction is obtained, and the in-vehicle entertainment system is controlled to play the virtual driving video according to the user operation instruction; the present invention calls the virtual driving video corresponding to the real-time scene information based on the real-time driving scene information of the driver, that is, automatically generates a set of customized virtual simulation teaching videos, compares the previous driving technology learning, and creates a new driving technology learning program, so that the previous rigid and boring learning method becomes vivid and interesting, and improves the fun and efficiency of driving technology learning.
[0045] It should be noted that OTA (Over the Air Technology) wireless upgrade is space download technology. In layman's terms, we use OTA technology to upgrade the system of our mobile phone. The system update package downloaded through the wireless network or 4G network is directly upgraded through OTA upgrade technology; car OTA upgrade is like a smart phone. It can support online upgrade of car computers and improve vehicle performance by upgrading the car's onboard computer system. At the same time, it can realize remote management of mobile terminal devices and SIM card data through the air interface of mobile communications.
[0046] Preferably, in another embodiment of the present application, the step of "S100, obtaining real-time scene information of the vehicle, comparing the real-time scene information with a preset scene information library, and obtaining a scene information comparison result" specifically includes the following steps:
[0047] S110, acquiring real-time scene information of the vehicle, extracting scene feature information of the real-time scene information through a C3D neural network, and converting the scene feature information into a real-time scene classification result based on a local training model;
[0048] S120, the preset scene information library includes a plurality of different types of preset scene classification results;
[0049] S130, comparing the real-time scene classification result with the preset scene classification result, and obtaining a preset scene classification result of the same type as the real-time scene classification result.
[0050] Specifically, in this embodiment, the C3D (Generic Features for Video Analysis) neural network is a 3D convolutional network used for video feature extraction. C3D has good feature recognition test results in the three databases of behavior recognition, action similarity annotation, and scene and object recognition. Similarly, the preset scene information library also extracts scene feature information through the C3D neural network for the preset scene information in advance, and then converts the scene feature information into a variety of different types of preset scene classification results based on the local training model.
[0051] Preferably, in another embodiment of the present application, after the step of “S100, obtaining real-time scene information of the vehicle, and extracting scene feature information of the real-time scene information through a C3D neural network”, the following steps are specifically included:
[0052] S140, generating a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and constructing the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software;
[0053] S150, uploading the traffic road map simulation video to a preset scene information library, and updating the preset scene information library based on a local training model to obtain an updated preset scene information library.
[0054] Specifically, in this embodiment, since the preset scene information in the preset scene information library is also limited, the real-time scene feature information obtained each time is converted into a traffic road map simulation video, and then the preset scene information library is updated based on the local training model. The updated preset scene information library includes more different types of preset scene classification results based on the original preset scene classification results. Therefore, more different types of preset scene classification results can be used to respond to various real-time scene information in real time.
[0055] At the same time, the intelligent driving complex traffic scenario simulation tool software can simulate roads and dynamic traffic flows, where the road part is composed of OpenDrive files and the dynamic traffic flow part is composed of OpenScenario files.
[0056] Preferably, in another embodiment of the present application, the step of "S300, obtaining a user operation instruction, and controlling the in-vehicle entertainment system to play a virtual driving video according to the user operation instruction" specifically includes the following steps:
[0057] The in-vehicle entertainment system includes an in-vehicle full LCD screen central control and an in-vehicle full LCD screen instrument;
[0058] S310, obtaining a user operation instruction, and controlling the vehicle-mounted full LCD screen central control to play a virtual driving video according to the user instruction; or
[0059] S320, obtaining a user operation instruction, and controlling the vehicle-mounted full-LCD screen instrument to play a virtual driving video according to the user operation instruction.
[0060] Preferably, in another embodiment of the present application, after the step of "obtaining real-time scene information of the vehicle", the following steps are specifically included:
[0061] When it is detected that the real-time scene information is in a busy traffic section, suspending the start-up scene information comparison;
[0062] When it is detected that the real-time scene information is not in a busy traffic section, the in-vehicle entertainment system is controlled to play a virtual driving video within a preset time.
[0063] Specifically, in this embodiment, when the real-time scene information is detected to be in a busy traffic section, it means that the roadside where the vehicle is located is relatively busy at this time, and the driver has no possibility and no time to watch the virtual driving video, so the scene information comparison will be suspended; when it is detected that the real-time scene information is not in a busy traffic section, it is impossible to waste too much time to watch the virtual driving video on the road, otherwise it will affect traffic, so the in-vehicle entertainment system is controlled to play the virtual driving video within the preset time.
[0064] See also Figure 2 As shown, the embodiment of the present invention further provides a virtual driving video teaching system 100, comprising:
[0065] A real-time scene information acquisition module 110 is used to acquire real-time scene information of the vehicle, compare the real-time scene information with a preset scene information library, and acquire a scene information comparison result;
[0066] A virtual driving video acquisition and transmission module 120 is connected to the real-time scene information acquisition module 110 for calling a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and sending the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade;
[0067] The virtual driving video operation module 130 is connected to the virtual driving video acquisition and transmission module 120 for acquiring user operation instructions and controlling the in-vehicle entertainment system to play the virtual driving video according to the user operation instructions.
[0068] The real-time scene information acquisition module 110 acquires the real-time scene information of the vehicle, extracts scene feature information of the real-time scene information through a C3D neural network, and converts the scene feature information into a real-time scene classification result based on a local training model; the preset scene information library includes different types of preset scene classification results; the real-time scene classification result is compared with the preset scene classification result, and a preset scene classification result of the same type corresponding to the real-time scene classification result is acquired.
[0069] It also includes a preset scene information library update module 140, which is in communication with the real-time scene information acquisition module 110, and is used to generate a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and construct the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software; upload the traffic road map simulation video to the preset scene information library, and update the preset scene information library to obtain an updated preset scene information library.
[0070] Therefore, the virtual driving video teaching system first obtains the real-time scene information of the vehicle, specifically by using the vehicle's panoramic camera, and then compares the real-time scene information with a preset scene information library to obtain a scene information comparison result; then, according to the scene information comparison result, the virtual driving video corresponding to the real-time scene information is called, and the virtual driving video is sent to the in-vehicle entertainment system through OTA wireless upgrade; then, the user operation instruction is obtained, and the in-vehicle entertainment system is controlled to play the virtual driving video according to the user operation instruction; the present invention calls the virtual driving video corresponding to the real-time scene information based on the driver's real-time driving scene information, that is, automatically generates a set of customized virtual simulation teaching videos, compares the previous driving technology learning, and creates a new driving technology learning plan, so that the previous rigid and boring learning method becomes vivid and interesting, and improves the fun and efficiency of driving technology learning.
[0071] Specifically, this embodiment corresponds one-to-one to the above method embodiment, and the functions of each module have been described in detail in the corresponding method embodiment, so they will not be repeated here.
[0072] Based on the same inventive concept, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, all or part of the method steps of the above method are implemented.
[0073] The present invention implements all or part of the process in the above method, and can also be completed by instructing related hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of each method embodiment can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.
[0074] Based on the same inventive concept, an embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program running on the processor, and when the processor executes the computer program, all or part of the method steps in the above method are implemented.
[0075] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of a computer device, and uses various interfaces and lines to connect various parts of the entire computer device.
[0076] The memory can be used to store computer programs and / or modules. The processor realizes various functions of the computer device by running or executing the computer programs and / or modules stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the mobile phone (such as audio data, video data, etc.). In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0077] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, servers or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.
[0078] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), servers, and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as a combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0079] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0080] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0081] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A virtual driving video teaching method, characterized in that: The following steps are involved: Acquire real-time scene information of the vehicle, compare the real-time scene information with a preset scene information library, and obtain a scene information comparison result; calling a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and sending the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade; Obtaining a user operation instruction, and controlling the in-vehicle entertainment system to play a virtual driving video according to the user operation instruction; The step of "obtaining real-time scene information of the vehicle, comparing the real-time scene information with a preset scene information library, and obtaining a scene information comparison result" specifically includes the following steps: Acquire real-time scene information of the vehicle, extract scene feature information of the real-time scene information through a C3D neural network, and convert the scene feature information into a real-time scene classification result based on a local training model; The preset scene information library includes a variety of different types of preset scene classification results; Comparing the real-time scene classification result with the preset scene classification result, and obtaining a preset scene classification result of the same type corresponding to the real-time scene classification result; The step of "obtaining a user operation instruction, and controlling the in-vehicle entertainment system to play a virtual driving video according to the user operation instruction" specifically includes the following steps: The in-vehicle entertainment system includes an in-vehicle full LCD screen central control and an in-vehicle full LCD screen instrument; Obtaining user operation instructions, and controlling the vehicle-mounted full LCD screen central control to play the virtual driving video according to the user operation instructions; or, Obtain user operation instructions, and control the vehicle's onboard full LCD screen instrument to play the virtual driving video according to the user operation instructions.
2. The virtual driving video teaching method according to claim 1, characterized in that: After the step of "obtaining real-time scene information of the vehicle and extracting scene feature information of the real-time scene information through a C3D neural network", the following steps are specifically included: Generate a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and construct the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software; The traffic road map simulation video is uploaded to a preset scene information library, and the preset scene information library is updated based on a local training model to obtain an updated preset scene information library.
3. The virtual driving video teaching method according to claim 1, characterized in that: After the step of "obtaining real-time scene information of the vehicle", the following steps are specifically included: When it is detected that the real-time scene information is in a busy traffic section, suspending the start-up scene information comparison; When it is detected that the real-time scene information is not in a busy traffic section, the in-vehicle entertainment system is controlled to play a virtual driving video within a preset time.
4. A virtual driving video teaching system, characterized in that: include: A real-time scene information acquisition module is used to acquire real-time scene information of the vehicle, compare the real-time scene information with a preset scene information library, and acquire a scene information comparison result; A virtual driving video acquisition and transmission module is communicatively connected with the real-time scene information acquisition module, and is used to call a virtual driving video corresponding to the real-time scene information according to the scene information comparison result, and send the virtual driving video to the in-vehicle entertainment system through OTA wireless upgrade; An operation virtual driving video module is connected to the virtual driving video acquisition and transmission module for acquiring user operation instructions and controlling the in-vehicle entertainment system to play the virtual driving video according to the user operation instructions; The real-time scene information acquisition module is used to acquire the real-time scene information of the vehicle, extract scene feature information of the real-time scene information through the C3D neural network, and convert the scene feature information into a real-time scene classification result based on the local training model; The preset scene information library includes different types of preset scene classification results; Comparing the real-time scene classification result with the preset scene classification result, and obtaining a preset scene classification result of the same type corresponding to the real-time scene classification result; The in-vehicle entertainment system includes an in-vehicle full LCD screen central control and an in-vehicle full LCD screen instrument; The virtual driving video operation module is used to obtain user operation instructions and control the vehicle-mounted full LCD screen central control to play the virtual driving video according to the user operation instructions; Alternatively, a user operation instruction is obtained, and according to the user operation instruction, the vehicle-mounted full-LCD screen instrument is controlled to play the virtual driving video.
5. The virtual driving video teaching system according to claim 4, characterized in that: It also includes a preset scene information library update module, which is in communication connection with the real-time scene information acquisition module, and is used to generate a road scene OpenDrive file and a dynamic traffic flow OpenScenario file from the scene feature information, and construct the road scene OpenDrive file and the dynamic traffic flow OpenScenario file into a traffic road map simulation video through simulation software; The traffic road map simulation video is uploaded to a preset scene information library, and the preset scene information library is updated to obtain an updated preset scene information library.
6. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the virtual driving video teaching method according to any one of claims 1 to 3 is implemented.
7. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor runs the computer program, the virtual driving video teaching method according to any one of claims 1 to 3 is implemented.
Citation Information
Patent Citations
Parallel driving control method
CN108776481A
Automatic driving simulation method and system
CN110647053A