Simulated driving interactive training method and related device

Abstract

The application discloses a kind of simulation driving interactive training method and related equipment, comprising: in response to the training start instruction of target user terminal, the real scene training video of training route is sent to the above-mentioned target user terminal, training route includes at least two training sections, at least two specific road condition scene different training sections exist in the real scene training video of each training route;Standard operation data is identified based on real scene training video;Based on real scene training video and standard operation data, the training user of target user terminal is carried out simulation driving interactive training;Under the condition of simulation driving interactive training, the simulation training data of training user is acquired;Based on the matching relationship of standard operation data and simulation training data, the training achievement of training user is calculated.The scheme is simulated driving interactive training to training user under real scene training video, gives training user in the same training route experience different specific road condition scene Real driving experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of virtual driving technology, in particular to a simulation driving interactive training method and related equipment. BACKGROUND

[0002] The existing virtual driving system as an advanced driving training tool contains a 3D virtual scene built on the basis of real scenes, and the user can control the virtual car in the virtual driving scene in real time, and the driving teaching prompts are played through the display screen to improve the driving level of the user.

[0003] However, the existing virtual driving system has the following problems: the scene construction of virtual driving is simple, and the virtual road lacks pedestrians and vehicles, so that the training user has a great difference between the feeling in the use process and the driving feeling in the real scene, without the feeling of being in the scene, which affects the driving teaching quality. SUMMARY

[0004] In view of the above problems, the embodiments of the present application provide a simulation driving interactive training method and related equipment, which can give the training user the driving teaching experience of different real scenes in a training route.

[0005] In order to at least solve the above problems, the first aspect of the embodiments of the present application provides a simulation driving interactive training method, which comprises:

[0006] In response to the training start instruction of the target user terminal, the real scene training video of the training route is sent to the target user terminal, and the training route comprises at least two training road sections, and there are at least two specific road condition scenes different from each other in the real scene training video of each training road section;

[0007] The standard operation data is identified based on the real scene training video;

[0008] The training user of the target user terminal is subjected to simulation driving interactive training based on the real scene training video and the standard operation data;

[0009] In the case of simulation driving interactive training, the simulation training data of the training user is obtained;

[0010] Based on the matching relationship between the standard operation data and the simulation training data, the training result of the training user is calculated.

[0011] Optionally, the road condition scene comprises at least one of the weather scene, the time scene and the congestion degree scene, at least two specific road condition scenes are included in the same scene type, and before the real scene training video of the training road section is sent to the target user terminal, the method further comprises:

[0012] recording the first real scene video of the training route under each specific road condition scenario;

[0013] dividing the first real scene video of the training route into real scene videos of different training road segments.

[0014] Optionally, the road condition scenarios include at least one of a weather scenario, a time scenario, and a congestion degree scenario, and at least two specific road condition scenarios are included in the same scenario type, and before the real scene training video of the training road segment is sent to the target user terminal, the method further includes:

[0015] recording a second real scene video of the training route;

[0016] generating a simulation scenario by simulating a specific road condition scenario;

[0017] adding different simulation scenarios as foreground to the second real scene video to generate a real scene simulation video;

[0018] dividing the real scene simulation video of the training route into real scene videos of different training road segments.

[0019] Optionally, the road condition scenarios include at least one of a weather scenario, a time scenario, and a congestion degree scenario, and at least two specific road condition scenarios are included in the same scenario type, and before the real scene training video of the training road segment is sent to the target user terminal, the method further includes:

[0020] recording a second real scene video of the training route;

[0021] generating a simulation scenario by simulating a specific road condition scenario;

[0022] adding different simulation scenarios as foreground to the second real scene video to generate a real scene simulation video;

[0023] dividing the real scene simulation video of the training route into real scene videos of different training road segments.

[0024] Optionally, the position information of the user is obtained.

[0025] The training route is determined based on the position information of the user, wherein the training route is a driving test route under the jurisdiction of an administrative region to which the position information belongs.

[0026] Optionally, the training achievement of the training user is calculated based on the matching relationship between the standard operation data and the simulation training data, including:

[0027] The delay value between the simulation training data and the standard operation data is obtained.

[0028] In the case that the delay value is greater than the preset delay value, the training result is calculated as a negative score.

[0029] In the case that the delay value is less than or equal to the preset delay value, the training result is calculated as a positive score.

[0030] Optionally, the operation data includes an operation type, and the training result of the training user is calculated based on a matching relationship between the standard operation data and the simulation training data, including:

[0031] The training result of the training user is determined based on a matching degree of the operation type in the standard operation data and the simulation training data.

[0032] Optionally, the virtual driving button type is determined based on a test type and a vehicle type selected by the training user.

[0033] The virtual driving button type is displayed on the target user terminal.

[0034] The second aspect of the embodiment of the present application provides a simulation driving interactive training device, which comprises:

[0035] A sending module is configured to send a real scene training video of a training road section to a target user terminal in response to a training starting instruction of the target user terminal.

[0036] An identifying module is configured to identify standard operation data based on the real scene training video.

[0037] A training module is configured to perform simulation driving interactive training on a training user of the target user terminal based on the real scene training video and the standard operation data.

[0038] An obtaining module is configured to obtain simulation training data of the training user in the case of the simulation driving interactive training.

[0039] A calculating module is configured to calculate a training result of the training user based on a matching relationship between the standard operation data and the simulation training data.

[0040] The third aspect of the embodiment of the present application provides an electronic device, which comprises at least one processor and at least one memory connected with the processor, wherein the processor is configured to call program instructions in the memory and execute the simulation driving interactive training method in any one of the first aspect.

[0041] The fourth aspect of the embodiment of the present application provides a storage medium, which comprises a stored program, wherein the device in which the storage medium is located performs the simulation driving interactive training method according to any one of the first aspect when the program runs.

[0042] Compared with the prior art, the present application at least has the following beneficial effects: the embodiment of the present application provides a simulation driving interactive training method, which comprises the following steps: in response to a training starting instruction of a target user terminal, sending a real scene training video of a training route to the target user terminal, the training route comprising at least two training road sections, and at least two training road sections with different specific road scene scenarios existing in the real scene training video of each training route; identifying standard operation data based on the real scene training video;

[0043] Based on the real scene training video and the standard operation data, the training user of the target user terminal is subjected to simulation driving interactive training; in the case of the simulation driving interactive training, simulation training data of the training user is obtained; and based on the matching relationship between the standard operation data and the simulation training data, the training achievement of the training user is calculated. The scheme enables the training user to perform simulation interactive practice based on the real real scene training video, the real scene training video comprising at least two training road sections with different specific road scene scenarios, and the simulation training data of the training user is matched with the standard operation data obtained based on the real scene training video, and the training achievement of the user is calculated according to the matching relationship. The scheme enables the training user to perform driving practice on a real scene training route, and the training user can experience different specific road scene scenarios in one training route, thereby providing the training user with a real driving experience, saving the training time of the training user for practicing different road scene scenarios, enriching the use experience of the training user, and calculating the training achievement of the training user based on the matching relationship between the simulation training data of the training user and the standard operation data, thereby enabling the training user to understand the driving operation based on the real road scene scenario, and improving the passing rate of the training user in the driving license examination. BRIEF DESCRIPTION OF DRAWINGS

[0044] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments with reference made to the accompanying drawings. The drawings are for purposes of illustration only and are not intended to be limiting of the present application. Like reference numerals have been used wherever possible to denote like parts and structure throughout the drawings. In the drawings:

[0045] Figure 1 A simulation driving interactive training method provided by the embodiment of the present application is shown in a schematic flowchart;

[0046] Figure 2 A specific road scene diagram of a training route provided by the embodiment of the present application is shown.

[0047] Figure 3 A schematic structural block diagram of a simulation driving interactive training device provided for an embodiment of the present application is shown in the figure;

[0048] Figure 4 A schematic structural block diagram of an electronic device provided for an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0049] In order to better understand the technical solutions of the present application, the technical solutions of the present application will be described in detail below in combination with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that only the parts related to the present application are shown in the accompanying drawings for the convenience of description.

[0050] In this document, relational terms such as first and second and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the recited element(s). The term "two or more" includes two or more than two.

[0051] Please refer to Figure 1 A schematic flow chart of a simulation driving interactive training method provided for an embodiment of the present application is shown in the figure, which specifically includes the following steps:

[0052] In step S110, in response to a training start instruction of a target user terminal, a real scene training video of a training route is sent to the target user terminal.

[0053] In some examples, the above step S110 can be performed by a server, which can be a local server or a cloud server. The training start instruction can be issued by a software application or a mini program of the simulation driving interactive training of the target user terminal. After receiving the training start instruction, the server sends the real scene training video of the training route to the target user terminal. In some cases, the server can send a real scene training video of one of the training routes to the target user terminal based on the frequently examined routes in the region where the target user terminal is located.

[0054] The training route includes at least two training sections, and the real scene training video corresponding to each training route includes at least two training sections with different specific road conditions.

[0055] In step S120, the standard operation data is identified based on the real scene training video.

[0056] In step S120, the server can identify the standard operation data based on the obtained real scene training video. The standard operation data is obtained based on the real scene training video, and can be the operation data of the camera car during the production of the real scene training video, such as the steering angle of the steering wheel during turning, the opening time of the windshield wiper, the braking time when facing a red light, etc.

[0057] In step S130, the training user of the target user terminal is simulated to drive and interactively trained based on the real scene training video and the standard operation data.

[0058] In step S130, the server performs interactive training on the training user based on the real scene training video and the standard operation data. The training user is the user of the target user terminal. The training user can be a bound user of the software application or applet of the interactive training. The training user can enter the interactive training through the software application or applet of the interactive training. The interactive training is based on the real scene training video, and meets the driving teaching experience of the training user in the real scene.

[0059] In step S140, the simulation training data of the training user is obtained in the case of the interactive training.

[0060] In step S140, the training user can realize the simulation driving process through an external device or a virtual button of the target user terminal in the case of the interactive training. At the same time, the server can obtain the simulation training data. It should be noted that the standard operation data should include the simulation training data.

[0061] In step S150, the training result of the training user is calculated based on the matching relationship between the standard operation data and the simulation training data.

[0062] In step S150, the training achievement of the training user is determined according to the matching relationship between the standard operation data and the simulation training data. In some cases, the training achievement of the training user is calculated by comparing the matching degree between the simulation operation of the training user and the operation of the camera car based on the real scene training video and the operation of the camera car as a reference.

[0063] In summary, the embodiment of the present application provides a simulation driving interactive training method. The present scheme enables the training user to perform simulation interactive practice based on a real real scene training video. The real scene training video includes at least two training road segments with different specific road scene types. The simulation training data of the training user is matched with the standard operation data obtained based on the real scene training video. The training achievement of the user is calculated according to the matching relationship. The present scheme enables the training user to perform driving practice on a real scene training route. The training user can experience different specific road scene types in one training route. The present scheme provides the training user with a real driving experience, saves the training time of the training user for different road scene types, and enriches the use experience of the training user. The training achievement of the training user is calculated based on the matching relationship between the simulation training data of the training user and the standard operation data. The present scheme enables the training user to understand the driving operation based on the real road scene type. The passing rate of the training user in the driving license examination is improved.

[0064] According to some embodiments, the road scene includes at least one of a weather scene, a time scene, and a congestion degree scene. At least two specific road scenes are included in the same scene type. Before the real scene training video of the training road segment is sent to the target user terminal, the method further includes:

[0065] recording a first real scene video of the training route under each specific road scene;

[0066] dividing the first real scene video of the training route into real scene videos of different training road segments.

[0067] In some examples, the first real scene video of the training route under each specific road scene is recorded. Each specific road scene can include at least one of a weather scene, a time scene, and a congestion scene. At the same time, at least two specific road scenes are included in the same scene type. For ease of understanding, an example is given. The weather scene type should include at least two scene types of sunny and rainy. The time scene type should include at least two scene types of morning and evening. The congestion scene type should include at least two scene types of early peak and late peak.

[0068] It can be explained that before sending the real scene training video of the training route to the target user terminal, the first real scene video of the training route under each specific road condition scenario is recorded, and the first real scene video of the training route is divided into real scene videos of different training sections.

[0069] An example is given, the road condition scenario is a time scenario, the time scenario includes morning, noon and evening, the camera car records the first real scene video of the same training route in the morning, noon and evening respectively, obtains three first real scene videos, and divides the three first real scene videos according to different training sections. Each first real scene video has a corresponding training section. In order to facilitate understanding, a specific road condition scenario diagram of a training route is given, as shown in Figure 2 The three specific road condition scenarios of the training route in the morning, noon and evening correspond to A, B and C. Each specific road condition scenario of the training route is divided into four training sections, corresponding to A, B, C and D. A1, A2, A3 and A4 should be the same section in geography, and B, C and D are the same. It is further explained that the real scene training video of the training route can be composed of A1, B2, C1 and D3 training sections, or A2, B1, C3 and D4. That is, any specific road condition scenario of the training sections corresponding to A, B, C and D can form a real scene training video. The selection of specific road condition scenarios, the number of training sections and the combination mode are not limited.

[0070] In another example, A represents the weather scenario of the training route, B represents the time scenario of the training route, and C represents the congestion scenario of the training route. For example, A represents the rainy day scenario of the training route, B represents the morning scenario of the training route, and C represents the late peak scenario of the training route. The camera car records the training route in the rain, in the morning and in the late peak respectively. Each specific road condition scenario of the training route is divided into four training sections, corresponding to A, B, C and D. The real scene training video of the training route can be composed of A3, B2, C2 and D4 training sections, or A1, B1, C2 and D2. That is, any specific road condition scenario of the training sections corresponding to A, B, C and D can form a real scene training video. The selection of specific road condition scenarios, the number of training sections and the combination mode are not limited.

[0071] In summary, the scheme given by the embodiment of the present application gives the training user the choice of multiple road condition scenarios, and the training user can choose multiple scenario types according to personal needs in different training sections of the training route. The scenario types can include weather scenarios, time scenarios, congestion scenarios, etc. On the basis of real scene training video, the scene dimension of the simulation driving interactive training is enriched, the diverse training needs of the training user are met in the same training time, the user's time is saved, and the interest of the simulation driving interactive training is increased.

[0072] According to some embodiments, the road condition scenarios include at least one of a weather scenario, a time scenario, and a congestion degree scenario, at least two of the specific road condition scenarios are included in the same scenario type, and before the real scene training video of the training road section is sent to the target user terminal, the method further includes:

[0073] recording a second real scene video of the training route;

[0074] generating a simulation scenario for a specific road condition scenario;

[0075] adding different simulation scenarios as foreground to the second real scene video to generate a real scene simulation video;

[0076] dividing the real scene simulation video of the training route into real scene videos of different training road sections.

[0077] In some examples, the training route is recorded once to obtain the second real scene video, and the camera car records the training route once under any specific road condition scenario.

[0078] The simulation scenario for a specific road condition scenario is generated, and the server can generate a simulation scenario according to a specific road condition scenario. In some cases, a corresponding filter can be generated for different specific road condition scenarios, such as a simulation scenario for a night and a simulation scenario for a snowy day.

[0079] Different simulation scenarios are added as foreground to the second real scene video to generate a real scene simulation video. The simulation scenarios are added as foreground to the second real scene video. For example, the simulation scenarios include a simulation scenario for a night and a simulation scenario for a snowy day. The server adds the simulation scenarios for the night and the snowy day as foreground to the second real scene video to obtain a second real scene simulation video for a night and a second real scene simulation video for a snowy day.

[0080] The real scene simulation video of the training route is divided into real scene videos of different training road sections. As in the foregoing embodiments, the real scene simulation video is divided based on different training road sections.

[0081] In summary, the scheme provided by the embodiments of the present application can add simulation scenarios for different specific road condition scenarios to a real scene video for a specific road condition scenario of a training route to generate real scene simulation videos for different specific road condition scenarios, which saves the acquisition of real scene videos of training routes, reduces the cost of recording videos, and avoids the problem of recording real scene videos across seasons and weather.

[0082] According to some embodiments, the location information of the user is obtained.

[0083] determine the training route based on the location information of the user, wherein the training route is a driving test route under the jurisdiction of the administrative region to which the location information belongs.

[0084] In some examples, the server can obtain the location information of the user bound to the software application or applet for the simulation driving interaction training of the target terminal, determine the training route of the training user based on the location information, and the training route is a driving test route under the jurisdiction of the administrative region to which the location information belongs. It should be noted that the training user usually takes the driving license test in the administrative region where he / she is located. After the server obtains the location information of the training user, the administrative region where the training user is located can be obtained, and the real scene training video corresponding to the driving test route under the jurisdiction of the administrative region can be selected from the database, and the real scene training video is recommended to the training user. The training user can perform simulation driving interaction training based on the real scene training video.

[0085] In summary, the scheme provided by the embodiments of the present application can recommend the real scene training video of the driving test route under the jurisdiction of the administrative region to which the training user belongs to the training user by obtaining the location information of the training user. The scheme can enable the training user to adapt to the real driving test route in advance, and improve the passing rate of the training user in the driving license test.

[0086] According to some embodiments, the training achievement of the training user is calculated based on the matching relationship between the standard operation data and the simulation training data, including:

[0087] obtaining the delay value between the simulation training data and the standard operation data;

[0088] in the case where the delay value is greater than a preset delay value, the training achievement is calculated as a negative score;

[0089] in the case where the delay value is less than or equal to the preset delay value, the training achievement is calculated as a positive score.

[0090] In some examples, the server can obtain a delay value between the simulation training data of the training user and the standard operation data obtained based on the real scene training video, the delay value being based on an absolute value of a difference between a time at which the standard operation data is generated and a time at which the simulation training data is generated. In a case where the delay value is greater than a preset delay value, the training achievement is calculated as a negative score, and in a case where the delay value is less than or equal to the preset delay value, the training achievement is calculated as a positive score. It should be noted that the preset delay value can have different values based on different driving operation types, for example, the preset delay value corresponding to a driving operation type of turning on the car lights when entering a tunnel can be 2 seconds, and the preset delay value corresponding to a driving operation type of stepping on the brake when encountering a red light can be 1 second, and the specific value is not limited for the purpose of understanding.

[0091] For the purpose of understanding, an example is given. For example, in a real scene training video, a specific video scene is encountering a red light, at this time, the camera car in the real scene training video performs a brake operation at t1, the training user performs a simulation brake operation at t2 in the above video scene, and the preset delay value of the above video scene is t. The server obtains the value of |t1-t2| and compares the value with t. If t is greater than |t1-t2|, the training achievement of the training user is a positive score, and if t is less than or equal to |t1-t2|, the training achievement of the training user is a negative score.

[0092] In summary, the scheme given by the embodiments of the present application gives different preset delay values based on different driving operation types, which conforms to the actual driving situation. At the same time, the delay value between the simulation operation data of the training user and the standard operation data is recorded, the delay value is compared with the preset delay value, and the training achievement of the training user is scored. This scheme can make the training user simulate the operation data in the real scene, and match the operation data with the standard operation data. Based on the matching result, the training achievement of the training user is determined. The training user simulates the standard operation in the real real scene training video, which improves the judgment of the driving operation of the training user in the real scene. Through scoring, the training user has a judgment on his own level. At the same time, the preset delay value conforms to the real driving situation, so that the scoring of the training achievement is more accurate, and the passing rate of the driving license examination of the training user is improved.

[0093] According to some embodiments, the operation data includes an operation type, and the matching relationship between the standard operation data and the simulation training data is used to calculate the training achievement of the training user, including:

[0094] The matching degree of the operation type in the standard operation data and the simulation training data is used to determine the training achievement of the training user.

[0095] In some examples, the operation data includes an operation type, such as a steering wheel turning operation for vehicle turning, a green light start operation of the vehicle, a passing horn signaling operation, etc., and based on different operation types, the above standard operation data and the above simulation training data have different comparison manners, and the training result of the training user is determined according to the matching degree of the comparison manner.

[0096] It should be further pointed out that, based on different operation types, the matching degree of the operation type in the standard operation data and the simulation training data can be distinguished, such as the steering wheel turning operation for vehicle turning, the angle of the steering wheel turning and the return time of the steering wheel turning in the standard operation data and the simulation training data can be matched, the passing horn signaling operation can match the time of starting the horn and the horn duration in the standard operation data and the simulation training data, and examples are only for reference, and the specific is not limited.

[0097] In order to facilitate understanding, an example is given, the operation type is the steering wheel turning operation for vehicle turning, in the case of real scene training video, a certain left turn intersection, the standard operation data is that the steering wheel turns left by 110 degrees, and the steering wheel returns after 10 seconds, the simulation training data is that the steering wheel turns left by 115 degrees, and the steering wheel returns after 12 seconds, which can be regarded as that the matching degree of the simulation training data and the standard operation data is high, thereby determining the training result of the training user.

[0098] In summary, the scheme given by the embodiment of the application provides a training mode of multiple operation types under real real scene training video, and provides a matching manner of the standard operation data and the simulation training data for different operation types, which can enable the training user to complete the training of multiple operation types in one simulation driving interactive training process, and has different evaluation standards for different operation types, so that the training user can complete the training of multiple operation types in one simulation driving interactive training, enriches the training mode dimension of simulation driving interactive training, improves the driving selection ability and operation ability of the training user in real scene, and improves the passing rate of the training user in the driving license examination.

[0099] According to some embodiments, the virtual driving button type is determined based on the examination type and the vehicle type selected by the training user;

[0100] The virtual driving button type is displayed on the target user terminal.

[0101] In some examples, the training user can use a virtual driving key running on the target user terminal for simulated driving interaction training, which can be determined based on the test type and vehicle type selected by the training user. It should be noted that the virtual driving key described above can include all virtual driving key types required for the training user to pass the driving test, and can be changed according to the test type selected by the training user and the simulated vehicle type.

[0102] For ease of understanding, an example is given. As described above, the test type is C2 (one of the motor vehicle driving license codes), the vehicle type is a micro automatic transmission truck, and the virtual driving key described above simulates the corresponding interactive virtual key of the automatic transmission, hand brake, steering wheel type, etc.

[0103] In summary, the scheme given in the embodiments of the present application determines the virtual driving key type based on the test type selected by the user and the vehicle type selected by the user, meets the application needs of training users of different test types, makes the simulated driving interaction training more consistent with the real scene, and at the same time enriches the interest of the simulated driving interaction training process.

[0104] The second aspect of the embodiments of the present application provides a simulated driving interaction training device 30, as shown in Figure 3 The device includes:

[0105] The sending module 301 is configured to send a real scene training video of a training section to the target user terminal in response to a training start instruction of the target user terminal.

[0106] The identification module 302 is configured to identify standard operation data based on the real scene training video.

[0107] The training module 303 is configured to perform simulated driving interaction training on the training user of the target user terminal based on the real scene training video and the standard operation data.

[0108] The acquisition module 304 is configured to acquire simulated training data of the training user in the case of the simulated driving interaction training.

[0109] The calculation module 305 is configured to calculate the training results of the training user based on the matching relationship between the standard operation data and the simulated training data.

[0110] The third aspect of the embodiments of the present application provides an electronic device 40, as shown in Figure 4 The electronic device includes at least one processor 401 and at least one memory 402 connected to the processor, wherein the processor is configured to call the program instructions in the memory and execute the simulated driving interaction training method of any one of the first aspect.

[0111] The fourth aspect of the embodiments of the present application provides a storage medium including a stored program, wherein the device where the storage medium is located performs the simulation driving interactive training method according to any one of the first aspect when the program runs.

[0112] The embodiments of the present application are described with reference to flowcharts and / or block diagrams according to the methods, devices (systems), and computer program products of the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing devices to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate one or more functions implemented in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs functions specified in one or more flows and / or blocks.

[0113] These computer program instructions can also be stored in a computer-readable memory that can direct the computer or other programmable data processing devices to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including instruction apparatus, which implements the functions specified in one or more flows and / or blocks. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs functions specified in one or more flows and / or blocks.

[0114] These computer program instructions can also be loaded into a computer or other programmable data processing device, so that a series of operation steps are performed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide a process for implementing the functions specified in one or more flows and / or blocks. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that performs functions specified in one or more flows and / or blocks.

[0115] The embodiments of the present application also provide a computer program product including computer software instructions, when the computer software instructions run on a processing device, so that the processing device performs the functions specified in one or more flows and / or blocks. Figure 1 the flow in the control method of the vehicle-mounted atmosphere lamp in the corresponding embodiments.

[0116] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described above according to the embodiments of the present application are generated wholly or partially. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through a wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer-readable storage medium can be any available medium that can be stored by the computer or a data storage device such as a server, data center, etc. containing one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)) and the like.

[0117] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0118] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the above units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0119] The units described above as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0120] In addition, each of the functional units in the various embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0121] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, essentially or in part, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods according to the various embodiments of the present application. The foregoing storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and various other media that can store program codes.

[0122] The above embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still make modifications to the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some of the technical features; and these modifications or replacements do not cause the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A simulated driving interactive training method, characterized in that, include: In response to a training start command from a target user terminal, a real-scene training video of a training route is sent to the target user terminal. The training route includes at least two training segments, and in the real-scene training video of each training route, there are at least two training segments with different specific road conditions. Based on the aforementioned real-scene training video recognition standard operation data; Based on the real-world training video and the standard operation data, simulated driving interaction training is conducted on the training users of the target user terminal. In the case of the simulated driving interactive training, the simulated training data of the training user is obtained; Based on the matching relationship between the standard operating data and the simulated training data, the training results of the training user are calculated; The road condition scenarios include at least one of the following scenario types: weather scenarios, time scenarios, and congestion scenarios. Each scenario type includes at least two specific road condition scenarios. Before sending the real-world training video of the training route to the target user terminal, the method further includes: Record a second real-world video of the training route; Simulate specific road conditions to generate simulated scenarios; Different simulated scenes are added as foreground elements to the second live-action video to generate a live-action simulated video; The real-scene simulation video of the training route is divided into real-scene training videos for different training sections.

2. The method according to claim 1, characterized in that, Also includes: Obtain the location information of the training user; The training route is determined based on the location information of the training user, wherein the training route is a driving test route under the jurisdiction of the administrative region to which the location information belongs.

3. The method according to claim 1 or 2, characterized in that, The calculation of the training results of the training user based on the matching relationship between the standard operating data and the simulated training data includes: Obtain the delay value between the simulated training data and the standard operating data; If the delay value is greater than the preset delay value, the training result will be calculated as a negative score; If the delay value is less than or equal to the preset delay value, the training result is calculated as a positive score.

4. The method according to claim 1 or 2, characterized in that, The simulated training data includes operation types. The calculation of the training results for the training user based on the matching relationship between the standard operation data and the simulated training data includes: The training results of the training user are determined based on the degree of matching between the operation types in the standard operation data and the simulated training data.

5. The method according to claim 1 or 2, characterized in that, Also includes: The virtual driving button type is determined based on the test type and vehicle type selected by the training user. The virtual driving button type is displayed on the target user terminal.

6. A simulated driving interactive training device, characterized in that, include: The sending module is used to send the real-scene training video of the training route to the target user terminal in response to the training start command of the target user terminal. The training route includes at least two training segments, and there are at least two training segments with different specific road conditions in the real-scene training video of each training route. The recognition module is used to recognize standard operating data based on the real-scene training video; The training module is used to conduct simulated driving interaction training for the training users of the target user terminal based on the real-scene training video and the standard operation data. The acquisition module is used to acquire the simulated training data of the training user during the simulated driving interactive training. The calculation module is used to calculate the training results of the training user based on the matching relationship between the standard operating data and the simulated training data; The road condition scenario includes at least one scenario type selected from weather scenario, time scenario, and congestion scenario, and the same scenario type includes at least two specific road condition scenarios. The device is also used for: Record a second real-world video of the training route; Simulate specific road conditions to generate simulated scenarios; Different simulated scenes are added as foreground elements to the second live-action video to generate a live-action simulated video; The real-scene simulation video of the training route is divided into real-scene training videos for different training sections.

7. An electronic device, characterized in that, The electronic device includes at least one processor and at least one memory connected to the processor, wherein the processor is used to call program instructions in the memory to execute the simulated driving interactive training method as described in any one of claims 1 to 5.

8. A storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program is executed, the device on which the storage medium is located is controlled to perform the simulated driving interactive training method as described in any one of claims 1 to 5.

Images