Simulated driving control methods, systems, driving simulators and storage media

Abstract

The embodiments of the present application provide a simulated driving control method, system, driving simulator and storage medium. In the embodiments of the present application, at least one target view is set in a virtual driving scene, and each target view is associated with an observation position parameter, an observation time parameter and an observation trigger condition. The observation position range and observation time range of each target view can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and observation time range of each target view are compared according to the gaze position and gaze time of the eye movement data to obtain the driver's observation result information for each target view, analyze and discover the cause of the driver's erroneous operation from the root, give and output feedback information in a targeted manner, and effectively improve the efficiency and effect of driving practice.

Description

Technical Field

[0001] The present application relates to the field of vehicle simulation driving technology, and in particular to a simulation driving control method, system, driving simulator and storage medium. Background Art

[0002] During the driving school examination, in order to assist students in better driving learning, the existing technology uses virtual reality technology to restore the training ground or examination ground for driving school subjects two and three, and develops driving school student simulation training software based on the teaching specifications and examination rules of subjects two and three. The software is run on a driving simulator, so that students can simulate driving for subjects two and three on the driving simulator.

[0003] During the simulated driving practice, the student's hand and foot driving operation data can be collected through the clutch, brake, throttle, steering, gear, handbrake, lights, wipers, ignition switch and other signal collection devices on the driving simulator, and then compared with the teaching standards or examination rules of Subjects 2 and 3 to find out the irregular or incorrect operations of the student, give error prompts or scores, and help the student improve his driving skills.

[0004] When students are practicing driving simulation, the process from information triggering, information receiving, information processing to responding is a relatively complicated process. Any error in any link will lead to wrong results. The existing technology can only give simple, direct, mechanical and rigid error prompts or scores based on the comparison between the operations that students have made and the operations that should be made. It is unable to analyze and find the root cause of the students' wrong operations, and therefore cannot give targeted guidance, resulting in low efficiency and poor results of driving simulation. Summary of the invention

[0005] Multiple aspects of the present application provide a simulated driving control method, system, driving simulator and storage medium, which are used to analyze and discover the causes of trainees' incorrect operations from the root, give and output targeted feedback information, and effectively improve the efficiency and effect of driving practice.

[0006] The embodiment of the present application provides a simulated driving control method, comprising: responding to a simulated driving operation generated by a driver operating a driving component on a driving simulator, controlling a driving state of a vehicle model in a virtual driving scene to perform simulated driving, wherein the virtual driving scene includes at least one target view that needs to be observed by the driver, and each target view is associated with an observation position parameter, an observation time parameter, and an observation trigger condition; during the simulated driving process, collecting the driver's eye movement data, the eye movement data including the driver's gaze position and gaze time on a target screen, and the target screen is a screen presenting the virtual driving scene; generating an observation position range and an observation time range corresponding to each target view according to the observation position parameter, the observation time parameter, and the observation trigger condition associated with each target view, combined with the driving state of the vehicle model; obtaining the driver's observation result information on each target view according to the driver's eye movement data and the observation position range and the observation time range corresponding to each target view; generating and outputting driving feedback information according to the driver's observation result information on each target view to guide the driver to perform simulated driving.

[0007] The embodiment of the present application also provides a simulated driving control system, including: a vision module, which is used to display a virtual driving scene, wherein the virtual driving scene includes at least one target vision that needs to be observed by the driver, and each target vision is associated with an observation position parameter, an observation time parameter, and an observation trigger condition; a driving control module, which is used to respond to the simulated driving operation generated by the driver operating the driving components on the driving simulator, and control the driving state of the vehicle model in the virtual driving scene to perform simulated driving; a collection module, which is used to collect the driver's eye movement data during the simulated driving process, and the eye movement data includes the driver's gaze position and gaze time on the target screen, and the target screen is a screen presenting the virtual driving scene; a calculation module, which is used to generate an observation position range and an observation time range corresponding to each target vision according to the observation position parameter, observation time parameter, and observation trigger condition associated with each target vision, combined with the driving state of the vehicle model; and according to the driver's eye movement data and the observation position range and observation time range corresponding to each target vision, obtain the driver's observation result information on each target vision; a feedback module, which is used to generate and output driving feedback information according to the driver's observation result information on each target vision, so as to guide the driver to perform simulated driving.

[0008] An embodiment of the present application also provides a driving simulator, comprising: a simulator body, and a computer host communicatively connected to the simulator body; wherein the simulator body is provided with various driving components; the computer host comprises a memory and a processor, the memory is used to store computer programs, and the processor is used to execute computer programs, so as to execute the steps in the simulated driving control method provided in the embodiment of the present application.

[0009] The embodiment of the present application also provides a simulated driving control system, including: a driving simulator and a server device; the driving simulator includes at least a simulator body, on which various driving components are arranged; the driving simulator is used to respond to simulated driving operations generated by the driver operating the driving components on the driving simulator, control the driving state of the vehicle model in the virtual driving scene to perform simulated driving, and report the driving state of the vehicle model in the virtual driving scene to the server device, wherein the virtual driving scene includes at least one target view that needs to be observed by the driver, and each target view is associated with an observation position parameter, an observation time parameter, and an observation trigger condition; and during the simulated driving process, the driver's eye movement data is collected and the eye movement data is uploaded to the server device; the eye movement data is sent to the server device; The eye movement data includes the driver's gaze position and gaze time on the target screen, and the target screen is a screen presenting a virtual driving scene; the server-side device is used to generate an observation position range and an observation time range corresponding to each target view according to the observation position parameters, observation time parameters and observation trigger conditions associated with each target view, combined with the driving state of the vehicle model; according to the driver's eye movement data and the observation position range and observation time range corresponding to each target view, the driver's observation result information on each target view is obtained, and driving feedback information is generated according to the driver's observation result information on each target view, and the driving feedback information is sent to the driving simulator; the driving simulator is also used to: output driving feedback guidance information to guide the driver to perform simulated driving.

[0010] An embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor implements the steps in the simulated driving control method provided in the embodiment of the present application.

[0011] In an embodiment of the present application, at least one target vision is set in a virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter, and an observation trigger condition. The observation position range and observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain observation result information on whether the driver has observed the target vision and whether the target vision has been observed in time. The cause of the driver's erroneous operation is analyzed and discovered from the root, and targeted feedback information is given and output, effectively improving the efficiency and effect of driving training. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0013] Figure 1 A flowchart of a simulated driving control method provided for an exemplary embodiment of the present application;

[0014] Figure 2 A schematic diagram of a process for analyzing driving behavior provided by an exemplary embodiment of the present application;

[0015] Figure 3 A schematic structural diagram of a simulated driving control system provided for an exemplary embodiment of the present application;

[0016] Figure 4 A schematic structural diagram of another simulated driving control system provided for an exemplary embodiment of the present application;

[0017] Figure 5 A schematic structural diagram of a driving simulator provided for an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0019] The prior art is unable to analyze and discover the reasons for the trainees' incorrect operations from the root, and therefore is unable to give targeted guidance, resulting in low efficiency and poor results in simulated driving training. In an embodiment of the present application, at least one target vision is set in the virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter, and an observation trigger condition. The observation position range and observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain the driver's observation result information for each target vision, analyze and discover the reasons for the driver's incorrect operations from the root, give and output targeted feedback information, and effectively improve the efficiency and effect of driving training.

[0020] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0021] Figure 1 The following is a flow chart of a simulated driving control method provided by an exemplary embodiment of the present application. Figure 1 As shown, the method includes:

[0022] 101. In response to a simulated driving operation generated by a driver operating a driving component on a driving simulator, control a driving state of a vehicle model in a virtual driving scene to perform simulated driving, wherein the virtual driving scene includes at least one target scene that needs to be observed by the driver, and each target scene is associated with an observation position parameter, an observation time parameter, and an observation trigger condition;

[0023] 102. During the simulated driving process, the driver's eye movement data is collected, and the eye movement data includes the driver's gaze position and gaze time on the target screen, and the target screen is the screen presenting the virtual driving scene;

[0024] 103. Generate an observation position range and an observation time range corresponding to each target visual scene according to the observation position parameter, observation time parameter and observation trigger condition associated with each target visual scene and in combination with the driving state of the vehicle model;

[0025] 104. Obtaining the driver's observation result information on each target visual scene according to the driver's eye movement data and the observation position range and observation time range corresponding to each target visual scene;

[0026] 105. Generate and output driving feedback information based on the driver's observation result information of each target visual scene to guide the driver to perform simulated driving.

[0027] In this embodiment, the driving simulator is a teaching device for driving training, and the driving simulator can simulate the vehicle model driving in a virtual driving scene through virtual reality (VR) technology. The vehicle model can be any vehicle model that can drive in a virtual driving scene, for example, the three-dimensional vehicle model virtual driving scene can be any road scene, such as right-angle turning scene, curve driving scene, reverse parking scene, side parking scene, ramp parking and starting scene, etc.

[0028] In this embodiment, the driving simulator includes a driving component for simulating driving, and the driver can operate the driving component to achieve control of the vehicle model. The driving simulator can respond to the simulated driving operation generated by the driver operating the driving component on the driving simulator, and control the driving state of the vehicle model in the virtual driving scene to simulate driving. Among them, the driving component may include but is not limited to: clutch (automatic gear does not include), brake, throttle, steering wheel, gear, handbrake, light, wiper, ignition switch, etc.; the simulated driving operation may include but is not limited to: turning the steering wheel half a circle to the left, stepping on the clutch, releasing the handbrake, engaging the gear, turning on the turn signal or turning off the wiper, etc.; the driving state of the vehicle model in the virtual driving scene may include but is not limited to: going straight, turning, braking, accelerating, decelerating, reversing or going uphill, etc. For example, the driver operates the brake component on the driving simulator, and the driving simulator can respond to the brake operation generated by the driver operating the brake component to control the vehicle model to be in a deceleration state; for another example, the driver operates the steering wheel on the driving simulator to turn left, and the driving simulator can respond to the turning operation generated by the driver operating the steering wheel to control the vehicle model to be in a turning state.

[0029] In this embodiment, no matter which virtual driving scene is used, the virtual driving scene may include at least one target view, and the target view is a view area in the virtual driving scene that the driver needs to observe or pay attention to. For example, when the virtual driving scene is implemented as a straight-ahead scene, the target real scene may include but not be limited to: "starting white line", "left line" or "right line", etc.; when the virtual driving scene is implemented as a reverse parking scene, the target real scene may include but not be limited to: "left rearview mirror", "lower edge of left rearview mirror", "left edge", "inner door handle" or "left front edge of the parking lot", etc.; when the virtual driving scene is implemented as a side scene, the target real scene may include but not be limited to: "right rearview mirror", "right rear parking lot corner" or "white line", etc. It should be noted that the target view may be pre-marked in the virtual driving scene, and further, the target view may be highlighted in the virtual driving scene, or it may not be highlighted.

[0030] The target vision is explained below using the teaching plan of Subject 2, reversing into a parking space, as an example, but it is not limited to this.

[0031] Step 1: Observe the left rearview mirror, keep the left edge of the mirror aligned with the white line, and drive slowly;

[0032] Step 2: After the inner door handle is aligned with the starting white line, stop the car and shift into reverse gear;

[0033] Step 3: Start reversing. When the lower edge of the left rearview mirror coincides with the starting white line, quickly turn the steering wheel all the way to the right.

[0034] Step 4: Observe the right rearview mirror, keep the right rear wheel 30 cm away from the right front corner of the parking space, and reverse until the vehicle body is straight, then quickly return to the correct direction;

[0035] Step 5: Observe the left rearview mirror and stop the car when its lower edge coincides with the left front edge of the garage.

[0036] The above teaching plan can be presented in the form of voice or text, for example, the steps in the teaching plan are displayed at an appropriate position on the target screen, and the steps in the teaching plan are broadcasted by voice. Of course, the teaching plan may not be displayed or the steps in the teaching plan may not be broadcasted.

[0037] Among them, the "left rearview mirror", "left edge", "white line", "inner door handle", "starting white line", "lower edge of left rearview mirror", "right rearview mirror", "right rear wheel", "right front corner of the garage", "left front edge of the garage", etc. in the teaching plan, the pixel coordinate range of the visual area that the driver needs to observe can be called the target visual area.

[0038] Each target view is associated with an observation position parameter, an observation time parameter, and an observation trigger condition. The observation position parameter refers to the position parameter of the target view in the virtual driving scene, for example, it can be the size information of the target view, such as length information or width information, or it can be the size information and size ratio coefficient of the target view; the observation time parameter refers to the time parameter for the driver to observe the target view, for example, it can be a time range value, such as 2s, 5s or 7s, or it can be a time range value and its time ratio coefficient, and the time ratio coefficient can be 0.1, 0.5 or 0.7, etc., which is not limited. The observation trigger condition refers to the condition that needs to be met to start observing the target view, and the trigger condition can be related to the driving state of the vehicle model, for example, the trigger condition can be that the "inner door handle" of the vehicle model is aligned with the "starting white line"; when reversing into the garage, the trigger condition can be that the "lower edge of the left rearview mirror" of the vehicle model coincides with the "left front edge of the garage".

[0039] In this embodiment, the observation position range and observation time range corresponding to each target vision can be generated according to the observation position parameter, observation time parameter and observation trigger condition associated with each target vision, combined with the driving state of the vehicle model, wherein the observation position range mainly refers to the position range on the target screen that the driver needs to observe, the observation time range mainly limits the start time and the latest observation time for the driver to watch the target vision, and the driving state of the vehicle model is mainly used to determine the observation trigger condition of the target vision. For example, the driving state of the vehicle model (such as the right turn state) meets the observation trigger condition of the target vision (such as the "right rearview mirror"), and the observation position range and observation time range corresponding to the "right rearview mirror" are generated according to the observation position parameter, observation time parameter and observation trigger condition associated with the "right rearview mirror". For another example, the driving state of the vehicle model (such as the reversing state) meets the observation trigger condition of the target vision (such as the "storage edge"), and the observation position range and observation time range corresponding to the "storage edge" are generated according to the observation position parameter, observation time parameter and observation trigger condition associated with the "storage edge".

[0040] In this embodiment, during the simulated driving process, the driver's eye movement data can be collected. The eye movement data includes the driver's gaze position and gaze time on the target screen. The gaze position and gaze time have a corresponding relationship. For example, the gaze time is the time the driver gazes at the gaze position on the target screen, and the target screen is a screen presenting a virtual driving scene.

[0041] Among them, during the simulated driving process, the implementation method of collecting eye movement data is not limited. In an optional embodiment, during the simulated driving process, the driver's eye movement data is collected using an eye tracker connected to the driving simulator. At this time, the target screen is implemented as the display screen of the driving simulator; wherein, the eye tracker is a device that can track and measure the position of a person's eyeballs and eye movement information. Its working principle is to track the eyeballs by measuring the position of the eye's gaze point or the movement of the eyeballs relative to the head, thereby collecting the driver's eye movement data. According to the use requirements of the eye tracker, it is installed in an appropriate position of the driving simulator, for example, in front of the target screen or above, below, left or right of the target screen; the eye tracker is connected to the computer host of the driving simulator, and the eye tracker driver is installed and the parameters of the eye tracker are set to collect the driver's eye movement data. In another optional embodiment, during the simulated driving process, the driver's eye movement data is collected using the eye movement collector on the VR glasses worn by the driver. At this time, the target screen is implemented as the display screen of the VR glasses.

[0042] In this embodiment, during the simulated driving process, the driver's eye movement data is collected, and the eye movement data includes the driver's gaze position and gaze time on the target screen. Each target visual scene corresponds to an observation position range and an observation time range. Then, according to the driver's eye movement data and the observation position range and observation time range corresponding to each target visual scene, the driver's observation result information of each target visual scene can be obtained. Among them, the observation result information includes but is not limited to: whether the observation position range corresponding to the target visual scene is observed, and whether the target visual scene is observed within the observation time range, etc.

[0043] In this embodiment, driving feedback information can also be generated based on the driver's observation result information of each target visual scene. The driving feedback information can include the observation result information; the driving feedback information can also be some driving suggestion information provided to the driver for the driving result information, such as "please pay more attention", "please observe the door handle in time" or "please observe the left rearview mirror" and other information; the driving feedback information can also include both the driving result information and the driving suggestion information, such as "the white line is not observed in time, please pay more attention" or "the door handle is not observed, please observe the door handle" and the like.

[0044] In this embodiment, after the feedback information is generated, driving feedback information can also be output to guide the driver to perform simulated driving. The method of outputting the driving feedback information is not limited, for example, it can be output in the form of voice, text or pictures on the target screen, and there is no limitation on this.

[0045] In an embodiment of the present application, at least one target vision is set in a virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter, and an observation trigger condition. The observation position range and observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain the driver's observation result information for each target vision, analyze and discover the cause of the driver's erroneous operation from the root, give and output targeted feedback information, and effectively improve the efficiency and effect of driving practice.

[0046] In an optional embodiment, the driving state of the vehicle model that meets the observation trigger condition can be called the first target driving state. For example, the observation trigger condition is: "steering wheel" is flush with "left front edge of the garage", and the first target driving state can be that the "steering wheel" of the vehicle model is flush with "left front edge of the garage"; for another example, the observation trigger condition is that "right rearview mirror" coincides with "right front corner of the garage", and the first target driving state can be that "right rearview mirror" of the vehicle model coincides with "right front corner of the garage". Based on this, for each target vision, when the vehicle model meets the observation trigger condition, the observation position range and observation time range corresponding to the target vision can be generated according to the time and position of the first target driving state, combined with the observation position parameter and observation time parameter associated with the target vision. For example, for each target vision, according to the time when the first target driving state appears, combined with the observation time parameter associated with the target vision, the observation time range corresponding to the target vision is generated; according to the position where the first target driving state appears, combined with the observation position parameter associated with the target vision, the observation position range corresponding to the target vision is generated.

[0047] Optionally, for each target vision, it is possible to monitor whether the vehicle model appears in a first target driving state that satisfies the observation trigger condition corresponding to the target vision; when the vehicle model appears in the first target driving state, the time when the first target driving state appears is used as the starting time of the observation time range, and the end time of the observation time range is generated based on the starting time and the observation time parameters; the position where the first target driving state appears is used as the starting position of the observation position range, and the end position of the observation position range is generated based on the starting position and the observation position parameters.

[0048] Among them, the way of generating the observation time range is different according to the different observation time parameters. For example, the observation time parameter is implemented as a time range value, such as 2s, and the time when the first target driving state appears is the starting time of the observation time range, such as 15:00. The starting time is directly summed with the observation time parameter to obtain the end time of the observation time range, such as 15:02. For another example, the observation time parameter is implemented as a time range value and a time scale coefficient. For example, the time range value is 10s, the time scale coefficient is 0.3, and the time when the first target driving state appears is the starting time of the observation time range, such as 14:00. After multiplying the time range value and the time scale coefficient, the observation time parameter is 10s*0.3=3s. The starting time is directly summed with the observation time parameter to obtain the end time of the observation time range, such as 14:03.

[0049] The shape of the observation position range can be determined based on the shape of the target visual scene. For example, if the target visual scene is a white line, the shape of the observation position range can be a part of the white line; if the target visual scene is a rearview mirror, the shape of the observation position range can be an ellipse or a rectangle, etc.; if the target visual scene is a steering wheel, the shape of the observation position range is a circle. According to different observation position parameters, the way of generating the observation position range is also different. For example, the observation position parameters are implemented as the size information of the target visual scene, such as the length x0 and width y0 of the rearview mirror, and the position where the first target driving state appears is used as the starting position (x1, y1) of the observation position range. The end position of the observation position range can be (x1+x0, y1+y0), and the observation position range can be an area defined by the starting position (x1, y1) and the end position (x1+x0, y1+y0), such as a rectangular area, and the starting position (x1, y1) and the end position (x1+x0, y1+y0) are two points on the diagonal of the rectangular area respectively. For another example, the observation position parameter is implemented as the size information and size ratio coefficient of the target visual scene. For example, the length of the white line appearing in the target screen is x2, and the size ratio coefficient is 0.5. The observation position parameter can be 0.5*x2=x3, and the position where the first target driving state appears is taken as the starting position (x4, y4) of the observation position range. The end position of the observation position range can be (x4+x3, y4+y3). At this time, the observation position range can be a part of the white line, such as the coordinates are the part from the coordinates (x4, y4) to the coordinates (x4+x3, y4+y3) on the white line.

[0050] Further optionally, during the simulated driving process, the vehicle model has a current position and a current viewing angle, wherein the current position refers to the current position information of the vehicle model in the virtual driving scene, and the current viewing angle refers to the viewing angle information of the vehicle model in the virtual driving scene, such as the viewing angle range. The current viewing angle may include a target view, and as the current viewing angle changes, the target view included in the current viewing angle will also change. Based on this, during the simulated driving process, the scene screen in the virtual driving scene can be dynamically loaded according to the current position and current viewing angle of the vehicle model. During the dynamic loading of the scene screen, at least one target view is loaded according to a certain screen loading order, and the scene screen in the virtual driving scene can be dynamically displayed on the target screen. In the case where the loaded scene screen includes a target view, for example, in the case where the loaded scene screen includes target views such as "inner door handle" and "rearview mirror", the current target view to be observed is determined according to the observation order between the target views. Among them, the observation order between the target views can be pre-set according to the teaching plan. For example, the observation order between the target views can be to observe the "inside door handle" first and then the "rearview mirror". The "inside door handle" can be used as the current target view to be observed first, and then the "rearview mirror" can be used as the current target view to be observed. Optionally, in order to facilitate the driver's learning or observation, the current target view to be observed is highlighted in the loaded scene screen, for example, the current target view to be observed is displayed through a highlighted background, or the current target view to be observed is enlarged to highlight it. For the current target view to be observed, the driving state of the vehicle model is continuously determined, and the vehicle model is monitored to see whether it has a first target driving state that meets the observation trigger condition corresponding to the current target view to be observed.

[0051] In this embodiment, the implementation method of obtaining the driver's observation result information of each target visual scene based on the driver's eye movement data and the observation position range and observation time range corresponding to each target visual scene is not limited. Among them, the observation position range corresponding to each target visual scene is three-dimensional data in the virtual driving scene, and the driver's eye movement data is two-dimensional data on the target screen. It is necessary to unify the data dimensions of the observation position range and the eye movement data to determine the observation result information of each target visual scene.

[0052] In an optional embodiment, the three-dimensional data in the virtual driving scene, that is, the observation position range, can be converted into two-dimensional data on the target screen, and then the driver's observation result information of each target visual scene can be determined based on the two-dimensional observation position range and the driver's eye movement data. Specifically, for each target visual scene, the observation position range corresponding to the target visual scene is mapped from the virtual driving scene to the target screen to obtain the screen position range corresponding to the target visual scene on the target screen; the screen position range and observation time range corresponding to the target visual scene are matched with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target visual scene.

[0053] In another optional embodiment, the two-dimensional eye movement data can be converted into three-dimensional data in the virtual driving scene, and then the driver's observation result information of each target visual scene can be determined based on the three-dimensional eye movement data and the observation position range. Specifically, for each target visual scene, the driver's eye movement data is mapped from the target screen to the virtual driving scene to obtain the driver's eye movement data in the virtual driving scene; the screen position range and observation time range corresponding to the target visual scene are matched with the gaze position and gaze time in the eye movement data in the virtual driving scene to obtain the driver's observation result information of the target visual scene.

[0054] Among them, in a two-dimensional scene, the screen position range and observation time range corresponding to the target vision are matched with the gaze position and gaze time in the eye movement data in the virtual driving scene, respectively, to obtain the driver's observation result information of the target vision, and in a three-dimensional scene, the screen position range and observation time range corresponding to the target vision are matched with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target vision. The implementation method is the same or similar. The following is an example of matching the screen position range and observation time range corresponding to the target vision in a three-dimensional scene with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target vision.

[0055] Optionally, the screen position range and observation time range corresponding to the target visual scene are matched with the gaze position and gaze time in the driver's eye movement data, respectively; that is, the screen position range corresponding to the target visual scene is matched with the gaze position in the driver's eye movement data, and the observation time range corresponding to the target visual scene is matched with the gaze time in the driver's eye movement data. For the convenience of distinction and description, the gaze position contained in the driver's eye movement data and located within the screen position range is called the first gaze position. If the eye movement data contains the first gaze position, and the gaze time of the first gaze position is within the observation time range, first observation result information is generated, and the first observation result information indicates that the driver has observed the target visual scene within a suitable time. If the eye movement data contains the first gaze position, but the gaze time of the first gaze position is not within the observation time range, second observation result information is generated, and the second observation result information indicates that the driver has not observed the target visual scene within a suitable time. If the eye movement data does not contain the first gaze position, third observation result information is generated, and the third observation result information indicates that the driver has not observed the target visual scene.

[0056] In an optional embodiment, when the driving component on the driving simulator is operated by the driver, an electric control signal corresponding to the driving component can be generated. For example, the driving component on the driving simulator corresponds to a sensor, and the electric control signal corresponding to the driving component can be generated by the sensor corresponding to the driving component, and the signal generated by the sensor is obtained by the main circuit board on the driving simulator. Among them, the electric control signals generated by the sensors corresponding to different types of driving components are different. For example, the electric control signal can be implemented as a pulse width modulation (PWM) signal, and the electric control signals generated by the sensors corresponding to different types of driving components can be distinguished by the waveform (including shape and amplitude), duty cycle or frequency of the signal. For another example, the waveforms generated by the sensors corresponding to different driving components can be marked, and marking information can be generated, and different types of driving components can be distinguished according to the marking information. Among them, the driving state of the vehicle model needs to be controlled by the driving state control signal, so it is necessary to convert the electric control signal of the driving component into a driving state control signal for the vehicle model, and control the driving state of the vehicle model by the driving state control signal. Specifically, in response to a simulated driving operation generated by a driver operating a driving component on a driving simulator, an electric control signal corresponding to the driving component corresponding to the simulated driving operation is obtained; in combination with the type of the driving component, the electric control signal corresponding to the driving component is converted into a driving state control signal for a vehicle model. For example, a correspondence between the type of driving component and the driving state control signal is pre-set, and the type of the driving state control signal is determined according to the type of the driving component, and the amplitude, frequency or duty cycle of the electric control signal generated by the driving component is respectively converted into the amplitude, frequency or duty cycle of the driving state control signal; according to the driving state control signal for the vehicle model, the driving state of the vehicle model in the virtual driving scene is controlled to perform simulated driving.

[0057] In an optional embodiment, not only can the reasons for the driver's erroneous operation be analyzed based on the driver's eye movement data and the observation position range and observation time range corresponding to each target visual scene, but also the driver's information reception, processing, processing and response process after the information is triggered can be analyzed in combination with the simulated driving operation generated by the driver's operation of the driving components, and the consistency with the standard driving operation. Among them, the standard driving operation can be regarded as a standard for measuring the simulated driving operation. In addition to being associated with the observation position parameter, the observation time parameter and the observation trigger condition, each target visual scene is also associated with a standard operation type, an operation time parameter and an operation trigger condition. Among them, the standard operation type refers to the type of driving operation. For example, the standard operation type can include but is not limited to: turning the steering wheel, stepping on the clutch, releasing the handbrake, shifting gears, turning on the turn signal or turning off the wiper, etc. The operation trigger condition is the condition that the target vision needs to meet. When the target vision meets the operation trigger condition, the driver needs to operate the corresponding driving component so that the driving component generates a simulated driving operation. The operation trigger condition can be related to the driving state of the vehicle model. For example, the operation trigger condition can be that the "left edge of the rearview mirror" of the vehicle model coincides with the "white line"; the operation trigger condition can also be that the "lower edge of the left rearview mirror" of the vehicle model coincides with the "left front edge of the garage". The operation time parameter refers to the time parameter of the driving component corresponding to the operation target vision. The operation time parameter can be a time range value, such as 2s, 3s or 8s, or a time range value and its time scale coefficient. The time scale coefficient can be 0.1, 0.3 or 0.5, etc., and there is no limitation on this.

[0058] Specifically, during the simulated driving process, the type and time of the simulated driving operation generated by the driver operating the driving components on the driving simulator are obtained; for each target vision, when the vehicle model appears in a second target driving state that meets the operation trigger condition corresponding to the target vision, the standard operation time range is determined according to the time when the second target driving state appears and the operation time parameter; according to the standard operation type and standard operation time range corresponding to each target vision, as well as the type and time of the simulated driving operation, the quality analysis information of the simulated driving operation of the driver during the simulated driving process is obtained. The details are described below.

[0059] In the process of simulated driving, the type and time of simulated driving operation generated by the driver operating the driving components on the driving simulator are obtained, wherein the type of simulated driving operation may include but is not limited to: turning the steering wheel, stepping on the clutch, releasing the handbrake, engaging the gear, turning on the turn signal or turning off the wiper, etc., and the time of the simulated driving operation refers to the time point when the driver operates the driving components to generate the simulated driving operation. In order to facilitate distinction and description, for each target vision, the driving state in which the vehicle model appears to meet the operation trigger condition corresponding to the target vision is called the second target driving state, and the time range of the standard driving operation is called the standard operation time range. When the vehicle model appears in the second target driving state, the driver needs to complete the corresponding type of simulated driving operation within the standard operation time range, so as to compare the simulated driving operation with the standard driving operation to analyze the consistency between the driver's information reception, processing, processing and reaction process after the information is triggered and the standard driving operation.

[0060] Specifically, when the vehicle model appears in the second target driving state, the standard operating time range can be determined according to the time when the second target driving state appears and the operating time parameter. For example, the time when the second target driving state appears can be used as the start time of the standard operating time range, and the end time of the standard operating time range is generated according to the start time and the operating time parameter.

[0061] Among them, the method of generating the end time of the standard operation time range according to the start time of the standard operation time range and the operation time parameter is not limited. For example, the operation time parameter is implemented as a time range value, such as 2s, and the time when the second target driving state appears is the start time of the standard operation time range, such as 8:00. The start time and the observation time parameter are directly summed to obtain the end time of the standard operation time range, such as 8:02. For another example, the operation time parameter is implemented as a time range value and a time scale coefficient. For example, the time range value is 10s, the time scale coefficient is 0.2, and the time when the second target driving state appears is the start time of the standard operation time range, such as 9:00. After multiplying the time range value and the time scale coefficient, the operation time parameter is 10s*0.2=2s. The start time and the operation time parameter are directly summed to obtain the end time of the standard operation time range, such as 9:02.

[0062] According to the standard operation type and standard operation time range corresponding to each target vision, as well as the type and time of the simulated driving operation, quality analysis information of the simulated driving operation of the driver during the simulated driving process is obtained. For example, the standard operation type corresponding to each target vision is compared with the type of the simulated driving operation to determine whether the type of the simulated driving operation is consistent with the standard operation type; the standard operation time range corresponding to each target vision is compared with the time of the simulated driving operation to determine whether the time of the simulated driving operation is within the standard operation time range. The quality analysis information of the simulated driving operation may include but is not limited to: whether the type of the simulated driving operation is consistent with the standard operation type or whether the time of the simulated driving operation is within the standard operation time range, etc.

[0063] In an optional embodiment, during the simulated driving process, the operating mode information of the simulated driving operation generated by the driver operating the driving components on the driving simulator can also be obtained. The operating mode information is compared with the standard operating mode information to obtain the operating result information of the simulated driving operation. The operating result information indicates whether the operating mode information of the simulated driving operation is standardized. If the similarity between the operating mode information and the standard operating mode information exceeds a set similarity threshold, such as the similarity threshold is 80%, 85% or 90%, etc., then it indicates that the operating mode information of the simulated driving operation is standardized. If the similarity between the operating mode information and the standard operating mode information does not exceed the set similarity threshold, then it indicates that the operating mode information of the simulated driving operation is not standardized.

[0064] In an optional embodiment, according to the driver's observation result information of each target visual scene, the quality analysis information of the simulated driving operation is integrated to generate and output driving feedback information to guide the driver to perform simulated driving. Alternatively, according to the driver's observation result information of each target visual scene, the driving result information of the simulated driving operation is integrated to generate and output driving feedback information to guide the driver to perform simulated driving, or according to the driver's observation result information of each target visual scene, the quality analysis information of the simulated driving operation and the driving result information are integrated to generate and output driving feedback information to guide the driver to perform simulated driving. Among them, the driving feedback information can analyze the root cause of the driver's operation being irregular, deviated or wrong, and help the driver find the direction where training needs to be strengthened.

[0065] For example, the observation result information of each target visual scene includes: information on whether the driver observes the target visual scene, and information on whether the driver observes the target visual scene in a timely manner; the quality analysis information of the simulated driving operation includes: information on whether the type of the simulated driving operation is consistent with the standard operation type, and whether the time of the simulated driving operation is timely; the driving result information includes: information on whether the operation method information of the simulated driving operation is standardized. The following is an example of the process of generating driving feedback information based on the driver's observation result information of each target visual scene, integrating the quality analysis information of the simulated driving operation and / or the driving result information, such as Figure 2 shown.

[0066] If the observation result information indicates that the driver did not observe the target vision and observed other target visions, the driving feedback information may indicate that the driver misunderstood the target vision, which may be due to the lack of knowledge of the teaching plan and the need to further study the teaching plan or require guidance from an instructor.

[0067] If the observation result information indicates that the driver did not observe the target scene and did not observe other target scenes, the driving feedback information may indicate that the driver is not paying attention and needs to improve his attention.

[0068] If the observation result information indicates that the driver observed the target scene in a timely manner, and the driving result information indicates that the driver's simulated driving operation deviates from the standard driving operation, then the driving feedback information may indicate that the driver is relatively familiar with the teaching plan, but the actual driving operation still lacks training and needs to strengthen driving training.

[0069] If the observation result information indicates that the driver observed the target scene late, the driving result information and the quality analysis information indicate that there is no problem with the driving operation, and the driving feedback information may indicate that the driver may be distracted and needs to concentrate.

[0070] There is no limitation on the timing of generating and outputting driving feedback information based on the driver's observation result information of each target scene, integrating the quality analysis information of the simulated driving operation and / or the driving result information, and an example is given below to illustrate.

[0071] Real-time feedback:For example, during the simulated driving process, whenever a designated driving state is detected in the vehicle model, a first target view associated with the designated driving state is determined, wherein the designated driving state may be the driving state of the vehicle model when the driver operates in an irregular, erroneous, deviated or untimely manner, and the first target view associated with the designated driving state is not limited. For example, the designated driving state is a parking state, and the first target view associated with the designated driving state may be an "inside door handle" or a "starting white line"; based on the driver's observation result information of the first target view, the quality analysis information and / or driving result information of the first simulated driving operation corresponding to the first target view are integrated to generate and output first driving feedback information to guide the driver to perform simulated driving, wherein the first simulated driving operation may be a braking operation or a handbrake operation.

[0072] Optionally, during the simulated driving process, if a designated driving state is detected in the vehicle model, the target view corresponding to the observation trigger condition satisfied by the first target driving state most recently appeared in the vehicle model is used as the first target view. Thus, it is possible to analyze whether the cause of the designated driving state is due to the driver's failure to observe the first target view or to fail to observe the first target view in a timely manner.

[0073] Driver-triggered feedback: For another example, after the simulation driving is finished, in response to the driver's viewing request, based on the driver's observation result information of each target visual scene in the simulation driving, the quality analysis information of the simulated driving operation and / or the driving result information in the simulation driving are integrated to generate and output the second driving feedback information to guide the driver to perform the simulation driving;

[0074] Phase feedback: For another example, a feedback cycle can be set in advance, and the feedback cycle can be one hour, one day or one week, etc., without limitation. When the set feedback cycle is reached, based on the driver's observation result information of each target scene during each simulated driving process within the feedback cycle, the quality analysis information and / or driving result information of the simulated driving operation during each simulated driving process are integrated to generate and output the third driving feedback information to guide the driver to perform simulated driving.

[0075] In an optional embodiment, the driver's area of ​​interest on the target screen can also be obtained through eye movement data, so as to make targeted adjustments to the user interface (UI) of the target screen, such as arranging important information in the area most frequently observed by the driver. For example, the area of ​​interest can be the center, top, bottom, left or right of the target screen, etc., and the area of ​​interest can be further personalized for different drivers to improve the efficiency of driver information acquisition. Specifically, according to the driver's eye movement data, the driver's area of ​​interest on the target screen is analyzed; the key information in the target information is determined, and the key information in the target information is displayed in the area of ​​interest, for example, a pop-up window or a floating layer is displayed in the area of ​​interest, and the key information in the target information is displayed in the pop-up window or the floating layer. The target information is information that needs to be output to the driver during the simulated driving process. The target information includes at least one of teaching copy information, instruction information for simulated driving operations, driving status information, driving result information, quality analysis information, observation result information, and driving feedback information. The key information is part of the target information. For example, the key information may be driving suggestion information, reminder information, or driver's erroneous operation information in the driving feedback information, and there is no limitation on this. An importance value may be set for each information in the target information, and the key information in the target information may be determined based on the importance value of each information. The importance value of each information may be personalized according to different drivers, or may be pre-set, and there is no limitation on this.

[0076] In an optional embodiment, the observation position parameter, observation time parameter, observation trigger condition and other parameters can be corrected and optimized according to the driver's eye movement data and simulated driving operation, so that these parameters are more and more accurate, so as to improve the accuracy of analyzing driving behavior. Specifically, according to the driver's observation result information of each target visual scene and the driving result information of the simulated driving operation, the observation position parameter, observation time parameter and observation trigger condition associated with each target visual scene are corrected. For example, an algorithm model can be established, the model parameters are the observation position parameter, observation time parameter and observation trigger condition, the model input is the driver's eye movement data and the driving state of the vehicle model, the model output is the observation result information of each target visual scene and the driving result information of the simulated driving operation, the loss function of each training is calculated, and the model parameters (such as the observation position parameter, observation time parameter and observation trigger condition) are adjusted according to the loss function of each training until the loss function meets the set requirements, and the modified or optimized algorithm model is obtained.

[0077] Optionally, different subjects correspond to different virtual driving scenes, and the target visions in different virtual driving scenes are different. For example, the virtual driving scene corresponding to subject two may include but is not limited to: right-angle turn virtual scene, curve driving virtual scene or reverse parking virtual scene, etc. The target visions in different virtual scenes are different. For example, the target vision in the reverse parking virtual scene may be "left rearview mirror", "left front edge of the garage" or "inner door handle", etc., and the target vision in the curve driving virtual scene may be "right edge" and "engine hood", "left front of the car" and "left edge", etc. Based on this, before responding to the simulated driving operation generated by the driver operating the driving components on the driving simulator, the driver can also perform a simulated driving trigger operation, for example, triggering a simulated driving control on the display screen, or triggering a simulated driving trigger operation by voice, and the simulated driving operation includes the subject identification to be simulated, such as subject two or subject three, etc.; in this case, the simulated driving trigger operation can be responded to, and the target subject corresponding to this simulated driving can be determined according to the subject identification in the simulated driving trigger operation, and the virtual driving scene corresponding to the target subject can be loaded and displayed.

[0078] Further optionally, the parameters used by the driver (e.g., the parameters associated with each target vision) can be classified according to the driver's attributes, and the observation position parameters, observation time parameters, observation trigger conditions and other parameters associated with each target vision of the classified driver can be determined. For example, in the case where the driver is a trainee, a set of parameters is determined for young trainees and a set of parameters is determined for old trainees; or a set of parameters is determined for male trainees and a set of parameters is determined for female trainees, etc., wherein the parameters in different parameter sets are not completely the same. Based on this, before responding to the simulated driving trigger operation, it also includes: selecting a target parameter set from a plurality of parameter sets corresponding to different personnel attributes according to the driver's attribute information; and pre-configuring various parameters associated with each target vision in the virtual driving scene according to various parameters associated with each target vision contained in the target parameter set.

[0079] It should be noted that the execution subject of each step of the method provided in the above embodiment can be the same device, or the method can be executed by different devices. For example, the execution subject of steps 101 to 103 can be device A; for another example, the execution subject of steps 101 and 102 can be device A, and the execution subject of step 103 can be device B; and so on.

[0080] In addition, in some of the processes described in the above embodiments and the accompanying drawings, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel, and the sequence numbers of the operations, such as 101, 102, etc., are only used to distinguish between different operations, and the sequence numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0081] Figure 3 The present application also provides a structural diagram of a simulated driving control system, such as Figure 3 The system shown includes: a vision module 301 , a driving control module 302 , a collection module 303 , a calculation module 304 and a feedback module 305 .

[0082] A visual module 301 is used to display a virtual driving scene, wherein the virtual driving scene includes at least one target visual scene that the driver needs to observe, and each target visual scene is associated with an observation position parameter, an observation time parameter, and an observation trigger condition;

[0083] The driving control module 302 is used to respond to the simulated driving operation generated by the driver operating the driving components on the driving simulator, and control the driving state of the vehicle model in the virtual driving scene to perform simulated driving;

[0084] The acquisition module 303 is used to collect the driver's eye movement data during the simulated driving process, where the eye movement data includes the driver's gaze position and gaze time on the target screen, where the target screen is the screen presenting the virtual driving scene;

[0085] The calculation module 304 is used to generate an observation position range and an observation time range corresponding to each target visual scene according to the observation position parameter, the observation time parameter and the observation trigger condition associated with each target visual scene and the driving state of the vehicle model; and obtain the driver's observation result information on each target visual scene according to the driver's eye movement data and the observation position range and the observation time range corresponding to each target visual scene;

[0086] The feedback module 305 is used to generate and output driving feedback information according to the driver's observation result information of each target visual scene, so as to guide the driver to perform simulated driving.

[0087] In an optional embodiment, each target vision is also associated with a standard operation type, an operation time parameter and an operation trigger condition. The acquisition module 303 is also used to obtain the type and time of the simulated driving operation generated by the driver operating the driving components on the driving simulator during the simulated driving process; the calculation module 304 is also used to, for each target vision, when the vehicle model appears in a second target driving state that meets the operation trigger condition corresponding to the target vision, determine the standard operation time range according to the time when the second target driving state appears and the operation time parameter; and obtain quality analysis information on the driver's simulated driving operation during the simulated driving process according to the standard operation type and standard operation time range corresponding to each target vision, as well as the type and time of the simulated driving operation.

[0088] Optionally, the acquisition module 303 may include a first acquisition module and a second acquisition module, wherein the first acquisition module is used to collect the driver's eye movement data during the simulated driving process, and the second acquisition module is used to obtain the type and time of the simulated driving operation generated by the driver operating the driving components on the driving simulator during the simulated driving process.

[0089] In an optional embodiment, the calculation module 304 is further used to modify the observation position parameters, observation time parameters and observation trigger conditions associated with each target visual scene according to the driver's observation result information of each target visual scene and the driving result information of the simulated driving operation.

[0090] In an optional embodiment, the simulated driving control system may further include a storage module 306, which is used to store the driver's eye movement data in units of drivers, as well as the type and time of the simulated driving operation of the acquisition module 303, so as to conduct a comprehensive and systematic analysis of the driver's driving behavior, obtain a simulated training behavior curve, and facilitate the discovery of the driver's habitual irregularities or errors, or the driver's improvement trend. The storage module 306 may be stored in a hard disk, a server, or a cloud storage, which is not limited.

[0091] Among them, regarding the detailed implementation of the simulated driving control system, please refer to the aforementioned embodiment and will not be repeated here.

[0092] The simulated driving control system provided in the embodiment of the present application sets at least one target vision in a virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter and an observation trigger condition. The observation position range and the observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and the observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain observation result information on whether the driver has observed the target vision and whether the target vision has been observed in time, so as to analyze and discover the cause of the driver's erroneous operation from the root, give and output feedback information in a targeted manner, and effectively improve the efficiency and effect of driving training.

[0093] Figure 4 A structural diagram of another simulated driving control system provided by an exemplary embodiment of the present application, such as Figure 4 As shown, the system includes: a driving simulator 401 and a server device 402. The server device 402 can be a conventional server, a server array or a cloud server, etc., which is not limited to this; the driving simulator at least includes a simulator body, and various driving components are arranged on the simulator body.

[0094] The driving simulator 401 is used to respond to the simulated driving operation generated by the driver operating the driving components on the driving simulator, control the driving state of the vehicle model in the virtual driving scene to perform simulated driving, and report the driving state of the vehicle model in the virtual driving scene to the server device, wherein the virtual driving scene includes at least one target scene that the driver needs to observe, and each target scene is associated with an observation position parameter, an observation time parameter, and an observation trigger condition; and during the simulated driving process, collect the driver's eye movement data and upload the eye movement data to the server device; the eye movement data includes the driver's gaze position and gaze time on the target screen, and the target screen is a screen that presents the virtual driving scene;

[0095] The server device 402 is used to generate an observation position range and an observation time range corresponding to each target view according to the observation position parameter, observation time parameter and observation trigger condition associated with each target view, combined with the driving state of the vehicle model; obtain the driver's observation result information on each target view according to the driver's eye movement data and the observation position range and observation time range corresponding to each target view, generate driving feedback information according to the driver's observation result information on each target view, and send the driving feedback information to the driving simulator;

[0096] The driving simulator 401 is also used to output driving feedback guidance information to guide the driver to perform simulated driving.

[0097] Optionally, the driving simulator includes: a simulator body and a computer host, the simulator body is provided with various driving components, and the computer host is used to respond to simulated driving operations generated by the driver operating the driving components on the driving simulator, and control the driving state of the vehicle model in the virtual driving scene to perform simulated driving.

[0098] Optionally, the driving simulator also includes a display screen, and the driving simulator is externally connected to an eye tracker, which is used to collect the driver's eye movement data during the simulated driving process, and provide the collected eye movement data to a computer host, which in turn provides the data to a server device.

[0099] Optionally, the driving simulator includes sensors corresponding to driving components, which are used to collect electronic control signals of the driving components. The sensors of each driving component are connected to the main circuit board of the driving simulator for integrating and processing the electronic control signals collected by each sensor, and the computer host of the driving simulator provides the integrated electronic control signals to the server device, which performs subsequent calculations and processing.

[0100] Among them, regarding the detailed implementation of the simulated driving control system, please refer to the aforementioned embodiment and will not be repeated here.

[0101] The simulated driving control system provided in the embodiment of the present application sets at least one target vision in a virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter and an observation trigger condition. The observation position range and the observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and the observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain observation result information on whether the driver has observed the target vision and whether the target vision has been observed in time, so as to analyze and discover the cause of the driver's erroneous operation from the root, give and output feedback information in a targeted manner, and effectively improve the efficiency and effect of driving training.

[0102] Figure 5 The schematic diagram of the structure of a driving simulator provided by the exemplary embodiment of the present application is shown in FIG. Figure 5 As shown, the device includes: a simulator body 51 and a computer host 52 connected to the simulator body 51 in communication; various driving components are arranged on the simulator body 51. The computer host 52 includes: a memory 54 and a processor 55.

[0103] The memory 54 is used to store computer programs and may be configured to store various other data to support operations on the computing platform. Examples of such data include instructions for any application program or method operating on the computing platform.

[0104] The memory 54 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0105] The processor 55 is coupled to the memory 54 and is used to execute the computer program in the memory 54, so as to: respond to the simulated driving operation generated by the driver operating the driving components on the driving simulator, control the driving state of the vehicle model in the virtual driving scene to perform simulated driving, the virtual driving scene includes at least one target view that needs to be observed by the driver, and each target view is associated with an observation position parameter, an observation time parameter, and an observation trigger condition; in the simulated driving process, collect the driver's eye movement data, the eye movement data includes the driver's gaze position and gaze time on the target screen, and the target screen is a screen presenting the virtual driving scene; according to the observation position parameter, observation time parameter, and observation trigger condition associated with each target view, combined with the driving state of the vehicle model, generate an observation position range and an observation time range corresponding to each target view; according to the driver's eye movement data and the observation position range and observation time range corresponding to each target view, obtain the driver's observation result information on each target view; according to the driver's observation result information on each target view, generate and output driving feedback information to guide the driver to perform simulated driving.

[0106] In an optional embodiment, when the processor 55 generates the observation position range and observation time range corresponding to each target view according to the observation position parameters, observation time parameters and observation trigger conditions associated with each target view and in combination with the driving state of the vehicle model, it is specifically used to: for each target view, when the vehicle model appears in a first target driving state that meets the observation trigger conditions, based on the time and position of the first target driving state, combined with the observation position parameters and observation time parameters, generate the observation position range and observation time range corresponding to the target view.

[0107] In an optional embodiment, when the vehicle model appears in the first target driving state that meets the observation trigger condition, the processor 55 generates the observation position range and observation time range corresponding to the target view according to the time and position of the first target driving state, combined with the observation position parameter and the observation time parameter for each target view. Specifically, it is used to: for each target view, monitor whether the vehicle model appears in the first target driving state that meets the observation trigger condition corresponding to the target view; when the first target driving state appears, use the time when the first target driving state appears as the starting time of the observation time range, and generate the end time of the observation time range according to the starting time and the observation time parameter; use the position where the first target driving state appears as the starting position of the observation position range, and generate the end position of the observation position range according to the starting position and the observation position parameter.

[0108] In an optional embodiment, when the processor 55 monitors, for each target view, whether the vehicle model is in the first target driving state that satisfies the observation trigger condition corresponding to the target view, it is specifically used to: during the simulated driving process, dynamically load the scene picture in the virtual driving scene according to the current position and current viewing angle of the vehicle model; when the loaded scene picture includes the target view, determine the current target view to be observed according to the observation order between the target views; and for the current target view to be observed, monitor whether the vehicle model is in the first target driving state that satisfies the observation trigger condition corresponding to the current target view to be observed.

[0109] In an optional embodiment, when the processor 55 obtains the driver's observation result information of each target vision based on the driver's eye movement data and the observation position range and observation time range corresponding to each target vision, it is specifically used to: for each target vision, map the observation position range corresponding to the target vision from the virtual driving scene to the target screen to obtain the screen position range corresponding to the target vision on the target screen; match the screen position range and observation time range corresponding to the target vision with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target vision.

[0110] In an optional embodiment, when the processor 55 matches the screen position range and observation time range corresponding to the target vision with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information on the target vision, it is specifically used to: match the screen position range and observation time range corresponding to the target vision with the gaze position and gaze time in the driver's eye movement data, respectively; if the eye movement data includes a first gaze position located within the screen position range, and the gaze time of the first gaze position is within the observation time range, first observation result information is generated that the driver has observed the target vision within a suitable time; if the eye movement data includes the first gaze position located within the screen position range, but the gaze time of the first gaze position is not within the observation time range, second observation result information is generated that the driver has not observed the target vision within a suitable time; if the eye movement data does not include the first gaze position located within the screen position range, third observation result information is generated that the driver has not observed the target vision.

[0111] In an optional embodiment, when the processor 55 responds to the simulated driving operation generated by the driver operating the driving components on the driving simulator and controls the driving state of the vehicle model in the virtual driving scene to perform simulated driving, it is specifically used to: respond to the simulated driving operation generated by the driver operating the driving components on the driving simulator, and obtain the electronic control signal corresponding to the driving component corresponding to the simulated driving operation; convert the electronic control signal into a driving state control signal for the vehicle model in combination with the type of the driving component; and control the driving state of the vehicle model in the virtual driving scene according to the driving state control signal to perform simulated driving.

[0112] In an optional embodiment, when the processor 55 collects the driver's eye movement data during the simulated driving process, it is specifically used to: during the simulated driving process, use an eye tracker externally connected to the driving simulator to collect the driver's eye movement data, and the target screen is the display screen of the driving simulator; or during the simulated driving process, use an eye movement collector on the VR glasses worn by the driver to collect the driver's eye movement data, and the target screen is the display screen of the VR glasses.

[0113] In an optional embodiment, each target vision is also associated with a standard operation type, an operation time parameter and an operation trigger condition, and the processor 55 is further used to: during the simulated driving process, obtain the type and time of the simulated driving operation generated by the driver operating the driving components on the driving simulator; for each target vision, when the vehicle model appears in a second target driving state that meets the operation trigger condition corresponding to the target vision, determine the standard operation time range according to the time when the second target driving state appears and the operation time parameter; according to the standard operation type and standard operation time range corresponding to each target vision, as well as the type and time of the simulated driving operation, obtain quality analysis information on the driver's simulated driving operation during the simulated driving process.

[0114] In an optional embodiment, when the processor 55 generates and outputs driving feedback information based on the driver's observation result information of each target visual scene to guide the driver to perform simulated driving, it is specifically used to: generate and output driving feedback information based on the driver's observation result information of each target visual scene, integrate the quality analysis information of the simulated driving operation and / or the driving result information, and guide the driver to perform simulated driving.

[0115] In an optional embodiment, the processor 55 generates and outputs driving feedback information based on the driver's observation result information of each target visual scene, and integrates the quality analysis information of the simulated driving operation and / or the driving result information to guide the driver to perform simulated driving. Specifically, during the simulated driving process, whenever it is monitored that the vehicle model appears in a specified driving state, a first target visual scene associated with the specified driving state is determined, and based on the driver's observation result information of the first target visual scene, the quality analysis information of the first simulated driving operation corresponding to the first target visual scene is integrated and / or the driving result information is generated and output to guide the driver to perform simulated driving; Alternatively, after the end of this simulated driving, in response to the driver's viewing request, based on the driver's observation result information of each target visual scene in this simulated driving, the quality analysis information of the simulated driving operation in this simulated driving and / or the driving result information are integrated to generate and output second driving feedback information to guide the driver to perform the simulated driving; or when the set feedback cycle is arrived, based on the driver's observation result information of each target visual scene in each simulated driving process within the feedback cycle, the quality analysis information of the simulated driving operation in each simulated driving process and / or the driving result information are integrated to generate and output third driving feedback information to guide the driver to perform the simulated driving.

[0116] In an optional embodiment, during the simulated driving process, whenever the processor 55 monitors that the vehicle model is in a specified driving state, when determining the first target view associated with the specified driving state, the processor 55 is specifically used to: during the simulated driving process, if the vehicle model is monitored to be in a specified driving state, the target view corresponding to the observation trigger condition satisfied by the first target driving state that most recently appeared in the vehicle model is used as the first target view.

[0117] In an optional embodiment, the processor 55 is also used to: analyze the driver's area of ​​interest on the target screen based on the driver's eye movement data; determine key information in the target information, the target information is the information that needs to be output to the driver during the simulated driving process; display the key information in the target information in the area of ​​interest; the target information includes at least one of teaching copy information, instruction information for simulated driving operations, driving status information and driving feedback information, and the key information is part of the target information.

[0118] In an optional embodiment, the processor 55 is further used to modify the observation position parameters, observation time parameters and observation trigger conditions associated with each target visual scene according to the driver's observation result information of each target visual scene and the driving result information of the simulated driving operation.

[0119] In an optional embodiment, before responding to the simulated driving operation generated by the driver operating the driving components on the driving simulator, the processor 55 is also used to: respond to the simulated driving trigger operation, determine the target subject corresponding to the current simulated driving according to the subject identifier in the simulated driving trigger operation, and load and display the virtual driving scene corresponding to the target subject; wherein the virtual driving scenes corresponding to different subjects are different, and the target views in different virtual driving scenes are different.

[0120] In an optional embodiment, before responding to the simulated driving trigger operation, the processor 55 is further used to: select a target parameter set from a plurality of parameter sets corresponding to different driver attributes based on the driver's attribute information, wherein the parameters in different parameter sets are not exactly the same; and pre-configure various parameters associated with each target view in the virtual driving scene based on various parameters associated with each target view included in the target parameter set.

[0121] In an optional embodiment, the simulator body 51 also includes a display screen, and the simulator body is externally connected to an eye tracker, which is used to collect the driver's eye movement data during the simulated driving process.

[0122] Among them, regarding the detailed implementation of the driving simulator, please refer to the aforementioned embodiment and will not be repeated here.

[0123] The driving simulator provided in the embodiment of the present application sets at least one target vision in a virtual driving scene, and each target vision is associated with an observation position parameter, an observation time parameter and an observation trigger condition. The observation position range and the observation time range of each target vision can be determined in combination with the driving state of the vehicle model in the virtual driving scene. During the simulated driving process, the driver's eye movement data is collected, and the observation position range and the observation time range of each target vision are compared based on the gaze position and gaze time of the eye movement data to obtain observation result information on whether the driver has observed the target vision and whether the target vision has been observed in time. The cause of the driver's erroneous operation is analyzed and discovered from the root, and targeted feedback information is given and output, effectively improving the efficiency and effect of driving training.

[0124] Further, if Figure 5 As shown, the computer host also includes: a communication component 56, a display 57, a power component 58, an audio component 59 and other components. Figure 5 Only some components are shown schematically, which does not mean that the computer host only includes Figure 5 Components shown.

[0125] Accordingly, the embodiment of the present application further provides a computer-readable storage medium storing a computer program, which can achieve the above-mentioned Figure 1 The steps in the method embodiment are shown.

[0126] Above Figure 5 The communication component in is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0127] Above Figure 5 The display in the embodiment includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0128] Above Figure 5 The power supply component in the device provides power to various components of the device where the power supply component is located. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply component is located.

[0129] Above Figure 5 The audio component in can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), and when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in a memory or sent via a communication component. In some embodiments, the audio component also includes a speaker for outputting an audio signal.

[0130] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0131] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0132] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0133] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0134] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0135] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0136] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0138] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A simulated driving control method, characterized in that: include: In response to a simulated driving operation generated by a driver operating a driving component on a driving simulator, the driving state of a vehicle model in a virtual driving scene is controlled to perform simulated driving, wherein the virtual driving scene includes at least one target view that needs to be observed by the driver, and each target view is associated with an observation position parameter, an observation time parameter, and an observation trigger condition, wherein the observation position parameter refers to a position parameter of the target view in the virtual driving scene, the observation time parameter refers to a time parameter for the driver to observe the target view, and the observation trigger condition refers to a condition that needs to be met to start observing the target view; During the simulated driving process, collecting the driver's eye movement data, the eye movement data including the driver's gaze position and gaze time on a target screen, the target screen being a screen presenting the virtual driving scene; According to the observation position parameter, observation time parameter and observation trigger condition associated with each target vision, combined with the driving state of the vehicle model, the observation position range and observation time range corresponding to each target vision are generated, including: for each target vision, monitoring whether the vehicle model appears a first target driving state that meets the observation trigger condition corresponding to the target vision; when the first target driving state appears, taking the time when the first target driving state appears as the starting time of the observation time range, and generating the end time of the observation time range according to the starting time and the observation time parameter; taking the position where the first target driving state appears as the starting position of the observation position range, and generating the end position of the observation position range according to the starting position and the observation position parameter; According to the driver's eye movement data and the observation position range and observation time range corresponding to each target visual scene, the driver's observation result information on each target visual scene is obtained, including: for each target visual scene, mapping the observation position range corresponding to the target visual scene from the virtual driving scene to the target screen to obtain the screen position range corresponding to the target visual scene on the target screen; matching the screen position range and observation time range corresponding to the target visual scene with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information on the target visual scene; Driving feedback information is generated and outputted according to the driver's observation result information of each target visual scene to guide the driver to perform simulated driving.

2. The method according to claim 1, characterized in that For each target vision, monitoring whether the vehicle model is in a first target driving state that satisfies an observation trigger condition corresponding to the target vision includes: During the simulated driving process, dynamically loading the scene picture in the virtual driving scene according to the current position and current viewing angle of the vehicle model; In the case where the loaded scene picture includes the target view, determining the current target view to be observed according to the observation order between the target views; For a current target scene to be observed, it is monitored whether the vehicle model is in a first target driving state that satisfies an observation trigger condition corresponding to the current target scene to be observed.

3. The method according to claim 1, characterized in that Matching the screen position range and observation time range corresponding to the target visual scene with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target visual scene, including: Matching the screen position range and observation time range corresponding to the target visual scene with the gaze position and gaze time in the driver's eye movement data, respectively; If the eye movement data includes a first gaze position located within the screen position range, and the gaze time of the first gaze position is within the observation time range, generating first observation result information that the driver has observed the target visual scene within a suitable time; If the eye movement data includes a first gaze position within the screen position range, but the gaze time of the first gaze position is not within the observation time range, generating second observation result information that the driver has not observed the target visual scene within a suitable time; If the eye movement data does not include a first gaze position within the screen position range, third observation result information indicating that the driver has not observed the target visual scene is generated.

4. The method according to claim 1, characterized in that: In response to the simulated driving operation generated by the driver operating the driving components on the driving simulator, the driving state of the vehicle model in the virtual driving scene is controlled to perform simulated driving, including: In response to a simulated driving operation generated by a driver operating a driving component on a driving simulator, obtaining an electric control signal corresponding to the driving component corresponding to the simulated driving operation; In combination with the type of the driving component, converting the electric control signal into a driving state control signal for the vehicle model; According to the driving state control signal, the driving state of the vehicle model in the virtual driving scene is controlled to perform simulated driving.

5. The method according to claim 1, characterized in that During the simulated driving process, the driver’s eye movement data is collected, including: During the simulated driving process, an eye tracker connected to the driving simulator is used to collect the driver's eye movement data, and the target screen is the display screen of the driving simulator; or During the simulated driving process, the eye movement data of the driver is collected using the eye movement collector on the VR glasses worn by the driver, and the target screen is the display screen of the VR glasses.

6. The method according to any one of claims 1 to 5, characterized in that: Each target scene is also associated with a standard operation type, an operation time parameter, and an operation trigger condition. The method further includes: During the simulated driving process, obtaining the type and time of simulated driving operations generated by the driver operating the driving components on the driving simulator; For each target vision, when the vehicle model appears in a second target driving state that meets the operation trigger condition corresponding to the target vision, determine a standard operation time range according to the time when the second target driving state appears and the operation time parameter; According to the standard operation type and the standard operation time range corresponding to each target vision, and the type and time of the simulated driving operation, quality analysis information of the simulated driving operation of the driver during the simulated driving process is obtained.

7. The method according to claim 5, characterized in that Generating and outputting driving feedback information according to the driver's observation result information of each target visual scene to guide the driver to perform simulated driving, including: According to the observation result information of each target visual scene by the driver, the quality analysis information of the simulated driving operation and / or the driving result information are integrated to generate and output driving feedback information to guide the driver to perform simulated driving.

8. The method according to claim 7, characterized in that According to the observation result information of each target visual scene by the driver, the quality analysis information of the simulated driving operation and / or the driving result information are integrated to generate and output driving feedback information to guide the driver to perform simulated driving, including: During the simulated driving process, whenever the vehicle model is monitored to be in a designated driving state, a first target visual associated with the designated driving state is determined, and based on the driver's observation result information of the first target visual, quality analysis information of a first simulated driving operation corresponding to the first target visual and / or driving result information are integrated to generate and output first driving feedback information to guide the driver to perform simulated driving; or After the simulated driving is finished, in response to the driver's viewing request, based on the driver's observation result information of each target visual scene in the simulated driving, the quality analysis information of the simulated driving operation and / or the driving result information in the simulated driving are integrated to generate and output second driving feedback information to guide the driver to perform the simulated driving; or When the set feedback cycle is reached, based on the driver's observation result information of each target scene during each simulated driving process within the feedback cycle, the quality analysis information of the simulated driving operation and / or the driving result information during each simulated driving process are integrated to generate and output the third driving feedback information to guide the driver to perform simulated driving.

9. The method according to claim 8, characterized in that During the simulated driving process, whenever it is detected that the vehicle model is in a designated driving state, determining a first target view associated with the designated driving state includes: During the simulated driving process, if it is monitored that the vehicle model is in a designated driving state, the target view corresponding to the observation trigger condition satisfied by the first target driving state that most recently appeared in the vehicle model is used as the first target view.

10. The method according to any one of claims 1 to 5, characterized in that: Also includes: Analyzing the driver's area of ​​interest on the target screen according to the driver's eye movement data; Determining key information in target information, wherein the target information is information that needs to be output to the driver during the simulated driving process; Display key information in the target information in the area of ​​interest; the target information includes at least one of teaching copy information, instruction information of simulated driving operation, driving status information and driving feedback information, and the key information is part of the target information.

11. The method according to any one of claims 1 to 5, characterized in that: Also includes: According to the driver's observation result information of each target visual scene and the driving result information of the simulated driving operation, the observation position parameter, observation time parameter and observation trigger condition associated with each target visual scene are modified.

12. The method according to claim 11, characterized in that Before responding to the simulated driving operation generated by the driver operating the driving components on the driving simulator, the method further includes: In response to a simulated driving trigger operation, a target subject corresponding to the simulated driving is determined according to the subject identifier in the simulated driving trigger operation, and a virtual driving scene corresponding to the target subject is loaded and displayed; wherein different virtual driving scenes correspond to different subjects, and target views in different virtual driving scenes are different.

13. The method according to claim 12, characterized in that Before responding to the simulated driving trigger operation, it also includes: According to the attribute information of the driver, a target parameter set is selected from a plurality of parameter sets corresponding to different attributes of the driver, wherein the parameters in different parameter sets are not completely the same; According to the various parameters associated with each target view included in the target parameter set, various parameters associated with each target view in the virtual driving scene are preconfigured.

14. A simulated driving control system, characterized in that: include: A visual module, used for displaying a virtual driving scene, wherein the virtual driving scene includes at least one target visual scene that needs to be observed by the driver, and each target visual scene is associated with an observation position parameter, an observation time parameter, and an observation trigger condition, wherein the observation position parameter refers to a position parameter of the target visual scene in the virtual driving scene, the observation time parameter refers to a time parameter for the driver to observe the target visual scene, and the observation trigger condition refers to a condition that needs to be met to start observing the target visual scene; A driving control module, used to respond to simulated driving operations generated by a driver operating a driving component on a driving simulator, and control a driving state of a vehicle model in a virtual driving scene to perform simulated driving; A collection module, used to collect the driver's eye movement data during the simulated driving process, wherein the eye movement data includes the driver's gaze position and gaze time on a target screen, wherein the target screen is a screen presenting the virtual driving scene; A calculation module, for generating an observation position range and an observation time range corresponding to each target vision according to the observation position parameter, the observation time parameter and the observation trigger condition associated with each target vision, in combination with the driving state of the vehicle model, specifically: for each target vision, monitoring whether the vehicle model appears a first target driving state that satisfies the observation trigger condition corresponding to the target vision; when the first target driving state appears, taking the time when the first target driving state appears as the starting time of the observation time range, and generating the end time of the observation time range according to the starting time and the observation time parameter; taking the position where the first target driving state appears as the starting position of the observation position range, and generating the end position of the observation position range according to the starting position and the observation position parameter; Furthermore, the calculation module is further used to obtain the driver's observation result information of each target vision according to the driver's eye movement data and the observation position range and observation time range corresponding to each target vision, specifically: for each target vision, the observation position range corresponding to the target vision is mapped from the virtual driving scene to the target screen to obtain the screen position range corresponding to the target vision on the target screen; the screen position range and observation time range corresponding to the target vision are matched with the gaze position and gaze time in the driver's eye movement data respectively to obtain the driver's observation result information of the target vision; The feedback module is used to generate and output driving feedback information according to the driver's observation result information of each target visual scene, so as to guide the driver to perform simulated driving.

15. A simulated driving control system, characterized in that: include: Driving simulator and server equipment; The driving simulator at least comprises a simulator body, on which various driving components are arranged; The driving simulator is used to respond to simulated driving operations generated by the driver operating the driving components on the driving simulator, control the driving state of the vehicle model in the virtual driving scene to perform simulated driving, and report the driving state of the vehicle model in the virtual driving scene to the server device, wherein the virtual driving scene includes at least one target scene that needs to be observed by the driver, and each target scene is associated with an observation position parameter, an observation time parameter, and an observation trigger condition, wherein the observation position parameter refers to a position parameter of the target scene in the virtual driving scene, the observation time parameter refers to a time parameter for the driver to observe the target scene, and the observation trigger condition refers to a condition that needs to be met to start observing the target scene; and during the simulated driving process, collecting the driver's eye movement data and uploading the eye movement data to the server device; the eye movement data includes the driver's gaze position and gaze time on the target screen, the target screen being the screen presenting the virtual driving scene; The server-side device is used to generate an observation position range and an observation time range corresponding to each target view according to the observation position parameter, observation time parameter and observation trigger condition associated with each target view, in combination with the driving state of the vehicle model, specifically: for each target view, monitor whether the vehicle model appears a first target driving state that satisfies the observation trigger condition corresponding to the target view; when the first target driving state appears, use the time when the first target driving state appears as the starting time of the observation time range, and generate the end time of the observation time range according to the starting time and the observation time parameter; use the position where the first target driving state appears as the starting position of the observation position range, and generate the end position of the observation position range according to the starting position and the observation position parameter; Furthermore, the server device is further used to obtain the driver's observation result information of each target vision according to the driver's eye movement data and the observation position range and observation time range corresponding to each target vision, specifically: for each target vision, the observation position range corresponding to the target vision is mapped from the virtual driving scene to the target screen to obtain the screen position range corresponding to the target vision on the target screen; the screen position range and observation time range corresponding to the target vision are matched with the gaze position and gaze time in the driver's eye movement data, respectively, to obtain the driver's observation result information of the target vision; And, the server device is further used to generate driving feedback information according to the driver's observation result information of each target visual scene, and send the driving feedback information to the driving simulator; The driving simulator is also used to: output the driving feedback guidance information to guide the driver to perform simulated driving.

16. A driving simulator, characterized in that: include: A simulator body, and a computer host connected to the simulator body for communication; wherein the simulator body is provided with various driving components; The computer host comprises a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to execute the computer program to perform the steps in the method according to any one of claims 1 to 13.

17. The driving simulator according to claim 16, characterized in that: The simulator body also includes a display screen, and the simulator body is externally connected to an eye tracker, which is used to collect eye movement data of the driver during the simulated driving process.

18. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the processor is caused to implement the steps in the method according to any one of claims 1 to 13.

Images