Simulation operation device and control method for simulation operation device

Abstract

To provide a driving simulator for effectively training safety confirmation, including recognition or judgment during driving.SOLUTION: A driving simulator includes a control apparatus, a display device, and a line-of-sight detection apparatus to simulate driving of a vehicle. The control apparatus includes: an image generation unit which generates a simulated image to be displayed on the display device and outputs the image to the display device; a gaze point acquisition unit which acquires a position of a point gazed by a trainee on the simulated image, on the basis of a line-of-sight direction of the trainee of a simulation training detected by the line-of-sight detection apparatus; a storage unit which stores training data of motion of line-of-sight on a simulated video; and an evaluation unit which evaluates a degree of safety confirmation for driving of the trainee, on the basis of similarity between the motion of the line-of-sight of the trainee on the simulated image and the motion of the line-of-sight of the training data.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a simulation operation device and a control method for a simulation operation device.

Background Art

[0002] In recent years, simulation operation devices have been widely used for driving training of vehicles such as motorcycles, automobiles, and railway vehicles. For example, Patent Document 1 describes a vehicle driving simulator device configured such that when it is determined that a subject has become proficient in brake operation, a mode switching unit switches from an operation proficiency mode to a main test mode. Further, Patent Document 2 describes a driving simulator for training on time-critical tasks.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] Driving is repeatedly performed through a process of recognition, judgment, and operation. However, although the operation process can be confirmed using the devices described in Patent Documents 1 and 2, the recognition and judgment processes cannot be confirmed even using existing simulation operation devices. For this reason, there has been a problem that trainees cannot accurately grasp the problems in the recognition and judgment processes in their own driving, and cannot effectively conduct safety confirmation training in which the recognition and judgment processes are important.

[0005] An object of the present invention is to provide a simulation operation device capable of effectively conducting safety confirmation training including recognition and judgment in driving.

Means for Solving the Problems

[0006] The simulation driving device according to an embodiment of the present invention includes a control device, a display device, and a line-of-sight detection device, and is a simulation driving device that simulates the driving of a vehicle. The control device includes an image generation unit that generates a simulation image to be displayed on the display device and outputs it to the display device, a fixation point acquisition unit that acquires the position of the fixation point of the trainee in the simulation image based on the direction of the line of sight of the trainee in the simulation training detected by the line-of-sight detection device, a storage unit that stores teacher data on the movement of the fixation point in the simulation, and an evaluation unit that evaluates the degree of safety confirmation of the trainee's driving based on the similarity between the movement of the fixation point of the trainee in the simulation image and the movement of the fixation point of the teacher data. Image An operation acquisition unit that acquires an operation signal representing an operation of an operation device by a trainee during a simulation training from the operation device, and has and an image generation unit generates a simulation image to be displayed on the display device according to the operation signal and outputs it to the display device, and an evaluation unit calculates the degree of similarity between the movement of the trainee's gaze point and the movement of the gaze point of the teacher data when the trainee performs a predetermined operation on the operation device as the degree of safety confirmation of the trainee's driving .

[0007] The control method of the simulation driving device according to an embodiment of the present invention generates a simulation image to be displayed on the display device and outputs it to the display device, acquires the position of the fixation point of the trainee in the simulation image based on the direction of the line of sight of the trainee in the simulation training detected by the line-of-sight detection device, and evaluates the degree of safety confirmation of the trainee's driving based on the similarity between the movement of the fixation point of the trainee in the simulation image and the movement of the fixation point of the teacher data.

Advantages of the Invention

[0008] According to the present invention, there is provided a simulation driving device capable of effectively conducting safety confirmation training including recognition and judgment in driving.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0010] The simulation driving device of the present invention evaluates the degree of safety confirmation of the learner's driving based on the similarity between the movement of the gaze point on the simulated image of the learner who is simulatedly driving a vehicle and the movement of the gaze point of the teacher data. As a result, since the process of recognition and judgment in the learner's driving is evaluated based on the movement of the gaze point of the learner on the simulated image, the learner can accurately grasp the problems of safety confirmation including recognition and judgment in driving.

[0011] Hereinafter, preferred embodiments will be described with reference to the drawings. Note that the present invention is not limited to the following embodiments, and can be appropriately changed without departing from the gist thereof. Also, in each figure, those having the same or corresponding functions are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0012] FIG. 1 is a diagram showing an example of the configuration of a simulation driving device 1. The simulation driving device 1 includes a control device 2, a steering wheel 31, a deceleration operation means 32, an acceleration operation means 33, a display device 4, and a gaze detection device 5. The simulation driving device 1 may further include a speaker or the like. Although FIG. 1 shows an example of the configuration of the simulation driving device 1 for automobile training, the simulation driving device 1 may be for training of motorcycles, railway vehicles, etc.

[0013] The control device 2 is communicably connected to the steering wheel 31, the deceleration operation means 32, the acceleration operation means 33, the display device 4, and the gaze detection device 5 by wire or wirelessly, and controls the entire simulation driving device 1. Also, the control device 2 functions as an arithmetic device for simulating a virtual space in which the vehicle of the learner moves together with other vehicles 6a, 6b, pedestrians 7a, 7b, bicycles 8, etc. based on the simulation training scenario.

[0014] The steering wheel 31, the deceleration operation means 32, and the acceleration operation means 33 are operated for the trainee of the simulation training to simulate driving the vehicle, and output an operation signal indicating that they have been operated by the trainee to the control device 2. When the simulation driving device 1 is for training an automobile, the steering wheel 31, the deceleration operation means 32, and the acceleration operation means 33 are a steering wheel, a brake pedal, and an accelerator pedal, respectively. When the simulation driving device 1 is for training a railway vehicle, the steering wheel 31 is omitted.

[0015] The display device 4 is arranged in front of the trainee, and displays a landscape in the virtual space that the trainee of the simulation training will see from the vehicle in the virtual space as a simulation image 41. This simulation image 41 is generated by the control device 2 and output to the display device 4. For example, in the simulation image 41 shown in FIG. 1, a landscape on the road in the virtual space that the trainee sees in front of the vehicle is displayed, and in the upper right of the simulation image 41, a landscape that the trainee sees behind the vehicle through the virtual rearview mirror 42 in the virtual space is displayed. The trainee of the simulation training simulates driving the vehicle while operating the steering wheel 31, the deceleration operation means 32, and the acceleration operation means 33 so that the vehicle does not collide with attention objects such as other vehicles 6a, 6b, pedestrians 7a, 7b, and bicycles 8 displayed on the simulation image 41. On the simulation image 41, other vehicles 6b, pedestrians 7a, 7b, bicycles 8, etc. that the trainee should pay attention to may be highlighted by a graphic 9 or by changing the color. The graphic 9 is, for example, in the shape of a circular frame, and the color is, for example, red. Thereby, since the trainee's gaze point is appropriately guided to the attention object, the training for safe driving confirmation is effectively performed.

[0016] The line-of-sight detection device 5 is installed, for example, on the display device 4 arranged in front of the trainee as shown in FIG. 1, detects the direction of the trainee's line of sight, and outputs it to the control device 2. As the line-of-sight detection device 5, for example, one having a visible light or infrared camera and detecting the direction of the trainee's line of sight based on the position of the pupil in the image of the trainee's eyes captured by the visible light or infrared camera is used.

[0017] FIG. 2 is a diagram showing an example of the hardware configuration of the control device 2 and the operation device 3. The control device 2 includes a storage unit 21, a control unit 22, an external communication I / F 23, and a video output I / F 24 that are communicably connected to each other via an internal bus 20. The operation device 3 includes a handle 31, a deceleration operation means 32, and an acceleration operation means 33.

[0018] The storage unit 21 includes a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as an HDD (Hard Disk Drive) or a flash memory (registered trademark). The storage unit 21 stores a computer program executed by the control unit 22, data processed by the computer program, and the like.

[0019] The control unit 22 includes one or more processors and peripheral circuits, and executes a computer program stored in the storage unit 21 to control each part of the simulation operation device 1. The control unit 22 may be configured by an integrated circuit such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0020] The external communication I / F 23 is a communication I / F circuit for connecting the control unit 22 to the operation device 3 and the line-of-sight detection device 5 via a communication line 30, and enables the control unit 22 to communicate with the operation device 3 and the line-of-sight detection device 5. The external communication I / F 23 receives a signal output from the operation device 3 or the line-of-sight detection device 5 and transmits it to the control unit 22, and receives a signal output from the control unit 22 and transmits it to the operation device 3 or the line-of-sight detection device 5.

[0021] The video output I / F 24 is a communication I / F circuit for connecting the control unit 22 to the display device 4 via a communication line 40, and enables the control unit 22 to communicate with the display device 4. The video output I / F 24 receives a signal output from the display device 4 and transmits it to the control unit 22, and receives a signal output from the control unit 22 and transmits it to the display device 4.

[0022] FIG. 3 is a functional block diagram of the storage unit 21 and the control unit 22 of the simulation operation device 1. The storage unit 21 stores an image generation program 211, an operation acquisition program 212, an evaluation program 213, and a fixation point acquisition program 214 as software modules or firmware. The control unit 22 functions as an image generation unit 221, an operation acquisition unit 222, an evaluation unit 223, and a fixation point acquisition unit 224 by reading and executing each computer program stored in the storage unit 21.

[0023] Further, the storage unit 21 may store teacher data 215 and the like, which will be described later, in a non-volatile memory.

[0024] FIG. 4 is a flowchart showing an example of a control method of the simulation operation device 1. This flowchart is executed by the control unit 22 in the control device 2 while and after a trainee of the simulation training operates the operation device 3 to simulate driving the vehicle so that the vehicle does not collide with an attention object displayed on the simulation image 41.

[0025] In step S1, the image generation unit 221 generates a simulation image 41 to be displayed on the display device 4 and outputs it to the display device 4. Further, the operation acquisition unit 222 acquires an operation signal indicating that the trainee of the simulation training has operated the operation device 3 from the operation device 3 and stores it in the storage unit 21 as operation data.

[0026] In step S2, the fixation point acquisition unit 224 acquires a signal indicating the direction of the trainee's line of sight detected by the line-of-sight detection device 5 from the line-of-sight detection device 5, calculates the position of the trainee's fixation point on the simulation image 41 based on the acquired signal, and stores it in the storage unit 21 as fixation point data. Here, the line of sight means the direction of the trainee's line of sight detected by the line-of-sight detection device 5, and the fixation point means the position coordinates of the viewpoint on the simulation image 41 that the trainee is gazing at, calculated based on the direction of the trainee's line of sight by the fixation point acquisition unit 224.

[0027] The image generation unit 221, the operation acquisition unit 222, and the gaze point acquisition unit 224 repeat steps S1 to S2 until the simulation training scenario ends (No in step S3).

[0028] When the simulation training scenario ends (Yes in step S3), the evaluation unit 223 calculates, in step S4, the degree of similarity between the movement of the learner's gaze point on the simulation image 41 and the movement of the gaze point of the teacher data. Here, as the teacher data, for example, the movement of the line of sight obtained by having a model driver take the simulation training scenario in advance and stored in the storage unit 21 as the teacher data 215 is used.

[0029] FIG. 5 is a diagram showing an example of the movement 10 of the learner's gaze point and the movement 11 of the gaze point of the teacher data. In FIG. 5(a), in the simulation training scenario, the movement 10 of the learner's gaze point acquired by the gaze point acquisition unit 224 when the vehicle driven by the learner approaches an intersection and the movement 11 of the gaze point of the teacher data stored in the storage unit 21 are superimposed and shown on the simulation image 41. Further, in FIG. 5(b), the position coordinates pi, qi of the movement 10 of the learner's gaze point at the time ti and the position coordinates ri, si of the movement 11 of the gaze point of the teacher data at the time ti are shown. Further, in FIG. 5(c), the trajectory 12 of the learner's gaze point and the trajectory 13 of the gaze point of the teacher data, excluding the time information from the movement 10 of the learner's gaze point and the movement 11 of the gaze point of the teacher data shown in FIG. 5(b), are shown.

[0030] When the learner of the simulation training approaches an intersection, the learner operates the deceleration operation means 32 at time t0 to decelerate the vehicle. At this time, the movement 10 of the learner's gaze point sequentially moves over the other vehicle 6a stopped on the road, the pedestrian 7a hidden in the blind spot of the other vehicle 6a, the other vehicle 6b moving in the oncoming lane, and the pedestrian 7b trying to cross the crosswalk, and then returns to the other vehicle 6a.

[0031] On the other hand, the movement 11 of the gaze point of the teacher data in which a model driver took the same simulation training scenario, in addition to the movement 10 of the gaze point of the trainee, further moves over the bicycle 8 approaching from the rear reflected in the rearview mirror 42. In this way, by comparing the movement 10 of the gaze point of the trainee and the movement 11 of the gaze point of the teacher data, it can be known that the trainee overlooks the safety check for the bicycle 8 approaching from the rear reflected in the rearview mirror 42.

[0032] Therefore, for example, the evaluation unit 223 calculates the similarity between the movement 10 of the gaze point of the trainee and the movement 11 of the gaze point of the teacher data when the trainee performs a predetermined operation on the operation device 3. The predetermined operation is, for example, the operation of the deceleration operation means 32. In this case, the evaluation unit 223 can calculate the similarity between the movement 10 of the gaze point of the trainee shown in Fig. 5(b) and the movement 11 of the gaze point of the teacher data by, for example, the following formula (1). Similarity = 1 / Σ{(pi - ri) 2 +(qi - si) 2} (1)

[0033] Here, Σ represents the sum for each time ti from time t0 to time t4. The time ti is normalized so that the time t0 when the trainee operates the deceleration operation means 32 is the reference time, and the time t4 is the time when a certain period has elapsed from the time t0. The certain period is, for example, 2 seconds.

[0034] Alternatively, the evaluation unit 223 may calculate the spatial similarity between the trajectory 12 of the viewer's point of gaze of the learner within a certain period including the time when the learner performed a predetermined operation and the trajectory 13 of the viewer's point of gaze of the teacher data. In this case, the evaluation unit 223 can calculate the similarity between the trajectory 12 of the viewer's point of gaze of the learner and the trajectory 13 of the viewer's point of gaze of the teacher data shown in FIG. 5(c) as, for example, the reciprocal of the DTW (Dynamic Time Warping) distance described in the literature (Hirokazu Naito, Kenji Matsuura, Akihiro Kashiwara, Rei Saito, Takeo Doi, Genta Kurita: Awareness Support Environment during Automobile Driving with Introduction of Gaze Induction, 4th Research Society of the Information Society of Educational Systems, 2020, Vol. 35, No. 4, 21-26, November 2020). Thereby, regardless of the order in which the learner confirmed the attention objects on the simulation image 41, it is possible to know whether or not the learner confirmed the attention objects.

[0035] The predetermined operation at the timing of calculating the similarity is not limited to the operation of the deceleration operation means 32, and may be a more complex operation. For example, the predetermined operation may be that the learner operated the operation device 3 in the order of the deceleration operation means 32, the steering wheel 31, and the acceleration operation means 33. In this case, the above-mentioned certain period for calculating the similarity may be, for example, the period from when the learner operates the deceleration operation means 32 until the learner operates the acceleration operation means 33.

[0036] In step S5, the evaluation unit 223 evaluates the degree of safety confirmation of the learner's driving based on the similarity calculated in step S4. For example, the evaluation unit 223 can use the average value of the similarities calculated in a plurality of scenes as the evaluation value of the safety confirmation of the learner's driving. Thereby, the movement of the viewer's point of gaze of the learner on the simulation image is associated with the process of the operation in driving, and the degree of safety confirmation of the learner's driving is evaluated, so that it is possible to comprehensively evaluate the process of recognition, judgment, and operation in the learner's driving.

[0037] In step S6, the image generation unit 221 generates a reproduction image 43 of the simulation training according to the operation data of the trainee acquired and stored in the storage unit 21 during the simulation training, and overlays the gaze point data of the trainee acquired and stored in the storage unit 21 during the simulation training on the reproduction image 43 and causes the display device 4 to reproduce it.

[0038] FIG. 6 is a diagram showing an example of the reproduction image 43 reproduced on the display device 4. On the reproduction image 43 shown in FIG. 6, the movement 10 of the gaze point of the trainee and the movement 11 of the gaze point of the instructor data are reproduced in an overlapping manner. The trainee can grasp the problems in safety confirmation in his or her own driving by looking at the reproduction image 43 reproduced by the playback. In FIG. 5(a), for the sake of convenience of explanation, the movement 10 of the gaze point of the trainee and the movement 11 of the gaze point of the instructor data are shown overlapped on the simulation image 41, but it should be noted that these are not displayed overlapped on the simulation image 41 during the simulation training.

[0039] Among the attention objects displayed on the reproduction image 43, the image generation unit 221 may emphasize and display those on which the gaze point of the trainee does not overlap but the gaze point of the instructor data overlaps by using the graphic 9 or changing the color on the simulation image. The graphic 9 is, for example, in the shape of a circular frame, and the color is, for example, red. Thereby, the trainee can know, for example, that he or she has missed the bicycle 8 approaching from behind reflected in the rearview mirror 42 shown in FIG. 6 by means of the graphic 9 or the like in the safety confirmation of driving, so that it becomes easier to grasp the problems in safety confirmation in his or her own driving.

[0040] The image generation unit 221 may output the evaluation value of the safety confirmation of the trainee's driving calculated by the evaluation unit 223 to the display device 4 for display.

[0041] As described above, the simulation driving device includes a control device, a display device, and a gaze detection device, and is a simulation driving device that simulates the driving of a vehicle. The control device includes an image generation unit that generates a simulation image to be displayed on the display device and outputs it to the display device, a gaze point acquisition unit that acquires the position of the gaze point of the trainee in the simulation image based on the direction of the gaze of the trainee in the simulation training detected by the gaze detection device, and the simulationImage A storage unit that stores teacher data on the movement of the fixation point on the upper side, and an evaluation unit that evaluates the degree of safety confirmation of the trainee's driving based on the similarity between the movement of the trainee's fixation point on the simulated image and the movement of the fixation point of the teacher data. An operation acquisition unit that acquires an operation signal representing an operation of an operation device by a trainee during a simulation training from the operation device, It has and an image generation unit generates a simulation image to be displayed on the display device according to the operation signal and outputs it to the display device, and an evaluation unit calculates the degree of similarity between the movement of the trainee's gaze point and the movement of the gaze point of the teacher data when the trainee performs a predetermined operation on the operation device as the degree of safety confirmation of the trainee's driving . Thereby, a simulated driving device is provided that can effectively conduct training on safety confirmation including cognitive and judgment in driving.

[0042] The above-described embodiments are merely examples of concretization in implementing the present invention, and the technical scope of the present invention should not be limitedly interpreted by these. That is, the present invention can be implemented in various forms without departing from its technical idea or its main features.

Explanation of symbols

[0043] 1 Simulated driving device 2 Control device 3 Operating device 4 Display device 5 Eye gaze detection device 6a Other vehicle 6b Other vehicle 7a Pedestrian 7b Pedestrian 8 Bicycle 9 Graphic 31 Steering wheel 32 Deceleration operation means 33 Acceleration operation means 41 Simulated image 42 Rearview mirror 43 Reproduced image 211 Image generation program 212 Operation acquisition program 213 Evaluation program 214 Fixation point acquisition program 221 Image generation unit 222 Operation acquisition unit 223 Evaluation unit 224 Fixation point acquisition unit

Claims

1. A simulation driving device that includes a control device, a display device, and a gaze detection device and simulates the driving of a vehicle, wherein the control device, an image generation unit that generates a simulation image to be displayed on the display device and outputs the image to the display device, a gaze point acquisition unit that acquires the position of the gaze point of the trainee in the simulation image based on the direction of the gaze of the trainee in the simulation training detected by the gaze detection device, a storage unit that stores teacher data on the movement of the gaze point in the simulation image, an evaluation unit that evaluates the degree of safety confirmation of the driving of the trainee based on the similarity between the movement of the gaze point of the trainee in the simulation image and the movement of the gaze point of the teacher data, an operation acquisition unit that acquires an operation signal representing the operation of the operation device by the trainee during the simulation training from the operation device, and has, the image generation unit generates a simulation image to be displayed on the display device according to the operation signal and outputs the image to the display device, the evaluation unit calculates the similarity between the movement of the gaze point of the trainee when the trainee performs a predetermined operation on the operation device and the movement of the gaze point of the teacher data as the degree of safety confirmation of the driving of the trainee. A simulation driving device.

2. A simulation driving device that includes a control device, a display device, and a gaze detection device and simulates the driving of a vehicle, wherein the control device, an image generation unit that generates a simulation image to be displayed on the display device and outputs the image to the display device, a gaze point acquisition unit that acquires the position of the gaze point of the trainee in the simulation image based on the direction of the gaze of the trainee in the simulation training detected by the gaze detection device, a storage unit that stores teacher data on the movement of the gaze point in the simulation image, an evaluation unit that evaluates the degree of safety confirmation of the driving of the trainee based on the similarity between the movement of the gaze point of the trainee in the simulation image and the movement of the gaze point of the teacher data, an operation acquisition unit that acquires an operation signal representing the operation of the operation device by the trainee during the simulation training from the operation device, and has, the image generation unit generates a simulation image to be displayed on the display device according to the operation signal and outputs the image to the display device, the evaluation unit calculates the spatial similarity between the trajectory of the gaze point of the trainee and the trajectory of the gaze point of the teacher data within a certain period including the time when the trainee performs a predetermined operation on the operation device as the degree of safety confirmation of the driving of the trainee. A simulation driving device.

3. A simulation driving device that includes a control device, a display device, and a line-of-sight detection device, and simulates the driving of a vehicle, wherein the control device, an image generation unit that generates a simulation image to be displayed on the display device and outputs the image to the display device, a fixation point acquisition unit that acquires the position of the fixation point of the trainee in the simulation image based on the direction of the line of sight of the trainee in the simulation training detected by the line-of-sight detection device, a storage unit that stores teacher data on the movement of the fixation point in the simulation image, an evaluation unit that evaluates the degree of safety confirmation of the trainee's driving based on the similarity between the movement of the fixation point of the trainee in the simulation image and the movement of the fixation point of the teacher data, an operation acquisition unit that acquires an operation signal representing the operation of the operation device by the trainee during the simulation training from the operation device, and has, the image generation unit generates a simulation image to be displayed on the display device according to the operation signal and outputs the image to the display device, after the trainee finishes the simulation training, the image generation unit generates a reproduction image of the simulation training according to the operation signal acquired by the operation acquisition unit and stored in the storage unit, overlays the movement of the fixation point of the trainee acquired by the fixation point acquisition unit and stored in the storage unit on the reproduction image, and displays the image on the display device as the simulation image. An attention object where the fixation point of the trainee does not overlap and the fixation point of the teacher data overlaps is highlighted and displayed on the reproduction image by a figure or by changing the color. A simulation driving device.

4. The operation device includes a deceleration operation means, the predetermined operation includes the trainee operating the deceleration operation means, The simulation driving device according to claim 1 or 2.

5. The operation device includes a steering wheel, a deceleration operation means, and an acceleration operation means, the predetermined operation includes the trainee operating the deceleration operation means, the steering wheel, and the acceleration operation means in this order, The simulation driving device according to claim 1 or 2.

6. A control method for a simulation driving device that includes a control device, a display device, and a line-of-sight detection device, and simulates the driving of a vehicle, wherein the control device, generates a simulation image to be displayed on the display device and outputs the image to the display device, acquires the position of the fixation point of the trainee in the simulation image based on the direction of the line of sight of the trainee in the simulation training detected by the line-of-sight detection device, Based on the similarity between the movement of the viewer's point of gaze on the simulated image and the movement of the point of gaze in the instructor data, evaluate the degree of safety confirmation of the trainee's driving. Obtain an operation signal representing the operation of the operation device by the trainee during the simulated training from the operation device. Generate a simulated image to be displayed on the display device according to the operation signal and output it to the display device. The similarity between the movement of the viewer's point of gaze of the trainee when the trainee performs a predetermined operation on the operation device and the movement of the point of gaze in the instructor data is calculated as the degree of safety confirmation of the trainee's driving. A control method for a simulated driving device.

7. A control method for a simulated driving device including a control device, a display device, and a gaze detection device, for simulating the driving of a vehicle, wherein the control device generates a simulated image to be displayed on the display device and outputs it to the display device. Based on the direction of the gaze of the trainee in the simulated training detected by the gaze detection device, obtain the position of the viewer's point of gaze of the trainee on the simulated image. Based on the similarity between the movement of the viewer's point of gaze of the trainee on the simulated image and the movement of the point of gaze in the instructor data, evaluate the degree of safety confirmation of the trainee's driving. Obtain an operation signal representing the operation of the operation device by the trainee during the simulated training from the operation device. Generate a simulated image to be displayed on the display device according to the operation signal and output it to the display device. The spatial similarity between the trajectory of the viewer's point of gaze of the trainee and the trajectory of the point of gaze in the instructor data within a certain period including the time when the trainee performs a predetermined operation on the operation device is calculated as the degree of safety confirmation of the trainee's driving. A control method for a simulated driving device.

8. A control method for a simulated driving device including a control device, a display device, and a gaze detection device, for simulating the driving of a vehicle, wherein the control device generates a simulated image to be displayed on the display device and outputs it to the display device. Based on the direction of the gaze of the trainee in the simulated training detected by the gaze detection device, obtain and store in a storage unit the position of the viewer's point of gaze of the trainee on the simulated image. Based on the similarity between the movement of the viewer's point of gaze of the trainee on the simulated image and the movement of the point of gaze in the instructor data read from the storage unit storing the instructor data of the movement of the point of gaze on the simulated image, evaluate the degree of safety confirmation of the trainee's driving. An operation signal representing an operation of the operation device by the trainee during the simulation training is acquired from the operation device and stored in the storage unit. A simulated image to be displayed on the display device is generated according to the operation signal and output to the display device. After the trainee finishes the simulation training, a reproduction image of the simulation training is generated according to the operation signal stored in the storage unit, the movement of the trainee's gaze point stored in the storage unit is superimposed on the reproduction image, and is displayed on the display device as the simulated image. An attention object on which the trainee's gaze points do not overlap and the gaze points of the teacher data overlap is highlighted and displayed on the reproduction image by a figure or by changing the color. A control method for a simulation driving device.

Images