Simulation operation device and control method for simulation operation device

Abstract

To provide a driving simulator which can train a trainee at a suitable level of difficulty in accordance with driving ability of the trainee.SOLUTION: A driving simulator includes a control apparatus, an operation device, and a display device, to simulate driving of a vehicle on the basis of a simulation training scenario. The control apparatus includes: an image generation unit which generates a simulated image on the basis of a simulation training scenario with a predetermined level of difficulty, and outputs the image to the display device; an operation acquisition unit which acquires an operation signal indicating operation on the operation device operated by a trainee during a simulation training using the simulated image displayed on the display device, from the operation device; a determination unit which determines driving ability of the trainee on the basis of the operation signal; and a difficulty level modification unit which modifies a level of difficulty of the simulation training scenario by changing the number of attention objects displayed simultaneously on the simulated image at least, in accordance with the ability of the trainee.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a simulation operation device and a control method for the simulation operation device.

Background Art

[0002] In recent years, simulation operation devices have been widely used for driving training of vehicles such as motorcycles, automobiles, and railway vehicles. For example, Patent Document 1 describes a vehicle driving simulator device configured such that when it is determined that a subject has become proficient in brake operation, a mode switching unit switches from an operation proficiency mode to a main test mode. Further, Patent Document 2 describes a driving simulator for training on time-critical issues.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] When conducting driving training using a simulation operation device, if the difficulty level of the simulation training scenario does not match the proficiency level of the trainee's driving, the trainee of the simulation training will not have enough room to accurately grasp the problems in their own driving, and the effect of the training will decline.

[0005] However, although the vehicle driving simulator device described in Patent Document 1 has an operation proficiency mode for determining whether a subject has reached the proficiency level to take this test, it is not possible to dynamically change the difficulty level of the operation proficiency mode according to the driving proficiency of the trainee. Also, the driving simulator described in Patent Document 2 changes the difficulty level of a task by changing the progress speed of time in the virtual space for a task with a time constraint, but it is not possible to change the difficulty level for tasks other than those with a time constraint.

[0006] An object of the present invention is to provide a simulated driving device that allows a trainee to conduct training at a difficulty level suitable for their own driving proficiency.

Means for Solving the Problem

[0007] The simulated driving device according to an embodiment of the present invention includes a control device, an operation device, and a display device, and is a simulated driving device that simulates the driving of a vehicle based on a simulated training scenario. The control device includes an image generation unit that generates a simulated image based on a simulated training scenario having a predetermined difficulty level and outputs it to the display device, an operation acquisition unit that acquires an operation signal representing the operation of the operation device by a trainee during simulated training using the simulated image displayed on the display device from the operation device, a determination unit that determines the driving proficiency of the trainee based on the operation signal, and a difficulty level change unit that changes the difficulty level of the simulated training scenario by changing at least the number of attention objects simultaneously displayed on the simulated image according to the proficiency of the trainee.

[0008] The control method of the simulated driving device according to an embodiment of the present invention generates a simulated image based on a simulated training scenario having a predetermined difficulty level and outputs it to the display device, acquires an operation signal representing the operation of the operation device by a trainee during simulated training using the simulated image displayed on the display device from the operation device, determines the driving proficiency of the trainee based on the operation signal, and changes the difficulty level of the simulated training scenario by changing at least the number of attention objects simultaneously displayed on the simulated image according to the proficiency of the trainee.

Advantages of the Invention

[0009] According to the present invention, there is provided a simulation driving device that enables a trainee to conduct training at a difficulty level suitable for their driving proficiency.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0011] The simulation driving device of the present invention determines the driving proficiency of a trainee in real time based on the operation of the trainee simulating the driving of a vehicle, and dynamically changes the difficulty level of the simulation training scenario according to the determined proficiency of the trainee. As a result, the difficulty level of the simulation training scenario is dynamically changed according to the proficiency of the trainee, at least by the number of attention objects simultaneously displayed on the simulation image, so that the trainee can conduct training at a difficulty level suitable for their driving proficiency.

[0012] Hereinafter, preferred embodiments will be described with reference to the drawings. It should be noted that the present invention is not limited to the following embodiments, and can be appropriately changed without departing from the gist thereof. Also, in each figure, those having the same or corresponding functions are denoted by the same reference numerals, and the description thereof may be omitted or simplified.

[0013] FIG. 1 is a diagram showing an example of the configuration of the simulation driving device 1. The simulation driving device 1 includes a control device 2, a steering wheel 31, a deceleration operation means 32, an acceleration operation means 33, a shift operation means 34, and a display device 4. The simulation driving device 1 may further include a speaker or the like. Although FIG. 1 shows an example of the configuration of the simulation driving device 1 for automobile training, the simulation driving device 1 may be for training of motorcycles, railway vehicles, etc.

[0014] The control device 2 is communicably connected to the steering wheel 31, the deceleration operation means 32, the acceleration operation means 33, the shift operation means 34, and the display device 4 by wire or wirelessly, and controls the entire simulation driving device 1. Further, the control device 2 also functions as an arithmetic device for simulating a virtual space in which the vehicle of the trainee moves together with attention objects such as other vehicles 6a, 6b, pedestrians 7a, 7b, bicycles, etc. based on the simulation training scenario. The simulation training scenario has, for example, the maximum number of attention objects that appear simultaneously around the vehicle of the trainee as the difficulty information of the simulation training scenario, and has the distance from the vehicle of the trainee to the attention object, etc. as the danger degree information of the attention object.

[0015] The steering wheel 31, the deceleration operation means 32, the acceleration operation means 33, and the shift operation means 34 are operated for the trainee of the simulation training to simulate driving the vehicle, and output an operation signal indicating that they have been operated by the trainee to the control device 2. When the simulation driving device 1 is for automobile training, the steering wheel 31, the deceleration operation means 32, the acceleration operation means 33, and the shift operation means 34 are a steering wheel, a brake pedal, an accelerator pedal, and a shift lever, respectively. When the simulation driving device 1 is for railway vehicle training, the steering wheel 31 and the shift operation means 34 are omitted.

[0016] The display device 4 is arranged in front of the trainee, and displays, as a simulation image 41, a landscape on a virtual space that a trainee in a simulation training would see from a vehicle on the virtual space. This simulation image 41 is generated by the control device 2 and output to the display device 4. For example, in the simulation image 41 shown in FIG. 1, a landscape on a road in the virtual space that the trainee sees in front of the vehicle is displayed, and in the upper right of the simulation image 41, a landscape that the trainee sees behind the vehicle through a rearview mirror 42 on the virtual space is displayed. The trainee in the simulation training simulates driving the vehicle while operating the steering wheel 31, the deceleration operation means 32, the acceleration operation means 33, and the shift operation means 34 so that the vehicle does not collide with attention objects such as other vehicles 6a, 6b, pedestrians 7a, 7b, etc. displayed on the simulation image 41.

[0017] FIG. 2 is a diagram showing an example of the hardware configuration of the control device 2 and the operation device 3. The control device 2 includes a storage unit 21, a control unit 22, an external communication I / F 23, and a video output I / F 24 that are communicably connected to each other via an internal bus 20. The operation device 3 includes a steering wheel 31, a deceleration operation means 32, an acceleration operation means 33, and a shift operation means 34.

[0018] The storage unit 21 includes a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as an HDD (Hard Disk Drive) or a flash memory (registered trademark). The storage unit 21 stores a computer program executed by the control unit 22, data processed by the computer program, and the like.

[0019] The control unit 22 includes one or more processors and peripheral circuits, and executes a computer program stored in the storage unit 21 to control each part of the simulation driving device 1. The control unit 22 may be configured by an integrated circuit such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0020] The external communication I / F 23 has a communication I / F circuit for connecting the control unit 22 to the operating device 3 via the communication line 30, enabling the control unit 22 to communicate with the operating device 3. The external communication I / F 23 receives the signal output from the operating device 3 and transmits it to the control unit 22, and receives the signal output from the control unit 22 and transmits it to the operating device 3.

[0021] The video output I / F 24 has a communication I / F circuit for connecting the control unit 22 to the display device 4 via the communication line 40, enabling the control unit 22 to communicate with the display device 4. The video output I / F 24 receives the signal output from the display device 4 and transmits it to the control unit 22, and receives the signal output from the control unit 22 and transmits it to the display device 4.

[0022] FIG. 3 is a functional block diagram of the storage unit 21 and the control unit 22 of the simulation operation device 1. The storage unit 21 stores the image generation program 211, the operation acquisition program 212, the determination program 213, and the difficulty level change program 214 as software modules or firmware. The control unit 22 functions as an image generation unit 221, an operation acquisition unit 222, a determination unit 223, and a difficulty level change unit 224 by reading and executing each computer program stored in the storage unit 21.

[0023] Further, the storage unit 21 may store, in a non-volatile memory, values 215 etc. indicating the respective risks of the attention objects displayed on the simulation image 41, which will be described later.

[0024] FIG. 4 is a flowchart showing an example of the control method of the simulation operation device 1. This flowchart is executed by the control unit 22 in the control device 2 while and after the trainee of the simulation training operates the operating device 3 to simulate the driving of the vehicle so that the vehicle does not collide with the attention objects displayed on the simulation image 41.

[0025] In step S1, the image generation unit 221 generates a simulated image 41 to be displayed on the display device 4 based on the simulated training scenario and outputs it to the display device 4. Also, the operation acquisition unit 222 acquires an operation signal from the operation device 3 indicating that the trainee of the simulated training has operated the operation device 3.

[0026] In step S2, the determination unit 223 determines the proficiency of the trainee in driving in real time based on the operation signal when the trainee operates the operation device 3 to drive the vehicle during the simulated training using the simulated image 41 displayed on the display device 4 and the current difficulty level of the simulated training scenario.

[0027] For example, the determination unit 223 may determine the proficiency of the trainee as the number of attention objects simultaneously displayed on the simulated image 41 in which the trainee can avoid a collision in the simulated training. In this case, for example, when the trainee avoids a collision with an attention object, the determination unit 223 can set the larger of the number of attention objects simultaneously displayed on the simulated image 41 at that time and the value indicating the current proficiency of the trainee as the proficiency of the trainee. For example, in FIG. 1, since the number of attention objects simultaneously displayed on the simulated image 41 is four, namely the other vehicles 6a, 6b, and the pedestrians 7a, 7b, when the trainee avoids a collision with any of these attention objects, the proficiency of the trainee is at least 4. On the other hand, when the trainee cannot avoid a collision with an attention object, the determination unit 223 may reduce the proficiency of the trainee. For example, in FIG. 1, when the trainee's vehicle contacts any of the attention objects displayed on the simulated image 41, the proficiency of the trainee is reduced by 1, for example. The value indicating the proficiency of the trainee may be initialized to 1, for example, when the simulated training scenario starts.

[0028] Here, the determination unit 223 may determine whether the learner has avoided a collision with the attention object based on the collision margin time between the learner's vehicle and the attention object. In this case, when the collision margin time between the learner's vehicle and the attention object is always equal to or greater than a predetermined threshold, the determination unit 223 determines that the learner has avoided a collision with the attention object. On the other hand, when the collision margin time is less than the threshold even once, the determination unit 223 determines that the learner could not avoid a collision with the attention object. The collision margin time is calculated, for example, by the following formula (1) when the learner's vehicle is moving at a velocity vector v1, the attention object is moving at a velocity vector v2, and the distance between them is d. The threshold can be set as appropriate and is, for example, set to 2 seconds. Collision margin time = d / |v2 - v1| (1)

[0029] Also, when the learner performs a predetermined operation such as a sudden steering, sudden braking, or sudden acceleration to avoid a collision with the attention object, the determination unit 223 may reduce the learner's proficiency. For example, when the learner operates the steering wheel 31 beyond a first allowable operation amount, operates the deceleration operation means 32 beyond a second allowable operation amount, or operates the acceleration operation means 33 beyond a third allowable operation amount, the determination unit 223 reduces the learner's proficiency. Here, the first to third allowable operation amounts are determined as appropriate.

[0030] In step S3, the difficulty change unit 224 determines whether it has reached a predetermined difficulty change timing for dynamically changing the difficulty of the simulation training scenario. The difficulty change timing can be set as appropriate. For example, the difficulty change unit 224 may use the timing when the learner's vehicle approaches an intersection as the difficulty change timing. Alternatively, the difficulty change unit 224 may use the timing when the learner's vehicle travels a certain distance or when a certain time has elapsed as the difficulty change timing. For example, the certain distance can be set to 10 m and the certain time can be set to 2 seconds. The image generation unit 221, the operation acquisition unit 222, the determination unit 223, and the difficulty change unit 224 repeat steps S1 to S2 until the difficulty change timing is reached (No in step S3).

[0031] When it comes to the timing of difficulty level change (Yes in step S3), in step S4, the difficulty level change unit 224 dynamically changes the difficulty level of the simulation training scenario by changing at least the number of attention objects simultaneously displayed on the simulation image 41 according to the proficiency of the trainee and the current difficulty level of the simulation training scenario.

[0032] For example, the difficulty level change unit 224 may use the maximum number of attention objects simultaneously displayed on the simulation image 41 as the difficulty level of the simulation training scenario. For example, in FIG. 1, since a maximum of four attention objects, namely other vehicles 6a, 6b, pedestrians 7a, 7b, are simultaneously displayed on the simulation image 41, the difficulty level of the simulation training scenario is 4. The more attention objects are simultaneously displayed on the simulation image 41, the more the attention of the trainee is dispersed, and the higher the difficulty level of the simulation training scenario.

[0033] Alternatively, the difficulty level change unit 224 may use the maximum value of the total risk level of the attention objects simultaneously displayed on the simulation image 41 as the difficulty level of the simulation training scenario. For example, in FIG. 1, if the risk levels of three attention objects, namely other vehicles 6a, 6b, and pedestrian 7b that are easily visible from the trainee's vehicle, are each set to 1, and the risk level of pedestrian 7b that is hidden in the blind spot of other vehicle 6a parked on the road and is difficult to see is set to 2, then the difficulty level of the simulation training scenario is 1×3 + 2 = 5. Thus, the risk level of the attention object hidden in the blind spot and difficult to see can be reflected in the difficulty level of the simulation training scenario. The risk level of the attention object may also be set high according to other factors such as the speed of movement, size, proximity from the trainee's vehicle, and difficulty of predicting movement of the attention object. The value 215 indicating the risk level of each attention object is pre-stored in the storage unit 21 of the simulation driving device 1.

[0034] FIG. 5 is a flowchart showing an example of the difficulty level change process in the control method of the simulation driving device 1. This difficulty level change process is executed in step S4 of the flowchart shown in FIG. 4.

[0035] In step S41, the difficulty level change unit 224 determines whether the value of the proficiency level of the learner determined by the determination unit 223 is equal to or higher than the value of the difficulty level of the simulated training scenario. When the proficiency level of the learner is equal to or higher than the difficulty level of the simulated training scenario (Yes in step S41), the difficulty level change unit 224 increases the difficulty level of the simulated training scenario by, for example, 1 in step S42. On the other hand, when the proficiency level of the learner is lower than the difficulty level of the simulated training scenario (No in step S41), the difficulty level change unit 224 reduces the difficulty level of the simulated training scenario by, for example, 1 in step S43. Thereby, the difficulty level of the simulated training scenario is dynamically changed according to the proficiency level of the learner.

[0036] FIG. 6 is a diagram showing an example of simulated images 41b and 41c in which the difficulty level of the simulated training scenario is changed.

[0037] FIG. 6(a) shows a simulated image 41b in which, as a result of the difficulty level being changed and increased by 1 by the difficulty level change unit 224, the maximum number of attention objects displayed simultaneously is 5. A bicycle 8 is additionally displayed on the rearview mirror 42 in the upper right of the simulated image 41b. Thereby, a learner with a high proficiency level can also perform training to avoid collisions with attention objects such as the bicycle 8 that appears from the blind spot behind the learner's vehicle.

[0038] FIG. 6(b) shows a simulated image 41c in which, as a result of the difficulty level being changed and decreased by 1 by the difficulty level change unit 224, the maximum number of attention objects displayed simultaneously is 3. In the simulated image 41c, the other vehicle 6b moving in the oncoming lane, which was displayed in the simulated image 41 shown in FIG. 1, is no longer displayed. Thereby, a learner with a low proficiency level can concentrate on training with three attention objects: the other vehicle 6a, and the pedestrians 7b and 7b.

[0039] In this way, by dynamically changing the difficulty level of the simulated training scenario by changing at least the number of attention objects displayed simultaneously on the simulated image according to the proficiency level of the learner, the learner can grasp the problems in their own driving, thus improving the effect of the training.

[0040] The image generation unit 221, the operation acquisition unit 222, the determination unit 223, and the difficulty level change unit 224 repeat steps S1 to S4 until the simulation training scenario ends (No in step S5).

[0041] When the simulation training scenario ends (Yes in step S5), the image generation unit 221 may output and display the final proficiency level of the trainee's driving on the display device 4 in step S6.

[0042] As described above, the simulated driving device of the embodiment includes a control device, an operation device, and a display device, and is a simulated driving device that simulates the driving of a vehicle based on a simulation training scenario. The control device includes an image generation unit that generates a simulated image based on a simulation training scenario having a predetermined difficulty level and outputs it to the display device, an operation acquisition unit that acquires an operation signal representing the operation of the operation device by the trainee during the simulation training using the simulated image displayed on the display device from the operation device, a determination unit that determines the proficiency level of the trainee's driving based on the operation signal, and a difficulty level change unit that changes the difficulty level of the simulation training scenario by changing at least the number of attention objects simultaneously displayed on the simulated image according to the proficiency level of the trainee. Thereby, a simulated driving device is provided in which a trainee can perform training at a difficulty level suitable for his / her own driving proficiency level.

[0043] The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner by these. That is, the present invention can be implemented in various forms without departing from its technical idea or its main features.

Explanation of Reference Numerals

[0044] 1 Simulated driving device 2 Control device 3 Operation device 4 Display device 6a Other vehicle 6b Other vehicle 7a Pedestrian 7b Pedestrian 8 Bicycle 31 Handle 32 Deceleration operation means 33 Acceleration operation means 34 Shift operation means 41 Simulation image 42 Rearview mirror 211 Image generation program 212 Operation acquisition program 213 Decision program 214 Difficulty change program 221 Image generation unit 222 Operation acquisition unit 223 Decision unit 224 Difficulty change unit

Claims

1. A simulation driving device that includes a control device, an operation device, and a display device, and simulates the driving of a vehicle based on a simulation training scenario, wherein the control device an image generation unit that generates a simulation image based on the simulation training scenario having a predetermined difficulty level and outputs the simulation image to the display device; an operation acquisition unit that acquires an operation signal representing an operation of the operation device by a trainee during simulation training using the simulation image displayed on the display device from the operation device; a determination unit that determines the proficiency level of the trainee's driving based on the operation signal; a difficulty level change unit that changes the difficulty level of the simulation training scenario by changing at least the number of attention objects simultaneously displayed on the simulation image according to the proficiency level of the trainee; a storage unit that stores in advance values indicating the risk levels of the respective attention objects displayed on the simulation image; and has The difficulty level change unit sets the maximum value of the total value of the risk levels of the attention objects simultaneously displayed on the simulation image as the difficulty level of the simulation training scenario. A simulation driving device.

2. A simulation driving device that includes a control device, an operation device, and a display device, and simulates the driving of a vehicle based on a simulation training scenario, wherein the control device an image generation unit that generates a simulation image based on the simulation training scenario having a predetermined difficulty level and outputs the simulation image to the display device; an operation acquisition unit that acquires an operation signal representing an operation of the operation device by a trainee during simulation training using the simulation image displayed on the display device from the operation device; a determination unit that determines the proficiency level of the trainee's driving based on the operation signal; a difficulty level change unit that changes the difficulty level of the simulation training scenario by changing at least the number of attention objects simultaneously displayed on the simulation image according to the proficiency level of the trainee; and has When the trainee avoids a collision between the vehicle and the attention object, the determination unit determines the proficiency level of the trainee based on the number of attention objects simultaneously displayed on the simulation image. When the trainee fails to avoid a collision between the vehicle and the attention object, the determination unit reduces the proficiency level of the trainee. At a predetermined difficulty level change timing, when the proficiency level is equal to or higher than the difficulty level, the difficulty level change unit increases the difficulty level, and when the proficiency level is lower than the difficulty level, the difficulty level change unit reduces the difficulty level. A simulation driving device.

3. The difficulty changing unit sets the maximum number of the attention objects simultaneously displayed on the simulation image as the difficulty of the simulation training scenario. The simulation driving device according to claim 2.

4. When the trainee avoids a collision between the vehicle and the attention object, the determination unit determines the larger of the number of the attention objects simultaneously displayed on the simulation image and the value indicating the current proficiency level of the trainee as the proficiency level of the trainee. The simulation driving device according to claim 2 or 3.

5. When the collision margin time between the vehicle and the attention object is equal to or greater than a threshold value, the determination unit determines that the trainee has avoided a collision between the vehicle and the attention object; when the collision margin time is less than the threshold value, the determination unit determines that the trainee has not been able to avoid a collision between the vehicle and the attention object. The simulation driving device according to any one of claims 2 to 4.

6. The operation device includes a steering wheel, a deceleration operation means, and an acceleration operation means. When the trainee operates the steering wheel beyond a first allowable operation amount, operates the deceleration operation means beyond a second allowable operation amount, or operates the acceleration operation means beyond a third allowable operation amount, the determination unit reduces the proficiency level of the trainee. The simulation driving device according to any one of claims 1 to 5.

7. A control method for a simulation driving device including a control device, an operation device, and a display device, and simulating the driving of a vehicle based on a simulation training scenario, wherein the control device generates a simulation image based on the simulation training scenario having a predetermined difficulty and outputs the simulation image to the display device, acquires an operation signal representing an operation of the operation device by a trainee during simulation training using the simulation image displayed on the display device from the operation device, determines the proficiency level of the trainee's driving based on the operation signal, changes at least the number of attention objects simultaneously displayed on the simulation image according to the proficiency level of the trainee to change the difficulty of the simulation training scenario, values indicating the risk levels of the respective attention objects displayed on the simulation image are stored in a storage unit in advance, A control method for a simulation driving device, wherein the maximum value of the total value of the risk levels of the attention objects simultaneously displayed on the simulation image is set as the difficulty of the simulation training scenario. A control method for a simulation driving device that includes a control device, an operation device, and a display device and simulates the driving of a vehicle based on a simulation training scenario, comprising: The control device generates a simulation image based on the simulation training scenario having a predetermined difficulty level and outputs the simulation image to the display device; acquires an operation signal representing an operation of the operation device by a trainee during simulation training using the simulation image displayed on the display device from the operation device; determines the proficiency level of the trainee's driving based on the operation signal; changes at least the number of warning objects simultaneously displayed on the simulation image according to the proficiency level of the trainee to change the difficulty level of the simulation training scenario; when the trainee avoids a collision between the vehicle and the warning object, the proficiency level of the trainee is determined based on the number of warning objects simultaneously displayed on the simulation image, and when the trainee fails to avoid a collision between the vehicle and the warning object, the proficiency level of the trainee is reduced; A control method for a simulation driving device, wherein at a predetermined difficulty change timing, when the proficiency level is equal to or higher than the difficulty level, the difficulty level is increased, and when the proficiency level is lower than the difficulty level, the difficulty level is reduced.

Images