Display device

Abstract

To provide a display device that enables an operator to start a smooth manual operation when a traveling control mode of a mobile body transitions from an automatic operation mode to a manual operation mode.SOLUTION: A display device 10 comprises: a mode transition information acquisition unit that acquires mode transition information related to transition between traveling control modes which are control modes related to automatic traveling of a mobile body; and a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the traveling control mode of the mobile body is to transition, makes a display unit display a traveling landscape as viewed from the mobile body at a point that is expected to be passed after the traveling control mode has transitioned.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display device, and more particularly to a display device capable of displaying information for assisting a driver of a mobile body such as an autonomously driven automobile. [Background technology]

[0002] Conventionally, there are known driving assistance technologies that automatically perform driving operations related to vehicle travel on behalf of the driver. For example, Patent Document 1 proposes a device that notifies the driver in advance of switching from automatic driving to manual driving (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-30158 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, in a moving body such as an automobile having the above-mentioned automatic driving function, switching occurs from an automatic driving mode, which is a driving control mode in which driving control is performed automatically, to a manual driving mode, which is a driving control mode in which driving control is performed by the driver's operation. At the time of this switching, the driver, who did not need to perform a steering operation for steering during the automatic driving mode, is suddenly placed in a situation where a steering operation is required when switching to the manual driving mode. Therefore, it takes time for the driver to get used to manual steering, and one example of the problem is that it is difficult to smoothly switch from the automatic driving mode to the manual driving mode.

[0005] The present invention has been made in consideration of the above-mentioned points, and aims to provide a display device that enables a driver to smoothly start manual driving, for example, when the driving control mode of a moving body transitions from an automatic driving mode to a manual driving mode. [Means for solving the problem]

[0006] The invention described in claim 1 is a display device characterized by including a mode transition information acquisition unit that acquires mode transition information regarding transitions between driving control modes, which are control modes for automatic driving of a moving body, and a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the driving control mode of the moving body will be transitioned, causes a display unit to display the driving scenery seen from the moving body at a point that the moving body is expected to pass through after the driving control mode is transitioned. [Brief description of the drawings]

[0007] [Figure 1] 1 is a perspective view of a front seat portion of an automobile equipped with a display device according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing an example of a configuration of a display device according to a first embodiment of the present invention. [Diagram 3] 1 is an example of a simulation data group. [Figure 4] FIG. 2 is a perspective view of the front seat portion of the automobile during the simulation. [Diagram 5] FIG. 4 is a flowchart of an operation routine of the display device according to the first embodiment of the present invention. [Figure 6] FIG. 11 is a flowchart showing an operation routine of a display device according to a modified example of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] In the following, preferred embodiments of the present invention will be described. However, these may be modified and combined as appropriate. In the following description and the accompanying drawings, substantially the same or equivalent parts are denoted by the same reference numerals. In the following description, images are described as including moving images and still images. In the following description, operations for controlling the running of an automobile, i.e., operations for steering, are also simply referred to as steering operations. EXAMPLES

[0009] A display device 10 according to a first embodiment of the present invention will be described below with reference to the accompanying drawings. In the first embodiment, the display device 10 will be described as being mounted on an automobile M as an example of a moving body.

[0010] Fig. 1 is a perspective view of a front seat portion of an automobile M as a moving body to which a display device 10 is attached, viewed from inside the automobile M. Fig. 1 shows, as an example of an attachment, a case in which the display device 10 is attached near a center console of a dashboard DB of the front seat of the automobile M.

[0011] The camera 11 is a camera capable of photographing passengers in the automobile M. The camera 11 is provided, for example, on the dashboard DB, and is oriented so as to be able to photograph the driver in the driver's seat. The camera 11 may be disposed in a position where it can photograph the situation of the passenger's upper body movements, etc. For example, the camera 11 may be provided on the rearview mirror RM, or on the upper end of the windshield FG or on the ceiling near the upper end.

[0012] The camera 11 is communicably connected to the display device 10 and is capable of transmitting a signal of a captured image to the display device 10.

[0013] The steering wheel 13 is a member that receives a steering operation for steering the automobile M. The steering wheel 13 is provided on the dashboard DB so as to be rotatable relative to the dashboard DB. When the steering wheel 13 is turned, the steering wheels of the automobile M move accordingly.

[0014] In the automobile M of this embodiment, a so-called steer-by-wire system is used, in which the rotation amount and rotation force of the steering wheel 13 are detected by sensors (not shown), and a control signal calculated based on the detection information of the sensors is transmitted to a steering control device such as a motor that controls the turning angle of the steering wheels via a wire harness. The detection information of the rotation amount and rotation force of the steering wheel 13 detected by the sensors is transmitted to the display device 10.

[0015] The accelerator pedal 15 is provided under the driver's seat and is a member that receives, when the driver depresses it, an operation related to control of a prime mover such as an engine or a motor for driving the automobile M. In other words, the accelerator pedal 15 is a member that receives a steering operation related to acceleration and deceleration of the automobile M.

[0016] In the automobile M of this embodiment, a so-called throttle-by-wire system is used, in which the amount of movement and the speed of movement of the accelerator pedal 15 are detected by sensors (not shown), and a control signal calculated based on the information detected by the sensors is transmitted via a wire harness to a prime mover control device, which is a control device that controls an engine or a motor, which is a prime mover. The information on the amount of movement and the speed of movement of the accelerator pedal 15 detected by the sensors is transmitted to the display device 10.

[0017] The brake pedal 17 is provided under the driver's seat and is a member that receives an operation related to control of the brakes of the automobile M by a driver's depressing action. That is, the brake pedal 17 is a member that receives a steering operation related to deceleration of the automobile M.

[0018] In the automobile M of this embodiment, a so-called brake-by-wire system is used, in which the movement amount and movement speed of the brake pedal 17 are detected by sensors (not shown), and a control signal calculated based on the detection information of the sensors is transmitted to a brake control device, which is a control device that controls the brakes, via a wire harness. Detection information of the movement amount and movement speed of the brake pedal detected by the sensor is transmitted to the display device 10.

[0019] As described above, the automobile M of this embodiment is provided with a so-called drive-by-wire system, which is a system consisting of a steering-by-wire system, a throttle-by-wire system, and a brake-by-wire system.

[0020] In the following description, the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 These are collectively referred to as a steering operation receiving device that receives steering operations including steering operations and acceleration / deceleration operations.

[0021] The GPS receiver 19 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 19 is arranged, for example, on a dashboard DB. The GPS receiver 19 may be arranged anywhere as long as it can receive GPS signals. The GPS receiver 19 is communicably connected to the display device 10 and can transmit the received GPS signals to the display device 10.

[0022] The touch panel 21 is, for example, a touch panel monitor in which a display 21A such as a liquid crystal display capable of displaying images and a touch pad 21B are combined. The touch panel 21 is disposed, for example, in a center console of the dashboard DB. The touch panel 21 may be disposed in a location that is visible to the driver and within the driver's reach. For example, the touch panel 21 may be attached on the dashboard DB.

[0023] The display 21A is communicably connected to the display device 10, and is capable of displaying a screen under the control of the display device 10. In addition, the touch panel 21B is capable of transmitting to the display device 10 a signal representing an input operation to the touch panel 21B received from a user.

[0024] The speaker 23 is provided, for example, on the interior side of the A-pillar AP. The speaker 23 is communicably connected to the display device 10 and can emit sounds such as voices based on the control of the display device 10.

[0025] The projection device 25 is a device that constitutes a windshield-projection type head-up display. The head-up display 25 is provided on the dashboard DB, and can project an image or video onto the windshield FG by irradiating the windshield FG with projection light.

[0026] The projection device 25 is connected to the display device 10 so as to be able to communicate with it, and is capable of irradiating projection light onto a display area AR, which is an area of ​​the windshield FG near the driver's seat, based on the control of the display device 10, and performing screen display in the display area AR of the windshield FG. Note that the projection device 25 may also be capable of performing screen display in an area other than the display area AR of the windshield FG. For example, the projection device 25 may be capable of performing image display on the entire surface of the windshield FG.

[0027] [System configuration] 2 shows the configuration of the display device 10. For example, the display device 10 is a device in which a large-capacity storage device 33, a control unit 35, an input unit 37, an output unit 39, and a data communication unit 41 cooperate with each other via a system bus 31.

[0028] The mass storage device 33 is configured, for example, by a hard disk device, a solid state drive (SSD), a flash memory, etc., and stores various programs such as an operating system and software for terminals.

[0029] The various programs may be acquired from other server devices or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, the various programs stored in the mass storage device 33 (including a program for executing the processing in the display device 10, which will be described later) can be transmitted via a network, and can be recorded on a computer-readable recording medium and transferred.

[0030] A map information database (map information DB) 33A is constructed in the large-capacity storage device 33. The map information database 33A holds map information including road maps. The map information database 33A may also include information on automatic driving areas, which are areas where the automobile M can travel automatically, and manual driving areas, which are areas where the automobile M cannot travel automatically. The automatic driving areas and manual driving areas may be determined, for example, by law or regulations.

[0031] A simulation database (simulation DB) 33B is also constructed in the large-capacity storage device 33. The simulation database 33B includes information that enables a driving simulation at a specific point or area on a road. The simulation database 33B includes information that enables a driving simulation at a point or area on a road that is closest to the boundary between an automatic driving area and a manual driving area and that requires a steering operation or a complex steering operation including a steering operation or an acceleration / deceleration operation. For example, examples of areas or points on a road that require a steering operation or a complex steering operation include curves, intersections, forks, and junctions.

[0032] Fig. 3 shows a simulation data group SD, which is an example of data included in the simulation database 33B. As shown in Fig. 3, in the simulation data group SD, for example, the road name and area to be the subject of the simulation, and the simulation data, which is data for the simulation, are linked to each of the data IDs.

[0033] The simulation data includes, for example, scenery data for the simulation and appropriate operation amounts of the steering wheel 13, accelerator pedal 15, and brake pedal 17 in the simulation.

[0034] 2 again, the control unit 35 is configured with a CPU (Central Processing Unit) 35A, a ROM (Read Only Memory) 35B, a RAM (Random Access Memory) 35C, etc., and functions as a computer. The CPU 35A reads out and executes various programs stored in the ROM 35B and the large-capacity storage device 33 to realize various functions.

[0035] The input unit 37 is an interface unit that communicatively connects the display device 10 and the touch pad 21B. The display device 10 can receive, via the input unit 37, a signal indicating an input operation to the touch pad 21B.

[0036] The output unit 39 is communicably connected to the display 21A, the speaker 23, and the projection device 25, and can transmit a video or image signal to the display 21A to display it, and transmit an audio signal to the speaker 23 to output sound. The output unit 39 can also transmit a video or image signal to the projection device 25 to display it on the windshield FG.

[0037] The data communication unit 41 is an interface unit that communicatively connects the display device 10 with the camera 11 and the GPS receiver 19. The data communication unit 41 is also an interface unit that communicatively connects the display device 10 with the steering sensor 13A, which is a sensor that detects physical quantities related to the operation of the steering wheel 13, such as the amount of rotation and the rotational force.

[0038] The data communication unit 41 is an interface unit that communicatively connects the display device 10 to an accelerator sensor 15A, which is a sensor that detects physical quantities related to operations such as the amount of movement of the accelerator pedal 15 and the travel speed, etc. The data communication unit 41 is an interface unit that communicatively connects the display device 10 to a brake sensor 17A, which is a sensor that detects physical quantities related to operations such as the amount of movement of the brake pedal 15 and the travel speed, etc.

[0039] The display device 10 receives a video signal from the camera 11 via the data communication unit 41. The display device 10 can determine the line of sight of the driver of the automobile M from the video signal received via this data communication unit 41. The display device 10 receives a GPS signal from the GPS receiver 19 via the data communication unit 41. The display device 10 can acquire location information, which is information specifying the location of the automobile M, from the GPS signal received via this data communication unit 41.

[0040] Furthermore, the display device 10 receives signals relating to physical quantities related to the operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 from the steering sensor 13A, the accelerator sensor 15A, and the brake sensor 17A, respectively. The display device 10 can recognize the operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 from the signals relating to the physical quantities received via the data communication unit 41. For example, the display device 10 can calculate the operation amounts of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17.

[0041] The data communication unit 41 also serves as an interface that communicatively connects the display device 10 to a driving control device VC of the automobile M in which the display device 10 is mounted. The driving control device VC is a device that controls the driving of the automobile M.

[0042] In this embodiment, the driving control device VC determines whether to perform manual driving control in which acceleration / deceleration and steering are manually controlled when driving the automobile M, to perform partially automatic driving control in which only acceleration / deceleration or steering is automatically controlled, or to perform fully automatic driving control in which all driving control including acceleration / deceleration and steering is automatically performed.

[0043] In addition, the driving control mode when driving under manual driving control is referred to as the manual driving mode, the driving control mode when driving under partial automatic driving control is referred to as the partial automatic driving mode, and the driving control mode when driving under fully automatic driving control is referred to as the fully automatic driving mode. Note that, hereinafter, among the partial automatic driving modes, the case where steering is automatically controlled is referred to as the steering automatic driving mode, and the case where acceleration and deceleration are automatically controlled is referred to as the acceleration / deceleration automatic driving mode.

[0044] For example, if we were to apply the above three types of driving control to the levels of automated driving defined by the Japanese government or the U.S. Department of Transportation's National Highway Traffic Safety Administration (NHTSA), manual driving control would be level 0, partial automated driving control would be level 1 or 2, and fully automated driving control would be level 3 or above.

[0045] Furthermore, in this embodiment, the driving control device VC can transmit driving control mode information, such as whether the current driving control mode of the automobile M is a manual driving mode, a partially automatic driving mode, i.e., a steering automatic driving mode or an acceleration / deceleration automatic driving mode, or a fully automatic driving mode, to the display device 10 via the data communication unit 41.

[0046] Furthermore, when there is a plan to transition the driving control mode, the driving control device VC can transmit mode transition information indicating the transition to the display device 10. The mode transition information may include information on the driving control mode after the transition. Note that the state of manual driving control in which all driving-related control, such as steering, acceleration and deceleration operations, is manually performed by the driver, is defined as autonomous driving level 0.

[0047] Furthermore, when there is a plan to change the driving control mode of the automobile M, the driving control device VC can transmit the plan to the display device 10 via the data communication unit 41. The driving control device VC may set the driving control mode of the automobile M to the automatic driving mode when the area in which the automobile M is driving is an automatic driving area, and may set the driving control mode to the manual driving mode when the area is a manual driving area.

[0048] In switching the driving control mode, the driving control device VC may determine whether to switch the driving mode using a position specifying device such as a GPS device and map information and the like that the driving control device VC has.

[0049] The driving control device VC may receive position information from the display device 10 and refer to the map information database 33A of the display device 10 to determine whether to switch the driving control mode. For example, the driving control device VC may determine whether to switch the driving control mode of the automobile M depending on the situation around the automobile M. The display device 10 may determine by itself that there is a transition in the driving control mode based on the information in the map information database 33A and the GPS signal from the GPS receiver 19.

[0050] [Display device operation] The operation of the display device 10 will be described below. When there is a change in the driving control mode, the display device 10 receives mode transition information from the driving control device VC. When this mode transition information indicates that at least one of steering or acceleration / deceleration is switched from automatic control to manual control, the display device 10 causes the driver of the automobile M to perform a driving simulation. That is, the display device 10 causes the driver to perform a driving simulation when the driving control mode of the automobile M transitions to a mode in which at least one of steering or acceleration / deceleration is more dependent on the driver.

[0051] Specifically, for example, the display device 10 displays a driving scene for simulation using the projection device 25. This driving scene for simulation may be a driving scene in an actually existing place, or may be a driving scene in a non-existent virtual place.

[0052] Fig. 4 is a diagram showing the front seat area of ​​the automobile M when a driving simulation is being performed. As shown in Fig. 4, during the driving simulation, a driving scene for the simulation is displayed in the display area AR of the windshield FG by the projection device 25. The example of Fig. 4 shows a case where the automobile M is actually driving on a straight road, but is driving around a left curve in the simulation. Also, as an example, a case where the driver is turning the steering wheel 13 to the left in accordance with the driving scene for the simulation is shown.

[0053] While displaying the driving scenery for the simulation, the display device 10 changes the driving scenery based on signals from the steering sensor 13A, the accelerator sensor 15A, and the brake sensor 17A. That is, the display device 10 functions as a drive simulator in which the display area AR is used as a screen and the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 are used as controls.

[0054] In addition, the display device 10 may determine whether the driver's operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 is appropriate while displaying the simulation driving scenery. The result of this determination may be notified to the driver by being displayed on the display 21 or the display area AR. In addition, the result of this determination may be notified to the driver by voice from the speaker 23.

[0055] The display device 10 may also determine whether the direction of the driver's line of sight is appropriate while displaying the driving scenery for the simulation. The result of this determination may be notified to the driver by, for example, displaying it on the display 21 or the display area AR. The result of this determination may also be notified to the driver by voice through the speaker 23. The display device 10 may also suggest to the driver an appropriate line of sight direction by displaying it in the display area AR through the projection device 25.

[0056] In addition, when the display device 10 receives mode transition information, the display device 10 may cause the driver to perform a driving simulation even when the mode transition information indicates that at least one of steering or acceleration / deceleration is switched from manual control to automatic control. That is, when the driving control mode changes, the display device 10 may cause the driver to perform a driving simulation regardless of the manner of the change. For example, the display device 10 may cause the driver to perform a driving simulation even when the driving control mode changes to a mode in which the driver's dependency on driving control is lower.

[0057] As described above, the automobile M employs a drive-by-wire system as an example, and the operations on the steering wheel 13, accelerator pedal 15, and brake pedal 17 during the driving simulation can be separated from the actual driving control of the automobile. Specifically, the operations on the driving control accepting devices are separated from the actual driving control by preventing signals from each of the steering control device, the prime mover control device, and the brake control device from reaching each of the devices.

[0058] In the above description, the display device 10 receives the mode transition information from the driving control device VC, but the display device 10 may determine whether or not there is a transition of the driving control mode. Specifically, for example, the display device 10 may determine whether or not there is a transition of the driving control mode based on the GPS information and the map information database 33A, and generate and acquire the mode transition information by itself.

[0059] [Example Operating Routine of Display Device 10] An example of an operation routine of the display device 10 will be described below.

[0060] 5 is a diagram showing a simulation operation routine R1 as an example of an operation routine. The simulation operation routine R1 is repeatedly executed, for example, when the power of the display device 10 is turned on. For example, the simulation operation routine R1 is repeatedly executed when the accessory power supply (hereinafter, referred to as the ACC power supply) of the automobile M is turned on.

[0061] When the simulation operation routine R1 is started, the control unit 35 first waits for reception from the driving control device VC (step S1). Next, the control unit 35 determines whether or not mode transition information has been received from the driving control device VC (step S2). In steps S1 and S2, the control unit 35 functions as a mode transition information acquisition unit.

[0062] In step S2, when it is determined that mode transition information has been received from the cruise control device VC (step S2: YES), the control unit 35 determines whether or not the control of at least one of steering or acceleration / deceleration is transitioned from automatic to manual due to the mode transition (step S3). In step S2, when it is determined that mode transition information has not been received from the cruise control device VC (step S2: NO), the routine ends.

[0063] In step S3, if it is determined that at least one of steering or acceleration / deceleration control will be shifted from automatic to manual (step S3: YES), the control unit 35 determines whether or not the mode shift is within a first predetermined time (e.g., 10 minutes) (step S4). In step S3, if it is determined that at least one of steering or acceleration / deceleration control will not be shifted from automatic to manual (step S3: NO), the routine ends.

[0064] In step S4, if it is determined that the mode transition is within the first predetermined time (step S4: YES), the control unit 35 reads out any simulation data from the simulation database 33A and starts the driving simulation (step S5). In this driving simulation, the control unit 35 causes the projection device 25 to display a driving scene based on the driver's steering operation in the display area AR.

[0065] In step S4, if it is determined that the mode transition is not within the first predetermined time (step S4: NO), the control unit 35 determines that it is still too early to start the driving simulation, and after waiting for a certain period of time, executes step S4 again.

[0066] After starting the driving simulation in step S5, the control unit 35 determines whether the driver's operations are appropriate or not in step S6. This determination may be made by determining whether the amounts of operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 by the driver for a certain period of time (e.g., several seconds) are within ranges defined in the simulation data.

[0067] The determination in step S6 may be made only with respect to operations that will become manual after the mode transition. For example, if only steering will be manually controlled after the mode transition, the determination may be made only with respect to the operation of the steering wheel 13. Also, for example, if only acceleration and deceleration will be manually controlled after the mode transition, the determination may be made only with respect to the operation of the accelerator pedal 15 and the brake pedal 17. In step S6, the control unit 35 functions as a determination unit.

[0068] In step S6, if it is determined that the operation by the driver is appropriate (step S6: YES), the control unit 35 determines whether or not the transition of the driving mode is within a second predetermined time (for example, 30 seconds) (step S7).

[0069] In step S6, if it is determined that the operation by the driver is inappropriate (step S6: NO), the control unit 35 notifies the driver that the operation is inappropriate (step S8). Specifically, for example, the control unit 35 may notify the driver by displaying a warning on the display 21A, displaying a warning in the display area AR using the projection device 25, or issuing an audio warning through the speaker 23. After executing step S8, the control unit 35 executes step S7.

[0070] If it is determined in step S7 that the switching is within the second predetermined time (step S7: YES), the control unit 35 ends the simulation (step S9), and then routine R1 ends. If it is determined in step S7 that the switching is not within the second predetermined time (step S7: NO), the control unit 35 continues the simulation, and step S6 is executed again. In steps S6-9, the control unit 35 functions as a display control unit. The driving simulation may be interrupted by the driver's operation on the touchpad 21B.

[0071] For safety reasons, during the driving simulation, the driving operation to the driving command receiving device or the operation of the driving command receiving device is separated from the actual driving control of the automobile M and is not used for the driving control of the automobile M. Specifically, for example, during the driving simulation, it is possible that an electrical signal corresponding to the operation of the driving command receiving device is not transmitted.

[0072] According to the display device 10 of the first embodiment, when the driving control mode is changed so that at least one of the driving operations is changed from automatic to manual, the driver can perform a simulation of the driving operation in advance. Therefore, when the driving control mode is changed, the driver can smoothly start the driving operation.

[0073] In addition, according to the display device of the first embodiment, if the driver's steering operation is inappropriate in the simulation, the driver is notified of the fact. That is, feedback is given to the driver regarding the appropriateness of the steering operation. Therefore, the driver can be aware that he or she has a sense of inappropriate steering. This enables the driver to perform more appropriate steering operation during manual driving.

[0074] [Variations] The following describes modified examples of the display device 10. In the above-mentioned first embodiment, an example has been described in which the display device 10 reads out any simulation data and performs a driving simulation when the driving control mode of the automobile M is changed. However, the display device 10 may perform a driving simulation in an area or a point where the automobile M is expected to pass after the change in the driving control mode of the automobile M, before the change in the driving control mode of the automobile M.

[0075] Specifically, for example, before the driving control mode of the automobile M is changed, the display device 10 may perform a driving simulation by displaying a driving scene in an area or a location where a maneuvering operation including a steering operation and an acceleration / deceleration operation or a complex maneuvering operation is expected to be required for the first time after the change of the driving control mode of the automobile M. The area or location where the maneuvering operation or a complex maneuvering operation is required (hereinafter, also simply referred to as a maneuvering required area) is, for example, a curve, an intersection, a junction, or a branch, as described above.

[0076] In this case, the display device 10 identifies the area requiring maneuver that will be passed through first after the transition of the driving control mode based on the map information database 33A. Then, the display device 10 searches the simulation database 33B for simulation data of the area requiring maneuver. If simulation data of the area requiring maneuver that will be passed through first is found, a driving simulation is performed based on the data.

[0077] If the simulation data of the first area requiring maneuver is not present in the simulation database 33B, the simulation data of the second or subsequent areas requiring maneuver may be sequentially searched for after the transition of the driving control mode, and the driving simulation may be performed based on the simulation data. Also, the simulation data of the first area requiring maneuver may be generated based on the map information in the map information database 33A, and the driving simulation may be performed based on the generated simulation data.

[0078] 6, an operation routine R2, which is an example of an operation routine of a modified example of the display device 10, will be described. The operation routine R2 is the same as the operation routine R1 except that a process is added between steps S3 and S4 of the operation routine R1. Therefore, a description of the parts other than the added process will be omitted.

[0079] In the operation routine R2, when it is determined in step S3 that at least one of the steering or acceleration / deceleration control will be transitioned from automatic to manual (step S3: YES), the control unit 35 determines whether or not simulation data for the first area requiring steering that will be passed through after the transition of the driving control mode is present in the simulation database 33B (step S3-1).

[0080] In step S3-1, if it is determined that the simulation data for the first maneuver required area is in the simulation database 33B (step S3-1: YES), the control unit 35 acquires the simulation data from the simulation database 33B (step S3-2).

[0081] In step S3-1, when it is determined that the simulation data of the first area requiring maneuver is not present in the simulation database 33B (step S3-1: NO), the control unit 35 generates simulation data of the first area requiring maneuver (step S3-3). This simulation data may be generated based on, for example, map information in the map information database 33A.

[0082] For example, if the first maneuvering area is an intersection, new simulation data may be generated by generating scenery data based on the shape of the intersection. Note that instead of generating new simulation data, simulation data of an intersection having a shape similar to the shape of the intersection may be obtained from the simulation database 33B and used instead.

[0083] In processing the operation routine R2, in step S4, a driving simulation of the first area requiring maneuvering that is passed through after the transition of the driving control mode is started using the simulation data acquired in step S3-2 or the simulation data generated in step S3-3.

[0084] According to the display device 10 of the modified example, when the driving control mode is changed so that at least one of the driving operations is changed from automatic to manual, the driver can perform a simulation of the driving operation that is expected to be actually required after the driving control mode is changed. Therefore, when the driving control mode is changed, the driver can smoothly and safely enter into the driving operation. Such a simulation is particularly effective for a driver who is driving in the above-mentioned driving-required region for the first time or a driver who has little driving experience, in order to enable the driver to smoothly and safely perform the driving operation.

[0085] In the above embodiment, the display device 10 displays the driving scenery that changes based on the driver's operation of the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 during the driving simulation. However, the display device 10 may simply display the driving scenery during the driving simulation.

[0086] For example, specifically, the display device 10 may simply display a driving scene when the vehicle is properly driven along a road at a constant speed in a simulation target area. Also, the display device 10 may display a driving scene when the vehicle is properly driven along a road in a manner in which the speed changes based on the operation of the accelerator pedal 15 and the brake pedal 17. When performing such a simulation, it may be determined whether or not the steering wheel 13 is being properly operated according to the driving scene.

[0087] In the above embodiment, an example has been described in which the display device 10 is mounted on the automobile M. However, the display device 10 can be applied to various other moving bodies that are capable of automatic driving and may require a driver to perform steering operations, such as ships, aircraft, motorcycles, monorails, linear motor cars, and the like.

[0088] The configuration, routines, data formats, and the like of the display device 10 in the above-described embodiment are merely examples, and can be appropriately selected or changed depending on the application, and the like. [Explanation of symbols]

[0089] 10 Display device 13 Steering wheel 15 Accelerator pedal 17 Brake pedal 21 Touch Panel 25 Projection device 31 System Bus 33 Mass storage 35 Control section

Claims

[Claim 1] a mode transition information acquisition unit that acquires mode transition information regarding a transition between driving control modes, which are control modes related to automatic driving of a moving object; a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the driving control mode of the moving body is to be transitioned, displays on a display unit a driving scenery seen from the moving body at a point that the moving body is expected to pass through after the driving control mode is transitioned; A display device comprising:

Images