Indication device

The display device facilitates a smooth transition from autonomous to manual driving by simulating future driving scenarios, addressing the challenge of sudden steering operation demands through mode transition simulations and feedback.

JP2026182902APending Publication Date: 2026-11-19PIONEER IP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2026197163
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2026-08-31
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Drivers transitioning from autonomous driving to manual driving face challenges in smoothly performing steering operations due to sudden requirement for manual control, leading to a difficult transition.

Method used

A display device that acquires mode transition information and displays a driving scene expected to be encountered after the mode change, allowing drivers to simulate and practice steering operations through a drive-by-wire system, providing feedback on appropriateness of their actions.

Benefits of technology

Enables drivers to smoothly transition to manual driving by simulating future driving scenarios, improving their readiness and reducing the time needed to adapt to manual control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026182902000001_ABST
    Figure 2026182902000001_ABST
Patent Text Reader

Abstract

The present invention provides a display device that enables the driver to smoothly initiate manual driving when the vehicle's driving control mode transitions from automatic driving mode to manual driving mode. [Solution] The display device 10 includes a mode transition information acquisition unit that acquires mode transition information regarding the transition between driving control modes, which are control modes related to the automatic driving of a moving object, and a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the driving control mode of the moving object is changing, causes the display unit to display the driving scenery as seen from the moving object at a point that is expected to be passed after the driving control mode has changed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display device, for example, to a display device capable of displaying information for assisting a driver of a moving body such as an automobile capable of autonomous driving.

Background Art

[0002] Conventionally, technologies related to driving assistance that automatically perform driving operations related to vehicle travel on behalf of the driver are known. For example, Patent Document 1 proposes a device that notifies the driver in advance of switching from autonomous driving to manual driving (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0004] For example, in a moving body such as an automobile having the above-described autonomous driving function, switching occurs from an autonomous driving mode, which is a travel control mode in which travel control is performed automatically, to a manual driving mode, which is a travel control mode in which travel control is performed by the driver's steering operation. At the time of this switching, the driver, who did not need to perform steering operations that are operations for steering during the autonomous driving mode, is placed in a situation where steering operations are suddenly required when switching to the manual driving mode. Therefore, it takes time for the driver to get used to manual steering operations, and one example of the problem is that it is difficult to smoothly perform the transition from the autonomous driving mode to the manual driving mode.

[0005] The present invention has been made in view of the above points, and an object thereof is to provide a display device that enables a driver to smoothly start manual driving when, for example, the travel control mode of a moving body transitions from an autonomous driving mode to a manual driving mode. [Means for solving the problem]

[0006] The invention described in claim 1 is a display device comprising: a mode transition information acquisition unit that acquires mode transition information relating to the transition between driving control modes, which are control modes relating to the automatic driving of a moving body; and a display control unit that, when the mode transition information acquisition unit acquires mode transition information indicating that the driving control mode of the moving body is transitioning, causes the display unit to display a driving scene as seen from the moving body at a point that is expected to be passed after the driving control mode has transitioned. [Brief explanation of the drawing]

[0007] [Figure 1] This is a perspective view of the front seat area of ​​an automobile equipped with a display device, which is an embodiment of the present invention. [Figure 2] This block diagram shows an example of the configuration of a display device according to Embodiment 1 of the present invention. [Figure 3] This is an example of a set of simulation data. [Figure 4] This is a perspective view of the front seat area of ​​the car during simulation. [Figure 5] This is a flowchart of the operating routine of the display device, which is an embodiment of the present invention. [Figure 6] This is a flowchart of the operating routine of a display device, which is a modified example of the present invention. [Modes for carrying out the invention]

[0008] Preferred embodiments of the present invention will be described below. However, these may be modified and combined as appropriate. In the following description and accompanying drawings, substantially identical or equivalent parts will be denoted by the same reference numerals. In the following description, "image" will be described as including both moving images and still images. In the following description, the operation for controlling the driving of an automobile, i.e., the operation for steering, will also be simply referred to as steering operation. [Examples]

[0009] The display device 10, which is Embodiment 1 of the present invention, will be described below with reference to the attached drawings. Embodiment 1 will be described using the example of mounting the display device 10 on an automobile M, which is an example of a mobile device.

[0010] Figure 1 is a perspective view from inside the vehicle M of the front seat area of ​​a mobile vehicle M to which the display device 10 is attached. In Figure 1, as an example of attachment, the display device 10 is shown attached near the center console of the dashboard DB of the front seat of the vehicle M.

[0011] Camera 11 is a camera capable of photographing the occupants of the automobile M. Camera 11 is, for example, mounted on the dashboard DB and oriented to photograph the driver in the driver's seat. Camera 11 only needs to be positioned in a location that can photograph the movements of the occupants' upper bodies, etc. For example, camera 11 may be mounted on the rearview mirror RM or on the upper edge of the windshield FG or on the ceiling near that upper edge.

[0012] The camera 11 is connected to the display device 10 in a communicative manner and is capable of transmitting the captured video signal to the display device 10.

[0013] The steering wheel 13 is a component that receives steering inputs for steering the automobile M. The steering wheel 13 is mounted on the dashboard DB so as to be rotatable relative to the dashboard DB. When the steering wheel 13 is rotated, the steering wheels of the automobile M move accordingly.

[0014] In this embodiment, the automobile M will be described using a so-called steer-by-wire system as an example, in which the amount of rotation and rotational force of the steering wheel 13 are detected by sensors (not shown), and control signals calculated based on the detection information from these sensors are transmitted via a wire harness to a steering control device such as a motor that controls the steering angle of the steering wheels. The detection information of the amount of rotation and rotational force of the steering wheel 13 detected by the sensors is transmitted to the display device 10.

[0015] The accelerator pedal 15 is located at the driver's feet and is a component that receives control operations related to the engine or motor of the automobile M when the driver presses it down. In other words, the accelerator pedal 15 is a component that receives control operations related to the acceleration and deceleration of the automobile M.

[0016] In this embodiment, the automobile M will be described using a so-called throttle-by-wire system, in which the amount of movement and speed of movement of the accelerator pedal 15 are detected by sensors (not shown), and control signals calculated based on the detection information from these sensors are transmitted via a wire harness to the engine control unit, which is a control device that controls the engine or motor, which is the prime mover. The detection information of the amount of movement and speed of movement of the accelerator pedal 15 detected by the sensors is transmitted to the display device 10.

[0017] The brake pedal 17 is located at the driver's feet and is a component that receives control of the brakes of the vehicle M through the driver's pressing motion. In other words, the brake pedal 17 is a component that receives control of the vehicle M's deceleration.

[0018] Note, in the automobile M of the present embodiment, description will be given by taking as an example a case where a so-called brake-by-wire system is used, in which a sensor (not shown) detects the movement amount, movement speed and the like of the brake pedal 17, and a control signal calculated based on the detection information from these sensors is transmitted via a wire harness to a brake control device which is a control device that controls the brakes. The detection information of the movement amount and movement speed of the brake pedal detected by the sensor is transmitted to the display device 10.

[0019] As described above, in the automobile M of the present embodiment, a system composed of a steering-by-wire system, a throttle-by-wire system, and a brake-by-wire system, that is, a so-called drive-by-wire system is constructed.

[0020] Note that, hereinafter, the steering wheel 13, the accelerator pedal 15, and the brake pedal 17 are collectively also referred to as a steering operation reception device that receives steering operations including steering operation and acceleration / deceleration operations.

[0021] The GPS receiver 19 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 19 is arranged, for example, on the dashboard DB. Note that the GPS receiver 19 may be arranged anywhere as long as it can receive GPS signals. The GPS receiver 19 is communicably connected to the display device 10, and is capable of transmitting the received GPS signals to the display device 10.

[0022] The touch panel 21 is, for example, a touch panel monitor in which a display 21A such as a liquid crystal display capable of displaying video and a touch pad 21B are combined. The touch panel 21 is arranged, for example, at the center console of the dashboard DB. The touch panel 21 only needs to be arranged at a location that is visible to the driver and within the driver's reach. For example, the touch panel 21 may be mounted on the dashboard DB.

[0023] The display 21A is connected to the display device 10 in a communicative manner and can display information on its screen based on the control of the display device 10. The touch panel 21B can also transmit signals to the display device 10 representing input operations received from the user.

[0024] The speaker 23 is located, for example, on the interior side of the A-pillar AP. The speaker 23 is communicatively connected to the display device 10 and is capable of emitting sounds such as voices based on the control of the display device 10.

[0025] The projection device 25 is a device that constitutes a windshield projection type head-up display. The head-up display 25 is mounted on the dashboard DB and can project images or videos onto the windshield FG by irradiating the windshield FG with projection light.

[0026] The projection device 25 is communicatively connected to the display device 10 and, based on the control of the display device 10, projects light onto the display area AR, which is the area of ​​the windshield FG near the driver's seat, and can display an image in the display area AR of the windshield FG. The projection device 25 may also be capable of displaying an image in an area other than the display area AR of the windshield FG. For example, the projection device 25 may be capable of displaying an image across the entire surface of the windshield FG.

[0027] [System Configuration] Figure 2 shows the configuration of the display device 10. For example, the display device 10 is a device in which a large-capacity storage device 33, a control unit 35, an input unit 37, an output unit 39, and a data communication unit 41 cooperate via a system bus 31.

[0028] The large-capacity storage device 33 is composed of, for example, a hard disk drive, an SSD (solid state drive), flash memory, etc., and stores various programs such as the operating system and terminal software.

[0029] Furthermore, various programs may be acquired, for example, from other server devices via a network, or they may be recorded on a recording medium and read via various drive devices. In other words, various programs stored in the mass storage device 33 (including programs for executing processing in the display device 10 described later) can be transmitted via a network, and can also be recorded on a computer-readable recording medium and transferred.

[0030] A map information database (map information DB) 33A is constructed in the large-capacity storage device 33. The map information database 33A holds map information, including road maps. The map information database 33A may also include information on autonomous driving areas, which are areas where the vehicle M can drive autonomously, and manual driving areas, which are areas where the vehicle M cannot drive autonomously. These autonomous driving areas and manual driving areas may be defined, for example, by laws or regulations.

[0031] Furthermore, a simulation database (simulation DB) 33B is constructed in the large-capacity storage device 33. The simulation database 33B contains information that enables driving simulations at specific points or areas on the road. For example, the simulation database 33B contains information that enables driving simulations at points or areas on the road that are closest to the boundary between the automated driving area and the manual driving area and that require steering operations or complex steering operations, including steering operations or acceleration / deceleration operations. For example, areas or points on the road that require steering operations or complex steering operations include curves, intersections, junctions, and merges.

[0032] Figure 3 shows an example of the simulation data group SD included in the simulation database 33B. As shown in Figure 3, in the simulation data group SD, for example, the road name, area, and simulation data used for the simulation are each associated with a data ID.

[0033] The simulation data includes, for example, landscape data for the simulation and the appropriate amounts of operation for the steering wheel 13, accelerator pedal 15, and brake pedal 17 in the simulation.

[0034] Referring again to Figure 2, the control unit 35 is composed of a CPU (Central Processing Unit) 35A, a ROM (Read Only Memory) 35B, a RAM (Random Access Memory) 35C, etc., and functions as a computer. The CPU 35A then reads and executes various programs stored in the ROM 35B and the mass storage device 33 to realize various functions.

[0035] The input unit 37 is an interface unit that enables communication between the display device 10 and the touchpad 21B. The display device 10 can receive signals indicating input operations to the touchpad 21B via the input unit 37.

[0036] The output unit 39 is connected to the display 21A, speaker 23, and projection device 25 in a communicative manner, and can transmit video or image signals to the display 21A for display, or transmit audio signals to the speaker 23 for sound output. The output unit 39 can also transmit video or image signals to the projection device 25 for display on the windshield FG.

[0037] The data communication unit 41 is an interface unit that enables communication between the display device 10, the camera 11, and the GPS receiver 19. The data communication unit 41 is also an interface unit that enables communication between the display device 10 and the steering sensor 13A, which is a sensor that detects physical quantities related to the operation of the steering wheel 13, such as the amount of rotation and rotational force.

[0038] Furthermore, the data communication unit 41 is an interface unit that enables communication between the display device 10 and the accelerator sensor 15A, which is a sensor that detects physical quantities related to the operation of the accelerator pedal 15, such as the amount of movement and speed of movement. Furthermore, the data communication unit 41 is an interface unit that enables communication between the display device 10 and the brake sensor 17A, which is a sensor that detects physical quantities related to the operation of the brake pedal 15, such as the amount of movement and speed of movement.

[0039] The display device 10 receives a video signal from the camera 11 via the data communication unit 41. The display device 10 can determine the driver's line of sight of the automobile M from the video signal received via the data communication unit 41. The display device 10 also receives a GPS signal from the GPS receiver 19 via the data communication unit 41. The display device 10 can obtain location information, which identifies the position of the automobile M, from the GPS signal received via the data communication unit 41.

[0040] Furthermore, the display device 10 receives signals from the steering sensor 13A, accelerator sensor 15A, and brake sensor 17A, respectively, relating to physical quantities concerning the operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17. The display device 10 can recognize the operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17 from the signals relating to physical quantities received via the data communication unit 41. For example, the display device 10 can calculate the amount of operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17.

[0041] Furthermore, the data communication unit 41 also serves as an interface that enables communication between the display device 10 and the driving control device VC of the automobile M on which the display device 10 is installed. The driving control device VC is a device that controls the driving of the automobile M.

[0042] In this embodiment, the driving control device VC determines whether to perform manual driving control, which manually controls acceleration, deceleration, and steering, partially automatic driving control, which automatically controls only acceleration, deceleration, or steering, or fully automatic driving control, which automatically controls all driving operations, including acceleration, deceleration, and steering, when the vehicle M is driving.

[0043] Furthermore, the driving control mode when the vehicle is being driven under manual driving control will be referred to as manual driving mode, the driving control mode when the vehicle is being driven under partially automated driving control will be referred to as partially automated driving mode, and the driving control mode when the vehicle is being driven under fully automated driving control will be referred to as fully automated driving mode. In the following, among the partially automated driving modes, the mode in which steering is automatically controlled will be referred to as steering automated driving mode, and the mode in which acceleration and deceleration are automatically controlled will be referred to as acceleration and deceleration automated driving mode.

[0044] For example, if we were to apply the above three driving controls to the levels of autonomous driving defined by the Japanese government or the U.S. National Highway Traffic Safety Administration (NHTSA), manual driving control would be level 0, partially autonomous driving control would be level 1 or 2, and fully autonomous driving control would be level 3 or higher.

[0045] Furthermore, in this embodiment, the driving control device VC can transmit driving control mode information, such as whether the current driving control mode of the vehicle M is manual driving mode, partially automatic driving mode, that is, steering automatic driving mode, acceleration / deceleration automatic driving mode, or fully automatic driving mode, to the display device 10 via the data communication unit 41.

[0046] Furthermore, the driving control device VC can transmit mode transition information to the display device 10 when it is scheduled to transition to a new driving control mode. The mode transition information may include information about the new driving control mode. Note that the state in which all driving-related controls, such as steering and acceleration / deceleration, are performed manually by the driver is defined as automatic driving level 0.

[0047] Furthermore, if the driving control device VC plans to change the driving control mode of the vehicle M, it can transmit this plan to the display device 10 via the data communication unit 41. The driving control device VC may set the driving control mode of the vehicle M to automatic driving mode if the area in which the vehicle M is driving is an automatic driving area, and to manual driving mode if it is a manual driving area.

[0048] In switching between these driving control modes, the driving control device VC may use a GPS or other location-determining device and map information provided by the driving control device VC to make a decision on switching between driving modes.

[0049] Furthermore, the driving control device VC may receive location information from the display device 10 and refer to the map information database 33A of the display device 10 to determine whether to switch the driving control mode. Alternatively, for example, the driving control device VC may determine whether to switch the driving control mode of the vehicle M according to the conditions around the vehicle M. The display device 10 may also determine on its own whether there is a transition in the driving control mode based on the information in the map information database 33A and the GPS signal from the GPS receiver 19.

[0050] [Display device operation] The operation of the display device 10 is described below. When there is a change in the driving control mode, the display device 10 receives mode transition information from the driving control device VC. If this mode transition information indicates that at least one of the steering or acceleration / deceleration controls will be switched from automatic control to manual control, the display device 10 will have the driver of the vehicle M perform a driving simulation. In other words, when the driving control mode of the vehicle M transitions to a mode in which at least one of the steering or acceleration / deceleration controls is more dependent on the driver, the display device 10 will have the driver perform a driving simulation.

[0051] Specifically, for example, the display device 10 uses the projection device 25 to display a simulated driving scene. This simulated driving scene may be a driving scene in an actual existing location, or it may be a driving scene in a non-existent virtual location.

[0052] Figure 4 shows the front seat area of ​​car M during a driving simulation. As shown in Figure 4, during the driving simulation, the projection device 25 displays a simulated driving scene on the display area AR of the windshield FG. In the example in Figure 4, car M is actually driving on a straight road, but in the simulation it is driving on a left curve. As another example, it shows the driver turning the steering wheel 13 to the left in accordance with the simulated driving scene.

[0053] The display device 10 changes the driving scene for the simulation based on signals from the steering sensor 13A, accelerator sensor 15A, and brake sensor 17A while displaying the driving scene. In other words, the display device 10 functions as a driving simulator with the display area AR as the screen and the steering wheel 13, accelerator pedal 15, and brake pedal 17 as controls.

[0054] Furthermore, the display device 10 may determine whether the driver's operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17 is appropriate while the driving scene for the simulation is being displayed. The result of this determination may be notified to the driver by being displayed on the display 21 or the display area AR. Alternatively, the result may be notified to the driver by voice from the speaker 23.

[0055] Furthermore, the display device 10 may determine whether the driver's gaze direction is appropriate while displaying the driving scene for the simulation. This determination result can be communicated to the driver, for example, by being displayed on the display 21 or the display area AR. Alternatively, this determination result can be communicated to the driver by voice from the speaker 23. The display device 10 can also suggest an appropriate gaze direction to the driver by displaying it on the display area AR using the projection device 25.

[0056] Furthermore, the display device 10 may also prompt the driver to perform a driving simulation when it receives mode transition information, even if the mode transition information indicates that at least one of the steering or acceleration / deceleration controls will be switched from manual control to automatic control. In other words, the display device 10 may prompt the driver to perform a driving simulation when the driving control mode changes, regardless of the nature of the change. For example, the display device 10 may also prompt the driver to perform a driving simulation when the driving control mode transitions to a mode in which the driver's dependence on driving control decreases.

[0057] As described above, the vehicle M employs a drive-by-wire system as an example, and operations on the steering wheel 13, accelerator pedal 15, and brake pedal 17 during the driving simulation can be separated from the actual driving control of the vehicle. Specifically, the operations on the control receivers are separated from the actual driving control by preventing signals from each control receiver from reaching the steering control device, the engine control device, and the brake control device.

[0058] In the above explanation, the display device 10 receives mode transition information from the driving control device VC, but the display device 10 may also determine whether or not there is a transition in the driving control mode. Specifically, for example, the display device 10 may determine whether or not there is a transition in the driving control mode based on GPS information and the map information database 33A, and generate and acquire the mode transition information itself.

[0059] [Example operation routine of display device 10] The following describes an example of the operating routine of the display device 10.

[0060] Figure 5 shows a simulation operation routine R1 as an example of an operation routine. The simulation operation routine R1 is repeatedly executed, for example, when the power to the display device 10 is turned on. For example, the simulation operation routine R1 is repeatedly executed when the accessory power (hereinafter referred to as ACC power) of the automobile M is turned on.

[0061] When the simulation operation routine R1 is started, the control unit 35 first waits for a signal from the driving control device VC (step S1). Next, the control unit 35 determines whether or not mode transition information has been received from the driving control device VC (step S2). In steps S1 and S2, the control unit 35 functions as a mode transition information acquisition unit.

[0062] In step S2, if it is determined that mode transition information has been received from the driving control device VC (step S2: YES), the control unit 35 determines whether the mode transition will cause at least one of the steering or acceleration / deceleration controls to switch from automatic to manual (step S3). In step S2, if it is determined that mode transition information has not been received from the driving control device VC (step S2: NO), the routine terminates.

[0063] In step S3, if it is determined that the control of at least one of the steering or acceleration / deceleration controls will transition from automatic to manual (step S3: YES), the control unit 35 determines whether or not the mode transition will occur within a first predetermined time (e.g., 10 minutes) (step S4). In step S3, if it is determined that the control of at least one of the steering or acceleration / deceleration controls will not transition from automatic to manual (step S3: NO), the routine ends.

[0064] In step S4, if it is determined that the mode transition is within the first predetermined time (step S4: YES), the control unit 35 reads arbitrary simulation data from the simulation database 33A and starts the driving simulation (step S5). In this driving simulation, the control unit 35 displays the driving scenery based on the driver's steering operations in the display area AR using the projection device 25.

[0065] In step S4, if it is determined that the mode transition is not within the first predetermined time (step S4: NO), the control unit 35 determines that it is still too early to start the driving simulation, waits for a certain period of time, and then executes step S4 again.

[0066] After starting the driving simulation in step S5, the control unit 35 determines in step S6 whether the driver's operations are appropriate. This determination may be made by determining whether the amount of operation performed by the driver on the steering wheel 13, accelerator pedal 15, and brake pedal 17 during a certain period of time (for example, several seconds) falls within the range specified in the simulation data.

[0067] Furthermore, the determination made in step S6 may be made only with respect to operations that become manual after the mode transition. For example, if only steering becomes manually controlled after the mode transition, the determination may be made only with respect to the operation of the steering wheel 13. Also, for example, if only acceleration and deceleration become manually controlled after the mode transition, the determination may be made only with respect to the operation of the accelerator pedal 15 and the brake pedal 17. In step S6, the control unit 35 functions as a determination unit.

[0068] In step S6, if it is determined that the driver's operation is appropriate (step S6: YES), the control unit 35 determines whether or not the transition to the driving mode is within a second predetermined time (e.g., 30 seconds) (step S7).

[0069] In step S6, if it is determined that the driver's operation is inappropriate (step S6: NO), the control unit 35 notifies the driver that the operation is inappropriate (step S8). Specifically, for example, the control unit 35 may notify the driver by displaying a warning on the display 21A, displaying a warning on the display area AR using the projection device 25, or issuing an audio warning through the speaker 23. After executing step S8, the control unit 35 executes step S7.

[0070] In step S7, if it is determined that the switchover is within the second predetermined time (step S7: YES), the control unit 35 terminates the simulation (step S9), and then routine R1 terminates. In step S7, if it is determined that the switchover is not within the second predetermined time (step S7: NO), the control unit 35 continues the simulation, and step S6 is executed again. In steps S6-9, the control unit 35 functions as a display control unit. The driving simulation may be interrupted by the driver's operation on the touchpad 21B.

[0071] For safety reasons, during the driving simulation, steering inputs to the control input device, or the operation of the control input device, are separated from the actual driving control of the vehicle and are not used for the driving control of vehicle M. Specifically, for example, during the driving simulation, it is possible to prevent the transmission of electrical signals corresponding to the operation of the control input device.

[0072] According to the display device 10 of the above embodiment 1, when transitioning to a driving control mode in which at least one of the steering operations changes from automatic to manual, the driver can simulate the driving operation in advance. Therefore, when transitioning to a driving control mode, the driver can smoothly enter into driving control operations.

[0073] Furthermore, according to the display device of Embodiment 1 described above, if the driver's steering operation is inappropriate during the simulation, the driver will be notified accordingly. In other words, the driver will receive feedback on the appropriateness of their steering operation. Therefore, the driver will be able to become aware of their own sense of inappropriate steering. This will enable the driver to perform more appropriate steering operations when driving manually.

[0074] [Differentiation] The following describes some modifications of the display device 10. In the above embodiment 1, an example was described in which the display device 10 reads arbitrary simulation data and performs a driving simulation when the driving control mode of the automobile M changes. However, the display device 10 may also perform a driving simulation in the area or location that the automobile M is expected to pass through after the change in the driving control mode of the automobile M.

[0075] Specifically, for example, the display device 10 may perform a driving simulation by displaying a driving scene in an area or location where it is expected that the vehicle M will need to perform steering and acceleration / deceleration operations, or complex steering operations, for the first time after the transition, before the vehicle M's driving control mode changes. The area or location where such steering or complex steering operations are required (hereinafter also simply referred to as the area requiring steering) is, as described above, for example, a curve, intersection, merge, or junction.

[0076] In this case, the display device 10 identifies the first area requiring steering after the transition to the driving control mode, based on the map information database 33A. Then, it searches the simulation database 33B to see if there is simulation data for that area requiring steering. If simulation data for that first area requiring steering is found, it performs a driving simulation based on it.

[0077] If simulation data for the first area requiring steering is not found in the simulation database 33B, after the transition to the driving control mode, simulation data for the second and subsequent areas requiring steering may be sequentially searched, and the driving simulation may be performed based on that simulation data. Alternatively, simulation data for the first area requiring steering may be generated based on the map information in the map information database 33A, and the driving simulation may be performed based on the generated simulation data.

[0078] Figure 6 illustrates an example of an operating routine R2, which is a modified version of the display device 10. Operating routine R2 is identical to operating routine R1 except that processing is added between steps S3 and S4 of operating routine R1. Therefore, the explanation of parts other than the additional processing will be omitted.

[0079] In the operation routine R2, if it is determined in step S3 that the control of at least one of the steering or acceleration / deceleration controls has transitioned from automatic to manual (step S3: YES), the control unit 35 determines whether or not simulation data for the first control required area to be traversed after the transition in the driving control mode exists in the simulation database 33B (step S3-1).

[0080] In step S3-1, if it is determined that simulation data for the first area requiring steering is present in the simulation database 33B (step S3-1: YES), the control unit 35 retrieves the simulation data from the simulation database 33B (step S3-2).

[0081] In step S3-1, if it is determined that simulation data for the first area requiring maneuvering is not available in the simulation database 33B (step S3-1: NO), the control unit 35 generates simulation data for the first area requiring maneuvering (step S3-3). This simulation data may be generated, for example, based on map information in the map information database 33A.

[0082] For example, if the initial area requiring maneuvering is an intersection, new simulation data may be generated by creating landscape data based on the shape of the intersection. Alternatively, instead of generating new simulation data, simulation data of an intersection with a similar shape may be obtained from the simulation database 33B and used as a substitute.

[0083] In the processing of the operation routine R2, in step S4, a driving simulation of the first control area to be traversed after the transition to the driving control mode is started using the simulation data acquired in step S3-2 or the simulation data generated in step S3-3.

[0084] According to the modified display device 10, when transitioning to a driving control mode in which at least one of the steering operations changes from automatic to manual, the driver can simulate in advance the driving operations that are expected to be actually required after the transition to the driving control mode. Therefore, when transitioning to a driving control mode, the driver can smoothly and safely enter into steering operations. Such simulations are particularly effective for drivers who are driving in the aforementioned required steering area for the first time or for drivers with little driving experience, in order to enable them to smoothly perform steering operations related to safe driving.

[0085] In the above embodiment, the display device 10 displays the driving scenery that changes based on the driver's operation of the steering wheel 13, accelerator pedal 15, and brake pedal 17 during the driving simulation. However, the display device 10 may simply display the driving scenery during the driving simulation.

[0086] For example, the display device 10 may simply display the driving scene when the target area of ​​the simulation is driven appropriately along the road at a constant speed. Alternatively, the display device 10 may display the driving scene when the vehicle is driven appropriately along the road in a manner in which the speed changes based on the operation of the accelerator pedal 15 and the brake pedal 17. When performing such a simulation, it may be determined whether or not the steering wheel 13 is being operated appropriately according to the driving scene.

[0087] In the above embodiment, an example was described in which the display device 10 is mounted on an automobile M. However, the display device 10 can be applied to various other mobile devices that are capable of autonomous driving but may also require driver operation, such as ships, aircraft, motorcycles, monorails, and maglev trains.

[0088] The configuration, routines, and data formats of the display device 10 in the above-described embodiment are merely examples and can be appropriately selected or modified depending on the application. [Explanation of Symbols]

[0089] 10 Display device 13 Steering Wheel 15. Accelerator pedal 17 Brake pedal 21 Touch panel 25 Projection device 31 System bus 33 Mass storage 35 Control Unit

Claims

[Claim 1] A mode transition information acquisition unit acquires mode transition information regarding the transition between driving control modes, which are control modes related to the automatic driving of a mobile object. When the mode transition information acquisition unit acquires mode transition information indicating that the driving control mode of the moving body is transitioning, the display control unit causes the display unit to display the driving scenery as seen from the moving body at a point that is expected to be passed after the driving control mode transition, A display device characterized by including

Citation Information

Patent Citations

  • Liquid storage body, liquid jet system

    JP2017030158A