Vehicle display control device, method, and program

The vehicle display control system aligns the displayed view with the traveling direction to prevent misrecognition during vehicle departure, ensuring accurate surroundings recognition.

JP7700763B2Active Publication Date: 2025-07-01TOYOTA JIDOSHA KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022149616
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-20
Publication Date
2025-07-01
Estimated Expiration
2042-09-20

AI Technical Summary

Technical Problem

Existing vehicle display systems fail to correlate the displayed surrounding image with the vehicle's traveling direction, leading to potential misrecognition of the vehicle's surroundings during departure.

Method used

A vehicle display control system that switches the displayed view to match the vehicle's traveling direction when detected, using input units and driving state sensors to ensure accurate directional alignment.

Benefits of technology

Prevents misrecognition of the vehicle's surroundings at departure by aligning the displayed view with the traveling direction, enhancing user awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007700763000001
    Figure 0007700763000001
  • Figure 0007700763000002
    Figure 0007700763000002
  • Figure 0007700763000003
    Figure 0007700763000003
Patent Text Reader

Abstract

To prevent a vehicle peripheral situation displayed as a view when starting a vehicle from being erroneously recognized as a situation in a travel direction of the vehicle by a user.SOLUTION: A display control ECU 26 causes a display 22 to display a view in a selected direction via an input part 16 in the plurality of views in mutually-different directions obtained from a photographed image acquired from an imaging part 12 that images the periphery of the vehicle. The display control ECU 26, when a travel state detection part 18 for detecting a travel state and a travel direction of the vehicle detects that the travel of the vehicle has been started, and the view displayed on the display 22 is different from the travel direction of the vehicle, switches the view displayed on the display 22 to the view in the travel direction of the vehicle.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program.

Background Art

[0002] Patent Document 1 describes a technique for displaying a surrounding image acquired by an imaging unit on a display unit and changing the display range of the surrounding image based on the vehicle speed V of the host vehicle detected by a vehicle speed sensor.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 does not describe the relevance between the surrounding image to be displayed on the display unit and the driving state and traveling direction of the host vehicle. For this reason, in the technique described in Patent Document 1, when a surrounding image in a direction different from the traveling direction of the vehicle is displayed on the display unit at the time of vehicle departure, the user cannot confirm the situation in the traveling direction from the surrounding image displayed on the display unit.

[0005] The present disclosure has been made in consideration of the above facts, and an object thereof is to obtain a vehicle display control device, a vehicle display control method, and a vehicle display control program that can prevent the situation around the vehicle displayed as a view at the time of vehicle start from being misrecognized by the user as the situation in the traveling direction of the vehicle.

Means for Solving the Problems

[0006] The vehicle display control device according to the first aspect causes a display unit to display a view in a direction selected via an input unit from among a plurality of views with different directions obtained from a captured image acquired from an imaging unit that images the periphery of the vehicle, and a driving state detection unit that detects the driving state and traveling direction of the vehicle detects that the vehicle has started to travel, and when the view displayed on the display unit is different from the traveling direction of the vehicle, includes a control unit that switches the view being displayed on the display unit to a view in the traveling direction of the vehicle.

[0007] In the first aspect, when a driving state detection unit that detects the driving state and traveling direction of the vehicle detects that the vehicle has started to travel and the view displayed on the display unit is different from the traveling direction of the vehicle, the control unit switches the view being displayed on the display unit to a view in the traveling direction of the vehicle. Thereby, it is possible to prevent the situation around the vehicle displayed as a view at the time of starting the vehicle from being misrecognized by the user as the situation in the traveling direction of the vehicle. And it is possible to cause the user to recognize the situation in the traveling direction of the vehicle from the view displayed on the display unit at the time of starting the vehicle.

[0008] The second aspect is, in the first aspect, when the control unit switches the view being displayed on the display unit to a view in the traveling direction of the vehicle, the control unit notifies the user via a notification unit.

[0009] According to the second aspect, it is possible to cause the user to recognize that the view being displayed on the display unit has been switched.

[0010] The third aspect is, in the first aspect or the second aspect, when the control unit detects that a view in a direction other than the traveling direction of the vehicle is selected via the input unit after the vehicle has started to travel, the control unit switches the view being displayed on the display unit to a view in the direction other than the traveling direction.

[0011] According to the third aspect, after the vehicle starts running, that is, after the user checks the view in the traveling direction of the vehicle, the user can switch the view displayed on the display unit to the view selected via the input unit.

[0012] The vehicle display control method according to the fourth aspect causes a computer to execute a process including: displaying, on a display unit, a view in a direction selected via an input unit from among a plurality of views having different directions obtained from a captured image acquired from an imaging unit that images the periphery of the vehicle; and when a traveling state detection unit that detects the traveling state and traveling direction of the vehicle detects that the vehicle has started running and the view displayed on the display unit is different from the traveling direction of the vehicle, switching the view being displayed on the display unit to the view in the traveling direction of the vehicle.

[0013] According to the fourth aspect, similar to the first aspect, it is possible to prevent the situation around the vehicle displayed as a view at the time of starting the vehicle from being misrecognized by the user as the situation in the traveling direction of the vehicle, and it is possible to cause the user to recognize the situation in the traveling direction of the vehicle from the view displayed on the display unit at the time of starting the vehicle.

[0014] The vehicle display control program according to the fifth aspect causes a computer to execute a process including: displaying, on a display unit, a view in a direction selected via an input unit from among a plurality of views having different directions obtained from a captured image acquired from an imaging unit that images the periphery of the vehicle; and when a traveling state detection unit that detects the traveling state and traveling direction of the vehicle detects that the vehicle has started running and the view displayed on the display unit is different from the traveling direction of the vehicle, switching the view being displayed on the display unit to the view in the traveling direction of the vehicle.

[0015] According to the fifth aspect, similar to the first aspect, it is possible to prevent the situation around the vehicle displayed as a view at the time of starting the vehicle from being misrecognized by the user as the situation in the traveling direction of the vehicle, and it is possible to allow the user to recognize the situation in the traveling direction of the vehicle from the view displayed on the display unit at the time of starting the vehicle.

Effect of the Invention

[0016] The present disclosure has an effect of preventing the situation around the vehicle displayed as a view at the time of starting the vehicle from being misrecognized by the user as the situation in the traveling direction of the vehicle.

Brief Description of the Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of the present disclosure will be described in detail with reference to the drawings. As shown in FIG. 1, a vehicle display device 10 according to the present embodiment includes an imaging unit 12, an input unit 16, a traveling state detection unit 18, a display 22, an audio output unit 24, and a display control ECU 26.

[0019] The imaging unit 12 is a functional block that images the surroundings of the vehicle, and includes a plurality of cameras 14 mounted on the vehicle with their mounting positions and imaging ranges set so as to image different ranges from different positions of the vehicle. In the present embodiment, the imaging unit 12 includes a camera 14 that images the front side of the vehicle and a camera 14 that images the rear side of the vehicle so as to be able to generate a view on the front side of the vehicle (refer to FIG. 4(A) as an example) and a view on the rear side of the vehicle (refer to FIG. 4(B) as an example) from the images captured by the imaging unit 12. Note that the number of cameras 14 in the imaging unit 12 may be three or more.

[0020] The input unit 16 is a functional block for a user (e.g., a passenger in the vehicle) to input information, and is composed of, for example, a four-way switch, a keyboard, or the like. The information input by the user via the input unit 16 includes information specifying the direction of the view (the front side or the rear side of the vehicle) when displaying an image (view) of the vehicle and its surroundings on the display 22.

[0021] The driving state detection unit 18 is a functional block that detects the driving state and traveling direction of the vehicle, and includes, for example, a vehicle speed sensor that detects the vehicle speed of the vehicle and a shift position sensor that can detect whether the vehicle is moving forward or backward. Note that the driving state detection unit 18 may further include a steering angle sensor that detects the steering angle of the vehicle.

[0022] The display 22 is composed of, for example, a center display arranged at the center in the vehicle width direction in the vehicle interior of the vehicle, or a meter display arranged in front of the driver's seat in the vehicle interior of the vehicle. An image (e.g., a video such as a view on the front side or the rear side of the vehicle) generated by the display control ECU 26 is displayed on the display 22. Note that the display 22 is an example of the display unit in the present disclosure.

[0023] The voice output unit 24 is composed of a buzzer that outputs a buzzer sound, or a speaker that can output any voice. The voice output unit 24 is controlled by the display control ECU 26 so that a predetermined voice is output when the view displayed on the display 22 is switched. The voice output unit 24 and the display 22 are an example of the notification unit in the present disclosure.

[0024] The display control ECU 26 includes a CPU (Central Processing Unit) 28, a memory 30 such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and a non-volatile storage unit 32 such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive). The display control ECU 26 also includes an I / F (InterFace) unit 34. The imaging unit 12, the input unit 16, the traveling state detection unit 18, the display 22, and the voice output unit 24 are respectively connected to the I / F unit 34. The CPU 28, the memory 30, the storage unit 32, and the I / F unit 34 are respectively connected to an internal bus 40 and can communicate with each other.

[0025] Further, a display control program 42 is stored in the storage unit 32 of the display control ECU 26. The display control ECU 26 functions as the control unit 48 shown in FIG. 2 and performs the display control process (FIG. 3) described later when the display control program 42 is read from the storage unit 32 and expanded in the memory 30, and the display control program 42 expanded in the memory 30 is executed by the CPU 28. Note that the display control ECU 26 is an example of the vehicle display control device according to the present disclosure.

[0026] The control unit 48 generates a plurality of views with different directions (views on the front side or the rear side of the vehicle) from the captured images obtained from the imaging unit 12 that images the periphery of the vehicle. In this embodiment, the control unit 48 generates a view on the front side of the vehicle by adding auxiliary lines 52 for assisting the user in spatial perception to the input image from one camera 14 that images the front side of the vehicle (see Fig. 4(A)), and generates a view on the rear side of the vehicle by adding auxiliary lines 54 for assisting the user in spatial perception to the input image from one camera 14 that images the rear side of the vehicle (see Fig. 4(B)). Then, the control unit 48 causes the display 22 to display the view in the direction selected via the input unit 16 among the generated plurality of views.

[0027] Also, when the running state detection unit 18 that detects the running state and the traveling direction of the vehicle detects that the vehicle has started running and the view displayed on the display 22 is different from the traveling direction of the vehicle, the control unit 48 switches the view being displayed on the display 22 to the view in the traveling direction of the vehicle.

[0028] Next, as the operation of this embodiment, with reference to Fig. 3, for example, the display control process executed by the control unit 48 while the ignition switch of the vehicle is on will be described.

[0029] In step 70 of the display control process, the control unit 48 determines whether the vehicle (own vehicle) is stopped. If the determination in step 70 is affirmative, the process proceeds to step 72. In step 72, the control unit 48 detects when the direction of the view to be displayed on the display 22 is selected by the user via the input unit 16. Then, in step 74, the control unit 48 switches the view to be displayed on the display 22 to the view in the direction selected by the user via the input unit 16. In this way, while the vehicle is stopped, the user can freely switch the direction of the view to be displayed on the display 22.

[0030] In the next step 76, the control unit 48 acquires from the driving state detection unit 18 the driving state (presence or absence of driving) and the traveling direction of the vehicle detected by the driving state detection unit 18, and determines whether the vehicle has started driving based on the acquired driving state of the vehicle. If the determination in step 76 is negative, the display control process ends.

[0031] Also, when it is detected by the driving state detection unit 18 that the vehicle has started driving, the determination in step 76 is affirmed and the process proceeds to step 78. In step 78, the control unit 48 determines whether the current view being displayed on the display 22 is a view in the traveling direction of the vehicle.

[0032] For example, when the view on the rear side of the vehicle (for example, the view shown in FIG. 4(B)) is being displayed on the display 22 and the detected traveling direction of the vehicle is "reverse", the determination in step 78 is affirmed and the process proceeds to step 80. Also, for example, when the view on the front side of the vehicle (for example, the view shown in FIG. 4(A)) is being displayed on the display 22 and the detected traveling direction of the vehicle is "forward", the determination in step 78 is also affirmed and the process proceeds to step 80.

[0033] In step 80, the control unit 48 does not switch the view. Thus, when the direction of the view being displayed on the display 22 is the same as the traveling direction of the vehicle, the view is not switched, so that when the vehicle starts, the user can recognize the situation in the traveling direction of the vehicle based on the view originally displayed on the display 22.

[0034] On the other hand, for example, when the view on the front side of the vehicle (for example, the view shown in FIG. 4(A)) is being displayed on the display 22 and the traveling direction of the vehicle is "reverse", the determination in step 78 is negative and the process proceeds to step 82. Also, for example, when the view on the rear side of the vehicle (for example, the view shown in FIG. 4(B)) is being displayed on the display 22 and the traveling direction of the vehicle is "forward", the determination in step 78 is also negative and the process proceeds to step 82.

[0035] In step 82, the control unit 48 automatically switches the view being displayed on the display 22 to the view in the traveling direction of the vehicle. For example, when the traveling direction of the vehicle is "reverse", the view to be displayed on the display 22 is automatically switched from the view on the front side of the vehicle to the view on the rear side of the vehicle. Also, for example, when the traveling direction of the vehicle is "forward", the view to be displayed on the display 22 is automatically switched from the view on the rear side of the vehicle to the view on the front side of the vehicle.

[0036] In this way, when the direction of the view being displayed on the display 22 is different from the traveling direction of the vehicle, the view being displayed on the display 22 is switched to the view in the traveling direction of the vehicle. Thereby, the user can recognize the situation in the traveling direction of the vehicle based on the view switched at the time of starting the vehicle.

[0037] In the next step 84, the control unit 48 outputs a predetermined sound (for example, the sound "beep") from the voice output unit 24 and displays a predetermined icon (for example, an icon indicating view switching) on the display 22, thereby notifying the user that the view being displayed on the display 22 has been switched. Thereby, the user can be made to recognize that the view being displayed on the display 22 has been switched.

[0038] Also, in step 70, when the vehicle is running, the determination in step 70 is negated and the process proceeds to step 86. In step 86, the control unit 48 detects it when the direction of the view to be displayed on the display 22 is selected by the user via the input unit 16. Then in step 88, the control unit 48 switches the view to be displayed on the display 22 to the view in the direction selected by the user via the input unit 16.

[0039] After the processes of steps 86 and 88 cause the vehicle to start running and temporarily switch the view displayed on the display 22 to the view in the traveling direction of the vehicle, the user can freely switch the direction of the view to be displayed on the display 22.

[0040] As described above, in the present embodiment, the control unit 48 causes the display 22 to display the view in the direction selected via the input unit 16 from among a plurality of views having different directions obtained from the captured image acquired by the imaging unit 12 that images the periphery of the vehicle. Further, when the traveling state detection unit 18 that detects the traveling state and traveling direction of the vehicle detects that the vehicle has started running and the view displayed on the display 22 is different from the traveling direction of the vehicle, the control unit 48 switches the view displayed on the display 22 to the view in the traveling direction of the vehicle. Thereby, it is possible to prevent the situation around the vehicle displayed as a view at the time of starting the vehicle from being misrecognized by the user as the situation in the traveling direction of the vehicle, and it is possible to cause the user to recognize the situation in the traveling direction of the vehicle from the view displayed on the display 22 at the time of starting the vehicle.

[0041] Also, in the present embodiment, when the control unit 48 switches the view displayed on the display 22 to the view in the traveling direction of the vehicle, the control unit 48 notifies the user via the audio output unit 24 and the display 22. Thereby, the user can be made aware that the view displayed on the display 22 has been switched.

[0042] Also, in the present embodiment, after the vehicle has started running, when a view in a direction other than the traveling direction of the vehicle is selected via the input unit 16, the control unit 48 switches the view displayed on the display 22 to the view in the direction other than the traveling direction of the vehicle. Thereby, after the vehicle has started running, that is, after the user has confirmed the view in the traveling direction of the vehicle, the user can switch the view displayed on the display 22 to the view selected via the input unit 16.

[0043] In the above-described embodiment, the mode of selecting the view to be displayed on the display 22 from among the two views, i.e., the view on the front side of the vehicle and the view on the rear side of the vehicle, has been described. However, the view to be displayed on the display 22 is not limited to the above. For example, an image (3D view) obtained by overlooking the vehicle and its surroundings from an arbitrary viewpoint may be generated and displayed from the images captured by four or more cameras 14 respectively.

[0044] Further, in the above, the mode in which the display control program 42, which is an example of the vehicle display control program according to the present disclosure, is pre-stored (installed) in the storage unit 32 has been described. However, the vehicle display control program according to the present disclosure can also be provided in a form recorded on a non-temporary recording medium such as an HDD, an SSD, or a DVD. In addition, the vehicle display control device according to the present disclosure is applicable also during manual driving of a vehicle capable of autonomous driving.

Explanation of Reference Numerals

[0045] 10 Vehicle display device 12 Imaging unit 16 Input unit 18 Travel state detection unit 22 Display (display unit / notification unit) 24 Audio output unit (notification unit) 26 Display control ECU 48 Control unit

Claims

1. A vehicle display control device including a control unit that causes a display unit to display a view in a direction selected via an input unit from among a plurality of views having different directions obtained from a captured image acquired by an imaging unit that captures the periphery of the vehicle, and when a running state detection unit that detects the running state and traveling direction of the vehicle detects that the vehicle has started running from a stopped state of the vehicle and the view displayed on the display unit is different from the traveling direction of the vehicle, switches the view being displayed on the display unit to a view in the traveling direction of the vehicle.

2. The vehicle display control device according to claim 1, wherein the control unit causes a notification unit to perform notification when switching the view being displayed on the display unit to a view in the traveling direction of the vehicle.

3. The vehicle display control device according to claim 1 or 2, wherein the control unit switches the view being displayed on the display unit to a view in a direction other than the traveling direction when a view in a direction other than the traveling direction of the vehicle is selected via the input unit after the vehicle has started running.

4. A vehicle display control method for causing a computer to execute a process including causing a display unit to display a view in a direction selected via an input unit from among a plurality of views having different directions obtained from a captured image acquired by an imaging unit that captures the periphery of the vehicle, and when a running state detection unit that detects the running state and traveling direction of the vehicle detects that the vehicle has started running from a stopped state of the vehicle and the view displayed on the display unit is different from the traveling direction of the vehicle, switching the view being displayed on the display unit to a view in the traveling direction of the vehicle.

5. A vehicle display control program for causing a computer to execute a process including causing a display unit to display a view in a direction selected via an input unit from among a plurality of views having different directions obtained from a captured image acquired by an imaging unit that captures the periphery of the vehicle, and when a running state detection unit that detects the running state and traveling direction of the vehicle detects that the vehicle has started running from a stopped state of the vehicle and the view displayed on the display unit is different from the traveling direction of the vehicle, switching the view being displayed on the display unit to a view in the traveling direction of the vehicle. ​

Citation Information

Patent Citations

  • Rear monitoring device

    JP1998217852A

  • Intersection information provision system and driving support system

    JP2008059082A

  • Information processing unit

    JP2017175182A

  • Parking support apparatus, vehicle, parking support method, and program

    JP2020044888A

  • Around view monitor system and monitoring method

    US20140036063A1