Processing device and processing method

Abstract

To a processing device and a processing method that effectively assist a driver in parking.SOLUTION: A vehicle 1 includes a display device 11, a plurality of external cameras 12, a plurality of surrounding environment sensors 13, a plurality of wheel speed sensors 14, a vehicle interior camera 15, and a processing device 16. The processing device 16 includes a control unit that executes display control to display an image showing the surroundings of the vehicle 1. The control unit executes display control on the basis of line-of-sight information of the driver of the vehicle 1.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a processing device and a processing method.

Background Art

[0002] In recent years, for example, as disclosed in Patent Document 1, technologies related to display control for assisting driving by a driver of a vehicle have been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For the purpose of assisting the driving by the driver during parking, display control for displaying an image reflecting the surroundings of the vehicle may be used. The driver can smoothly perform a parking operation after grasping the situation around the vehicle by performing a driving operation while visually recognizing the image reflecting the surroundings of the vehicle. Here, it is desired to more effectively assist the driving by the driver during parking by utilizing the above display control.

[0005] Therefore, in view of such problems, an object of the present invention is to provide a processing device and a processing method capable of effectively assisting the driving by the driver during parking.

Means for Solving the Problems

[0006] To solve the above problems, a processing device is a processing device of a vehicle, and includes a control unit that executes display control for displaying an image reflecting the surroundings of the vehicle. The control unit executes the display control based on the line-of-sight information of the driver of the vehicle.

[0007] In order to solve the above problems, a processing method is a processing method for a vehicle, and a control unit of a processing device executes display control for displaying an image reflecting the surroundings of the vehicle, and the control unit executes the display control based on the line-of-sight information of the driver of the vehicle.

Effect of the Invention

[0008] According to the present invention, it is possible to effectively assist the driving by the driver during parking.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Mode for Carrying Out the Invention

[0010] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Dimensions, materials, and other specific numerical values shown in such embodiments are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In the present specification and drawings, elements having substantially the same function and configuration are denoted by the same reference numerals to omit redundant description, and elements not directly related to the present invention are not shown.

[0011] <Configuration of the Vehicle> Referring to FIGS. 1 and 2, the configuration of the vehicle 1 according to an embodiment of the present invention will be described.

[0012] FIG. 1 is a schematic diagram showing a schematic configuration of the vehicle 1. As shown in FIG. 1, the vehicle 1 includes a display device 11, a plurality of external cameras 12, a plurality of ambient environment sensors 13, a plurality of wheel speed sensors 14, an in-vehicle camera 15, and a processing device 16.

[0013] Note that the drive source of the vehicle 1 is not particularly limited. For example, the vehicle 1 may include only a motor as a drive source, may include only an engine as a drive source, or may include both a motor and an engine as drive sources.

[0014] The display device 11 is a device that visually displays various information. Examples of the display device 11 include a liquid crystal display and the like.

[0015] The external cameras 12 image the surroundings of the vehicle 1. In the example of FIG. 1, four external cameras 12 are provided at the front, rear, left side, and right side of the vehicle 1, respectively. The front external camera 12 images the front of the vehicle 1. The rear external camera 12 images the rear of the vehicle 1. The left external camera 12 images the left side of the vehicle 1. The right external camera 12 images the right side of the vehicle 1. Note that the images obtained by the plurality of external cameras 12 are used for displaying images for assisting the driver during parking, as will be described later. However, the number and arrangement of the external cameras 12 are not limited to the example of FIG. 1. For example, the number of external cameras 12 may be larger than that in the example of FIG. 1.

[0016] The surrounding environment sensor 13 detects surrounding environment information regarding the environment around the vehicle 1. In the example of FIG. 1, four surrounding environment sensors 13 are respectively provided at the left front, right front, left rear, and right rear of the vehicle 1. The surrounding environment sensor 13 at the left front detects the surrounding environment information in front of the vehicle 1 on the left. The surrounding environment sensor 13 at the right front detects the surrounding environment information in front of the vehicle 1 on the right. The surrounding environment sensor 13 at the left rear detects the surrounding environment information behind the vehicle 1 on the left. The surrounding environment sensor 13 at the right rear detects the surrounding environment information behind the vehicle 1 on the right.

[0017] The surrounding environment information detected by the surrounding environment sensor 13 may be information related to the distance or orientation to a subject located around the vehicle 1 (for example, relative position, relative distance, relative speed, relative acceleration, etc.), or may be characteristics of a subject located around the vehicle 1 (for example, the type of the subject, the shape of the subject itself, marks attached to the subject, etc.). The surrounding environment sensor 13 is, for example, a radar, a Lidar sensor, an ultrasonic sensor, or the like.

[0018] The wheel speed sensor 14 is provided on each wheel and detects the wheel speed of each wheel.

[0019] The in-vehicle camera 15 is a camera for detecting the state inside the vehicle 1. The in-vehicle camera 15 is provided inside the vehicle 1. For example, the in-vehicle camera 15 is provided near the rearview mirror inside the vehicle 1 and faces downward and backward. In particular, the in-vehicle camera 15 can detect the driver of the vehicle 1. As will be described later, the image captured by the in-vehicle camera 15 is used for detecting the driver's line of sight.

[0020] The processing device 16 includes a CPU (Central Processing Unit) which is an arithmetic processing unit, a ROM (Read Only Memory) which is a storage element for storing programs, arithmetic parameters, etc. used by the CPU, and a RAM (Random Access Memory) which is a storage element for temporarily storing parameters that change as appropriate during the execution of the CPU. The processing device 16 may be, for example, one, or may be divided into a plurality. When the processing device 16 is divided into a plurality, since various functions described below are shared among the plurality of devices, for example, some functions of the control unit 16b described later and some other functions may be shared by different devices.

[0021] FIG. 2 is a block diagram showing an example of the functional configuration of the processing device 16. As shown in FIG. 2, the processing device 16 includes, for example, an acquisition unit 16a and a control unit 16b.

[0022] The acquisition unit 16a acquires information from each device in the vehicle 1. For example, the acquisition unit 16a acquires information from the external camera 12, the surrounding environment sensor 13, the wheel speed sensor 14, and the cabin camera 15. In this specification, the acquisition of information may include the extraction or generation (for example, calculation) of information.

[0023] In particular, the acquisition unit 16a can acquire the line-of-sight information of the driver of the vehicle 1. For example, the acquisition unit 16a can recognize the line of sight of the driver sitting in the driver's seat by performing image processing on the image captured by the cabin camera 15. In this way, the acquisition unit 16a can acquire information indicating the driver's line of sight as line-of-sight information. However, the line-of-sight information only needs to be information related to the driver's line of sight, and may be information other than information directly indicating the driver's line of sight, as described later.

[0024] The control unit 16b controls the operations of each device in the vehicle 1. In particular, the control unit 16b performs control related to various displays by controlling the display device 11.

[0025] <Operation of the processing device> Referring to FIGS. 3 to 5, the operation of the processing device 16 according to the embodiment of the present invention will be described.

[0026] As described above, the control unit 16b of the processing device 16 performs control related to various displays by controlling the display device 11. In particular, the control unit 16b executes display control for displaying an image that reflects the surroundings of the vehicle 1. Here, as the images displayed by the display control, a plurality of images with different viewpoints can be switched. In other words, the viewpoint of the image displayed by the display control can be switched.

[0027] FIG. 3 is a diagram showing an example of the viewpoint of an image in the display control. In the example of FIG. 3, one viewpoint can be selected from seven viewpoints of the first view V1, the second view V2, the third view V3, the fourth view V4, the fifth view V5, the sixth view V6, and the seventh view V7. And in the display control, the image of the selected viewpoint is displayed. However, in the display control, it may not be possible to select some of the above viewpoints, or additional viewpoints different from the above viewpoints may be selectable.

[0028] As shown in FIG. 3, the first view V1 is a viewpoint facing backward from the rear of the vehicle 1. The second view V2 is a viewpoint facing backward from near the left side mirror of the vehicle 1. The third view V3 is a viewpoint facing backward from near the right side mirror of the vehicle 1. The fourth view V4 is a viewpoint overlooking the left front part of the vehicle 1 from above. The fifth view V5 is a viewpoint overlooking the right front part of the vehicle 1 from above. The sixth view V6 is a viewpoint overlooking the left rear part of the vehicle 1 from above. The seventh view V7 is a viewpoint overlooking the right rear part of the vehicle 1 from above.

[0029] The control unit 16b can generate images of the various views described above by using, for example, images captured by the external camera 12. For example, the control unit 16b performs a compositing process of joining together the images obtained by each external camera 12, and processes a planar image into a bowl-shaped three-dimensional image within the virtual space. Further, the control unit 16b superimposes a model such as a 3D model representing the vehicle 1 on a three-dimensional image representing the surroundings including the front, rear, left side, and right side of the vehicle 1 generated in this way. Then, the control unit 16b can generate images of the various views described above by changing the viewpoint within the virtual space with respect to the model of the vehicle 1 generated as described above and the three-dimensional image representing the surroundings of the vehicle 1. Note that the image of the first view V1 among the various views described above may be the image itself captured by the rear external camera 12.

[0030] The display of the image by display control is mainly used for the purpose of assisting the driver during parking. Therefore, the control unit 16b mainly executes display control when the vehicle 1 is parked. For example, when a specific operation is performed by the driver, the control unit 16b executes display control and causes the display device 11 to display an image of any one of the various views described above. Examples of the specific operation include an operation using a specific operation unit within the vehicle 1 (for example, an operation of pressing a button), or an operation of switching the shift position to a position where the vehicle 1 moves backward (for example, the R range). Then, the driver can smoothly complete parking by performing a parking operation while visually recognizing the displayed image. For example, during the execution of display control, the driver can change the viewpoint of the displayed image by performing a predetermined operation. Therefore, the driver can perform a parking operation while switching the viewpoint of the displayed image to a desired viewpoint.

[0031] In this embodiment, the control unit 16b executes display control based on the line-of-sight information of the driver of the vehicle 1. Thereby, as will be described later, it is realized to effectively support the driving by the driver during parking by utilizing the display control. Hereinafter, as processes related to the display control performed by the processing device 16, the process related to the automatic start of the display control and the process related to the automatic switching of the viewpoint of the image in the display control will be described in order.

[0032] FIG. 4 is a flowchart showing an example of the flow of the process related to the automatic start of the display control performed by the processing device 16. Step S101 in FIG. 4 corresponds to the start of the processing flow shown in FIG. 4. Step S105 in FIG. 4 corresponds to the end of the processing flow shown in FIG. 4.

[0033] In the process related to the automatic start of the display control shown in FIG. 4, the display control is automatically started regardless of the operation by the driver. Therefore, the processing flow shown in FIG. 4 starts when the display control is not being executed. For example, the processing flow shown in FIG. 4 repeatedly starts at a preset time interval when the display control is not being executed.

[0034] When the processing flow shown in FIG. 4 is started, in step S102, the control unit 16b determines whether the speed of the vehicle 1 is lower than a threshold value.

[0035] The acquisition unit 16a can acquire information indicating the speed of the vehicle 1 based on, for example, the detection result of the wheel speed sensor 14. Therefore, the control unit 16b can perform the determination in step S102 using the information thus acquired. The determination in step S102 is made to determine whether there is a possibility that a parking operation is being performed by the driver. Therefore, the above threshold value is set to a small value that can determine whether there is a possibility that a parking operation is being performed by the driver, for example. The case where the speed of the vehicle 1 is lower than the threshold value corresponds to the case where there is a possibility that a parking operation is being performed by the driver.

[0036] When it is determined that the speed of the vehicle 1 is equal to or higher than the threshold value (step S102 / NO), the processing flow shown in FIG. 4 ends. On the other hand, when it is determined that the speed of the vehicle 1 is lower than the threshold value (step S102 / YES), the process proceeds to step S103.

[0037] When it is determined as YES in step S102, in step S103, the control unit 16b determines whether a difficult parking operation is being performed by the driver.

[0038] A difficult parking operation means an operation with a high level of difficulty and a high need for assistance by display control. In the processing example of FIG. 4, as will be described later, when a difficult parking operation is being performed by the driver, the display control automatically starts. Thereby, it is realized to effectively assist the driver's driving during parking.

[0039] In step S103, the control unit 16b determines whether a difficult parking operation is being performed by the driver based on the driver's line-of-sight information. For example, when the line-of-sight information indicates that there is a high possibility that a difficult parking operation is being performed, the control unit 16b determines that a difficult parking operation is being performed by the driver.

[0040] For example, when the control unit 16b can determine based on the line-of-sight information that the driver's line of sight is significantly deviated from the line of sight during driving (that is, the line of sight when gazing at the front of the vehicle 1), the control unit 16b may determine that a difficult parking operation is being performed by the driver. Also, for example, when the control unit 16b can determine based on the line-of-sight information that the driver's line of sight frequently changes significantly (for example, the line of sight frequently changes from left to right and then back from right to left), the control unit 16b may determine that a difficult parking operation is being performed by the driver.

[0041] Here, in addition to the driver's line-of-sight information, the control unit 16b may determine whether a difficult parking operation is being performed by the driver based on the surrounding environment information of the vehicle 1. For example, when both the line-of-sight information and the surrounding environment information indicate a high possibility that a difficult parking operation is being performed, the control unit 16b determines that a difficult parking operation is being performed by the driver.

[0042] For example, when the line-of-sight information indicates a high possibility that a difficult parking operation is being performed, and based on the surrounding environment information, it can be determined that the gap between an obstacle (such as another vehicle) existing around the vehicle 1 and the vehicle 1 is equal to or less than a predetermined value, the control unit 16b may determine that a difficult parking operation is being performed by the driver.

[0043] In addition, in addition to the driver's line-of-sight information, the control unit 16b may determine whether a difficult parking operation is being performed by the driver based on the driver's operation information. For example, when both the line-of-sight information and the operation information indicate a high possibility that a difficult parking operation is being performed, the control unit 16b determines that a difficult parking operation is being performed by the driver.

[0044] The operation information is information related to the driver's driving operation. For example, it includes information related to the gear shift operation (such as information indicating what kind of gear shift operation is being performed), or information related to the steering operation (such as information indicating what kind of steering operation is being performed), etc. The acquisition unit 16a can acquire the operation information from each operation unit, for example. Note that the operation information may be information related to operation units other than the above (such as information related to the accelerator operation or information related to the brake operation, etc.).

[0045] For example, if the line-of-sight information indicates that a difficult parking operation is likely to be performed and it can be determined based on the operation information that the gearshift operation is frequently performed, the control unit 16b may determine that the driver is performing a difficult parking operation. Also, for example, if the line-of-sight information indicates that a difficult parking operation is likely to be performed and it can be determined based on the operation information that the steering operation direction is frequently switched, the control unit 16b may determine that the driver is performing a difficult parking operation.

[0046] In addition to the driver's line-of-sight information, the control unit 16b may determine whether the driver is performing a difficult parking operation based on both the surrounding environment information of the vehicle 1 and the driver's operation information.

[0047] If it is determined that the driver is not performing a difficult parking operation (step S103 / NO), the processing flow shown in FIG. 4 ends. On the other hand, if it is determined that the driver is performing a difficult parking operation (step S103 / YES), the process proceeds to step S104.

[0048] If it is determined YES in step S103, in step S104, the control unit 16b automatically starts the display control, and the processing flow shown in FIG. 4 ends.

[0049] As described above, in the processing example of FIG. 4, the control unit 16b executes the display control based on the line-of-sight information of the driver of the vehicle 1. In particular, in the processing example of FIG. 4, the control unit 16b automatically starts the display control based on the line-of-sight information when the display control is not being executed. Thereby, the display control can be automatically started according to the driver's behavior. For example, when the driver is performing a difficult parking operation, the display control can be automatically started. Therefore, it is appropriately realized to effectively assist the driver's driving during parking.

[0050] FIG. 5 is a flowchart showing an example of the processing flow regarding the automatic switching of the viewpoint of the image in the display control performed by the processing device 16. Step S201 in FIG. 5 corresponds to the start of the processing flow shown in FIG. 5.

[0051] In the process regarding the automatic switching of the viewpoint of the image in the display control shown in FIG. 5, the viewpoint of the image displayed in the display control is automatically switched without depending on the operation by the driver. Therefore, the processing flow shown in FIG. 5 starts during the execution of the display control. Note that at the time when the display control starts, for example, an image of a preset viewpoint (for example, the first view V1) is displayed.

[0052] When the processing flow shown in FIG. 5 starts, in step S202, the control unit 16b identifies the viewpoint desired by the driver.

[0053] In step S202, the control unit 16b identifies the viewpoint desired by the driver based on the line-of-sight information of the driver. The control unit 16b identifies, for example, a viewpoint from which it is easy to grasp the situation of the location where the driver is gazing as the viewpoint desired by the driver.

[0054] For example, when the control unit 16b determines based on the line-of-sight information that the driver is gazing at the left front part of the vehicle 1, the control unit 16b identifies the fourth view V4, which is a viewpoint overlooking the left front part of the vehicle 1 from above, as the viewpoint desired by the driver. Also, for example, when the control unit 16b determines based on the line-of-sight information that the driver is gazing at the right rear of the vehicle 1 with the face sticking out of the vehicle 1 with the right window of the vehicle 1 open, the control unit 16b identifies the third view V3, which is a viewpoint facing backward from near the right side mirror of the vehicle 1, as the viewpoint desired by the driver.

[0055] Next to step S202, in step S203, the control unit 16b determines whether the viewpoint desired by the driver is different from the viewpoint of the currently displayed image.

[0056] When it is determined that the viewpoint desired by the driver matches the viewpoint of the currently displayed image (step S203 / NO), the process returns to step S202. On the other hand, when it is determined that the viewpoint desired by the driver is different from the viewpoint of the currently displayed image (step S203 / YES), the process proceeds to step S204.

[0057] When it is determined as YES in step S203, in step S204, the control unit 16b automatically switches the viewpoint of the displayed image to the viewpoint desired by the driver and returns to step S202. Note that the control unit 16b does not switch the viewpoint of the displayed image, for example, when the driver is gazing at the display in the vehicle 1. Thereby, it is possible to suppress the switching of the viewpoint of the displayed image from being performed too frequently.

[0058] As described above, in the processing example of FIG. 5, the control unit 16b executes display control based on the line-of-sight information of the driver of the vehicle 1. In particular, in the processing example of FIG. 5, the control unit 16b automatically switches the viewpoint of the displayed image based on the line-of-sight information during the execution of the display control. Thereby, according to the behavior of the driver, the viewpoint of the image displayed in the display control can be automatically switched. For example, during the execution of the display control, the viewpoint of the displayed image can be automatically switched to the viewpoint desired by the driver. Therefore, it is appropriately realized to effectively support the driving by the driver during parking.

[0059] As described above, as processing examples performed by the processing device 16, the processing example of FIG. 4 and the processing example of FIG. 5 have been described. However, the processing performed by the processing device 16 is not limited to the above-described processing examples, and for example, processing obtained by appropriately modifying the above-described processing examples may be used.

[0060] For example, in the processing example of FIG. 5 described above, the control unit 16b automatically switches the viewpoint of the image based on the line-of-sight information of the driver during the execution of the display control. Here, the control unit 16b may automatically switch the viewpoint of the image based on other information in addition to the line-of-sight information of the driver.

[0061] For example, in addition to the driver's line-of-sight information, the control unit 16b may automatically switch the viewpoint of the image based on the surrounding environment information of the vehicle 1. For example, basically, the control unit 16b automatically switches the viewpoint of the image based on the line-of-sight information, but when the surrounding environment information is specific information, it may automatically switch the viewpoint of the image based on the surrounding environment information. For example, when the control unit 16b can determine based on the surrounding environment information that the gap between an obstacle (such as another vehicle) existing in the right front of the vehicle 1 and the right front part of the vehicle 1 is equal to or less than a predetermined value, the viewpoint of the displayed image may be automatically switched to the fifth view V5 which is a viewpoint as if looking down on the right front part of the vehicle 1 from above.

[0062] In addition, for example, in addition to the driver's line-of-sight information, the control unit 16b may automatically switch the viewpoint of the image based on the driver's operation information. For example, basically, the control unit 16b automatically switches the viewpoint of the image based on the line-of-sight information, but when the operation information is specific information, it may automatically switch the viewpoint of the image based on the surrounding environment information. For example, when the control unit 16b can determine based on the operation information that the driver is performing an operation of reversing the vehicle 1 at an accelerator opening of a predetermined value or more with the steering wheel turned to the left, the viewpoint of the displayed image may be automatically switched to the sixth view V6 which is a viewpoint as if looking down on the left rear part of the vehicle 1 from above.

[0063] In addition, for example, in the above, an example in which information directly indicating the driver's line of sight is used as the line-of-sight information has been described. However, the line-of-sight information may be any information related to the driver's line of sight, and may be information other than information directly indicating the driver's line of sight. For example, the acquisition unit 16a can recognize the orientation of the head of the driver sitting in the driver's seat by performing image processing on the image captured by the cabin camera 15. In this way, the acquisition unit 16a may acquire information indicating the orientation of the driver's head as the line-of-sight information. That is, the orientation of the driver's head may be regarded as the driver's line of sight.

[0064] <Effect of the processing device> The effects of the processing device 16 according to the embodiments of the present invention will be described.

[0065] The processing device 16 includes a control unit 16b that executes display control for displaying an image reflecting the surroundings of the vehicle 1. And the control unit 16b executes the display control based on the line-of-sight information of the driver of the vehicle 1. Thereby, the display control can be appropriately executed according to the behavior of the driver. Therefore, it is possible to effectively support the driving by the driver during parking.

[0066] Preferably, in the processing device 16, when the display control is not executed, the control unit 16b automatically starts the display control based on the line-of-sight information. Thereby, the display control can be automatically started according to the behavior of the driver. For example, when a difficult parking operation is being performed by the driver, the display control can be automatically started. Therefore, it is appropriately realized that the driving by the driver during parking is effectively supported.

[0067] Preferably, in the processing device 16, when the display control is not executed, the control unit 16b automatically starts the display control based on the line-of-sight information in addition to the surrounding environment information of the vehicle 1. Thereby, in addition to the behavior of the driver, the display control can be automatically started according to the situation around the vehicle 1. Therefore, it is more appropriately realized that the driving by the driver during parking is effectively supported.

[0068] Preferably, in the processing device 16, when the display control is not executed, the control unit 16b automatically starts the display control based on the line-of-sight information in addition to the operation information of the driver. Thereby, in addition to the behavior of the driver, the display control can be automatically started according to the operation being performed by the driver. Therefore, it is more appropriately realized that the driving by the driver during parking is effectively supported.

[0069] Preferably, in the processing device 16, during the execution of the display control, the control unit 16b automatically switches the viewpoint of the image based on the line-of-sight information. Thereby, according to the behavior of the driver, the viewpoint of the image displayed in the display control can be automatically switched. For example, during the execution of the display control, the viewpoint of the displayed image can be automatically switched to the viewpoint desired by the driver. Therefore, it is appropriately realized to effectively assist the driver's operation during parking.

[0070] Preferably, in the processing device 16, during the execution of the display control, in addition to the line-of-sight information, the control unit 16b automatically switches the viewpoint of the image based on the surrounding environment information of the vehicle 1. Thereby, in addition to the behavior of the driver, according to the situation around the vehicle 1, the viewpoint of the image displayed in the display control can be automatically switched. Therefore, it is more appropriately realized to effectively assist the driver's operation during parking.

[0071] Preferably, in the processing device 16, during the execution of the display control, in addition to the line-of-sight information, the control unit 16b automatically switches the viewpoint of the image based on the operation information of the driver. Thereby, in addition to the behavior of the driver, according to the operation being performed by the driver, the viewpoint of the image displayed in the display control can be automatically switched. Therefore, it is more appropriately realized to effectively assist the driver's operation during parking.

[0072] As described above, the preferred embodiments of the present invention have been described with reference to the accompanying drawings. However, it goes without saying that the present invention is not limited to the above-described embodiments, and various modification examples or correction examples within the scope described in the claims also belong to the technical scope of the present invention.

[0073] For example, the processes described using flowcharts in this specification do not necessarily have to be executed in the order shown in the flowcharts. Some process steps may be executed in parallel. Also, additional process steps may be adopted, and some process steps may be omitted.

[0074] Also, for example, the series of processes by the processing device 16 described above may be realized using any of software, hardware, and a combination of software and hardware. The program constituting the software is stored in advance, for example, in a storage medium provided inside or outside the information processing device.

Explanation of Signs

[0075] 1 Vehicle 11 Display device 12 External camera 13 Surrounding environment sensor 14 Wheel speed sensor 15 Cabin camera 16 Processing device 16a Acquisition unit 16b Control unit

Claims

1. A processing device (16) for a vehicle (1), comprising a control unit (16b) that executes display control for displaying an image reflecting the surroundings of the vehicle (1), wherein the control unit (16b) executes the display control based on the line-of-sight information of the driver of the vehicle (1). Processing device.

2. The control unit (16b) automatically starts the display control based on the line-of-sight information when the display control is not being executed. The processing device according to Claim 1.

3. The control unit (16b) automatically starts the display control based on the line-of-sight information and, in addition, based on the surrounding environment information of the vehicle (1) when the display control is not being executed. The processing device according to Claim 2.

4. The control unit (16b) automatically starts the display control based on the line-of-sight information and, in addition, based on the operation information of the driver when the display control is not being executed. The processing device according to Claim 2.

5. During the execution of the display control, the control unit (16b) automatically switches the viewpoint of the image based on the line-of-sight information. The processing device according to Claim 1.

6. During the execution of the display control, the control unit (16b) automatically switches the viewpoint of the image based on the line-of-sight information and, in addition, based on the surrounding environment information of the vehicle (1). The processing device according to Claim 5.

7. During the execution of the display control, the control unit (16b) automatically switches the viewpoint of the image based on the line-of-sight information and, in addition, based on the operation information of the driver. The processing device according to Claim 5.

8. A processing method for a vehicle (1), wherein a control unit (16b) of a processing device (16) executes display control for displaying an image reflecting the surroundings of the vehicle (1), and the control unit (16b) executes the display control based on the line-of-sight information of the driver of the vehicle (1). Processing method.

Images