Processing apparatus and processing method

Abstract

To create an added value by utilizing a surround view.SOLUTION: A processing apparatus, which is a processing apparatus for a vehicle, comprises a control unit which executes display control to display a surround view 20 being a synthetic image like an overhead image of a vehicle viewed from the outside. The control unit executes superimposition control for superimposing, on the surround view 20, virtual objects 21 moving relatively with respect to a vehicle model 30, in the display control.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a processing apparatus and a processing method. [Background technology]

[0002] 2. Description of the Related Art In recent years, as disclosed in, for example, Patent Document 1, a technique relating to display control for assisting a driver of a vehicle in driving has been proposed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] US Patent Application Publication No. 2015 / 0097860 Summary of the Invention [Problem to be solved by the invention]

[0004] Display control that displays a surround view may be used to assist a driver in parking or other driving situations. The surround view is a composite image that shows a bird's-eye view of the vehicle from the outside. For example, a driver can smoothly park the vehicle as if he or she were looking down on the vehicle from the outside by driving the vehicle while viewing the surround view. Here, it is desired to create added value by utilizing the surround view.

[0005] In view of the above, an object of the present invention is to provide a processing device and a processing method capable of creating added value by utilizing surround view. [Means for solving the problem]

[0006] In order to solve the above problem, the processing device is a processing device of a vehicle and is equipped with a control unit that performs display control to display a surround view, which is a synthetic image of the vehicle as viewed from the outside, and the control unit performs superimposition control in the display control to superimpose a virtual object that moves relative to the vehicle model on the surround view.

[0007] In order to solve the above problem, the processing method is a vehicle processing method, in which a control unit of the processing device performs display control to display a surround view, which is a synthetic image of the vehicle as viewed from the outside, and the control unit performs superimposition control in the display control to superimpose a virtual object that moves relative to the vehicle model on the surround view. Effect of the Invention

[0008] According to the present invention, it is possible to create added value by utilizing the surround view. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram showing a schematic configuration of a vehicle according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing an example of a functional configuration of a processing device according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram showing an example of a surround view according to an embodiment of the present invention. [Figure 4] 5 is a flowchart showing a first example of a process flow regarding superimposition control performed by the processing device according to the embodiment of the present invention. [Diagram 5] FIG. 11 is a diagram showing an example of a surround view when superimposition control according to the embodiment of the present invention is being executed. [Figure 6] 10 is a flowchart showing a second example of the flow of processing related to superimposition control performed by the processing device according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] A preferred embodiment of the present invention will be described in detail below with reference to the accompanying drawings. The dimensions, materials, and other specific values ​​shown in the embodiment are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In this specification and drawings, elements having substantially the same functions and configurations are given the same reference numerals to avoid repeated explanations, and elements not directly related to the present invention are not shown.

[0011] <Vehicle configuration> The configuration of a vehicle 10 according to an embodiment of the present invention will be described with reference to FIGS.

[0012] Fig. 1 is a schematic diagram showing a general configuration of a vehicle 10. As shown in Fig. 1, the vehicle 10 includes a display device 11, a plurality of cameras 12, a rain sensor 13, an outside air temperature sensor 14, a plurality of wheel speed sensors 15, and a processing device 16.

[0013] There is no particular limitation on the drive source of the vehicle 10. For example, the vehicle 10 may be equipped with only a motor as a drive source, may be equipped with only an engine as a drive source, or may be equipped with both a motor and an engine as drive sources.

[0014] The display device 11 is a device that visually displays various information. An example of the display device 11 is a liquid crystal display.

[0015] The cameras 12 capture images of the surroundings of the vehicle 10. In the example of FIG. 1, four cameras 12 are provided at the front, rear, left side, and right side of the vehicle 10, respectively. The front camera 12 captures images in front of the vehicle 10. The rear camera 12 captures images behind the vehicle 10. The left camera 12 captures images on the left side of the vehicle 10. The right camera 12 captures images on the right side of the vehicle 10. Images obtained by the multiple cameras 12 are used to display a surround view, as described later. However, the number and arrangement of the cameras 12 are not limited to the example of FIG. 1. For example, the number of cameras 12 may be greater than that of the example of FIG. 1.

[0016] The rain sensor 13 detects the presence or absence of rain around the vehicle 10. The rain sensor 13 may further detect the intensity of the rain.

[0017] The outside air temperature sensor 14 detects the outside air temperature surrounding the vehicle 10 .

[0018] A wheel speed sensor 15 is provided on each wheel to detect the wheel speed of each wheel.

[0019] The processing device 16 includes a CPU (Central Processing Unit) which is an arithmetic processing device, a ROM (Read Only Memory) which is a storage element for storing programs and arithmetic parameters used by the CPU, and a RAM (Random Access Memory) which is a storage element for temporarily storing parameters that change appropriately during execution of the CPU. The processing device 16 may be, for example, one unit, or may be divided into multiple units. When the processing device 16 is divided into multiple units, various functions described below are shared among the multiple units, so that, for example, some functions of the control unit 16b described below and other functions may be shared by different units.

[0020] Fig. 2 is a block diagram showing an example of a functional configuration of the processing device 16. As shown in Fig. 2, the processing device 16 includes, for example, an acquisition unit 16a, a control unit 16b, and a storage unit 16c.

[0021] The acquisition unit 16a acquires information from each device in the vehicle 10. For example, the acquisition unit 16a acquires information from the camera 12, the rain sensor 13, the outside air temperature sensor 14, and the wheel speed sensor 15. In this specification, the acquisition of information may include the extraction or generation (e.g., calculation) of information. For example, the acquisition unit 16a may acquire information indicating the speed of the vehicle 10 based on the detection result of the wheel speed sensor 15. The acquisition unit 16a may also acquire information from an external device by wirelessly communicating with the external device of the vehicle 10.

[0022] The control unit 16b controls the operation of each device in the vehicle 10. In particular, the control unit 16b controls the display device 11 to perform control related to various displays.

[0023] The storage unit 16c stores various types of information. The information stored in the storage unit 16c is used in the processing performed by the control unit 16b.

[0024] <Operation of the processing device> The operation of the processing device 16 according to the embodiment of the present invention will be described with reference to FIGS.

[0025] As described above, the control unit 16b of the processing device 16 performs control regarding various displays by controlling the display device 11. Here, the control unit 16b executes display control for displaying a surround view.

[0026] FIG. 3 is a diagram showing an example of the surround view 20. As shown in FIG. 3, the surround view 20 is a composite image of the vehicle 10 as viewed from the outside. In other words, the surround view 20 is a composite image showing a model 30 of the vehicle 10 and its surroundings from a viewpoint of a virtual bird's-eye view of the vehicle 10 from the outside. Specifically, the control unit 16b performs a synthesis process of joining together images obtained by the cameras 12, and processes a planar image into a bowl-shaped three-dimensional image in the virtual space. Furthermore, the control unit 16b generates an image showing the surroundings including the front, rear, left side, and right side of the vehicle 10 by setting the viewpoint in the virtual space to face the vicinity of the center of the three-dimensional image. Then, the control unit 16b displays a model 30 such as a 3D model showing the vehicle 10 on the image thus generated. In the example of FIG. 3, a 3D model is used as the model 30 showing the vehicle 10. The model 30 showing the vehicle 10 is stored in advance in the storage unit 16c, for example.

[0027] The surround view 20 is mainly used for the purpose of assisting the driver in parking. Therefore, the control unit 16b mainly executes display control when parking the vehicle 10. For example, when a specific operation is performed by the driver, the control unit 16b executes display control and causes the display device 11 to display the surround view 20. Examples of the specific operation include an operation using a specific operation unit in the vehicle 10 (for example, pressing a button), or an operation of switching the shift position to a position where the vehicle 10 moves backward (for example, to the R range). The driver can smoothly park the vehicle by performing driving operations while viewing the surround view 20. For example, the driver can change the viewpoint of the surround view 20 (that is, the direction in which the vehicle 10 is viewed from above in the surround view 20) during the execution of the display control. Therefore, the driver can park the vehicle while switching the viewpoint of the surround view 20 to a desired viewpoint.

[0028] In this embodiment, the control unit 16b executes superimposition control in which a virtual object that moves relatively to the model 30 of the vehicle 10 is superimposed on the surround view 20 in display control for displaying the surround view 20. This makes it possible to create added value by utilizing the surround view 20, as described later. Below, a first example and a second example will be described in order as examples of processing related to the superimposition control performed by the processing device 16.

[0029] Fig. 4 is a flowchart showing a first example of a process flow related to superimposition control performed by the processing device 16. Step S101 in Fig. 4 corresponds to the start of the control flow shown in Fig. 4. Step S105 in Fig. 4 corresponds to the end of the control flow shown in Fig. 4. The control flow shown in Fig. 4 is executed, for example, when display control for displaying the surround view 20 is started.

[0030] 4 starts, the acquisition unit 16a acquires date information in step S102. The date information is information relating to the current date.

[0031] The acquisition unit 16a acquires, for example, information indicating the current date as date information. For example, information indicating the current date is stored in the storage unit 16c, and the information is updated daily. Therefore, the acquisition unit 16a can acquire information indicating the current date as date information from the storage unit 16c.

[0032] After step S102, in step S103, the control unit 16b determines whether or not the current date is a specific date based on the date information.

[0033] The specific date is, for example, a date belonging to a specific season, a national holiday, the driver's birthday, an anniversary, an event date, etc. For example, information indicating the specific date is stored in advance in the storage unit 16c. Then, the control unit 16b can determine whether the current date is a specific date by comparing the information indicating the specific date with the date information acquired in step S102.

[0034] If it is determined that the current date is a specific date (step S103 / YES), the process proceeds to step S104. On the other hand, if it is determined that the current date is not a specific date (step S103 / NO), the control flow shown in FIG. 4 ends.

[0035] If the determination in step S103 is YES, in step S104, the control unit 16b executes the superimposition control, and the control flow shown in FIG. 4 ends.

[0036] As described above, the superimposition control is a control for superimposing a virtual object that moves relatively to the model 30 of the vehicle 10 on the surround view 20. In the surround view 20, the above-mentioned virtual object superimposed by the superimposition control moves, for example, even if the vehicle 10 is stopped.

[0037] Fig. 5 is a diagram showing an example of the surround view 20 when the superimposition control is being executed. The example in Fig. 5 is an example in which, when the current date is a date that belongs to winter, the determination in step S103 is YES, and the superimposition control is executed.

[0038] 5, in the superimposition control, control unit 16b superimposes virtual objects 21 representing snow that move relatively to model 30 of vehicle 10 on surround view 20. In this case, control unit 16b superimposes multiple virtual objects 21 representing snow on surround view 20 so that these virtual objects 21 appear to be descending from the sky. For example, in surround view 20, multiple virtual objects 21 representing snow float in the air and descend while swaying.

[0039] For example, a 3D model of a virtual object 21 representing snow is stored in advance in the storage unit 16c. Then, the control unit 16b reads out the 3D model from the storage unit 16c and superimposes it on the surround view 20 as the virtual object 21 representing snow. Also, for example, information representing the behavior (e.g., trajectory, movement speed, etc.) of the virtual object 21 representing snow is stored in advance in the storage unit 16c. Then, the control unit 16b controls the behavior of the virtual object 21 in the surround view 20 based on the information.

[0040] In the above, an example has been described with reference to Fig. 5 in which, in the superimposition control, a virtual object 21 representing snow is superimposed on the surround view 20 when the current date is a date that belongs to winter. However, the control unit 16b may change the type of the virtual object 21 based on the date information. Note that the combination of the date information and the type of the virtual object 21 superimposed on the surround view 20 is not particularly limited, and may be a combination other than the examples given in this specification.

[0041] For example, if the current date is a date that belongs to spring, the determination in step S103 may be YES, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing a cherry blossom petal that moves relatively to the model 30 of the vehicle 10 on the surround view 20. In this case, the control unit 16b superimposes a plurality of virtual objects 21 representing cherry blossom petals on the surround view 20 so that these virtual objects 21 appear to be descending from the sky. For example, in the surround view 20, the plurality of virtual objects 21 representing cherry blossom petals float in the air and descend while swaying.

[0042] For example, if the current date is a date that belongs to autumn, the determination in step S103 may be YES, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing autumn leaves that moves relatively to the model 30 of the vehicle 10 on the surround view 20. In this case, the control unit 16b superimposes, for example, a plurality of virtual objects 21 representing autumn leaves on the surround view 20 so that these virtual objects 21 appear to be descending from the sky. For example, in the surround view 20, the plurality of virtual objects 21 representing autumn leaves float in the air and descend while swaying.

[0043] Also, for example, if the current date is a date that belongs to summer, the determination in step S103 may be YES, and the superimposition control may be executed. In this case, for example, in the superimposition control, the control unit 16b may superimpose a virtual object 21 representing fireworks that moves relatively to the model 30 of the vehicle 10 on the surround view 20. In this case, the control unit 16b superimposes a plurality of virtual objects 21 representing fireworks on the surround view 20 so that these virtual objects 21 bloom in the sky and then disappear.

[0044] Also, for example, when the current date is Christmas, the determination in step S103 may be YES, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing snow that moves relatively to the model 30 of the vehicle 10 on the surround view 20. In this case, the behavior of the virtual object 21 on the surround view 20 may be, for example, similar to the example in FIG. 5.

[0045] Also, for example, when the current date is a birthday, the determination in step S103 may be YES, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing fireworks moving relatively to the model 30 of the vehicle 10 on the surround view 20. In this case, the behavior of the virtual object 21 on the surround view 20 may be the same as when the current date is a date belonging to summer, for example. Note that when the current date is a birthday, the control unit 16b may, for example, superimpose a virtual object 21 representing a balloon rising while floating in the air on the surround view 20.

[0046] Here, the control unit 16b may change the superimposition manner of the virtual object 21 based on date information.

[0047] For example, in the superimposition control executed when the current date belongs to winter, when the current date belongs to a period of winter when the temperature is particularly low, the control unit 16b may increase the moving speed of the virtual objects 21 representing snow when the current date belongs to a period of winter when the temperature is particularly low, compared to when the current date belongs to winter but does not belong to a period of winter when the temperature is particularly low. Also, for example, in the superimposition control executed when the current date belongs to winter, when the current date belongs to a period of winter when the temperature is particularly low, the control unit 16b may increase the number of virtual objects 21 representing snow when the current date belongs to winter but does not belong to a period of winter when the temperature is particularly low, compared to when the current date belongs to winter but does not belong to a period of winter when the temperature is particularly low.

[0048] As described above, in the first example shown in FIG. 4, the control unit 16b executes superimposition control in which the virtual object 21 that moves relatively to the model 30 of the vehicle 10 is superimposed on the surround view 20 in the display control for displaying the surround view 20. This allows the driver to enjoy driving by looking at the virtual object 21 superimposed on the surround view 20. Therefore, not only does the surround view 20 assist the driver in driving during parking, etc., but the surround view 20 also allows the driver to enjoy driving more. In this way, according to this embodiment, it is possible to create added value by utilizing the surround view 20.

[0049] In particular, in the first example shown in Fig. 4, the control unit 16b executes the superimposition control based on date information. This allows the control unit 16b to appropriately execute the superimposition control according to the current date, so that the surround view 20 can appropriately realize a more enjoyable driving experience for the driver.

[0050] Fig. 6 is a flowchart showing a second example of the process flow regarding the superimposition control performed by the processing device 16. Step S201 in Fig. 6 corresponds to the start of the control flow shown in Fig. 6. Step S205 in Fig. 6 corresponds to the end of the control flow shown in Fig. 6. The control flow shown in Fig. 6 is executed, for example, when display control for displaying the surround view 20 is started.

[0051] 6 starts, the acquisition unit 16a acquires environmental information in step S202. The environmental information is information about the current surrounding environment of the vehicle 10.

[0052] The acquisition unit 16a may acquire, for example, information indicating the current weather around the vehicle 10 as the environmental information. For example, the acquisition unit 16a may acquire information indicating whether the weather is rainy or not as the environmental information based on the detection result of the rain sensor 13. The acquisition unit 16a may acquire information indicating the current weather around the vehicle 10 by communicating with an external device of the vehicle 10. For example, the acquisition unit 16a may acquire information indicating a weather forecast from an external device, acquire information indicating the current position of the vehicle 10 based on information transmitted from a GPS (Global Positioning System) satellite, and acquire information indicating the current weather around the vehicle 10 by comparing these pieces of information. The acquisition unit 16a may also acquire information indicating the current weather around the vehicle 10 by performing image processing on an image obtained by the camera 12.

[0053] Furthermore, the acquisition unit 16a may acquire, for example, information indicating the current outside air temperature around the vehicle 10 as the environmental information. For example, the acquisition unit 16a can acquire, based on the detection result of the outside air temperature sensor 14, information indicating the current outside air temperature around the vehicle 10 as the environmental information.

[0054] After step S202, in step S203, the control unit 16b determines whether or not the current environment around the vehicle 10 is a specific environment based on the environment information.

[0055] The specific environment is, for example, a specific weather, a specific outside temperature, etc. For example, information indicating the specific environment is stored in advance in the storage unit 16c. Then, the control unit 16b can determine whether the current environment around the vehicle 10 is the specific environment by comparing the information indicating the specific environment with the environmental information acquired in step S202.

[0056] If it is determined that the current environment around the vehicle 10 is a specific environment (step S203 / YES), the process proceeds to step S204. On the other hand, if it is determined that the current environment around the vehicle 10 is not a specific environment (step S203 / NO), the control flow shown in FIG. 6 ends.

[0057] If the determination in step S203 is YES, in step S204, the control unit 16b executes the superimposition control, and the control flow shown in FIG. 6 ends.

[0058] For example, when the weather around the vehicle 10 is currently raining, the result of the determination in step S203 is YES. In this case, in step S204, the control unit 16b superimposes a virtual object 21 representing rain that moves relatively to the model 30 of the vehicle 10 on the surround view 20 in the superimposition control. In this case, the control unit 16b superimposes a plurality of virtual objects 21 representing rain on the surround view 20 so that these virtual objects 21 fall from the sky. For example, in the surround view 20, a plurality of virtual objects 21 representing rain fall in the air. Note that it is difficult for the driver to visually recognize actual raindrops reflected in the surround view 20. On the other hand, by superimposing a virtual object 21 representing large raindrops on the surround view 20, the driver can easily recognize that it is raining.

[0059] In the above, an example has been described in which, in the superimposition control, when the current weather around the vehicle 10 is rainy, the virtual object 21 representing rain is superimposed on the surround view 20. However, the control unit 16b may change the type of the virtual object 21 based on the environmental information. Note that the combination of the environmental information and the type of the virtual object 21 superimposed on the surround view 20 is not particularly limited, and may be a combination other than the examples given in this specification.

[0060] For example, when the current weather around the vehicle 10 is snowing, a determination of YES may be made in step S203, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing snow that moves relative to the model 30 of the vehicle 10 on the surround view 20. In this case, the behavior of the virtual object 21 in the surround view 20 may be, for example, similar to the example in FIG.

[0061] Also, for example, when the current outside air temperature around the vehicle 10 is lower than a reference temperature (for example, 0° C.), a determination of YES may be made in step S203, and the superimposition control may be executed. In this case, the control unit 16b may, for example, in the superimposition control, superimpose a virtual object 21 representing snow that moves relative to the model 30 of the vehicle 10 on the surround view 20. In this case, the behavior of the virtual object 21 in the surround view 20 may be, for example, similar to the example in FIG. 5.

[0062] Here, the control unit 16b may change the superimposition manner of the virtual object 21 based on environmental information.

[0063] For example, in the superimposition control executed when the weather around the current vehicle 10 is rainy, the control unit 16b may increase the moving speed of the virtual object 21 representing rain as the intensity of rain detected by the rain sensor 13 increases. Also, for example, in the superimposition control executed when the weather around the current vehicle 10 is rainy, the control unit 16b may increase the number of virtual objects 21 representing rain as the intensity of rain detected by the rain sensor 13 increases. Also, for example, in the superimposition control executed when the weather around the current vehicle 10 is rainy, the control unit 16b may increase the size of the virtual object 21 representing rain as the intensity of rain detected by the rain sensor 13 increases.

[0064] As described above, in the second example shown in Fig. 6, similar to the first example shown in Fig. 4, the control unit 16b executes superimposition control in display control for displaying the surround view 20, in which the virtual object 21 that moves relative to the model 30 of the vehicle 10 is superimposed on the surround view 20. This makes it possible to create added value by utilizing the surround view 20, similar to the first example shown in Fig. 4.

[0065] 6, the control unit 16b executes the superimposition control based on the environmental information. This allows the control unit 16b to appropriately execute the superimposition control according to the current surrounding environment of the vehicle 10, so that the surround view 20 can appropriately realize a more enjoyable driving experience for the driver.

[0066] As described above, the first example shown in Fig. 4 and the second example shown in Fig. 6 have been described as examples of processing performed by the processing device 16. However, the processing performed by the processing device 16 is not limited to the above processing examples, and may be, for example, a processing in which the above processing examples have been appropriately modified.

[0067] For example, the control unit 16b may execute the superimposition control based on both the date information and the environmental information. Also, for example, the control unit 16b may execute the superimposition control without using at least one of the date information and the environmental information.

[0068] Furthermore, for example, in the superimposition control, the control unit 16b may change the superimposition manner of the virtual object 21 based on behavior information of the vehicle 10. The behavior information of the vehicle 10 is information on the behavior of the vehicle 10, and may include, for example, information indicating the speed, acceleration, yaw rate, steering angle, etc. of the vehicle 10.

[0069] As described above, the acquisition unit 16a can acquire information indicating the speed of the vehicle 10 based on, for example, the detection result of the wheel speed sensor 15. Then, for example, in the superimposition control, the control unit 16b may increase the moving speed of the virtual object 21 as the speed of the vehicle 10 increases. Also, for example, in the superimposition control, the control unit 16b may change the moving direction of the virtual object 21 according to the speed of the vehicle 10. Also, for example, in the superimposition control, the control unit 16b may change the moving speed or moving direction of the virtual object 21 according to the acceleration of the vehicle 10.

[0070] <Effects of the treatment device> The effects of the processing device 16 according to the embodiment of the present invention will be described.

[0071] The processing device 16 includes a control unit 16b that executes display control to display a surround view 20, which is a composite image of the vehicle 10 as if seen from above from the outside. In the display control, the control unit 16b executes superimposition control to superimpose a virtual object 21 that moves relatively to a model 30 of the vehicle 10 on the surround view 20. This allows the driver to enjoy driving by looking at the virtual object 21 superimposed on the surround view 20. Therefore, the surround view 20 not only assists the driver in driving during parking, but also allows the driver to enjoy driving more. In this way, according to the present embodiment, it is possible to create added value by utilizing the surround view 20.

[0072] Preferably, in the processing device 16, the control unit 16b executes the superimposition control based on the date information. This allows the superimposition control to be executed appropriately according to the current date, so that the surround view 20 can be used to appropriately realize a more enjoyable driving experience for the driver.

[0073] Preferably, in the processing device 16, the control unit 16b changes whether or not to execute the superimposition control based on date information. This allows the control unit 16b to appropriately change whether or not to execute the superimposition control depending on the current date. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0074] Preferably, in the processing device 16, the control unit 16b changes the type of the virtual object 21 based on date information in the superimposition control. This makes it possible to change the type of the virtual object 21 superimposed on the surround view 20 in the superimposition control according to the current date. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0075] Preferably, in the processing device 16, the control unit 16b changes the overlay manner of the virtual object 21 based on date information in the overlay control. This makes it possible to change the overlay manner of the virtual object 21 overlaid on the surround view 20 in the overlay control according to the current date. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0076] Preferably, in the processing device 16, the control unit 16b executes the superimposition control based on the environmental information. This allows the superimposition control to be executed appropriately according to the current surrounding environment of the vehicle 10, so that the surround view 20 can appropriately realize a more enjoyable driving experience for the driver.

[0077] Preferably, in the processing device 16, the control unit 16b changes whether or not to execute the superimposition control based on the environmental information. This makes it possible to appropriately change whether or not to execute the superimposition control depending on the current surrounding environment of the vehicle 10. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0078] Preferably, in the processing device 16, the control unit 16b changes the type of the virtual object 21 based on the environmental information in the superimposition control. This makes it possible to change the type of the virtual object 21 superimposed on the surround view 20 in the superimposition control according to the current surrounding environment of the vehicle 10. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0079] Preferably, in the processing device 16, the control unit 16b changes the superimposition manner of the virtual object 21 based on the environmental information in the superimposition control. This makes it possible to change the superimposition manner of the virtual object 21 superimposed on the surround view 20 in the superimposition control according to the current surrounding environment of the vehicle 10. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0080] Preferably, in the processing device 16, the control unit 16b changes the superimposition manner of the virtual object 21 in the superimposition control based on behavior information of the vehicle 10. This makes it possible to change the superimposition manner of the virtual object 21 superimposed on the surround view 20 in the superimposition control according to the behavior of the vehicle 10. Therefore, the surround view 20 can more appropriately realize a more enjoyable driving experience for the driver.

[0081] The above describes a preferred embodiment of the present invention with reference to the attached drawings. However, it goes without saying that the present invention is not limited to the above-described embodiment, and various modified or altered examples within the scope of the claims also fall within the technical scope of the present invention.

[0082] For example, the processes described herein using flowcharts do not necessarily have to be performed in the order shown in the flowcharts, some process steps may be performed in parallel, additional process steps may be employed, and some process steps may be omitted.

[0083] Also, for example, the series of processes by the processing device 16 described above may be realized using any of software, hardware, and a combination of software and hardware. The programs constituting the software are stored in advance, for example, in a storage medium provided inside or outside the information processing device. [Explanation of symbols]

[0084] 10 Vehicles 11 Display device 12 Camera 13 Rain Sensor 14 Outside Air Temperature Sensor 15 Wheel speed sensor 16 Processing equipment 16a Acquisition part 16b Control section 16c storage section 20 Surround View 21 Virtual Objects 30 Models

Claims

1. A processing device (16) for a vehicle (10), comprising: a control unit (16b) that executes display control to display a surround view (20) that is a composite image of the vehicle (10) as if viewed from the outside; The control unit (16b) executes, in the display control, a superimposition control for superimposing a virtual object (21) moving relatively to a model (30) of the vehicle (10) on the surround view (20). Processing unit.

2. The control unit (16b) executes the superimposition control based on date information. The processing device of claim 1 .

3. The control unit (16b) changes whether or not the superimposition control is performed based on the date information. The processing device according to claim 2 .

4. The control unit (16b) changes the type of the virtual object (21) based on the date information in the superimposition control. The processing device according to claim 2 .

5. The control unit (16b) changes a superimposition manner of the virtual object (21) based on the date information in the superimposition control. The processing device according to claim 2 .

6. The control unit (16b) executes the superimposition control based on environmental information. The processing device of claim 1 .

7. The control unit (16b) changes whether or not to execute the superimposition control based on the environmental information. The processing device of claim 6.

8. The control unit (16b) changes the type of the virtual object (21) based on the environmental information in the superimposition control. The processing device of claim 6.

9. The control unit (16b) changes a superimposition manner of the virtual object (21) based on the environmental information in the superimposition control. The processing device of claim 6.

10. The control unit (16b) changes a superimposition manner of the virtual object (21) based on behavior information of the vehicle (10) in the superimposition control. The processing device according to any one of claims 1 to 9.

11. A method of treating a vehicle (10), comprising the steps of: A control unit (16b) of the processing device (16) executes display control to display a surround view (20) which is a composite image as if the vehicle (10) were viewed from the outside, The control unit (16b) executes, in the display control, a superimposition control for superimposing a virtual object (21) moving relatively to a model (30) of the vehicle (10) on the surround view (20). Processing methods.

Images