Processing apparatus and processing method

Abstract

According to the invention, the panorama is utilized to create the added value. A processing device for a vehicle is provided with a control unit that executes display control for displaying a panoramic view (20) that is a composite image in which the vehicle is overlooked from the outside, and the control unit executes superimposition control for superimposing a virtual object (21), which moves relative to a model (30) of the vehicle, on the panoramic view (20) during the display control.

Description

Technical Field

[0001] The invention relates to a processing device and a processing method. Background Art

[0002] In recent years, as disclosed in Patent Document 1, for example, a technology related to display control of a vehicle for assisting a driver in driving has been proposed.

[0003] Patent document 1: U.S. Patent Publication No. 2015 / 0097860.

[0004] In order to assist the driver in driving such as parking, display control that displays a surround view is sometimes used. The surround view is a composite image that looks like a vehicle from outside. For example, the driver can park smoothly as if looking from outside by performing driving operations while observing the surround view. Here, it is desired to create added value by utilizing the surround view. Summary of the invention

[0005] Therefore, in view of such a problem, an object of the present invention is to provide a processing device and a processing method that can create added value by utilizing the surroundings.

[0006] In order to solve the above-mentioned problem, the processing device is a processing device of the vehicle, and is equipped with a control unit. The control unit performs display control of displaying a surrounding scene, wherein the surrounding scene is a synthetic image as if the vehicle is viewed from the outside. During the display control, the control unit performs overlapping control of overlapping a virtual object that moves relative to a model of the vehicle with the surrounding scene.

[0007] In order to solve the above-mentioned problem, a processing method is a vehicle processing method, and a control unit of a processing device performs display control of displaying a surrounding scene, wherein the aforementioned surrounding scene is a synthetic image as if the vehicle is viewed from the outside. In the display control, the control unit performs overlapping control to overlap a virtual object that moves relative to a model of the vehicle with the surrounding scene.

[0008] Effects of the Invention

[0009] According to the present invention, it is possible to create added value by utilizing the surroundings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a schematic diagram showing a schematic structure of a vehicle according to an embodiment of the present invention.

[0011] Figure 2 This is a block diagram showing an example of the functional configuration of a processing device according to an embodiment of the present invention.

[0012] Figure 3 This is a diagram showing an example of a surrounding scene according to an embodiment of the present invention.

[0013] Figure 4 This is a flowchart showing a first example of the flow of processing related to overlap control performed by the processing device according to the embodiment of the present invention.

[0014] Figure 5 This is a diagram showing an example of a scene when superimposition control according to the embodiment of the present invention is executed.

[0015] Figure 6 This is a flowchart showing a second example of the flow of the process related to the overlap control performed by the processing device according to the embodiment of the present invention. DETAILED DESCRIPTION

[0016] Below, while referring to the attached Figure 1 The preferred embodiment of the present invention is described in detail. The dimensions, materials, and other specific numerical values ​​shown in the embodiment are merely examples for easy understanding of the invention, and are not used to limit the present invention unless otherwise specified. In addition, in this specification and the drawings, the same reference numerals are marked for elements that actually have the same function and structure, thereby omitting repeated descriptions, and the drawings are omitted for elements that are not directly related to the present invention.

[0017] <Vehicle structure>

[0018] Reference Figure 1 and Figure 2 , the structure of the vehicle 10 according to the embodiment of the present invention will be described.

[0019] Figure 1 Schematic diagram showing the schematic structure of the vehicle 10. Figure 1 As shown, the vehicle 10 includes a display device 11 , a plurality of cameras 12 , a rain sensor 13 , an outside air temperature sensor 14 , a plurality of wheel speed sensors 15 , and a processing device 16 .

[0020] The driving source of the vehicle 10 is not particularly limited. For example, the vehicle 10 may include only a motor as a driving source, only an engine as a driving source, or both a motor and an engine as driving sources.

[0021] The display device 11 is a device that visually displays various information. As the display device 11, a liquid crystal display or the like is given, for example.

[0022] The camera 12 captures images of the surroundings of the vehicle 10 . Figure 1In the example of FIG. 1 , four cameras 12 are respectively arranged at the front, rear, left side, and right side of the vehicle 10. The front camera 12 captures the front of the vehicle 10. The rear camera 12 captures the rear of the vehicle 10. The left camera 12 captures the left side of the vehicle 10. The right camera 12 captures the right side of the vehicle 10. In addition, the images obtained by the plurality of cameras 12 are used for displaying the surround view as described later. However, the number and arrangement of the cameras 12 are not limited to Figure 1 For example, the number of cameras 12 may also be greater than Figure 1 There are many examples.

[0023] The rain sensor 13 detects the presence or absence of rain around the vehicle 10. In addition, the rain sensor 13 may further detect the intensity of rain.

[0024] The outside air temperature sensor 14 detects the outside air temperature around the vehicle 10 .

[0025] The wheel speed sensor 15 is provided on each wheel to detect the wheel speed of each wheel.

[0026] The processing device 16 includes a central processing unit (CPU) as a computing processing device, a read-only memory (ROM) as a storage element for storing programs and computing parameters used by the CPU, and a random access memory (RAM) as a storage element for temporarily storing parameters that change appropriately during the execution of the CPU. The processing device 16 can be, for example, one or more. In addition, when the processing device 16 is divided into multiple devices, the various functions described below are shared by multiple devices, so for example, the functions of a part of the control unit 16b described later and the functions of another part can also be shared by separate devices.

[0027] Figure 2 1 is a block diagram showing an example of the functional structure of the processing device 16. Figure 2 As shown, the processing device 16 includes, for example, an acquisition unit 16a, a control unit 16b, and a storage unit 16c.

[0028] The acquisition unit 16a acquires information from each device in the vehicle 10. For example, the acquisition unit 16a acquires information from the camera 12, the rain sensor 13, the outside air temperature sensor 14, and the wheel speed sensor 15. In addition, in this specification, the acquisition of information may include extraction or generation (for example, calculation) of information. For example, the acquisition unit 16a can acquire information indicating the speed of the vehicle 10 based on the detection result of the wheel speed sensor 15. In addition, the acquisition unit 16a can also acquire information from an external device by wirelessly communicating with the device outside the vehicle 10.

[0029] The control unit 16b controls the operation of each device in the vehicle 10. In particular, the control unit 16b controls the display device 11 to perform various controls related to display.

[0030] The storage unit 16c stores various information. The information stored in the storage unit 16c is used in the processing performed by the control unit 16b.

[0031] <Operation of the processing device>

[0032] Reference Figure 3 to Figure 6 , the operation of the processing device 16 according to the embodiment of the present invention is described.

[0033] As described above, the control unit 16b of the processing device 16 performs various display-related controls by controlling the display device 11. Here, the control unit 16b performs display control of the display environment.

[0034] Figure 3 20 is a diagram showing an example of the surrounding scene 20. Figure 3 As shown, the surround 20 is a synthetic image of the vehicle 10 as viewed from outside. In other words, the surround 20 is a synthetic image that represents the model 30 of the vehicle 10 and its surroundings from a perspective that simulates overlooking the vehicle 10 from the outside. Specifically, the control unit 16b performs a synthesis process of splicing the images obtained by each camera 12, and processes the flat image into a bowl-shaped stereoscopic image in the virtual space. Furthermore, the control unit 16b generates an image representing the surroundings including the front, rear, left side, and right side of the vehicle 10 by setting the perspective in the virtual space to be toward the center of the stereoscopic image. In addition, the control unit 16b displays the model 30 such as the 3D model representing the vehicle 10 in the image generated in this way. Figure 3 In the example of , a 3D model is used as the model 30 representing the vehicle 10. In addition, the model 30 representing the vehicle 10 is stored in advance in the storage unit 16c, for example.

[0035] The surround 20 is mainly used for the purpose of assisting the driver in driving when parking. Therefore, the control unit 16b mainly performs display control when the vehicle 10 is parked. For example, when a specific operation is performed by the driver, the control unit 16b performs display control to display the surround 20 on the display device 11. As the above-mentioned specific operation, for example, an operation using a specific operating unit in the vehicle 10 (for example, an operation of pressing a button) or an operation of switching the gear to a position for reversing the vehicle 10 (for example, R gear) is cited. In addition, the driver can smoothly park by performing driving operations while observing the surround 20. For example, during the execution of the display control, the driver can change the viewing angle of the surround 20 (that is, the direction of overlooking the vehicle 10 in the surround 20). Therefore, the driver can park while switching the viewing angle of the surround 20 to a desired viewing angle.

[0036] In the present embodiment, the control unit 16b performs an overlapping control for overlapping the virtual object moving relative to the model 30 of the vehicle 10 with the surroundings 20 in the display control for displaying the surroundings 20. As a result, as described later, the purpose of creating added value by utilizing the surroundings 20 is achieved. The first and second examples are described in sequence as examples of the processing performed by the processing device 16 regarding the overlapping control.

[0037] Figure 4 This is a flowchart showing a first example of the flow of processing related to overlap control performed by the processing device 16 . Figure 4 Step S101 in Figure 4 The start of the control flow shown corresponds to . Figure 4 Step S105 in Figure 4 corresponds to the end of the control flow shown. Figure 4 The control flow shown is executed, for example, when display control of the display environment 20 is started.

[0038] like Figure 4 The control flow shown starts, and in step S102, the acquisition unit 16a acquires date information. The date information is information about the current date.

[0039] The acquisition unit 16a acquires information indicating the current date as date information. For example, the information indicating the current date is stored in the storage unit 16c, and the information is updated every day. Therefore, the acquisition unit 16a can acquire information indicating the current date from the storage unit 16c as date information.

[0040] Following step S102 , in step S103 , the control unit 16 b determines whether the current date is a specific date based on the date information.

[0041] The specific date is, for example, a date belonging to a specific season, a holiday, the driver's birthday, an anniversary, an event day, etc. For example, the storage unit 16c stores information indicating the specific date in advance. Furthermore, the control unit 16b can determine whether the current date is the specific date by comparing the information indicating the specific date with the date information obtained in step S102.

[0042] If it is determined that the current date is a specific date (step S103 / Yes), the process proceeds to step S104. On the other hand, if it is determined that the current date is not a specific date (step S103 / No), Figure 4 The control flow shown ends.

[0043] If the determination result in step S103 is YES, in step S104, the control unit 16b executes the overlap control. Figure 4 The control flow shown ends.

[0044] As described above, the superimposition control is a control for superimposing the surrounding scene 20 with a virtual object that moves relative to the model 30 of the vehicle 10. In the surrounding scene 20, the virtual object superimposed by the superimposition control moves even when the vehicle 10 stops, for example.

[0045] Figure 5 1 is a diagram showing an example of the surrounding scene 20 when the overlap control is executed. Figure 5 The example is an example in which, when the current date is a date belonging to winter, the determination in step S103 is yes and the overlap control is executed.

[0046] Figure 5 In the example of FIG. 1 , the control unit 16b causes the virtual object 21 representing snow, which is moving relative to the model 30 of the vehicle 10, to overlap with the surrounding scenery 20 during the overlapping control. In this case, the control unit 16b causes the virtual objects 21 representing snow to overlap with the surrounding scenery 20, for example, in such a manner that the virtual objects 21 representing snow fall from the sky. For example, in the surrounding scenery 20, the virtual objects 21 representing snow float in the air and fall precariously.

[0047] For example, the storage unit 16c stores a 3D model of a virtual object 21 representing snow in advance. The control unit 16b reads the 3D model from the storage unit 16c and overlaps the 3D model with the surroundings 20 as the virtual object 21 representing snow. In addition, for example, the storage unit 16c stores information indicating the behavior (e.g., trajectory, moving speed, etc.) of the virtual object 21 representing snow in advance. The control unit 16b controls the behavior of the virtual object 21 in the surroundings 20 based on the information.

[0048] In the above content, refer to Figure 5The example in which the virtual object 21 representing snow overlaps the surrounding scenery 20 in the overlapping control when the current date is a winter date has been described. However, the control unit 16b may change the type of the virtual object 21 based on the date information. In addition, the combination of the date information and the type of the virtual object 21 overlapped with the surrounding scenery 20 is not particularly limited, and may be a combination other than the examples given in this specification.

[0049] For example, if the current date is a date belonging to spring, it may be determined as yes in step S103 and the overlap control may be performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing the petals of cherry blossoms that moves relatively to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the control unit 16b overlaps the virtual objects 21 representing the petals of cherry blossoms with the surrounding scenery 20 in a manner such that the virtual objects 21 represent the petals of cherry blossoms, for example, fall from the sky. For example, in the surrounding scenery 20, the virtual objects 21 representing the petals of cherry blossoms float in the air and fall precariously.

[0050] For example, if the current date is a date in autumn, it may be determined as yes in step S103 and the overlap control may be performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing red leaves that moves relatively to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the control unit 16b overlaps the virtual objects 21 representing red leaves with the surrounding scenery 20 in a manner such that the virtual objects 21 fall from the sky. For example, in the surrounding scenery 20, the virtual objects 21 representing red leaves float in the air and fall precariously.

[0051] In addition, for example, if the current date is a date in summer, the determination in step S103 is yes, and the overlap control is performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing fireworks that moves relatively to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the control unit 16b overlaps the virtual objects 21 representing fireworks with the surrounding scenery 20 in a manner such that the virtual objects 21 bloom in the sky and then disappear.

[0052] In addition, for example, if the current date is Christmas, the judgment in step S103 is yes and the overlap control is performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing snow that moves relative to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the behavior of the virtual object 21 in the surrounding scenery 20 may be overlapped with the surrounding scenery 20. Figure 5 The same example.

[0053] In addition, for example, if the current date is a birthday, it may be determined as yes in step S103 and the overlap control may be performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing fireworks that moves relative to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the behavior of the virtual object 21 in the surrounding scenery 20 may be the same as when the current date is a summer date. In addition, if the current date is a birthday, the control unit 16b may, for example, overlap the virtual object 21 representing a balloon that floats and rises in the air with the surrounding scenery 20.

[0054] Here, the control unit 16 b may change the superimposition method of the virtual object 21 based on the date information.

[0055] For example, the control unit 16b may increase the moving speed of the virtual object 21 representing snow when the current date is in a period of particularly low temperature in winter, as compared to a case where the current date is in winter but not in a period of particularly low temperature, in the overlapping control executed when the current date is in winter. In addition, for example, the control unit 16b may increase the number of virtual objects 21 representing snow when the current date is in a period of particularly low temperature in winter, as compared to a case where the current date is in winter but not in a period of particularly low temperature, in the overlapping control executed when the current date is in winter.

[0056] As explained above, Figure 4 In the first example shown, the control unit 16b performs an overlapping control for overlapping the virtual object 21 that moves relative to the model 30 of the vehicle 10 with the surroundings 20 in the display control for displaying the surroundings 20. Thus, the driver can drive easily by observing the virtual object 21 overlapping with the surroundings 20. Therefore, the surroundings 20 can not only assist the driver in driving when parking, but also make the driver drive more easily. In this way, according to this embodiment, the purpose of creating added value by utilizing the surroundings 20 is achieved.

[0057] In particular, Figure 4 In the first example shown, the control unit 16 b performs the overlap control based on the date information. Thus, the overlap control can be appropriately performed according to the current date, so that the driver can drive more easily with the help of the surround view 20.

[0058] Figure 6 1 is a flowchart showing a second example of the flow of processing related to overlap control performed by the processing device 16 . Figure 6 Step S201 in Figure 6 The start of the control flow shown corresponds to . Figure 6 Step S205 in Figure 6 corresponds to the end of the control flow shown. Figure 6 The control flow shown is executed, for example, when display control of the display environment 20 is started.

[0059] like Figure 6 The control flow shown starts, and in step S202 , the acquisition unit 16 a acquires environmental information. The environmental information is information related to the environment around the current vehicle 10 .

[0060] The acquisition unit 16a may also acquire, for example, information indicating the current weather around the vehicle 10 as environmental information. For example, the acquisition unit 16a may acquire information indicating whether the weather is rainy as environmental information based on the detection result of the rain sensor 13. In addition, the acquisition unit 16a may also acquire information indicating the current weather around the vehicle 10 by communicating with a device outside the vehicle 10. For example, the acquisition unit 16a may also acquire information indicating a weather forecast from an external device, acquire information indicating the current position of the vehicle 10 based on information transmitted from a GPS (Global Positioning System) satellite, and acquire information indicating the current weather around the vehicle 10 by comparing the information. In addition, the acquisition unit 16a may also acquire information indicating the current weather around the vehicle 10 by performing image processing on the image obtained by the camera 12.

[0061] The acquisition unit 16a may acquire, for example, information indicating the current outside temperature around the vehicle 10 as environmental information. For example, the acquisition unit 16a may acquire information indicating the current outside temperature around the vehicle 10 as environmental information based on the detection result of the outside temperature sensor 14.

[0062] Following step S202 , in step S203 , the control unit 16 b determines whether the current environment around the vehicle 10 is a specific environment based on the environmental information.

[0063] The specific environment is, for example, specific weather, specific outside temperature, etc. For example, the storage unit 16c stores information indicating the specific environment in advance. Furthermore, the control unit 16b can determine whether the current environment around the vehicle 10 is the specific environment by comparing the information indicating the specific environment with the environmental information obtained in step S202.

[0064] If it is determined that the current environment around the vehicle 10 is a specific environment (step S203 / Yes), the process proceeds to step S204. On the other hand, if it is determined that the current environment around the vehicle 10 is not a specific environment (step S203 / No), Figure 6 The control flow shown ends.

[0065] If the determination result in step S203 is YES, in step S204, the control unit 16b executes the overlap control. Figure 6 The control flow shown ends.

[0066] For example, when the current weather around the vehicle 10 is rainy, the judgment in step S203 is yes. In this case, in step S204, the control unit 16b overlaps the virtual object 21 representing rainwater that moves relatively to the model 30 of the vehicle 10 with the surrounding scenery 20 in the overlap control. In this case, the control unit 16b overlaps the surrounding scenery 20 with a plurality of virtual objects 21 representing rainwater, for example, in such a manner that the virtual objects 21 fall from the sky. For example, in the surrounding scenery 20, a plurality of virtual objects 21 representing rainwater fall from the sky. In addition, it is difficult for the driver to observe the real raindrops reflected in the surrounding scenery 20. On the other hand, by overlapping the virtual object 21 representing large drops of rainwater with the surrounding scenery 20, the driver can easily realize that it is raining.

[0067] In the above description, an example is described in which a virtual object 21 representing rain is overlapped with the surrounding scenery 20 in the overlap control when the current weather around the vehicle 10 is rainy. However, the control unit 16b may change the type of the virtual object 21 based on the environmental information. In addition, the combination of the environmental information and the type of the virtual object 21 overlapped with the surrounding scenery 20 is not particularly limited, and may be a combination other than the examples listed in this specification.

[0068] For example, if the current weather around the vehicle 10 is snow, the judgment in step S203 is yes and the overlap control is performed. In this case, the control unit 16b may, for example, overlap the virtual object 21 representing snow that moves relative to the model 30 of the vehicle 10 with the surrounding scenery 20 during the overlap control. In this case, the behavior of the virtual object 21 in the surrounding scenery 20 may also overlap, for example, Figure 5 The same example.

[0069] In addition, for example, when the current outside temperature around the vehicle 10 is lower than the reference temperature (for example, 0° C.), the determination in step S203 is yes and the overlap control is performed. In this case, the control unit 16 b may, for example, overlap the virtual object 21 representing snow that moves relative to the model 30 of the vehicle 10 with the surrounding scene 20 during the overlap control. In this case, the behavior of the virtual object 21 in the surrounding scene 20 may, for example, overlap with the surrounding scene 20. Figure 5 The same example.

[0070] Here, the control unit 16 b may change the superimposition method of the virtual object 21 based on the environmental information.

[0071] For example, the control unit 16b may also increase the moving speed of the virtual object 21 representing rainwater as the intensity of rainwater detected by the rain sensor 13 is stronger, during the overlap control performed when the current weather around the vehicle 10 is raining. Also, for example, the control unit 16b may also increase the number of virtual objects 21 representing rainwater as the intensity of rainwater detected by the rain sensor 13 is stronger, during the overlap control performed when the current weather around the vehicle 10 is raining. Also, for example, the control unit 16b may also increase the size of the virtual object 21 representing rainwater as the intensity of rainwater detected by the rain sensor 13 is stronger, during the overlap control performed when the current weather around the vehicle 10 is raining.

[0072] As explained above, Figure 6 In the second example shown, Figure 4 As in the first example shown, the control unit 16b performs a superimposition control to superimpose the virtual object 21 moving relative to the model 30 of the vehicle 10 on the surroundings 20 during the display control of displaying the surroundings 20. Figure 4 The same as the first example shown, the purpose of creating added value by utilizing the environment 20 is achieved.

[0073] In particular, Figure 6 In the second example shown, the control unit 16 b performs overlap control based on the environmental information. This allows the overlap control to be appropriately performed in accordance with the current environment around the vehicle 10 , thereby appropriately achieving an effect in which the driver can drive more easily with the help of the surroundings 20 .

[0074] The above is an example of processing performed by the processing device 16. Figure 4 The first example shown and Figure 6 However, the processing performed by the processing device 16 is not limited to the above-mentioned processing example, and for example, the processing may be appropriately modified with respect to the above-mentioned processing example.

[0075] For example, the control unit 16b may perform the superimposition control based on both the date information and the environmental information. In addition, for example, the control unit 16b may perform the superimposition control without using at least one of the date information and the environmental information.

[0076] In addition, for example, the control unit 16b may change the superimposition method of the virtual object 21 during the superimposition control based on the behavior information of the vehicle 10. The behavior information of the vehicle 10 is information about the behavior of the vehicle 10, and may include information indicating the speed, acceleration, yaw rate, steering angle, etc. of the vehicle 10.

[0077] As described above, the acquisition unit 16a can acquire information indicating the speed of the vehicle 10 based on the detection result of the wheel speed sensor 15, for example. Furthermore, the control unit 16b can also, for example, in the overlap control, make the moving speed of the virtual object 21 faster as the speed of the vehicle 10 is higher. Furthermore, the control unit 16b can also, for example, in the overlap control, change the moving direction of the virtual object 21 in accordance with the speed of the vehicle 10. Furthermore, the control unit 16b can also, for example, in the overlap control, change the moving speed or moving direction of the virtual object 21 in accordance with the acceleration of the vehicle 10.

[0078] <Effects of treatment equipment>

[0079] The effects of the processing device 16 according to the embodiment of the present invention will be described.

[0080] The processing device 16 includes a control unit 16b, and the control unit 16b performs display control for displaying an environment 20 that is a synthetic image that looks down on the vehicle 10 from the outside. In addition, the control unit 16b performs overlapping control for overlapping the environment 20 with a virtual object 21 that moves relative to the model 30 of the vehicle 10 during display control. As a result, the driver can drive easily by observing the virtual object 21 overlapping the environment 20. Therefore, the driver can not only be assisted in driving when parking, etc., but also can drive more easily with the help of the environment 20. In this way, according to this embodiment, the purpose of creating added value by utilizing the environment 20 is achieved.

[0081] Preferably, in the processing device 16, the control unit 16b performs the overlap control based on the date information. Thus, the overlap control can be appropriately performed according to the current date, so that the driver can drive more easily with the help of the surround view 20.

[0082] Preferably, in the processing device 16, the control unit 16b changes whether the overlapping control is executed based on the date information. Thus, whether the overlapping control is executed can be appropriately changed according to the current date. Therefore, the effect of the driver driving more easily with the help of the surround view 20 can be more appropriately achieved.

[0083] Preferably, in the processing device 16, the control unit 16b changes the type of the virtual object 21 based on the date information during the overlap control. Thus, the type of the virtual object 21 overlapped with the surrounding scenery 20 during the overlap control can be changed according to the current date. Therefore, the effect of making the driver drive more easily with the surrounding scenery 20 can be more appropriately achieved.

[0084] Preferably, in the processing device 16, the control unit 16b changes the overlapping manner of the virtual object 21 based on the date information during the overlapping control. Thus, the overlapping manner of the virtual object 21 overlapping with the surrounding scenery 20 during the overlapping control can be changed in accordance with the current date. Therefore, the effect of making the driver drive more easily with the help of the surrounding scenery 20 can be more appropriately achieved.

[0085] Preferably, in the processing device 16 , the control unit 16 b performs the overlap control based on the environmental information. Thus, the overlap control can be appropriately performed in accordance with the current environment around the vehicle 10 , so that the driver can drive more easily with the help of the surroundings 20 .

[0086] Preferably, in the processing device 16, the control unit 16b changes whether the overlap control is executed based on the environmental information. Thus, it is possible to appropriately change whether the overlap control is executed in accordance with the current environment around the vehicle 10. Therefore, the effect of the driver driving more easily with the help of the surrounding view 20 is more appropriately achieved.

[0087] Preferably, in the processing device 16, the control unit 16b changes the type of the virtual object 21 based on the environmental information during the overlap control. Thus, the type of the virtual object 21 overlapped with the surrounding scene 20 can be changed during the overlap control in accordance with the current environment around the vehicle 10. Therefore, the effect of making the driver drive more easily with the help of the surrounding scene 20 can be more appropriately achieved.

[0088] Preferably, in the processing device 16, the control unit 16b changes the overlapping manner of the virtual object 21 based on the environmental information during the overlapping control. Thus, the overlapping manner of the virtual object 21 overlapping with the surrounding scenery 20 can be changed during the overlapping control in accordance with the current environment around the vehicle 10. Therefore, the effect of making the driver drive more easily with the help of the surrounding scenery 20 can be more appropriately achieved.

[0089] Preferably, in the processing device 16, the control unit 16b changes the overlapping manner of the virtual object 21 based on the behavior information of the vehicle 10 during the overlapping control. Thus, the overlapping manner of the virtual object 21 overlapping with the surrounding scenery 20 can be changed during the overlapping control in accordance with the behavior of the vehicle 10. Therefore, the effect of making the driver drive more easily with the help of the surrounding scenery 20 can be more appropriately achieved.

[0090] The above, while referring to the attached Figure 1 Although the preferred embodiments of the present invention have been described, the present invention is not limited to the above embodiments, and various changes and modifications within the scope of the claims are also within the technical scope of the present invention.

[0091] For example, the processing described in the flowcharts in this specification may not necessarily be performed in the order shown in the flowcharts. Some processing steps may also be performed in parallel. In addition, additional processing steps may be adopted, and some processing steps may be omitted.

[0092] Furthermore, for example, the series of processes of the processing device 16 described above may be implemented by software, hardware, or a combination of software and hardware. The program constituting the software is stored in advance in a storage medium provided inside or outside the information processing device, for example.

[0093] Description of Reference Numerals

[0094] 10 Vehicles

[0095] 11 Display device

[0096] 12 Camera

[0097] 13 Rain Sensor

[0098] 14 External air temperature sensor

[0099] 15 Wheel speed sensor

[0100] 16 Processing device

[0101] 16a Acquisition

[0102] 16b Control Unit

[0103] 16c Storage

[0104] 20 Panorama

[0105] 21 Virtual Objects

[0106] 30 models.

Claims

1. A processing device (16), which is a processing device (16) of a vehicle (10), A control unit (16b) is provided, wherein the control unit (16b) performs display control for displaying a surrounding scene (20), wherein the surrounding scene (20) is a composite image in which the vehicle (10) is viewed from outside. The control unit (16b) performs overlapping control in the display control, wherein the overlapping control causes a virtual object (21) that moves relative to a model (30) of the vehicle (10) to overlap with the surrounding scenery (20).

2. The processing device according to claim 1, characterized in that The control unit (16b) performs the overlapping control based on date information.

3. The processing device according to claim 2, characterized in that The control unit (16b) changes whether the overlap control is to be executed based on the date information.

4. The processing device according to claim 2, characterized in that The control unit (16b) changes the type of the virtual object (21) based on the date information during the superimposition control.

5. The processing device according to claim 2, characterized in that The control unit (16b) changes the superimposition method of the virtual object (21) based on the date information in the superimposition control.

6. The processing device according to claim 1, characterized in that The control unit (16b) performs the overlapping control based on the environmental information.

7. The processing device according to claim 6, characterized in that The control unit (16b) changes whether the overlap control is to be executed based on the environmental information.

8. The processing device according to claim 6, characterized in that The control unit (16b) changes the type of the virtual object (21) based on the environmental information during the superposition control.

9. The processing device according to claim 6, characterized in that The control unit (16b) changes the superimposition method of the virtual object (21) based on the environmental information during the superimposition control.

10. The processing device according to any one of claims 1 to 9, characterized in that The control unit (16b) changes the superimposition mode of the virtual object (21) based on the behavior information of the vehicle (10) during the superimposition control.

11. A method of treating a vehicle (10), A control unit (16b) of a processing device (16) performs display control for displaying a surrounding scene (20), wherein the surrounding scene (20) is a composite image in which the vehicle (10) is viewed from outside. The control unit (16b) performs overlapping control in the display control, wherein the overlapping control causes a virtual object (21) that moves relative to a model (30) of the vehicle (10) to overlap with the surrounding scenery (20).

Images