Information processing device and information processing method

Abstract

The information processing device and the information processing method according to the present invention perform control on a display unit having a display region in which a surrounding area of a vehicle is displayed perspectively so as to be visible from a driver's seat of the vehicle. On the basis of information of objects situated around the vehicle, whether or not there is an object within a prescribed distance range from the vehicle or from a pathway on which the vehicle is about to travel is determined, and in the case when it is determined that there exists an object within the range, a change is made to part or all of an image to be superimposed and displayed in the display region, whereby the proportion of the surrounding area to be displayed perspectively in the display region is increased.

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] A head-up display device is known that displays an AR (Augmented Reality) guide in a display area visible through the windshield from the driver's seat of a vehicle, overlaying the AR guide on the real world and allowing the user to more easily recognize important information while driving (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2018 / 070193 Summary of the Invention [Problem to be solved by the invention]

[0004] According to the invention described in Patent Document 1, the AR guide is superimposed on the real world, and as a result, the user's attention to the real world may be reduced by the AR guide. As a result, there is a problem that the vehicle user may be late in noticing changes in the driving environment in the real world.

[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an information processing device and an information processing method that prevent a user's attention to the real world from being reduced by AR guides, and enables a vehicle user to easily notice changes in the driving environment in the real world. [Means for solving the problem]

[0006] According to an aspect of the present invention, an information processing device and an information processing method control a display unit having a display area that allows the surroundings of the vehicle to be seen through so as to be visible from the driver's seat of the vehicle. Based on information about objects located around the vehicle, it is determined whether or not an object is present within a predetermined distance from the vehicle or a route along which the vehicle is scheduled to travel, and when it is determined that an object is present within the range, a part or the whole of an image displayed and superimposed on the display area is changed to increase the proportion of the display area that allows the surroundings to be seen through. Effect of the Invention

[0007] According to the present invention, the AR guide is prevented from distracting the user's attention from the real world, and the vehicle user can easily notice changes in the driving environment in the real world. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the configuration of an information processing device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a flowchart showing the processing of the information processing device according to one embodiment of the present invention. [Figure 3A] FIG. 3A is a diagram illustrating a first example of a display of the AR guide. [Figure 3B] FIG. 3B is a diagram showing a second example of the display of the AR guide. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0010] [Configuration of information processing device] An example of the configuration of an information processing device according to this embodiment will be described with reference to Fig. 1. As an example, the information processing device is mounted on a vehicle. As shown in Fig. 1, the information processing device includes an acquisition unit 25, a display unit 21, and a controller 100.

[0011] The acquisition unit 25 is connected to the controller 100, and acquires information on objects located around the vehicle (object information) and information on a route along which the vehicle is scheduled to travel (route information).

[0012] More specifically, the acquisition unit 25 is connected to a plurality of object detection sensors mounted on the vehicle, such as a laser radar, a millimeter wave radar, and a camera, that detect objects around the vehicle. The object detection sensors detect moving objects including other vehicles, motorcycles, bicycles, and pedestrians, and stationary objects including parked vehicles, as objects around the vehicle. For example, the object detection sensors detect the positions, attitudes (yaw angles), sizes, speeds, accelerations, decelerations, and yaw rates of moving and stationary objects relative to the vehicle. The acquisition unit 25 acquires information about moving and stationary objects detected by the object detection sensors as object information.

[0013] The acquisition unit 25 is connected to a navigation device (not shown) and acquires, for example, information on a guide route to the destination of the vehicle as route information. The acquisition unit 25 may also acquire information such as a road map, the current position of the vehicle, and points of interest (POIs) that are points of interest to the user and are located between the vehicle and the destination.

[0014] Alternatively, the acquisition unit 25 may acquire a captured image obtained by capturing an image of the surroundings of the vehicle.

[0015] The acquisition unit 25 may include a storage unit that stores the acquired object information and route information.

[0016] The display unit 21 is connected to the controller 100 and has a display area 23 that allows the surroundings of the vehicle to be seen through so that the surroundings can be seen from the driver's seat of the vehicle. The AR guide (image) generated by the controller 100 is displayed in the display area 23. Therefore, the AR guide is displayed in the display area 23 superimposed on the scenery around the vehicle.

[0017] For example, the display unit 21 may be a head-up display device, a head-mounted display, smart glasses, or a prompter.

[0018] The display area 23 may be the windshield of the vehicle, and the AR guide may be presented to the user by projecting the AR guide from a projector (not shown) onto the display area 23. As a result, the user visually recognizes the AR guide superimposed on the scenery around the vehicle seen through the windshield.

[0019] The AR guide presented by the display unit 21 represents, for example, a guidance route to the vehicle's destination, a road map, the vehicle's current position, and Points of Interest (POIs) that are places of interest to the user scattered between the vehicle and the destination.

[0020] The display unit 21 may display the AR guide by superimposing it on the captured image acquired by the acquisition unit 25. In this case, the display area 23 may be a display capable of displaying the captured image and the AR guide, instead of allowing the surroundings of the vehicle to be seen through so as to be visible from the driver's seat of the vehicle.

[0021] The controller 100 is a general-purpose computer including a CPU (Central Processing Unit), a memory, a storage device, an input / output unit, etc. The controller 100 is connected to a navigation device (not shown). For example, the navigation device executes route guidance for a vehicle.

[0022] The controller 100 (control unit) is a general-purpose microcomputer equipped with a CPU (Central Processing Unit), a memory, and an input / output unit. A computer program for functioning as an information processing device is installed in the controller 100. By executing the computer program, the controller 100 functions as a plurality of information processing circuits (110, 120, 130, 140) included in the information processing device. The computer program may be stored in a recording medium that can be read and written by a computer.

[0023] In this embodiment, an example is shown in which multiple information processing circuits (110, 120, 130, 140) are realized by software. However, it is also possible to configure the information processing circuits (110, 120, 130, 140) by preparing dedicated hardware for executing each information process described below. Also, the multiple information processing circuits (110, 120, 130, 140) may be configured by individual hardware. Furthermore, the information processing circuits (110, 120, 130, 140) may also be used as a navigation device or a control unit used for controlling the vehicle.

[0024] As shown in FIG. 1, the controller 100 includes an object extraction unit 110, a determination unit 120, an image generation unit 130, and an output unit 140 as a plurality of information processing circuits (110, 120, 130, 140).

[0025] The object extraction unit 110 extracts objects that may interfere with the running of the vehicle based on the object information and the route information. For example, the object extraction unit 110 extracts objects that exist within a predetermined distance from the vehicle or within a predetermined distance from the route along which the vehicle is scheduled to run. Here, the predetermined distance is set in advance.

[0026] In addition, different predetermined distances may be set depending on the type of object. For example, the predetermined distance set for an object moving at a high speed may be set longer than the predetermined distance set for an object moving at a low speed. The predetermined distance set for extracting other vehicles, motorcycles, and bicycles may be set longer than the predetermined distance set for extracting pedestrians and parked vehicles.

[0027] Alternatively, the object extraction unit 110 may extract an object that is located within a predetermined distance from the vehicle or within a predetermined distance from the route along which the vehicle is planned to travel, and that is located ahead of the vehicle in the direction of travel.

[0028] The object extraction unit 110 may extract objects located within a range visible from the driver's seat of the vehicle via the display area 23.

[0029] The determination unit 120 determines whether or not an object extracted by the object extraction unit 110 interferes with the traveling of the vehicle based on the object information and the route information.

[0030] For example, the determination unit 120 may determine whether an object is approaching the vehicle or a route along which the vehicle is scheduled to travel, and if it is determined that the object is approaching the vehicle or the route, determine that the object will interfere with the travel of the vehicle.

[0031] The determination unit 120 may predict a distance between the object and the vehicle after a unit time has elapsed based on the object information and the route information, and may determine that the object approaches the vehicle when the distance between the object and the vehicle after a unit time has elapsed is smaller than the current distance between the object and the vehicle.

[0032] The determination unit 120 may predict the distance between the object and the route along which the vehicle is scheduled to travel after a unit time has elapsed based on the object information and the route information. The determination unit 120 may determine that the object approaches the route along which the vehicle is scheduled to travel when the distance between the object and the route after a unit time has elapsed is smaller than the current distance between the object and the route.

[0033] In addition, the determination unit 120 may determine whether an object is occluded by the AR guide displayed in the display area 23 when viewed from the driver's seat, and if it is determined that the object is occluded by the AR guide, determine that the object will interfere with the traveling of the vehicle.

[0034] Furthermore, the determination unit 120 may determine whether or not the distance between the image of the object visually recognized in the display area 23 as viewed from the driver's seat and the AR guide (the distance on the display area 23) is equal to or less than a predetermined distance. The determination unit 120 may determine that the object interferes with the traveling of the vehicle when the distance between the image of the object and the AR guide is equal to or less than the predetermined distance.

[0035] The predetermined distance may be set based on the size of the image of the object in the display area 23 and the size of the AR guide. For example, the predetermined distance may be set larger when the size of the image of the object is small than the predetermined distance set when the size of the image of the object is large. Also, the predetermined distance may be set larger when the ratio of the size of the image of the object to the size of the AR guide is small than the predetermined distance set when the ratio of the size of the image of the object to the size of the AR guide is large.

[0036] The determination unit 120 may also calculate a collision time between the object and the vehicle based on the object information and the route information, and determine whether the collision time is equal to or shorter than a predetermined time. The determination unit 120 may also determine that the object interferes with the traveling of the vehicle when it is determined that the collision time is equal to or shorter than the predetermined time. Here, the collision time between the object and the vehicle is calculated from the moving speed and moving direction of the object, and the moving speed and moving direction of the vehicle.

[0037] Furthermore, the determination unit 120 may determine whether the vehicle speed is equal to or greater than a predetermined speed, and if it is determined that the vehicle speed is equal to or greater than the predetermined speed, determine that an object is interfering with the vehicle's travel.

[0038] In addition, the judgment unit 120 may determine whether the speed of the object is equal to or greater than a predetermined speed based on the object information, and if it is determined that the speed of the object is equal to or greater than the predetermined speed, determine that the object will interfere with the traveling of the vehicle.

[0039] The image generation unit 130 generates an AR guide based on the route information. For example, the image generation unit 130 generates an AR guide that is superimposed on an image of the route along which the vehicle is scheduled to travel, which is visually recognized in the display area 23 as seen from the driver's seat.

[0040] 3A and 3B show examples of AR guides generated so as to be superimposed on an image of a route along which the vehicle is scheduled to travel. Fig. 3A is a diagram showing a first example of the display of the AR guide. Fig. 3B is a diagram showing a second example of the display of the AR guide. In Figs. 3A and 3B, it is assumed that the vehicle is scheduled to make a left turn at an intersection located ahead of the lane along which the vehicle is scheduled to travel.

[0041] 3A shows a state in which the AR guides AR1 to AR7 are displayed in the display area 23 along an image TL of a route along which the vehicle is scheduled to travel. Therefore, the user can recognize the route along which the vehicle is scheduled to travel along the AR guides AR1 to AR7.

[0042] 3B shows a state in which AR guides AR1 to AR5 are displayed in the display area 23 along an image TL of a route along which the vehicle is scheduled to travel. Unlike FIG. 3A, AR guides AR6 and AR7 are not shown due to the presence of another vehicle VC.

[0043] When the other vehicle VC becomes visible through the display area 23, the image generating unit 130 changes the AR guide from the state in FIG. 3A to the state in FIG. 3B.

[0044] That is, when an object extracted by the object extraction unit 110 exists, the image generation unit 130 changes a part or the whole of the AR guide to increase the percentage of the display area 23 through which the surroundings of the vehicle are visible. In addition, when the determination unit 120 determines that an object interfering with the traveling of the vehicle exists, the image generation unit 130 may change a part or the whole of the AR guide to increase the percentage of the display area 23 through which the surroundings of the vehicle are visible.

[0045] Furthermore, the image generating unit 130 may increase the transmittance of the display area 23 to the surroundings of the vehicle by increasing the transmittance of a part or the whole of the AR guide. Furthermore, the image generating unit 130 may increase the transmittance of the display area 23 to the surroundings of the vehicle by setting the transmittance of a part or the whole of the AR guide to 100%. According to Figs. 3A and 3B, the other vehicle VC shown in Fig. 3B may be made visible by increasing the transmittance of the AR guides AR6 and AR guides AR7.

[0046] The image generating unit 130 may increase the percentage of the display area 23 through which the surroundings of the vehicle are visible by reducing the size of the AR guide in part or in its entirety. As shown in Fig. 3A and Fig. 3B, the size (e.g., height or width) of the AR guides AR1 to AR7 in part or in its entirety after the size change (Fig. 3B) is reduced compared to the state before the size change (Fig. 3A). This makes it easier to view the other vehicle VC shown in Fig. 3B.

[0047] Furthermore, the image generating unit 130 may increase the percentage of the display area 23 that transmits the surroundings of the vehicle by reducing the width of the AR guide that indicates the route along which the vehicle is scheduled to travel along the road width direction along which the vehicle travels. According to Fig. 3A and Fig. 3B, the width W2 of the AR guide along the road width direction after the size is changed (Fig. 3B) is smaller than the width W1 of the AR guide along the road width direction before the size is changed (Fig. 3A). This makes it easier to see the other vehicle VC shown in Fig. 3B.

[0048] In addition, the image generation unit 130 may increase the proportion of the display area 23 that is transparent to the surroundings of the vehicle by reducing the length of the AR guide that indicates the route along which the vehicle is planned to travel, along the direction in which the vehicle is traveling.

[0049] 3A and 3B, the height H2 of the AR guide in the direction in which the vehicle travels after the size is changed (FIG. 3B) is smaller than the height H1 of the AR guide in the direction in which the vehicle travels before the size is changed (FIG. 3A). This makes it easier to see the other vehicle VC shown in FIG. 3B.

[0050] In addition, compared to the overall length of the AR guides along the direction in which the vehicle travels in the state of Fig. 3A (the length from AR guide AR1 to AR guide AR5), the overall length of the AR guides along the direction in which the vehicle travels in the state of Fig. 3B (the length from AR guide AR1 to AR guide AR5) is smaller, making it easier to see the other vehicle VC shown in Fig. 3B.

[0051] Furthermore, the image generating unit 130 may increase the percentage of the display area 23 that transmits the surroundings of the vehicle by making the color of a part or the whole of the AR guide closer to the color of the surroundings of the vehicle. For example, the image generating unit 130 may acquire the color of the surroundings of the vehicle based on a captured image.

[0052] 3A and 3B, the other vehicle VC shown in Fig. 3B may be made visible by making the colors of the AR guides AR1 to AR7 closer to the color of the surrounding vehicle that serves as the background in the display area 23. Also, the colors of the AR guides AR6 and AR guides AR7 in Fig. 3A may be made closer to the color of the other vehicle VC in Fig. 3B.

[0053] By making the color of a part or the whole of the AR guide closer to the color of the surroundings of the vehicle, the AR guide becomes less noticeable in the display area 23, and objects visible through the display area 23 become more noticeable in comparison. As a result, according to FIG. 3B, the other vehicle VC becomes easily visible.

[0054] In addition, "bringing the colors closer" means, for example, in an RGB color model (a model that expresses colors using the three primary colors of red, green, and blue), bringing the RGB values ​​of the AR guide closer to the RGB values ​​of the image around the vehicle reflected in the display area 23.

[0055] Alternatively, the image generation unit 130 may change a part or the whole of the AR guide to reduce the percentage of the display area 23 that transmits the surroundings of the vehicle when there is no object extracted by the object extraction unit 110. Also, the image generation unit 130 may change a part or the whole of the AR guide to reduce the percentage of the display area 23 that transmits the surroundings of the vehicle when there is no object that interferes with the traveling of the vehicle according to the determination unit 120.

[0056] 3A and 3B, when the other vehicle VC has driven away and is no longer visible through the display area 23, the AR guide may be changed from the state of Fig. 3B to the state of Fig. 3A, thereby reducing the percentage of the surroundings of the vehicle that are transparent through the display area 23. This makes the AR guide easily visible.

[0057] The output unit 140 outputs the AR guide generated and changed by the image generation unit 130. The output AR guide is displayed in the display area 23.

[0058] [Processing procedure of information processing device] Next, a processing procedure of the information processing device according to this embodiment will be described with reference to the flowchart of Fig. 2. The processing of the information processing device shown in Fig. 2 may be started based on a user's instruction, or may be repeatedly executed at a predetermined cycle.

[0059] First, in step S101, the acquisition unit 25 acquires object information and route information. The acquired object information and route information are transmitted to the controller 100.

[0060] In step S103, the image generation unit 130 generates an AR guide based on the route information.

[0061] In step S105, the object extraction unit 110 extracts an object that may interfere with the traveling of the vehicle based on the object information and the route information. Then, the determination unit 120 determines whether or not the object extracted by the object extraction unit 110 interferes with the traveling of the vehicle based on the object information and the route information.

[0062] If it is determined that the object interferes with the traveling of the vehicle (YES in step S107), the image generation unit 130 changes the AR guide in step S109. More specifically, the image generation unit 130 changes a part or the whole of the AR guide to increase the proportion of the display area 23 that transmits the surroundings of the vehicle. Then, the process proceeds to step S111.

[0063] On the other hand, if it is determined that the object does not interfere with the traveling of the vehicle (NO in step S107), the process proceeds to step S111.

[0064] In step S111, the output unit 140 outputs the AR guide generated and changed by the image generation unit 130. The output AR guide is displayed in the display area 23.

[0065] [Effects of the embodiment] As described above in detail, the information processing device and the information processing method according to the present embodiment control a display unit having a display area that transmits the surroundings of the vehicle so that the surroundings can be seen from the driver's seat of the vehicle. Based on information about objects located around the vehicle, it is determined whether or not an object is present within a predetermined distance from the vehicle or a route along which the vehicle is scheduled to travel, and when it is determined that an object is present within the range, a part or the whole of an image (AR guide) displayed superimposed on the display area is changed to increase the proportion of the display area that transmits the surroundings.

[0066] This prevents the AR guide from distracting the user from the real world, and allows the vehicle user to easily notice changes in the driving environment in the real world. In addition, the AR guide reduces the possibility of objects around the vehicle being occluded, making it easier for the user to notice the objects and changes in the behavior of the objects. As a result, the user can perform faster driving operations in response to changes in the behavior of the objects.

[0067] Therefore, the user can receive driving assistance from the system by displaying the AR guide, while at the same time driving the vehicle without reducing attention to objects located around the vehicle.

[0068] In addition, the information processing device and the information processing method according to the present embodiment may increase the transmittance of a part or the whole of an image to increase the rate at which the display area transmits the surroundings. This reduces the possibility that an object located around the vehicle is blocked by the AR guide, making it easier for the user to notice the object or a change in the behavior of the object. By controlling the transmittance of the image, the user can direct his / her attention to the object located around the vehicle while checking the displayed AR guide.

[0069] Furthermore, the information processing device and the information processing method according to the present embodiment may increase the rate at which the display area transmits the surroundings by setting the transmittance to 100%. This prevents objects around the vehicle from being blocked by the AR guide, making it easier for the user to notice the objects and changes in the behavior of the objects. In addition, the user can focus their attention on objects around the vehicle.

[0070] In addition, the information processing device and the information processing method according to the present embodiment may increase the rate at which the display area transmits the surroundings by reducing the size of a part or the entire image, thereby preventing objects located around the vehicle from being blocked by the AR guide.

[0071] Furthermore, the information processing device and the information processing method according to the present embodiment may increase the percentage of the display area that is transparent to the surroundings by reducing the width of the image showing the route along the width direction of the road on which the vehicle is traveling. This makes it easier for the user to notice objects located on the side of the road on which the vehicle is traveling and changes in the behavior of the objects. In particular, the user can easily notice objects that jump out from the side of the road on which the vehicle is traveling. As a result, the user can perform faster driving operations in response to objects that jump out from the side of the road.

[0072] In addition, the information processing device and the information processing method according to the present embodiment may increase the percentage of the display area that is transparent to the surroundings by reducing the length of the image showing the route along the direction in which the vehicle travels. This makes it easier for the user to notice objects located ahead of the vehicle along the direction in which the vehicle travels and changes in the behavior of the objects. As a result, the user can perform faster driving operations in response to objects located ahead of the vehicle.

[0073] Furthermore, the information processing device and the information processing method according to the present embodiment may increase the percentage of the display area that transmits the surroundings by making the color of a part or the whole of the image closer to the color of the surroundings. This prevents the AR guide from reducing the user's attention to objects located around the vehicle. Furthermore, the user is more likely to notice changes in the behavior of the object. As a result, the user can perform faster driving operations in response to changes in the behavior of the object.

[0074] In addition, the information processing device and the information processing method according to the present embodiment may determine whether or not an object will interfere with the traveling of the vehicle based on information on objects located around the vehicle and the route along which the vehicle is scheduled to travel, and may increase the ratio when it is determined that the object will interfere with the traveling of the vehicle. This makes it possible to extract objects that require a change in the driving operation of the vehicle to avoid interference with the traveling of the vehicle. This makes it easier for the user to notice the object, and allows the user to perform a more rapid driving operation corresponding to the behavior of the object that requires a change in the driving operation of the vehicle.

[0075] Furthermore, the information processing device and the information processing method according to the present embodiment may determine whether an object approaches a vehicle or a route, and if it is determined that the object approaches the vehicle or the route, determine that the object will interfere with the traveling of the vehicle. This makes it possible to accurately extract objects that require a change in the driving operation of the vehicle to avoid interference with the traveling of the vehicle.

[0076] In addition, the information processing device and the information processing method according to the present embodiment may determine whether an object is occluded by an image displayed in the display area as viewed from the driver's seat, and if it is determined that the object is occluded by the image, determine that the object interferes with the running of the vehicle. This makes it possible to accurately extract objects that require a change in the driving operation of the vehicle to avoid interference with the running of the vehicle. In addition, since it is possible to determine whether an object is occluded by an image based on information on the position of the object, regardless of information on the speed of the object, it is possible to reduce the calculation cost required for extracting the object.

[0077] Furthermore, the information processing device and the information processing method according to the present embodiment may calculate a collision time between the object and the vehicle, determine whether the collision time is equal to or shorter than a predetermined time, and determine that the object will interfere with the running of the vehicle if it is determined that the collision time is equal to or shorter than the predetermined time. This makes it possible to accurately extract an object that requires a change in the driving operation of the vehicle to avoid interference with the running of the vehicle.

[0078] In addition, the information processing device and the information processing method according to the present embodiment may determine whether the speed of the vehicle is equal to or greater than a predetermined speed, and when it is determined that the speed of the vehicle is equal to or greater than the predetermined speed, determine that the object interferes with the running of the vehicle. This makes it possible to accurately extract an object that requires a change in the driving operation of the vehicle to avoid interfering with the running of the vehicle. In addition, since it is possible to determine whether the object is occluded by the image based on the information on the speed of the object, regardless of the information on the position of the object, it is possible to reduce the calculation cost required for extracting the object.

[0079] Furthermore, the information processing device and the information processing method according to the present embodiment may reduce the ratio when it is determined that the object does not interfere with the running of the vehicle. As a result, the smaller the number of objects interfering with the running of the vehicle, the smaller the ratio of the display area through which the surroundings are transparent. As a result, the effect of the driving support that the user receives from the system through the display of the AR guide can be maximized.

[0080] Each of the functions described in the above embodiments may be implemented by one or more processing circuits, including a programmed processor, an electrical circuit, or a device such as an application specific integrated circuit (ASIC), or a circuit component arranged to perform the described functions.

[0081] Although the contents of the present invention have been described above in accordance with the embodiments, the present invention is not limited to these descriptions, and various modifications and improvements are possible, which will be obvious to those skilled in the art. The descriptions and drawings forming part of this disclosure should not be understood as limiting the present invention. Various alternative embodiments, examples, and operating techniques will be apparent to those skilled in the art from this disclosure.

[0082] Of course, the present invention includes various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention-specifying matters related to the scope of the claims appropriate from the above description. [Explanation of symbols]

[0083] 21 Display section 23 Display area 25 Acquisition Department 100 Controller 110 Object extraction part 120 Judgment section 130 Image Generation Unit 140 Output section

Claims

1. An information processing device including a display unit, an acquisition unit, and a controller, The acquisition unit is Acquire information about objects located around the vehicle and a route along which the vehicle is scheduled to travel; The display unit is a display area that allows the surroundings to be seen through so as to be visible from a driver's seat of the vehicle; Displaying an image superimposed on the display area; When generating the image based on the path, the controller Based on the above information, A collision time between the object and the vehicle is calculated, and if the collision time is equal to or shorter than a predetermined time, A distance on the screen between the image of the object and the image viewed in the display area as seen from the driver's seat is equal to or less than a predetermined distance on the screen; and If the speed of the vehicle is equal to or greater than a predetermined speed, determining that the object interferes with the traveling of the vehicle in at least one of the following cases; When it is determined that the object interferes with the traveling of the vehicle, a part or the whole of the image is changed to increase a proportion of the display area through which the surroundings are transparent. An information processing device comprising:

2. 2. The information processing device according to claim 1, The controller determines that the object interferes with the traveling of the vehicle when the collision time is equal to or shorter than the predetermined time. An information processing device comprising:

3. 2. The information processing device according to claim 1, The controller determines that the object interferes with the traveling of the vehicle when the on-screen distance is equal to or smaller than a predetermined on-screen distance. An information processing device comprising:

4. 4. The information processing device according to claim 3, The predetermined on-screen distance is set based on the size of the image of the object in the display area or the size of the image in the display area. An information processing device comprising:

5. 2. The information processing device according to claim 1, The controller determines that the object interferes with the traveling of the vehicle when the speed of the vehicle is equal to or higher than the predetermined speed. An information processing device comprising:

6. 2. The information processing device according to claim 1, When generating the image based on the path, the controller determining whether the object is approaching the path based on the information; When it is determined that the object is approaching the path, Based on the above information, A collision time between the object and the vehicle is calculated, and if the collision time is equal to or shorter than a predetermined time, A distance on the screen between the image of the object and the image viewed in the display area as seen from the driver's seat is equal to or less than a predetermined distance on the screen; and If the speed of the vehicle is equal to or greater than a predetermined speed, and determining that the object interferes with the traveling of the vehicle in at least one of the cases above. An information processing device comprising:

7. The information processing device according to any one of claims 1 to 6, The controller: Increasing the transmittance of a part or the whole of the image An information processing device comprising:

8. The information processing device according to claim 7, The controller: The transmittance is set to 100%. An information processing device comprising:

9. The information processing device according to any one of claims 1 to 8, The controller: Reducing the size of part or all of said image An information processing device comprising:

10. The information processing device according to claim 9, The controller: Reducing the width of the image showing the route along a width direction of the road on which the vehicle is traveling. An information processing device comprising:

11. 11. The information processing device according to claim 9, The controller:

2. An information processing device comprising: a display unit for displaying a route along a direction in which the vehicle is traveling;

12. The information processing device according to any one of claims 1 to 11, The controller: Making the color of a part or the whole of the image closer to the color of the surroundings An information processing device comprising:

13. The information processing device according to any one of claims 1 to 12, The controller: determining whether the object is occluded by the image displayed in the display area as viewed from the driver's seat; When it is determined that the object is occluded by the image, it is determined that the object interferes with the traveling of the vehicle. An information processing device comprising:

14. The information processing device according to any one of claims 1 to 13, The controller: and decreasing the ratio when it is determined that the object does not interfere with the traveling of the vehicle. An information processing device comprising:

15. 1. An information processing method for a controller that controls a display unit having a display area that allows a surrounding area of ​​a vehicle to be transparent so as to be visible from a driver's seat of the vehicle, comprising: Acquire information about objects located around the vehicle and a route along which the vehicle is scheduled to travel; When generating an image to be superimposed and displayed on the display area based on the path, the controller Based on the above information, A collision time between the object and the vehicle is calculated, and if the collision time is equal to or shorter than a predetermined time, A distance on the screen between the image of the object and the image viewed in the display area as seen from the driver's seat is equal to or less than a predetermined distance on the screen; and If the speed of the vehicle is equal to or greater than a predetermined speed, determining that the object interferes with the traveling of the vehicle in at least one of the following cases; When it is determined that the object interferes with the traveling of the vehicle, a part or the whole of the image is changed to increase a proportion of the display area through which the surroundings are transparent. An information processing method comprising:

Images