Information processing device and program
The information processing device generates and displays vehicle surroundings images from varying virtual viewpoints based on driving direction and speed, addressing the issue of adapting displayed areas to the vehicle's operation state, thereby improving driver awareness and safety.
Patent Information
- Application Number
- DE112017001178
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2016-03-07
- Filing Date
- 2017-03-06
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2037-03-06
AI Technical Summary
Existing vehicle image display systems fail to adapt the displayed area surrounding the vehicle based on the vehicle's driving state, such as forward, reverse, or stopped conditions.
An information processing device that uses cameras and sensors to generate and display surrounding images from different virtual viewpoints based on the vehicle's driving direction and speed, allowing the display device to show appropriate areas depending on the vehicle's operation state.
Enables the driver to view images adapted to the vehicle's situation, providing clear and comprehensive views of the surroundings relevant to the current driving state, enhancing safety and ease of navigation.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical area
[0001] The present invention relates to a technique for capturing an image of the environment of a vehicle and for displaying the image. State of the art
[0002] A technique for displaying an image of a vehicle's surroundings from a virtual viewpoint is known. For example, WO 00 / 07 373 A1 proposes a technique for displaying an image of the vehicle from a top-down, oblique viewpoint.
[0003] JP 2002-109 697 A discloses an information processing device comprising: a state determination unit designed to determine a control state of a control system performed by an output control device that controls an output direction of a propulsive force for a vehicle; a speed detection unit designed to detect a vehicle's travel speed; and a display control unit designed to allow a display device to show one or more environmental images contained within multiple environmental images, wherein the environmental images are images depicting the vehicle's surroundings based on images captured by one or more cameras.the images capture the vehicle's surroundings and differ from each other with respect to at least one viewpoint and display area; wherein the display control unit is designed to allow the display device to show the environmental image that depicts an area visually detected when viewed downwards from a viewpoint above the vehicle, when the speed detected by the speed detection unit is equal to or less than a predetermined speed, and in a case where the control state determined by the state determination unit indicates that it is permissible to transmit a propulsive force such that the vehicle moves forward, to display the environmental image that depicts areas located to the sides and rear of the vehicle when the speed detected by the speed detection unit isthe predetermined speed is exceeded, and the display control unit is also designed, in a case where the control state determined by the state determination unit indicates that it is permissible to transmit a driving force in such a way that the vehicle moves backwards, to control the display device to show the surroundings, showing the rear of the vehicle.
[0004] US 2012 / 0068840A1 discloses a vehicle image display system that stores a current reverse display mode for presetting the next time reverse gear is engaged. Summary of the invention
[0005] The inventors have discovered that the proposed technology has a problem in that an area surrounding the vehicle, which the driver wishes to view inside the vehicle, varies depending on the vehicle's driving condition.
[0006] The object of the invention is to provide a technique for displaying an image that, depending on the vehicle's operation, shows a suitable area surrounding the vehicle. This object is achieved by an information processing device with the features of claim 1 or claim 2, and by a corresponding program with the features of claim 7 or claim 8. The dependent claims are directed to advantageous embodiments of the invention.
[0007] According to the invention, the display device is enabled to show images of the surroundings, depicting an area suitable for the vehicle's driving condition, based on the direction of the driving force exerted by the vehicle's propulsion source and the vehicle's speed. Therefore, the driver can view images adapted to the situation while in the vehicle.
[0008] Note that the initial direction of the driving force described above is a direction in which the vehicle can be moved by the driving force exerted by the propulsion source, and is either a forward direction or a reverse direction.
[0009] The program according to the invention enables the computer to perform functions similar to the functions of the information processing device.
[0010] Reference numerals in parentheses in the claims indicate a correspondence to the specific devices described as a mode in the following embodiments and do not limit the technical scope of the present invention. Brief description of the drawings Fig. Figure 1 is a block diagram representing a configuration of an image display system. Fig. Figure 2 is a diagram that represents the positions of virtual viewpoints. Fig. Figure 3 is a diagram that represents a rear view image, which is an example of an environment image. Fig. Figure 4 is a diagram that represents a top-down view, which is an example of an environment image. Fig. Figure 5 is a diagram that represents a front view image, which is an example of an environment image. Fig. Figure 6 is a diagram showing a front bird's-eye view image, which is an example of an environment image. Fig. 7 is a flowchart of an image display processing process. Description of the embodiments
[0011] With reference to the drawings, an embodiment according to the present invention is described. 1. Design 1-1. Configuration
[0012] A picture display system 1 is a system that is mounted on a vehicle, such as an automobile. As it is described in Fig. As shown in Figure 1, the image display system 1 comprises a front camera 3a, a rear camera 3b, a left camera 3c, a right camera 3d, a display device 5, and an electronic control unit (hereinafter referred to as ECU) 7, which are mounted on the vehicle. In the following description, one camera 3 can comprise the four cameras 3a, 3b, 3c, 3d. The ECU 7 corresponds to an information processing device.
[0013] Camera 3 is an imaging device mounted on the vehicle. Camera 3 can be, for example, a known CCD image sensor or a CMOS image sensor. Cameras 3a, 3b, 3c, and 3d capture images of the vehicle's surroundings at predetermined time intervals (for example, at intervals of 1 / 15 s). The front camera 3a, the rear camera 3b, the left camera 3c, and the right camera 3d are positioned to capture images of the front, rear, left side, and right side of the vehicle.
[0014] The display device 5 is a device that includes, for example, a liquid crystal display screen or an organic EL display screen on which images can be displayed. The display device 5 displays an image according to a signal received from the ECU 7.
[0015] The ECU 7 has a first input processing unit 11, a storage device 13, a second input processing unit 15, an output signal processing unit 17 and an image processing unit 19.
[0016] The first input processing unit 11 converts an analog signal of a recorded image received by the camera 3 into a digital signal and outputs the digital signal to the image processing unit 19.
[0017] The storage device 13 is a device that forms a storage area in which information can be stored. Parameters such as positions and angles at which the respective cameras 3 are installed are stored in the storage area formed by the storage device 13 and are read out by the image processing unit 19 as needed.
[0018] The second input processing unit 15 is connected to a vehicle-specific network 9. The second input processing unit 15 receives signals output by a switching sensor 9a and a vehicle speed sensor 9b, which are connected to the vehicle-specific network 9, and outputs the signals to the image processing unit 19.
[0019] The switching sensor 9a is a sensor that provides an output corresponding to a position to which a selector or selection device 31 is actuated. The selector or selection device is located near a driver's seat and is moved by the driver; in other words, an output corresponding to a switching range set by the driver operating the selector. In the present embodiment, the vehicle's transmission 33 can be an automatic transmission.
[0020] The selector 31 is an operating component, such as a lever, used to operate or actuate the vehicle's transmission 33. By operating the selector 31, the driver can set the shift range to any of the following: park (hereinafter referred to as P range), reverse (hereinafter referred to as R range), neutral (hereinafter referred to as N range), and drive / forward (hereinafter referred to as D range). The transmission 33 corresponds to an output control device.
[0021] The vehicle speed sensor 9b is a sensor that outputs a signal corresponding to the vehicle's driving speed.
[0022] The output signal processing unit 17 converts a digital signal from image data output by the image processing unit 19 into an analog signal and outputs the analog signal to the display device 5. The display device 5 displays an image based on the received signal.
[0023] The image processing unit 19 is primarily composed of a known microcomputer comprising a CPU 21 and semiconductor memory such as RAM, ROM, or flash memory (hereinafter referred to as memory 23). Various functions of the image processing unit 19 are performed by the CPU 21, which executes a program stored in a non-volatile storage medium. In this example, memory 23 corresponds to the non-volatile storage medium in which the program is stored. Furthermore, executing the program enables the execution of a procedure as defined by the program. One or more microcomputers can constitute the processing unit 19.
[0024] According to a configuration for functions performed by the CPU 21, which executes the program, the image processing unit 19 includes a state determination unit 25, a velocity detection unit 26, an image generation unit 27, and a display control unit 28, as shown in Fig. Figure 1 shows that a technique for implementing these elements, which form the image processing unit 19, is not limited to software. Some or all of the elements can be implemented using hardware that includes a combination of logic circuits, analog circuits, or the like.
[0025] The state determination unit 25 determines a control state of the transmission 33 based on a signal output by the shift sensor 9a.
[0026] The control state of the transmission 33 refers to the state of a control of an output direction of a drive force exerted by an internal combustion engine that serves as a drive propulsion source of the vehicle.
[0027] The output direction of the driving force is a direction in which the vehicle can be moved by the driving force of the internal combustion engine and is either a forward direction or a reverse direction. The output direction does not refer to the direction in which the vehicle is currently traveling. Even if the vehicle is traveling at a speed of 0 km / h, the output direction will be, for example, the forward direction if the transmission 33 is in a state in which the vehicle will move forward when the accelerator pedal is pressed by the driver.
[0028] Furthermore, the control state of the transmission 33 can be roughly classified into three states: (i) a state in which the transmission 33 transmits a driving force to move the vehicle forward, (ii) a state in which the transmission 33 does not transmit a driving force, and (iii) a state in which the transmission 33 transmits a driving force to move the vehicle backward. Of course, a more detailed classification of the states indicated by the control state of the transmission 33 is possible. The control state of the transmission 33 changes according to the nature of the connections between the gears that form the transmission 33.
[0029] In particular, when the D range is selected as the shift range, the control state of the transmission 33 is such that the transmission 33 transmits a driving force to move the vehicle forward. When the P range or the N range is selected as the shift range, the control state of the transmission 33 is such that the transmission 33 does not transmit a driving force. When the R range is selected as the shift range, the control state of the transmission 33 is such that the transmission 33 transmits a driving force to move the vehicle backward.
[0030] The speed detection unit 26 detects the vehicle's speed based on a signal output by the vehicle speed sensor 9b.
[0031] Based on images captured by one or more of the cameras 3a, 3b, 3c, 3d, the image generation unit 27 generates one or more images of viewpoints that differ from those for the images captured by the respective cameras 3a, 3b, 3c, 3d. To generate the one or more images, parameters for camera 3, which are stored in the storage device 13, are used.
[0032] The display control unit 28 enables the display device 5 to display environmental images. The environmental image is described below. 1-2. Surroundings
[0033] The environment image is an image showing the vehicle's surroundings and is generated by the image generation unit 27 based on an image captured by camera 3, which records images of the vehicle's surroundings. The image generation unit 27 generates images from viewpoints that differ from those of the four cameras 3 as described above. Each image generated by the image generation unit 27 is an environment image.
[0034] The viewpoint used here refers to a position as a standpoint from which a photographed object is viewed. Since a known technique is used to generate images with viewpoints different from those used for the photographed objects, based on images taken from multiple different viewpoints, the description of this technique is omitted.
[0035] As it is in Fig. As shown in Figure 2, the viewpoint for ambient images generated by the image generation unit 27 is set at four positions relative to a vehicle 101. A first virtual viewpoint 41 is a viewpoint where the camera looks obliquely downwards and forwards of the vehicle 101, on which the image display system 1 is mounted, from behind the vehicle 101. A second virtual viewpoint 43 is a viewpoint where the camera looks downwards at the vehicle 101 from above one of its front ends. A third virtual viewpoint 45 is a viewpoint where the camera looks towards the vehicle 101 from the front of the vehicle 101. A fourth virtual viewpoint 47 is a viewpoint where the camera looks obliquely downwards and backwards from the vehicle 101 from the front and above the vehicle 101.
[0036] Fig. Figure 3 is a diagram showing a rearview image 103, which is an image of the surroundings from the perspective of the first virtual viewpoint 41. The rearview image 103 is generated by synthesizing or combining images captured by the four cameras 3a, 3b, 3c, and 3d. Camera 3 does not capture an image of the vehicle 101 itself; therefore, previously prepared images of the vehicle 101 are used for the synthesis. This also applies to the images described below.
[0037] The rearview image 103 allows a driver in vehicle 101 to have a wide view of the front of vehicle 101 and enables a simple understanding of the positional relationship between vehicle 101 and, for example, obstacles shown in a captured image. That is, the rearview image 103 is an image suitable for checking a relatively wide or large area of the environment focused on the front of the vehicle, in cases where the vehicle is stopped, started, or parked.
[0038] Fig. Figure 4 is a diagram representing an overhead view image 105, which is an environmental image from the perspective of the second virtual viewpoint 43. The overhead view image 105 is generated by converting the viewpoint of an image captured by the front camera 3a. The overhead view image 105 shows an area corresponding to a road surface in front of the vehicle 101, which is an area containing a blind spot for the driver.
[0039] The overhead view image 105 allows the driver to obtain information about the area around the front of the vehicle 101. That is, the overhead view image 105 is an image suitable for situations where the vehicle is about to move forward or where the vehicle is moving slowly to avoid potential contact with an obstacle.
[0040] Fig. Figure 5 is a diagram representing a front view image 107, which is an environmental image from the perspective of the third virtual viewpoint 45. The front view image 107 is generated by synthesizing images captured by the rear camera 3b, the left camera 3c, and the right camera 3d.
[0041] The front view image 107 allows the driver to view an image that appears like a combination of a rearview mirror display and a side mirror display, showing areas located to the side and behind the vehicle, thus enabling a simple check for another vehicle that may be to the side or behind the vehicle 101. That is to say, the front view image 107 is an image suitable, for example, in a situation where the vehicle is changing lanes.
[0042] Fig. Figure 6 is a diagram representing a front bird's-eye view image 109, which is an environmental image from the perspective of the fourth virtual viewpoint 47. The front bird's-eye view image 109 is generated by synthesizing images captured by the four cameras 3a, 3b, 3c, and 3d.
[0043] The front bird's-eye view image 109 allows the driver to see a wide area behind the vehicle 101 and facilitates a clear understanding of the positional relationship between the vehicle 101 and, for example, an obstacle and white lines on the road surface. In other words, the front bird's-eye view image 109 is a preferred image when the vehicle is reversing, for instance, when confirmation of an obstacle or a parking space is needed. 1-3. Processing
[0044] The following describes an image display processing operation performed by CPU 21 of the ECU 7, using the flowchart of the Fig. 7 described. The present processing is carried out repeatedly during the time that an accessory switch of the vehicle is switched on.
[0045] First, in S1, CPU 21 uses selector 31 to determine whether the P-range or the N-range is set as the switching range. If CPU 21 determines in S1 that the P-range or the N-range is set as the switching range, processing proceeds to S2. If, on the other hand, it is determined that the P-range or the N-range is not set as the switching range, processing proceeds to S3.
[0046] In S2, CPU 21 sets the virtual viewpoint behind the vehicle. In other words, when the vehicle stops, the rearview image 103, in which the virtual viewpoint is positioned behind the vehicle, is displayed on the display device 5 as an environment image. The current processing then terminates.
[0047] Note that once the virtual viewpoint is set, the rear view image 103 is displayed until the setting is changed to a different virtual viewpoint. The rear view image 103, displayed on the display device 5, is updated based on a newly captured image from camera 3. That is, the display device 5 shows a moving image that depicts the current situation from the perspective of the virtual viewpoint behind the vehicle. This also applies when a different virtual viewpoint is set in S5, S6, and S7, as described below.
[0048] In S3, CPU 21 determines whether the D-area is set as a switching area. If CPU 21 determines in S3 that the D-area is set as a switching area, processing proceeds to S4. If, on the other hand, it is determined that the D-area is not set as a switching area—in other words, if it is determined that the R-area is set as a switching area—processing proceeds to S7.
[0049] In S4, CPU 21 determines whether the vehicle speed is equal to or less than a predetermined constant value. For example, the vehicle speed equal to or less than the constant value ranges from 15 km / h to 0 km / h. If S4 determines that the vehicle speed is equal to or less than the constant value, processing proceeds to S5. Conversely, if it determines that the vehicle speed is not equal to or less than the constant value—that is, if it determines that the vehicle speed exceeds the constant value—processing proceeds to S6. The vehicle speed of the constant value corresponds to a predetermined speed.
[0050] In S5, CPU 21 sets the virtual viewpoint above the front end of the vehicle. In other words, as the vehicle moves slowly forward, the top-down view image 105 described above, in which the virtual viewpoint is positioned above the front end of the vehicle, is displayed on the display device 5 as the surrounding image. The current processing then terminates.
[0051] In S6, CPU 21 sets the virtual viewpoint in front of the vehicle. In other words, when the vehicle moves forward quickly, the front view image 107 described above, in which the virtual viewpoint is located in front of the vehicle, is displayed on the display device 5 as an ambient image. The current processing then ends.
[0052] In S7, CPU 21 sets the virtual viewpoint above the front of the vehicle. In other words, when the vehicle moves backward, the front bird's-eye view image 109 described above, in which the virtual viewpoint is located above and in front of the vehicle, is displayed on the display device 5 as an ambient image. The current processing then terminates. 1.4. Effects
[0053] According to the embodiment described in detail above, the effects described below can be achieved.
[0054] (1a) In the image display system 1 according to the present embodiment, the display device 5 shows the surrounding image, which shows the area suitable for the vehicle's driving condition, based on the switching range set by operating the selector 31 and the vehicle's driving speed. Therefore, the driver of the vehicle can view a suitable image adapted to the situation.
[0055] (1b) The ambient images described above are images from viewpoints that differ from those of the respective cameras 3. Thus, not only is an image selected and displayed from the images recorded by the respective cameras 3, but the image can be displayed in such a way that confirmation based on the image is made easier for the driver.
[0056] (1c) The environmental image described above contains the image generated by synthesizing the images captured by the respective cameras 3. Compared to an image captured by a single camera, such an environmental image allows for the viewing of a wide area, making it possible to provide a large amount of information to the driver via a single environmental image.
[0057] (1d) In the present embodiment, environmental images from different viewpoints are displayed on the display device 5, distinguishing between the case in which the P-range or the N-range is set as the switching range and the case in which the D-range or the R-range is set as the switching range. Thus, the driver can use the environmental image to recognize whether the drive force from the internal combustion engine is being transmitted to the tires.
[0058] Furthermore, in the present embodiment, ambient images from different viewpoints are displayed on the display device 5 to distinguish between the case in which the R-range is set as the switching range and the case in which a range other than the R-range is set as the switching range. This enables the driver to recognize that the vehicle is in reverse. 2. Other embodiments
[0059] The present invention has been described to this extent. However, the present invention is not limited to the embodiment described above, and various variations of the embodiment are possible.
[0060] (2a) In the configuration of the embodiment described above, the control state of the transmission 33 is determined based on the operation of the selector 31 by the driver in the vehicle. However, the determination can be carried out using a different configuration. For example, the control state can be determined by receiving a signal indicating the state of the transmission from a control device that controls the transmission. If the transmission installed in the vehicle is operated manually, the control state can be determined based on the positions of a gearshift lever.
[0061] In a vehicle with automatic operating control, where some or all of the vehicle's operations are carried out by an automatic operating control device instead of by the driver, the control state of the transmission can also be determined based on a signal issued by the automatic operating control device indicating the control state of the transmission.
[0062] The control state of the transmission can be classified based on the gear ratio.
[0063] (2b) In the configuration shown in the embodiment described above, the state determination unit 25 determines the state of the transmission, which is an output control device that controls the output direction of the drive force for the vehicle, which contains the internal combustion engine as the drive source. However, the drive source and the output control device are not limited to those in the configuration of the embodiment described above. For example, an electric motor can be used as the drive source.
[0064] If the drive source is an electric motor, an electric motor control device that controls the direction of rotation of the electric motor corresponds to the output control device. The state determination unit 25 can determine the state of the electric motor control device based on a signal output by the electric motor control device or the operating position of the selector. Naturally, even if the drive source is an electric motor, the state determination unit 25 can be configured to determine the state of a transmission if the vehicle contains such a transmission.
[0065] (2c) In the configuration shown in the embodiment described above, four cameras are mounted on the vehicle. However, the number of cameras is not particularly limited. Five or more cameras, or three or fewer cameras, can be arranged.
[0066] (2d) In the configuration of the embodiment described above, the environmental images are displayed from the different viewpoints according to the control state of the transmission and the vehicle speed. However, images with different display areas can be displayed instead of the different viewpoints. For example, if the P range is set as the shift range, a bird's-eye view image can be displayed, in which the camera looks down at the vehicle from directly above it. On the other hand, if the D range is set as the shift range and the vehicle speed is equal to or less than the constant value, a portion of the bird's-eye view image corresponding to the area around the front of the vehicle can be displayed enlarged.
[0067] (2e) In the configuration of the embodiment described above, images of viewpoints different from those of the respective cameras 3 are generated and then displayed on the display device 5 as background images. However, at least one background image can be based on the same view as that of any of the cameras 3. The background image can be the image as it was captured by the camera 3, or it can be an image generated by performing image processing on the captured image.
[0068] (2f) In the configuration of the embodiment described above, the environmental image varies according to the speed only when the D range is set as the switching range. However, the environmental image can also vary according to the speed when the R range is set as the switching range. For example, if the selector is set to the R range, the rear view image 103 can be displayed when the speed is equal to or less than 3 km / h, whereas the front bird's-eye view image 109 can be displayed when the speed exceeds 3 km / h.
[0069] If a range other than the D range is available as a switching range for forward movement, environmental images can also be displayed according to the respective ranges and driving speeds.
[0070] Alternatively, environmental images can be displayed according to the gear ratios set for the transmission and the driving speeds.
[0071] Furthermore, the displayed environmental images can be varied depending on whether the P-range or the N-range is set as the switching range.
[0072] (2g) The types of environmental images are not limited to those shown in the embodiment described above. Furthermore, five or more types of environmental images may be used. For example, the displayed environmental image may change incrementally according to the driving speed and may have a varying viewpoint or display area.
[0073] Furthermore, if the displayed environmental image is changed according to the operation of the selector or a change in speed, the viewpoint for the image displayed on the display device 5 can be gradually varied by displaying one or more images of viewpoints arranged between a viewpoint before the change and a viewpoint after the change.
[0074] (2h) The display device 5 can be designed to display multiple environmental images simultaneously or to display one or more environmental images and any other image simultaneously.
[0075] (2i) The functions of a component in the respective embodiments described above may be assigned to several components, or the functions of several components may be achieved by one component. Alternatively, several functions of several components may be achieved by one component, or a function performed by several components may be achieved by one component. Furthermore, the configuration of each of the embodiments described above may be partially omitted. In addition, at least a part of the configuration of one embodiment above may be added to or replaced by another configuration of the embodiment above. All aspects within the technical ideas that are defined solely by the wording of the claims constitute an embodiment of the present invention.
[0076] (2j) In addition to the ECU 7 containing the image processing unit 19 described above, the present invention can be implemented in various ways, for example as the image display system 1 which includes the ECU 7 as a component, a program which causes a computer to serve as the image processing unit 19, a non-volatile recording medium such as a semiconductor memory in which the program is recorded, and an image display method.
Claims
[1] Information processing device (7) comprising: a state determination unit (25) configured to determine a control state of control performed by an output control device (33) that controls an output direction of a driving force for a vehicle; a speed detection unit (26) designed to detect a driving speed of the vehicle; and a display control unit (28) configured to allow a display device (5) to display one or more surrounding images included in a plurality of surrounding images (103, 105, 107, 109), wherein the surrounding images are images showing surroundings of the vehicle based on images captured by one or more cameras (3a, 3b, 3c, 3d) that capture images of the surroundings of the vehicle and differ from each other with respect to at least one of a viewpoint and a display area; wherein the display control unit is designed, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves forward, to allow the display device to display the surrounding image indicating an area visually recognized when viewed downward from a viewpoint above a front end of the vehicle when the speed detected by the speed detecting unit is equal to or less than a predetermined speed, and display the surrounding image showing areas located to the side and rear of the vehicle when the speed detected by the speed detection unit exceeds the predetermined speed, and the display control unit is further configured, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves backward, to control the display device to display the surrounding image showing the vehicle together with an area behind the vehicle as an image showing an area visually recognized when looking rearward from above and in front of the vehicle. [2] Information processing device (7) comprising: a state determination unit (25) configured to determine a control state of control performed by an output control device (33) that controls an output direction of a driving force for a vehicle; a speed detection unit (26) designed to detect a driving speed of the vehicle; and a display control unit (28) configured to enable a display device (5) to display one or more surrounding images included in a plurality of surrounding images (103, 105, 107, 109), wherein the surrounding images are images showing surroundings of the vehicle based on images captured by one or more cameras (3a, 3b, 3c, 3d) capturing images of the surroundings of the vehicle and differing from each other with respect to at least one of a viewpoint and a display area; wherein the display control unit is designed to allow the display device, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves forward, display the surrounding image indicating an area corresponding to a road surface in front of the vehicle that is a blind spot of a driver of the vehicle when the speed detected by the speed detection unit is equal to or less than a predetermined speed, and display the surrounding image that indicates areas located to the side and rear of the vehicle, and that is an image that indicates an area that is visually recognized when looking from the front of the vehicle to the rear when the speed detected by the speed detecting unit exceeds the predetermined speed. [3] The information processing apparatus according to claim 1 or 2, wherein the state determining unit is configured to determine the control state based on a shift range selected using a selector (31) disposed in the vehicle. [4] Information processing apparatus according to any one of claims 1 to 3, further comprising: an image generation unit (27) configured to generate, on the basis of images captured by the one or more cameras, one or more images that differ from the captured images in at least one of the viewpoint and the display area, wherein the environmental images contain the images generated by the image generation unit. [5] The information processing apparatus according to any one of claims 1 to 4, wherein the display control unit is configured to enable the display apparatus to display the surrounding images of different viewpoints in discrimination between a case where the control state determined by the state determination unit indicates that it is not permitted to transmit the driving force and a case where the control state determined by the state determination unit indicates that it is permitted to transmit the driving force such that the vehicle moves forward or backward. [6] The information processing apparatus according to any one of claims 1 to 5, wherein the display control unit is configured to enable the display apparatus to display the surrounding images of different viewpoints in discrimination between a case where the control state determined by the state determination unit indicates a state where it is permitted to transmit a driving force for moving the vehicle backward and a case where the control state determined by the state determination unit indicates other states. [7] A program that causes a computer to act as: a state determination unit (25) configured to determine a control state of control performed by an output control device (33) that controls an output direction of a driving force for a vehicle; a speed detection unit (26) designed to detect a driving speed of the vehicle; and a display control unit (28) configured to allow a display device (5) to display one or more surrounding images included in a plurality of surrounding images (103, 105, 107, 109), wherein the surrounding images are images showing surroundings of the vehicle based on images captured by one or more cameras (3a, 3b, 3c, 3d) that capture images of the surroundings of the vehicle and differ in at least one of a viewpoint and a display area; wherein the display control unit is designed, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves forward, to allow the display device to display the surrounding image indicating an area visually recognized when viewed downward from a viewpoint above a front end of the vehicle when the speed detected by the speed detecting unit is equal to or less than a predetermined speed, and display the surrounding image showing areas located to the side and rear of the vehicle when the speed detected by the speed detection unit exceeds the predetermined speed, and the display control unit is further configured, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves backward, to control the display device to display the surrounding image showing the vehicle together with an area behind the vehicle as an image showing an area visually recognized when looking rearward from above and in front of the vehicle. [8] A program that causes a computer to act as: a state determination unit (25) configured to determine a control state of control performed by an output control device (33) that controls an output direction of a driving force for a vehicle; a speed detection unit (26) designed to detect a driving speed of the vehicle; and a display control unit (28) configured to allow a display device (5) to display one or more surrounding images included in a plurality of surrounding images (103, 105, 107, 109), wherein the surrounding images are images showing surroundings of the vehicle based on images captured by one or more cameras (3a, 3b, 3c, 3d) that capture images of the surroundings of the vehicle and differ in at least one of a viewpoint and a display area; wherein the display control unit is designed to allow the display device, in a case where the control state determined by the state determination unit indicates that it is permitted to transmit a driving force such that the vehicle moves forward, display the surrounding image indicating an area corresponding to a road surface in front of the vehicle that is a blind spot of a driver of the vehicle when the speed detected by the speed detection unit is equal to or less than a predetermined speed, and display the surrounding image that indicates areas located to the side and rear of the vehicle, and that is an image that indicates an area that is visually recognized when looking from the front of the vehicle to the rear when the speed detected by the speed detecting unit exceeds the predetermined speed.
Citation Information
Patent Citations
Drive support device
JP2002109697A
Image generating apparatus and image display system
US20120068840A1
Method and apparatus for displaying image
WO2000007373A1
JP002002109697A
