Vehicles and methods for extending a rearview display

Abstract

Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60), comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: Each camera (60) has a first viewing angle in a first direction and a second viewing angle, which is larger than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted at the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is attached at the rear end (104) and is oriented such that the first viewing angle is in a horizontal direction and the second viewing angle is in a vertical direction; the vehicle (100) also includes: a flap (110) at the rear end (104), wherein the flap (110) is movable between a closed configuration and an open configuration, wherein the fourth camera (64) is attached to the flap (110) and is configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to crop the collected dynamic pixel images so that a lower part of the collected dynamic pixel images is displayed on the display screen (20) when the flap (110) is in the closed configuration, and to crop the collected dynamic pixel images so that an upper part of the collected dynamic pixel images is displayed on the display screen (20) when the flap (110) is in the open configuration.

Description

[0001] The technical field relates generally to the field of vehicles and, more particularly, to methods and systems for displaying a rear view from a rearview camera in a vehicle.

[0002] Many vehicles have a rearview camera that provides a view of the area behind the vehicle. However, in certain circumstances, the rearview camera may be part of a system that doesn't always provide optimal images in certain situations.

[0003] For example, in pickup trucks, sport utility vehicles (SUVs), hatchbacks, and other vehicles, the rearview camera may be mounted on a panel, such as a rear door or tailgate, that moves between closed and open configurations. This allows the dynamics of the camera position and orientation, as well as the dynamics of the moving vehicle, to be changed.

[0004] US 2017 / 0 163 939 A1 describes a system for displaying an image on a display device of a motor vehicle, comprising a rearview camera, the rearview camera being connected to a movable component on the motor vehicle, and a controller in communication with the rearview camera. The control logic includes capturing a field of view image from the rearview camera, determining a position of the rearview camera, modifying the field of view image based on the image perspective relationship to create a virtual perspective image, and displaying the virtual perspective image on the display device in the motor vehicle while the position of the rearview camera changes between at least a first position and a second position.

[0005] It may be considered an object to provide a method for enhancing a rearview display for a vehicle and vehicles that provide an appropriate view according to the current configuration or potential configuration of the vehicle.

[0006] The object is achieved by vehicles according to the invention according to claim 1, claim 3, claim 4, claim 5 and claim 6, furthermore the object is achieved by a method according to the invention for expanding a rearview display according to claim 8. Furthermore, an exemplary system for providing rearview displays is described, which system can be implemented in the vehicles and can be used in the method.

[0007] A vehicle according to the invention comprises a front end and a rear end, a left side and a right side, and a plurality of cameras, including a first camera, a second camera, a third camera, and a fourth camera. In the vehicle, each camera has a first viewing angle in a first direction and a second viewing angle, which is greater than the first viewing angle, in a second direction perpendicular to the first direction. Furthermore, the first camera is mounted at the front end, the second camera is mounted at the left side, the third camera is mounted at the right side, and each of the first camera, the second camera, and the third camera is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction. In the vehicle, the fourth camera is mounted at the rear end and oriented such thatthat the first viewing angle extends in the horizontal direction and the second viewing angle extends in the vertical direction. The vehicle further comprises a hatch at the rear end, the hatch being movable between a closed configuration and an open configuration, the fourth camera being mounted on the hatch and configured to capture dynamic pixel images of an area behind the vehicle; a display screen configured to display the captured dynamic pixel images; and a memory configured to include one or more executable instructions and a processor configured to execute executable instructions, the executable instructions enabling the processor to crop the collected dynamic pixel images such that a lower portion of the collected dynamic pixel images is displayed on the display screen.when the flip is in the closed configuration, and crop the collected dynamic pixel images such that an upper portion of the collected dynamic pixel images is displayed on the display screen when the flip is in the open configuration. In such embodiments, the lower portion of the collected dynamic pixel images may not cover more than 75% of the second viewing angle, and the upper portion of the collected dynamic pixel images may not cover more than 75% of the second viewing angle.

[0008] A vehicle according to the invention comprises a front end and a rear end, a left side and a right side, and a plurality of cameras including a first camera, a second camera, a third camera, and a fourth camera. In the vehicle, each camera has a first viewing angle in a first direction and a second viewing angle, which is greater than the first viewing angle, in a second direction perpendicular to the first direction. Further, the first camera is mounted at the front end, the second camera is mounted at the left side, the third camera is mounted at the right side, and each of the first camera, the second camera, and the third camera is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction.In the vehicle, the fourth camera is mounted at the rear end and oriented so that the first viewing angle extends in the horizontal direction and the second viewing angle extends in the vertical direction.The vehicle further includes a rear end hatch, the hatch being movable between a closed configuration and an open configuration, the fourth camera being mounted on the hatch and configured to capture dynamic pixel images of an area rearward of the vehicle; a display screen configured to display the captured dynamic pixel images; and a memory configured to include one or more executable instructions and a processor configured to execute executable instructions, the executable instructions enabling the processor to display a graphical overlay on the collected dynamic pixel images on the display screen when the hatch is in the open configuration, the graphical overlay representing an outline of a terminal edge of the hatch in the open configuration.

[0009] A vehicle according to the invention comprises a front end and a rear end, a left side and a right side, and a plurality of cameras including a first camera, a second camera, a third camera, and a fourth camera. In the vehicle, each camera has a first viewing angle in a first direction and a second viewing angle, which is greater than the first viewing angle, in a second direction perpendicular to the first direction. Further, the first camera is mounted at the front end, the second camera is mounted at the left side, the third camera is mounted at the right side, and each of the first camera, the second camera, and the third camera is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction.In the vehicle, the fourth camera is mounted at the rear end and oriented such that the first viewing angle extends in the horizontal direction and the second viewing angle extends in the vertical direction. The vehicle further includes a hatch at the rear end, the hatch being movable between a closed configuration and an open configuration, the fourth camera mounted on the hatch and configured to collect dynamic pixel images of an area rearward of the vehicle; a display screen configured to display the collected dynamic pixel images; and a memory configured to include one or more executable instructions and a processor configured to execute executable instructions, the executable instructions enabling the processor to detect when the hatch is in the open configuration.

[0010] A vehicle according to the invention comprises a front end and a rear end, a left side and a right side, and a plurality of cameras including a first camera, a second camera, a third camera, and a fourth camera. In the vehicle, each camera has a first viewing angle in a first direction and a second viewing angle, which is greater than the first viewing angle, in a second direction perpendicular to the first direction. Further, the first camera is mounted at the front end, the second camera is mounted at the left side, the third camera is mounted at the right side, and each of the first camera, the second camera, and the third camera is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction.In the vehicle, the fourth camera is mounted at the rear end and oriented so that the first viewing angle extends in the horizontal direction and the second viewing angle extends in the vertical direction.The vehicle further includes a hatch at the rear end, the hatch being movable between a closed configuration and an open configuration, the fourth camera being mounted on the hatch and configured to collect dynamic pixel images of an area rearward of the vehicle; a display screen configured to display the collected dynamic pixel images; and a memory configured to include one or more executable instructions and a processor configured to execute executable instructions, the executable instructions enabling the processor to detect when a hatch shadow from the hatch is present in the collected dynamic pixel images and to remove the hatch shadow from the collected dynamic pixel images.

[0011] A vehicle according to the invention comprises a front end and a rear end, a left side and a right side, and a plurality of cameras including a first camera, a second camera, a third camera, and a fourth camera. In the vehicle, each camera has a first viewing angle in a first direction and a second viewing angle, which is greater than the first viewing angle, in a second direction perpendicular to the first direction. Further, the first camera is mounted at the front end, the second camera is mounted at the left side, the third camera is mounted at the right side, and each of the first camera, the second camera, and the third camera is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction.In the vehicle, the fourth camera is mounted at the rear end and oriented so that the first viewing angle extends in the horizontal direction and the second viewing angle extends in the vertical direction.The vehicle further includes a rear end hatch, the hatch movable between a closed configuration and an open configuration, the fourth camera mounted on the hatch and configured to collect dynamic pixel images of an area rearward of the vehicle; a rear end hitch; a screen configured to display the collected dynamic pixel images; and memory configured to include one or more executable instructions and a processor configured to execute executable instructions, the executable instructions enabling the processor to detect when a hatch shadow from the hatch is present in the collected dynamic pixel images and to activate the hitch light to reduce the hatch shadow.

[0012] In certain embodiments of the vehicles, the first viewing angle is between 140 and 160 degrees and the second viewing angle is greater than 180 degrees.

[0013] For example, a rearview display system is provided for a vehicle having a hatch that can be moved between a closed configuration and an open configuration.The example system includes a camera mounted on the hatch and configured to collect dynamic pixel images of an area rearward of the vehicle; a display screen configured to display the collected dynamic pixel images; and memory configured to include one or more executable instructions and a processor configured to execute the executable instructions, wherein the executable instructions enable the processor to crop the collected dynamic pixel images such that a lower portion of the collected dynamic pixel images is displayed on the display screen when the hatch is in the closed configuration and crop the collected dynamic pixel images such that an upper portion of the collected dynamic pixel images is displayed on the display screen when the hatch is in the open configuration.

[0014] In the exemplary system, the camera may be oriented with a first viewing angle extending in the horizontal direction and a second viewing angle extending in the vertical horizontal direction, the second viewing angle being greater than the first viewing angle. The lower portion of the collected dynamic pixel images may not include more than 75% of the second viewing angle, and the upper portion of the collected dynamic pixel images may not include more than 75% of the second viewing angle.

[0015] In the example system, when the flap is in the open configuration, a top edge of the lower portion of the collected dynamic pixel images may be within 5 degrees of a horizon; and when the flap is in the closed configuration, a bottom edge of the upper portion of the collected dynamic pixel images may be within 5 degrees of the horizon.

[0016] In the example system, the executable instructions may enable the processor to display a graphical overlay of the collected dynamic pixel images on the screen when the flap is in the open configuration, and wherein the graphical overlay represents an outline of a trailing edge of the flap in the open configuration.

[0017] In the example system, the executable instructions may enable the processor to detect when the flap is in the open configuration.

[0018] In the example system, the executable instructions may enable the processor to detect when a gate shadow of the gate is present in the collected dynamic pixel images and to remove the gate shadow from the collected dynamic pixel images.

[0019] The example system may further include a hitch mounted on a rear end of the vehicle, and the executable instructions may enable the processor to detect when a flap shadow from the flap is present in the collected dynamic pixel images and activate the hitch to reduce the flap shadow.

[0020] Also provided is a method according to the invention for enhancing a rearview display for a vehicle having a hatch movable between a closed and an open configuration. The method includes capturing dynamic pixel images of an area rearward of the vehicle using a camera mounted on the hatch; when the hatch is in the closed configuration, cropping the collected dynamic pixel images to display a lower portion of the collected dynamic pixel images on the display screen via a processor; and when the hatch is in the open configuration, cropping the collected dynamic pixel images to display an upper portion of the collected dynamic pixel images on the display screen via the processor.

[0021] According to the invention, the method further comprises displaying, via the processor, a graphic overlay on the collected dynamic pixel images on the display screen when the flap is in the open configuration, the graphic overlay representing an outline of a terminal edge of the flap in the open configuration.

[0022] In certain embodiments, the method further includes the processor determining when the flap is in the open configuration based on the collected dynamic pixel images.

[0023] In certain embodiments, the method further comprises identifying, via the processor, when a flap shadow from the flap is present in the collected dynamic pixel images and removing the flap shadow from the collected dynamic pixel images or activating a stop light to reduce the flap shadow. Fig. 1 is a schematic side view of a vehicle with a hatch in a closed configuration according to one embodiment; Fig. 2 is a schematic side view of the vehicle of Fig. 1 with a flap in an open configuration according to one embodiment; Fig. 3 is a functional block diagram of the vehicle from Fig. 1-2 according to one embodiment; Fig. 4 is a side view of a tailgate having a camera mounted thereon according to one embodiment; Fig. 5 is a schematic side view of a camera mounted on a door in a closed configuration according to one embodiment; Fig. 6 is a schematic side view of a camera mounted on a door in an open configuration according to one embodiment; Fig. 7 is an uncropped image of a camera mounted on a closed door according to one embodiment; Fig. 8 is a cropped view of the image of Fig. 7 in accordance with an embodiment; Fig. 9 is an uncropped image of a camera mounted on a door in an open configuration according to one embodiment; Fig. 10 is a cropped view of the image of Fig. 9 in accordance with an embodiment; Fig. 11 is an uncropped image of a camera mounted on a door in an open configuration according to one embodiment; Fig. 12 is a cropped view of the image of Fig. 11 in accordance with one embodiment; Fig. 13 is a cutaway view of an image from a camera mounted on a door in an open configuration according to one embodiment; Fig. 14 is a representation of the image of Fig. 13 with the shadow removed according to one embodiment; Fig. 15 is an exemplary bird's-eye view presented on a display in accordance with various embodiments; and Fig. 16 is a flowchart of a method for displaying a rear view for a vehicle having a hatch movable between a closed and an open configuration, according to one embodiment.

[0024] The term “in reverse” means that the vehicle is in reverse gear (for vehicles with a transmission) or in reverse gear to travel in the opposite direction, or that it is moving in the opposite direction.

[0025] The embodiments contained herein enable an enhanced rearview display of a vehicle. In particular, embodiments are provided herein for a vehicle having a rearview camera mounted on a door, such as a liftgate (which opens downward about a pivoting lower hinge) or a tailgate (which opens upward about a pivoting upper hinge).

[0026] In the Fig. 1-3, an example vehicle 100 is shown in accordance with various embodiments. In Fig. 1, the vehicle 100 includes a hatch 110 in a closed configuration 111. The illustrated hatch 110 is a liftgate that opens via a lower hinge, although in certain embodiments, the hatch 110 may also be a liftgate that opens via a top hinge or other hinge arrangement.

[0027] As illustrated, the vehicle 100 includes a rearview camera 60 mounted on the hatch 110. The rearview camera 60 is configured to capture dynamic pixel images of an area 1000 behind the vehicle 100.

[0028] The vehicle 100 further includes a computer system 120 connected to a display 20 for displaying the collected dynamic pixel images of the area 1000a behind the vehicle 100 in accordance with various embodiments. According to various embodiments, the computer system 120 is configured to crop the dynamic pixel images and display the cropped images to the user when the hatch 110 is closed and the vehicle 100 is reversing. Accordingly, the user is provided with a rearview display that displays the relevant portion of the area 1000a behind the vehicle 100 for traffic or object avoidance.

[0029] Fig. 2 shows the vehicle 100 with the hatch 110 in the open configuration 112. As illustrated, the position and tilt angle, or perspective, of the rearview camera 60 relative to the rest of the vehicle 100 changes when the hatch 110 is moved to the open configuration 112. As illustrated, the region 1000a changes to the region 1000b when the perspective of the camera 60 is changed. According to various embodiments, the computer system 120 is configured to crop the dynamic pixel images and display the cropped images to the user when the hatch 110 is open and the vehicle 100 is reversing. Furthermore, the computer system 120 may be configured to generate a graphic overlay and display the enhanced cropped images to the user. An example graphic overlay includes an outline of the end edge of the hatch 110 in the open configuration.Accordingly, the user receives a rearview display showing the corresponding part of the area 1000b behind the vehicle 100, as well as an indication that the flap is open to avoid traffic or objects.

[0030] Fig. 3 shows the computer system 120 and other components of the vehicle 100 in accordance with various embodiments. As shown, the vehicle is equipped with a plurality of cameras 60, including a front camera 61 mounted on a front end 101 of the vehicle 100, a left camera 62 mounted on a left side 102 of the vehicle 100, a right camera 63 mounted on a right side 103 of the vehicle 100, and a rear camera 64 mounted on a rear end 104 of the vehicle 100, for example, on the tailgate 110.

[0031] As in Fig. 3, the vehicle 100 further includes the rearview screen 20, a user interface 30, a light 50, a processor 80, and a memory 90.

[0032] As illustrated, the rearview screen 20, the user interface 30, the light 50, the cameras 60, and the memory 90 are connected to the processor 80 and interconnected via the processor 80. These components can be considered a system 70 for providing a rearview image for the vehicle 100.

[0033] An exemplary rearview screen 20 is configured to display the collected dynamic pixel images and may be disposed in a cabin or other interior portion of the vehicle 100 for viewing by an occupant of the vehicle 100.

[0034] In exemplary embodiments, user interface 30 is an input for receiving a user-initiated request. Furthermore, in exemplary embodiments, user interface 30 may be provided in combination with rearview screen 20. For example, rearview screen 20 may include a touchscreen with one or more pressure sensors configured as user interface 30 to receive input or command from a user. In certain embodiments, a swipe or other gesture on the touchscreen may be used to communicate a user request or command to vehicle 100 or the system.

[0035] An exemplary lamp 50 is a coupling lamp, i.e. it is used to illuminate a coupling at the rear of the vehicle to facilitate connection to a trailer.

[0036] Each example camera 60 is connected to the vehicle 100 and configured to capture dynamic pixel images of the surroundings of the vehicle 100, with the rear camera 64 being configured to capture dynamic pixel images of the area 1000a, 1000b behind the vehicle 100. In example embodiments, each of the cameras 60 is identical, however, the rear camera 64 is rotated 90 degrees compared to the other cameras 61-63 to capture a desired field of view. In particular, each example camera 60 has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction. In example embodiments, the first viewing angle is less than 160 degrees, e.g., 150 degrees. In example embodiments, the second viewing angle is greater than 180 degrees, e.g., 190 degrees.In exemplary embodiments, cameras 61, 62, and 63 are mounted on vehicle 100 such that the smaller first viewing angle extends in the vertical direction and the larger second viewing angle extends in the horizontal direction. The exemplary rearview camera 64 is mounted on vehicle 100 such that the smaller first viewing angle extends in the horizontal direction and the larger second viewing angle extends in the vertical direction. By using identical cameras 60, costs and manufacturing effort can be reduced.

[0037] An example memory 90 is configured to include one or more executable instructions, and an example processor 80 is configured to execute the executable instructions. In example embodiments, the executable instructions enable the processor 80 to crop the collected dynamic pixel images to display a lower portion of the collected dynamic pixel images on the rearview screen 20 when the flip 110 is in the closed configuration 111, and to crop the collected dynamic pixel images to display an upper portion of the collected dynamic pixel images on the rearview screen 20 when the flip 110 is in the open configuration 112.

[0038] In exemplary embodiments, the executable instructions enable the processor 80 to detect when the flap 110 is in the closed configuration 111 or the open configuration 112.

[0039] In exemplary embodiments, the executable instructions enable the processor 80 to display a graphical overlay on the collected dynamic pixel images on the rearview screen 20 when the flap 110 is in the open configuration 112, and wherein the graphical overlay represents an outline of a terminal edge of the flap 110 in the open configuration 112.

[0040] In example embodiments, the executable instructions enable the processor 80 to detect when a gate shadow of the gate is present in the collected dynamic pixel images and to remove the gate shadow from the collected dynamic pixel images.

[0041] In exemplary embodiments, the executable instructions enable the processor 80 to detect when a flap shadow from the flap is present in the collected dynamic pixel images and to activate the hitch light to reduce the flap shadow.

[0042] With reference to Fig. 4 and with continued reference to Fig. 1-3 illustrates a side view of an exemplary rear end 104 of the vehicle 100. The rear end 104 includes a hatch 110 pivotally connected to a right-side rear panel 103. As illustrated, the rearview camera 64 is mounted to the hatch 110. Furthermore, the hatch 110 is configured such that the rearview camera 64 extends farther outward than any other feature of the hatch 110.

[0043] The Fig. illustrate the viewing angle of the exemplary rear view camera 64.

[0044] In Fig. 5, the flap 110 is in the closed configuration 111, with a distal edge 113 upright. The rearview camera 64 has a viewing angle 505 of approximately 190 degrees. As illustrated, the rearview camera has a field of view 500 extending from a lower endpoint 501 at zero degrees to an upper endpoint 502 at 190 degrees. Fig. 5, the viewing area 500 includes a desired portion 503 of the viewing area 500 extending from the lower endpoint 501 to a section line 506. Furthermore, the viewing area 500 includes an undesired portion 504 extending from the section line 506 to the upper endpoint 502. In exemplary embodiments, the desired portion 503 is a lower portion encompassing no more than 75% of the viewing angle 505, for example, no more than 70%, no more than 65%, or no more than 55% of the viewing angle 505. In exemplary embodiments, the desired portion 503 is a lower portion encompassing at least 25% of the viewing angle 505, such as at least 30%, at least 40%, at least 50%, or at least 55% of the viewing angle 505.

[0045] When the flap 110 is in the closed configuration 111, the system 70 processes the dynamic pixel images collected by the camera 64 in the field of view 500 and crops the collected images at the crop line 506 to display the dynamic pixel images in the desired section 503 on the rearview screen 20.

[0046] In Fig. 6, the flap 110 is in the open configuration 112, with a distal edge 113 extending laterally away from the vehicle. The rearview camera 64 has a viewing angle 505 of approximately 190 degrees. As shown, the rearview camera has a field of view 500 extending from a lower endpoint 501 at zero degrees to an upper endpoint 502 at 190 degrees. Fig. 5, the viewing area 500 includes a desired portion 503 of the viewing area 500 extending from the upper endpoint 502 to a cut line 506. Furthermore, the viewing area 500 includes an undesired portion 504 extending from the cut line 506 to the lower endpoint 501. In exemplary embodiments, the desired portion 503 is an upper portion that encompasses no more than 75% of the viewing angle 505, for example, no more than 70%, no more than 65%, or no more than 55% of the viewing angle 505. In exemplary embodiments, the desired portion 503 is an upper portion that encompasses at least 25% of the viewing angle 505, such as at least 30%, at least 40%, at least 50%, or at least 55% of the viewing angle 505.

[0047] When the hatch 110 is in the open configuration 112, the system 70 processes the dynamic pixel images collected by the camera 64 in the field of view 500 and crops the collected images at the crop line 506 to display the dynamic pixel images in the desired section 503 on the rearview screen 20.

[0048] Fig. Figure 7 shows collected dynamic pixel images 710 captured by a rearview camera in a closed configuration. The desired portion 503 of the images 710 is outlined by the cut line 506, and the remaining undesired portion 504 lies above the cut line 506.

[0049] Fig. 8 shows a display 700 of the desired portion 503 of the images 710.

[0050] Fig. Figure 9 shows collected dynamic pixel images 910 captured by a rearview camera in an open configuration. The desired portion 503 of the images 710 is outlined by the cut line 506, and the remaining undesired portion 504 is located below the cut line 506.

[0051] Fig. Figure 10 illustrates a display 900 of the desired part 503 of the images 910. Furthermore, Fig. 10 illustrates an embodiment in which a graphic overlay 1010 is provided in the cropped horizon area 1020 of the displayed image. In particular, the graphic overlay 1010 is a representation of the vehicle 100 with the hatch 110 in the open configuration. Such a graphic overlay 1010 may be stored in memory and automatically rendered when the hatch is in the open configuration and the vehicle is reversing. The graphic overlay 1010 may alert the driver that the hatch is open. Although only in Fig. 10, such a graphic overlay 1010 may be provided in any of the displayed images described herein.

[0052] The Fig. 11-12 show a graphic overlay of the displayed image on a screen 20. Fig. 11 shows collected dynamic pixel images 1110 captured by a rearview camera in an open configuration. The desired portion 503 of the images 1110 is located over the undesired portion 504 of the images 1110.

[0053] Fig. 12 shows a display screen 20 providing a rearview image 1210 of the cropped dynamic pixel images, i.e., the desired portion 503. Furthermore, the displayed image 1210 includes a graphic overlay 1220. In exemplary embodiments, the graphic overlay 1220 depicts an outline of the distal end edge 113 of the flap 110 in the open configuration. Such an outline may be stored in the memory 90.

[0054] The Fig. Figures 13-14 show the processing of an image with a shadow from the flap. Fig. 13 shows the collected dynamic pixel images 1310 captured by a rearview camera in an open configuration. As shown, a shadow 1320 of the open hatch is present in the collected dynamic pixel images 1310. The system 70 is capable of detecting the presence of the shadow 1320 in the collected dynamic pixel images 1310. The system 70 can then remove the shadow 1320 through data processing. Alternatively, the processor 80 can activate the light 50 and illuminate the area behind the vehicle, thereby reducing or eliminating the shadow.

[0055] Fig. 14 shows the view of the collected pixel images 1410 on the screen 20 with the shadow removed.

[0056] Fig. 15 is an example image 1510 of a bird's-eye view displayed on a screen 20 according to various embodiments. Such an image 1510 may be displayed on a rearview screen 20 alongside an image from the Fig. 8 or 10-14, or even displayed alone. As shown, the image 1510 includes a graphic overlay 1520 of the vehicle 100, which may be overlaid on a portion of the surrounding view 1530 obtained from dynamic pixel images captured by all cameras 60. When the hatch 110 is in the open configuration, the system may automatically modify or augment the graphic overlay 1520 of the vehicle 100 to depict an open hatch 110. In particular, a graphic overlay 1540 of the hatch is added to the graphic overlay 1520 of the vehicle 100, or the graphic overlay 1520 is replaced with a graphic overlay of a vehicle with an open hatch. In example embodiments, a graphic overlay 1550 may be highlighted at the trailing edge or highlighted in a highly visible color to remind the driver of the hatch status.In exemplary embodiments, the graphic overlays 1520, 1540, and 1550 may be stored in memory 90.

[0057] With reference to Fig. 16 illustrates a method 1600 for augmenting a rearview display for a vehicle having a hatch movable between a closed and an open configuration. The method 1600 includes, at action 1610, collecting dynamic pixel images of an area behind the vehicle using a rearview camera mounted on the hatch.

[0058] As shown, the example method 1600 includes, at query 1620, determining the status of the hatch to which the camera is mounted, i.e., whether the hatch is closed or open. In example embodiments, the processor determines the status of the hatch. For example, the processor may include instructions to identify the license plate number or other significant feature that is present in the images captured by one configuration but not present in the images captured by the other configuration. For example, the pixel images captured by the camera when the hatch is open include the license plate number, while the pixel images captured when the hatch is closed do not include the license plate number.

[0059] If query 1620 determines that the flip is closed, method 800 proceeds to action 1630 by cropping the image based on the flip status. For example, if the flip is closed, the processor crops the unwanted top portion. Method 800 then displays the cropped image on the screen (action 1680).

[0060] If query 1620 determines that the flip is open, method 800 proceeds to action 1640 by cropping the image based on the flip status. For example, if the flip is open, the processor crops out the unwanted bottom portion.

[0061] Method 1600 continues with action 1650 and adds a graphic overlay to the cropped image. For example, the processor may overlay an outline of the end edge of the opened flap over the cropped image.

[0062] Method 800 may continue with query 1660 to determine if a shadow is present in the clipped image. If query 1660 determines that no shadow is present, the method continues with displaying the clipped image with the graphic overlay at action 1680.

[0063] If query 1660 determines that a shadow is present, the method proceeds to action 1670, which removes or reduces the shadow. For example, the processor may perform image processing to reduce or eliminate the shadow based on previous images in which the shadow is not present. Alternatively or additionally, the processor may activate a light, such as a hitch light, to illuminate the area shadowed by the open hatch.

[0064] Thereafter, the method 1600 may continue with the display of the cropped image with the graphic overlay and the reduced shading at action 1680.

[0065] As described herein, a vehicle is equipped with a plurality of cameras. In particular, the example vehicle includes a front-end mounted camera, a right-side mounted camera, a left-side mounted camera, and a tailgate mounted camera. In example embodiments, each camera is identical and has a first viewing angle in a first direction and a second viewing angle in a second direction perpendicular to the first direction. In example embodiments, the second viewing angle is greater than the first viewing angle. In example embodiments, the front-end, right-side, and left-side cameras are all mounted with the same orientation. Namely, with the second viewing angle in the horizontal direction and the first viewing angle in the vertical direction.In exemplary embodiments, the camera is mounted on the rear hatch at a 90-degree angle relative to the other cameras, so that the second viewing angle is vertical and the first camera angle is horizontal. This allows the hatch-mounted camera to provide a sufficient view of the area behind the vehicle when the hatch is closed and when it is open.

[0066] In exemplary embodiments, the rearview display system can automatically determine whether the hatch is in the closed or open configuration based on the images collected by the rearview camera. Further, in exemplary embodiments, in response to determining the hatch configuration, the rearview display system crops the corresponding portion of the images collected by the camera for display on a screen.

[0067] It was also found that the orientation of the rear view camera and the intended image section eliminate or reduce the blind spots at the corners of the open hatch.

[0068] Furthermore, the present embodiments provide for a graphic overlay of an end edge of the flap to be displayed over the cropped image when the flap is in the open configuration.

[0069] The embodiments described herein also enable detection when a shadow from an opened flap is present in the collected images and removal of the shadow from the image through data processing or by activating a light to reduce the shadow.

Claims

[1] Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60) comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: each camera (60) has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted on the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is mounted on the rear end (104) and is oriented such that the first viewing angle is in the horizontal direction and the second viewing angle is in the vertical direction; wherein the vehicle (100) further comprises: a flap (110) at the rear end (104), the flap (110) being movable between a closed configuration and an open configuration, the fourth camera (64) being mounted on the flap (110) and being configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to crop the collected dynamic pixel images such that a lower portion of the collected dynamic pixel images is displayed on the display screen (20) when the flip (110) is in the closed configuration, and crop the collected dynamic pixel images such that an upper portion of the collected dynamic pixel images is displayed on the display screen (20) when the flip (110) is in the open configuration. [2] The vehicle (100) of claim 1, wherein the lower portion of the collected dynamic pixel images comprises no more than 75% of the second viewing angle and wherein the upper portion of the collected dynamic pixel images comprises no more than 75% of the second viewing angle. [3] Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60) comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: each camera (60) has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted on the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is mounted on the rear end (104) and is oriented such that the first viewing angle is in the horizontal direction and the second viewing angle is in the vertical direction; wherein the vehicle (100) further comprises: a flap (110) at the rear end (104), the flap (110) being movable between a closed configuration and an open configuration, the fourth camera (64) being mounted on the flap (110) and being configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to display a graphical overlay on the collected dynamic pixel images on the display screen (20) when the flap (110) is in the open configuration, and wherein the graphical overlay depicts an outline of a terminal edge of the flap (110) in the open configuration. [4] Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60) comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: each camera (60) has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted on the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is mounted on the rear end (104) and is oriented such that the first viewing angle is in the horizontal direction and the second viewing angle is in the vertical direction; wherein the vehicle (100) further comprises: a flap (110) at the rear end (104), the flap (110) being movable between a closed configuration and an open configuration, the fourth camera (64) being mounted on the flap (110) and being configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to detect when the flap (110) is in the open configuration. [5] Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60) comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: each camera (60) has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted on the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is mounted on the rear end (104) and is oriented such that the first viewing angle is in the horizontal direction and the second viewing angle is in the vertical direction; wherein the vehicle (100) further comprises: a flap (110) at the rear end (104), the flap (110) being movable between a closed configuration and an open configuration, the fourth camera (64) being mounted on the flap (110) and being configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to detect when a flap shadow from the flap (110) is present in the collected dynamic pixel images and to remove the flap shadow from the collected dynamic pixel images. [6] Vehicle (100), comprising: a front end (101) and a rear end (104); a left side (102) and a right side (103); and a plurality of cameras (60) comprising a first camera (61), a second camera (62), a third camera (63) and a fourth camera (64), wherein: each camera (60) has a first viewing angle in a first direction and a second viewing angle, greater than the first viewing angle, in a second direction perpendicular to the first direction; the first camera (61) is mounted on the front end (101), the second camera (62) is mounted on the left side (102), the third camera (63) is mounted on the right side (103), and each of the first camera (61), the second camera (62), and the third camera (63) is oriented such that the first viewing angle extends in a vertical direction and the second viewing angle extends in a horizontal direction; and the fourth camera (64) is mounted on the rear end (104) and is oriented such that the first viewing angle is in the horizontal direction and the second viewing angle is in the vertical direction; wherein the vehicle (100) further comprises: a flap (110) at the rear end (104), the flap (110) being movable between a closed configuration and an open configuration, the fourth camera (64) being mounted on the flap (110) and being configured to capture dynamic pixel images of an area (1000) behind the vehicle (100); a trailer lamp at the rear end (104); a display screen (20) configured to display the collected dynamic pixel images; and a memory (90) configured to contain one or more executable instructions, and a processor (80) configured to execute executable instructions, wherein the executable instructions enable the processor (80) to detect when a flap shadow from the flap (110) is present in the collected dynamic pixel images and to activate the trailer hitch light to reduce the flap shadow. [7] Vehicle (100) according to one of the preceding claims, wherein the first viewing angle is between 140 and 160 degrees and the second viewing angle is greater than 180 degrees. [8] A method of extending a rearview display for a vehicle (100) having a flap (110) movable between a closed and an open configuration, the method comprising: Capturing dynamic pixel images of an area (1000) behind the vehicle (100) with a camera (64) mounted on the flap (110); when the flap (110) is in the closed configuration, cropping the collected dynamic pixel images to display a lower portion of the collected dynamic pixel images on a display screen (20) via a processor (80); when the flap (110) is in the open configuration, cropping the collected dynamic pixel images to display an upper portion of the collected dynamic pixel images on the display screen via the processor (80); and Displaying a graphic overlay on the collected dynamic pixel images on the display screen (20) via the processor (80) when the flap (110) is in the open configuration, and wherein the graphic overlay represents an outline of a terminal edge of the flap (110) in the open configuration.

Images