SYSTEM FOR CHANGING THE FIELD OF VIEW OF AN EXTERNAL REARVIEW CAMERA

Abstract

Side reversing camera system, comprehensive: a side-mounted reversing camera that captures a video of an area that is at least beside and behind a vehicle and that has a predetermined field of view (FOV), wherein the predetermined FOV is defined by a first predetermined horizontal viewing angle (AOV) and a first predetermined vertical AOV; an advertisement; and a display module that is on the display: displays a first section of the video within a first predetermined section of the predetermined FOV, wherein the first predetermined section of the predetermined FOV is defined by a second predetermined horizontal AOV and a second predetermined vertical AOV; and selectively displays a second section of the video within a second predetermined section of the predetermined FOV, wherein the second predetermined section of the predetermined FOV is defined by a third predetermined horizontal AOV and a third predetermined vertical AOV, including at least one of: the third given horizontal AOV is larger than the second given horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined vertical AOV, wherein the display module displays the second section of the video within the second predetermined section of the predetermined FOV when the vehicle is in reverse gear and when a steering angle (SWA) is greater than a predetermined angle.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to exterior rearview mirror systems of vehicles, and more particularly to systems for adjusting the field of view of videos captured by exterior rearview mirror cameras. BACKGROUND

[0002] The background description provided herein is intended to provide a general context for the disclosure. The work of the presently identified inventors, to the extent described in this Background section, as well as aspects of the description not otherwise considered prior art at the time of filing, are not expressly or implicitly considered prior art to the present disclosure.

[0003] A vehicle driver traditionally views the vehicle's surroundings through windows, windshields, and other vehicle glass. The driver can control vehicle acceleration, deceleration, and steering based on the driver's visual observation of the vehicle's surroundings.

[0004] A vehicle may include one or more side-mounted rearview mirrors that allow the driver to see to the side and rear of the vehicle. These rearview mirrors include, for example, a driver-side rearview mirror located near a driver's door of the vehicle and a passenger-side rearview mirror located near a passenger door of the vehicle.

[0005] WO 2014 / 033099 A2 describes a vehicle with external rearview cameras, which also includes side rearview cameras that can be activated at higher vehicle speeds. DE 10 2012 019 234 A1, DE 10 2013 014 908 A1, US 2014 / 0347489 A1, and DE 43 36 288 C1 each disclose vehicles with a rearview camera mounted at the rear of the vehicle.

[0006] It is the object of the present invention to provide a side rear view camera system that makes reversing parking easier for the driver.

[0007] This problem is solved by the features of claim 1. SUMMARY

[0008] A side-view camera is located on the driver or passenger side of the vehicle, captures video to the side and rear of the vehicle, and has a specified field of view (FOV). The specified field of view is defined by a first specified horizontal angle of view (AOV) and a first specified vertical field of view (AOV). A display is located in a passenger compartment of the vehicle and is visible.A display module on the display: displays a first portion of the video within a first predetermined portion of the predetermined FOV, wherein the first predetermined portion of the predetermined FOV is defined by a second predetermined horizontal AOV and a second predetermined vertical AOV; and selectively displays a second portion of the video within a second predetermined portion of the predetermined FOV, wherein the second predetermined portion of the predetermined FOV is defined by a third predetermined horizontal AOV and a third predetermined vertical AOV. At least one of: the third predetermined horizontal AOV is greater than the second predetermined horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined horizontal AOV.

[0009] In further features, the display module displays the second portion of the video within the second predetermined portion of the predetermined FOV for a merging event of the vehicle.

[0010] In further features, the display module displays the second portion of the video within the second predetermined portion of the predetermined FOV for a lane change event of the vehicle.

[0011] In further features, a lane change module indicates the occurrence of the lane change event when a vehicle speed is higher than a predetermined speed and a driver has activated a vehicle turn signal.

[0012] The display module displays the second portion of the video within the second predetermined portion of the predetermined FOV when the vehicle is in reverse gear.

[0013] In further features, both: the third predetermined horizontal AOV is greater than the second predetermined horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined vertical AOV.

[0014] In further features, at least one of: the third predetermined horizontal AOV is less than the first predetermined horizontal AOV; and the third predetermined vertical AOV is less than the first predetermined vertical AOV.

[0015] In further features, both: the third predetermined horizontal AOV is smaller than the first predetermined horizontal AOV; and the third predetermined vertical AOV is smaller than the first predetermined vertical AOV.

[0016] In further features, a camera actuator module selectively tilts the side rearview camera vertically to a predetermined position in response to user input.

[0017] In further features, a camera actuator module selectively tilts the side rearview camera downward to a predetermined position in response to user input.

[0018] Also disclosed is a method comprising the steps of: receiving a video from a side view camera located on a driver or passenger side of the vehicle and capturing the video alongside and behind the vehicle, the side view camera having a predetermined field of view (FOV), the predetermined FOV defined by a first predetermined horizontal angle of view (AOV) and a first predetermined vertical AOV; displaying a first portion of the video within a first predetermined portion of the predetermined FOV on a display located and visible in a passenger cabin of the vehicle, the first predetermined portion of the predetermined FOV defined by a second predetermined horizontal AOV and a second predetermined vertical AOV;and selectively displaying a second portion of the video on the display from within a second predetermined portion of the predetermined FOV, wherein the second predetermined portion of the predetermined FOV is defined by a third predetermined horizontal AOV and a third predetermined vertical AOV. At least one of: the third predetermined horizontal AOV is greater than the second predetermined horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined horizontal AOV.

[0019] In further features, selectively displaying the second portion of the video includes displaying the second portion of the video from the second predetermined portion of the predetermined FOV for a merging event of the vehicle.

[0020] In further features, selectively displaying the second portion of the video includes displaying the second portion of the video from the second predetermined portion of the predetermined FOV for a lane change event of the vehicle.

[0021] In further features, the method further includes identifying the occurrence of the lane change event when a vehicle speed is greater than a predetermined speed and a driver has activated a turn signal of the vehicle.

[0022] In further features, selectively displaying the second portion of the video includes displaying the second portion of the video from the second predetermined portion of the predetermined FOV when a transmission of the vehicle is in reverse.

[0023] In further features, both: the third predetermined horizontal AOV is greater than the second predetermined horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined vertical AOV.

[0024] In further features, at least one of: the third predetermined horizontal AOV is less than the first predetermined horizontal AOV; and the third predetermined vertical AOV is less than the first predetermined vertical AOV.

[0025] In further features, both: the third predetermined horizontal AOV is less than the first predetermined horizontal AOV; and the third predetermined vertical AOV is less than the first predetermined vertical AOV.

[0026] In further features, the method further includes selectively vertically tilting the side rear view camera to a predetermined position in response to a user input.

[0027] In further features, the method further includes selectively tilting the side rear view camera vertically downward to a predetermined position in response to a user input.

[0028] Further areas of applicability of the present disclosure will become apparent from the detailed description, claims, and drawings. The detailed description and specific examples are provided for purposes of illustration only and are not intended to limit the scope of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The present disclosure will become more fully understood with reference to the detailed description and the accompanying drawings, in which: Fig. 1A and Fig. 1B are overhead views of an exemplary vehicle; Fig. 2 is an exemplary illustration from the perspective of a driver's seat in a passenger cabin of the vehicle; Fig. 3A, Fig. 3B and Fig. 3C include exemplary representations of videos from different viewpoints (FOVs); Fig. 4 is a functional block diagram of an exemplary implementation of a display control module; Fig. 5 is a flowchart illustrating an exemplary method for changing a view angle of the video displayed on a side view display based on whether a vehicle is merging; Fig. Figure 6 is an exemplary representation of the FOV used before, during, and after a left-fusing event; Fig. 7 is a flowchart showing an exemplary method for changing an FOV of the video displayed on a side view display based on whether a vehicle is changing lanes; Fig. Figure 8 is an exemplary representation of the FOV used before, during, and after a left lane change event; Fig. 9 is a flowchart showing an exemplary method for changing an FOV of the video displayed on a side rear view display based on whether a vehicle is backing up; Fig. 10 includes an exemplary representation of the FOV before and during a reverse parking event; Fig. 11 is a functional block diagram of an exemplary implementation of a display control module; and Fig. 12A and Fig. 12B illustrates the default FOV of a left-side rearview camera when tilted up and down.

[0030] In the drawings, the same reference numerals are used for similar and / or identical elements. DETAILED DESCRIPTION

[0031] Side (outside) rearview cameras capture video from the side and rear of a vehicle. For example, a left side rearview camera captures video from the left side and rear of the vehicle, while a right side rearview camera captures video from the right side and rear of the vehicle. Some vehicles may not have side rearview mirrors, for example, to reduce wind resistance. Instead of side rearview mirrors, videos captured with side rearview cameras may be displayed on side rearview displays located in a passenger compartment of the vehicle.

[0032] Side-view cameras have a predetermined field of view (FOV). A display control module can display video within a portion of the predetermined FOV on an associated side-view display in the passenger compartment to provide views of what is visible via rear exterior mirrors. According to the present application, the display control module selectively varies the portion of the predetermined FOV under different circumstances.

[0033] The display control module may generally display video within a first predetermined portion (a first predetermined FOV) of the predetermined FOV of a side view camera. The display control module may display video from within a second predetermined portion (a second predetermined FOV) of the predetermined FOV of the side view camera for a vehicle merging event, a vehicle lane change event, and a vehicle reverse parking event. The second predetermined portion is vertically and / or horizontally larger (angularly) than the first predetermined portion. Thus, when video from the second predetermined portion is displayed, features within the video are visibly smaller than the same features when video from the first predetermined portion was displayed. Video from a larger area of ​​the predetermined FOV is displayed when the second predetermined portion is used.This can provide more relevant video for the driver during merging, lane changing, and reverse parking events and replicates what a driver can see via a side view mirror by moving their head toward the side view mirror.

[0034] A side rear view camera may be mounted such that the specified FOV of the side rear view camera is fixed. Alternatively, a side rear view camera may be actuated such that the specified FOV can be tilted vertically up and down. According to the present application, the display control module may actuate a side rear view camera up and down under different circumstances to better position the specified FOV for the respective circumstances. For example, the display control module may actuate a side rear view camera vertically downward to capture the lane and generate overhead views. The display control module may actuate a side rear view camera vertically upward to generate 360-degree views around the vehicle and to capture video of the vehicle's surroundings.

[0035] Fig. 1A is an overhead view of an exemplary vehicle 100 with a functional block diagram of an exemplary backup camera system. The vehicle 100 includes a left-side backup camera 104 and a right-side backup camera 108. The left-side backup camera 104 captures video to the left and rear of the vehicle 100 and has a predetermined field of view (FOV). The right-side backup camera 108 captures video to the right and rear of the vehicle 100 and also has the predetermined FOV. The predetermined field of view is defined by a predetermined vertical angle of view (AOV) and a predetermined horizontal AOV, as discussed below.

[0036] Fig. Figure 1A illustrates the vehicle 100 without side view mirrors. Eliminating side view mirrors can reduce the fuel consumption of the vehicle 100 by reducing aerodynamic drag.

[0037] A display control module 112 displays the video captured by the left-side rearview camera 104 on a left-side rearview display 116 to provide visual feedback that a left-side rearview mirror may provide. The display control module 112 also displays video captured by the right-side rearview camera 108 on a right-side rearview display 120 to provide visual feedback that a right-side rearview mirror may provide. The left and right rearview displays 116 and 120 may be, for example, liquid crystal displays (LCDs), light-emitting diode (LED) displays, or another suitable type of video display.

[0038] The left-side rearview camera 104 may be positioned at or in front of a location where the left rearview mirror would otherwise be mounted, e.g., on the A-pillars of the vehicle. The right-side rearview camera 108 may be positioned at or in front of a location where the right rearview mirror would otherwise be mounted. The left and right rearview cameras 104 and 108 may be fixed cameras and have a fixed FOV, as in the example of Fig. 1A.

[0039] Alternatively, as in Fig. 1B, the left and right rear view cameras 104 and 108 can be tilted (e.g., vertically) to achieve different FOVs depending on the tilt position. Fig. 1B includes an overhead view of the vehicle 100 with a functional block diagram of an exemplary side view camera system. The vehicle 100 of Fig. 1B also includes the left and right side rearview mirrors 124 and 128. Since the vehicle 100 consists of Fig. 1B includes the left and right side rearview mirrors 124 and 128, the left and right side reversing indicators 116 and 120 can be omitted.

[0040] Referring now to the Fig. 1A and Fig. 1B, the display control module 112 may additionally or alternatively display videos captured with the left rearview camera 104, the right rearview camera 108, and / or one or more other cameras of the vehicle on one or more other displays, such as a center console display 132. In Fig. 1B, the display control module 112 may display videos captured by the left and right rearview cameras 104 and 108 on the center console display 132. Other cameras include, but are not limited to, one or more forward-facing cameras, such as the forward-facing camera 136, one or more rearward-facing cameras, such as the rearward-facing camera 140, and one or more other right-facing and / or left-facing cameras.

[0041] The display control module 112 may also display video signals on one or more displays of the vehicle based on signals received from other types of vehicle environmental sensors, such as LIDAR sensors, radar sensors, laser sensors, etc. Although exemplary locations are provided, the front- and rear-facing cameras 136 and 140 may be arranged differently and / or one or more other rear- and front-facing cameras may be provided. The left and right rearview cameras and forward- and rearward-facing cameras 136 and 140 may be located in other locations to capture video from positions adjacent to the vehicle 100, which may be viewed via the left and right rearview mirrors 124 and 128.

[0042] Fig. 2 is an exemplary illustration of a driver's seat within a passenger cabin of vehicle 100. The left and right rearview indicators 116 and 120 and the center console indicator 132 are visible from the driver's seat and other locations within the passenger cabin of the vehicle. However, as previously explained, the center console indicator 132 or the left and right rearview indicators 116 and 120 may be omitted in various implementations. The driver rotates a steering wheel 204 to steer the vehicle 100, for example, to change lanes, merge, and park the vehicle 100.

[0043] With reference back to the Fig. 1A and Fig. 1B, the display control module 112 generally displays a first predetermined FOV of the video captured by the left and right rearview cameras 104 and 108 on the left and right rearview displays 116 and 120. The first predetermined FOV may be narrower (angular) vertically and / or horizontally than the predetermined FOV of the left and right rearview cameras 104 and 108.

[0044] Fig. 3A includes an exemplary illustration with the predetermined FOV 304 of the right rearview camera 108. The predetermined FOV 304 is defined by a first predetermined horizontal angle of view (AOV) 316 and a first predetermined vertical AOV 320.

[0045] Fig. 3B includes an exemplary illustration of the first predetermined FOV 308 of the predetermined FOV 304 displayed on the right rear view display 120. The first predetermined FOV 308 is defined by a second predetermined horizontal AOV 324 and a second predetermined vertical AOV 328. The second predetermined horizontal AOV 324 is smaller than the first predetermined horizontal AOV 316, and the second predetermined vertical AOV 328 is smaller than the first predetermined vertical AOV 320.

[0046] With reference back to the Fig. 1A and Fig. 1B, the display control module 112 varies the FOV displayed on a side backup display when one or more conditions occur. For example, the display control module 112 displays the video within a second predetermined FOV on the left-side backup display 116 for a left merge event, a left lane change event, and a reverse parking of the vehicle. The display control module 112 displays the video within a second predetermined FOV on the right-side backup display 120 for a right merge event, a right lane change event, and a reverse parking of the vehicle.

[0047] Fig. 3C includes an exemplary illustration of the second predetermined FOV 312 of the predetermined FOV 304 displayed on the right rearview display 120. The second predetermined FOV 312 is defined by a third predetermined horizontal AOV 332 and a third predetermined vertical AOV 336. The third predetermined horizontal AOV 332 may be larger than the second predetermined horizontal AOV 324, and / or the third predetermined vertical AOV 336 may be larger than the second predetermined vertical AOV 328.

[0048] In other words, the second predetermined FOV 312 is vertically and / or horizontally larger (angularly) than the first predetermined FOV 308. As can be seen from a comparison of the Fig. 3B and Fig. 3C, the second predetermined FOV 312 may be vertically and horizontally larger than the first predetermined FOV 308, such that a larger area of ​​the predetermined FOV 304 is displayed on the right rearview display 120. The second predetermined FOV 312 may be vertically and / or horizontally narrower (angularly) than the predetermined FOV 304 of the left and right rearview cameras 104 and 108. Although the example of the second predetermined FOV is vertically and horizontally narrower than the predetermined FOV of the left and right rearview cameras 104 and 108, the second predetermined FOV may be vertically and / or horizontally equal to the predetermined FOV of the left and right rearview cameras 104 and 108. For example, predetermined FOVs that are narrower than the predetermined FOV 304 of the left and right rearview cameras 104 and 108 may be displayed to minimize image distortions that may occur near the edges of the predetermined FOV 304.While the example of the right reversing indicator 120 in the . Fig. 3A, Fig. 3B and Fig. 3C, the same is also applicable to the left reversing indicator 120.

[0049] Fig. 4 is a functional block diagram of an exemplary implementation of the display control module 112. The display control module 112 may include a merging module 404, a lane change module 408, a parking module 412, a view field module 416, and a display module 420. Fig. 5 includes a flowchart illustrating an exemplary method for changing a FOV displayed on a side view display based on whether a vehicle 100 is merging.

[0050] With reference now to the Fig. 4 and Fig. 5 generates the merge module 404 ( Fig. 4) a merge signal 424 indicating whether at 504 ( Fig. 5) a merge event occurs. If a merge event occurs, the merge module 404 may set the merge signal 424 to a first state indicating that a merge event occurs, and control continues with 508. If no merge event occurs, the merge module 404 may set the merge signal 424 to a second state indicating that no merge event occurs, and control continues with 524, as explained in more detail below. A merge event may occur when the vehicle 100 merges into a lane and / or when the vehicle 100 is expected to merge into a lane (e.g., within a predetermined future period from a current time).

[0051] The merge module 404 may determine whether a merge event occurs when a driver assistance system (ADAS) indicates via a fusion signal 428 that a merge event is occurring. ADAS systems may indicate that a merge event is occurring, for example, when a visual indicator of a merge event is captured, such as an image in front of the vehicle 100 (e.g., captured via a forward-facing camera), including a merging road sign, a merging lane marking, or a pattern in lane lines indicating the merge. Additionally or alternatively, the merge module 404 may determine whether a merge event occurs when a driver activates a turn signal to activate a turn signal (e.g., lights or lamps) of the vehicle 100. A turn signal 432 may indicate whether the driver has activated a turn signal of the vehicle 100.

[0052] At 508, the merge module 404 may determine whether the merge event is to the right. The blink signal 432 and / or the merge signal 428 may indicate whether the merge event is to the left or right. If 508 is true (the merge event is to the right), control continues with 512. At 512, the field of view module 416 sets ( Fig. 4) a right FOV signal 436 to a first state. When the right FOV signal 436 is in the first state, the rearview display 120 is displayed on the right side. Also at 512, the display module 420 displays the video from the second predetermined FOV of the right rearview video 440, which was captured with the right rearview camera 108. The right rearview video 440 includes video within the predetermined FOV, but the display module 420 only displays video within the second predetermined FOV of the right rearview video 440.

[0053] If 508 is false (the merge event is on the left), control continues with 516. At 516, the field of view module 416 sets an FOV signal 444 to a first state. If the left FOV signal 444 is in the first state, the rearview display 116 is displayed on the left side. Also at 516, the display module 420 displays the video from the second predetermined FOV of the left rearview video 448 captured by the left rearview camera 104. The left rearview video 448 includes video within the predetermined FOV, but the display module 420 only displays video within the second predetermined FOV of the left rearview video 448.

[0054] Also at 512, the field of view module 416 may set the left FOV signal 444 to the first state or a second state. When the left FOV signal 444 is in the second state, the display module 420 displays on the left rearview camera 116 the video from the first predetermined FOV of the left rearview video 448 captured with the left rearview camera 104. Also at 516, the field of view module 416 may set the right FOV signal 436 to the first state or a second state. When the right FOV signal 436 is in the second state, the rearview display 120 is displayed on the right side, with the display module 420 displaying the video from the first predetermined FOV of the right rearview video 440 captured with the right rearview camera 108.

[0055] Control continues from 512 and 516 to 520. At 520, the merge module 404 may determine whether the merge event is complete. For example, the merge module 404 may determine whether the merge signal 428 has transitioned to a second state and / or the turn signal 432 indicates that the driver has deactivated the turn signal. If 520 is false, control may return to 508 to continue the video display within the second predetermined field of view. If 520 is true, control continues to 524.

[0056] At 524, the field of view module 416 may set the right FOV signals 436 and 444 to the second state. As mentioned above, when the right FOV signal 436 is in the second state, the display module 420 displays on the right rearview camera 120 the video from the first predetermined FOV of the right rearview video 440 captured with the right rearview camera 108. When the left FOV signal 444 is in the second state, the display module 420 displays on the left rearview camera 116 the video from the first predetermined FOV of the left rearview video 448 captured with the left rearview camera 104. While the example of Fig. 5 represents termination after 524, control can return to 504 for a next control loop.

[0057] Fig. 6 includes an exemplary representation of the FOV used before, during, and after a left merge event. As illustrated by 604, the video from the first predetermined FOV is displayed before a merge event. As illustrated by 608, the video from the second (larger) predetermined FOV is displayed on the left rear view 116 during the left merge event. As illustrated by 616, the video from the first predetermined FOV is displayed after the merge event is completed.

[0058] Although the example of Fig. 6 illustrates at 612 the example of the video from the first predetermined FOV displayed on the right rear view display 120 during the merge event, the second predetermined FOV could also be used for the right rear view display 120 during the merge event. In addition, while the example of Fig. 6 illustrates the example of the second predetermined FOV having an angle greater than the first predetermined FOV in the horizontal direction, the second predetermined FOV may also be having an angle greater than the first predetermined FOV in the vertical direction.

[0059] Fig. 7 includes a flowchart illustrating an exemplary method for changing a FOV displayed on a side view display based on whether a vehicle 100 is changing lanes. Referring now to the Fig. 4 and Fig. 7 generates the lane change module 408 ( Fig. 4) a lane change signal 452 that indicates whether a lane change event occurs at 704 ( Fig. 7).

[0060] If a lane change event occurs, the lane change module 408 may set the lane change signal 452 to a first state indicating that a lane change event is occurring, and control continues at 708. If no lane change event occurs, the lane change module 408 may set the lane change signal 452 to a second state indicating that no lane change event is occurring, and control passes to 724, which is explained in more detail below. A lane change may occur when the vehicle is changing or has changed 100 lanes of a roadway.

[0061] The lane change module 408 may determine whether a lane change event occurs when the turn signal 432 indicates that the driver has activated a turn signal of the vehicle 100 and a vehicle speed 456 is greater than a first predetermined speed. The first predetermined speed is greater than zero and may, for example, be greater than or equal to 25 mph or another suitable speed. The vehicle speed 456 may be measured using one or more sensors. For example, the vehicle speed 456 may be determined based on or equal to one or more wheel speeds measured using respective wheel speed sensors.

[0062] At 708 ( Fig. 7), the lane change module 408 may determine whether the merge event is to the right. The turn signal 432 may indicate whether the merge event is to the left or right. If 708 is true (the merge event is to the right), control continues with 712. At 712, the view field module 416 sets ( Fig. 4) the right FOV signal 436 to the first state. When the right FOV signal 436 is in the first state, the rearview display 120 is displayed on the right side. Also at 712, the display module 420 displays the video from the second predetermined FOV of the right rearview video 440, which was captured with the right rearview camera 108. The right rearview video 440 includes video within the predetermined FOV, but the display module 420 only displays video within the second predetermined FOV of the right rearview video 440.

[0063] If 708 is false (the merge event is on the left trajectory), control continues to 716. At 716, the field of view module 416 sets the left FOV signal 444 to the first state. When the left FOV signal 444 is in the first state, the rearview display 116 is displayed on the left side. Also at 716, the display module 420 displays the video from the second predetermined FOV of the left rearview video 448 captured by the left rearview camera 104. The left rearview video 448 includes video within the predetermined FOV, but the display module 420 only displays video within the second predetermined FOV of the left rearview video 448.

[0064] Also at 712, the field of view module 416 may set the left FOV signal 444 to the first state or the second state. When the left FOV signal 444 is in the second state, the rearview display 116 is displayed on the left side, with the display module 420 displaying the video from the first predetermined FOV of the left rearview video 448 captured with the left rearview camera 104. Also at 716, the field of view module 416 may set the right FOV signal 436 to the first state or the second state. When the right FOV signal 436 is in the second state, the rearview display 120 is displayed on the right side, with the display module 420 displaying the video from the first predetermined FOV of the right rearview video 440 captured with the right rearview camera 108.

[0065] Control continues from 712 and 716 to 720. At 720, the lane change module 408 determines whether the lane change event is complete. For example, the lane change module 408 may determine whether the turn signal 432 indicates that the driver has turned off the turn signal. If 720 is false, control may return to 708 to continue the video display within the second predetermined field of view. If 720 is true, control continues to 724.

[0066] At 724, the field of view module 416 may set the right FOV signals 436 and 444 to the second state. As mentioned above, when the right FOV signal 436 is in the second state, the display module 420 displays on the right rearview camera 120 the video from the first predetermined FOV of the right rearview video 440 captured with the right rearview camera 108. When the left FOV signal 444 is in the second state, the rearview display 116 is displayed on the left side, with the display module 420 displaying the video from the first predetermined FOV of the left rearview video 448 captured with the left rearview camera 104. While the example of Fig. 7 represents termination after 724, control may return to 704 for a next control loop.

[0067] Fig. 8 includes an exemplary representation of the FOV used before, during, and after a left lane change event. As illustrated by 804, the video from the first predetermined FOV is displayed before a lane change event. As illustrated by 808, the video from the second (larger) predetermined FOV is displayed on the left rear view 116 during the left-to-left merge event.

[0068] As illustrated by 816, the video from the first predetermined FOV is displayed after the lane change event is completed.

[0069] Although the example of Fig. 8 at 812 illustrates the example of the video from the first predetermined FOV displayed on the right rear view display 120 during the merge event, the second predetermined FOV could also be used for the right rear view display 120 during the merge event. In addition, while the example of Fig. 8 illustrates the example of the second predetermined FOV having an angle greater than the first predetermined FOV in the horizontal direction, the second predetermined FOV may also be having an angle greater than the first predetermined FOV in the vertical direction.

[0070] Fig. 9 includes a flowchart illustrating an exemplary method for changing a FOV displayed on a side view display based on whether a vehicle 100 is backing up. Referring now to the Fig. 4 and Fig. 9 generates the parking module 412 ( Fig. 4) a parking signal 460 that indicates whether a parking event occurs at 904 ( Fig. 9).

[0071] If a parking event occurs, the parking module 412 may set the parking signal 460 to a first state indicating that a parking event occurs, and control continues at 908. If no parking event occurs, the parking module 412 may set the parking signal 460 to a second state indicating that no parking event occurs, and control continues at 916, which is explained in more detail below. For example, a parking event may occur when the vehicle 100 reverses to park the vehicle 100 at a location.

[0072] The parking module 412 may determine whether a parking event occurs when the vehicle 100 is traveling in reverse and a steering wheel angle (SWA) 464 is greater than a predetermined angle. Vehicle speed 456 being greater than a second predetermined speed while a transmission of the vehicle is in reverse may indicate that the vehicle 100 is traveling in reverse. The second predetermined speed is greater than zero and may be, for example, about 1 mph or another suitable speed. The SWA 464 may be measured using an SWA sensor that measures a current angle of the steering wheel 204 relative to a predetermined reference angle. The predetermined reference angle may be, for example, an angle of the steering wheel 204 where the vehicle 100 may be traveling along a longitudinal axis of the vehicle 100.

[0073] At 908 ( Fig. 9) the field of view module 416 ( Fig. 4) set the right and left FOV signals 436 and 444 to the first state. When the right FOV signal 436 is in the first state, the rearview display 120 is displayed on the right side. Also at 908, the display module 420 displays the video from the second predetermined FOV of the right rearview video 440, which was recorded with the right rearview camera 108. The right rearview video 440 includes video within the predetermined FOV, but the display module 420 only displays video within the second predetermined FOV of the right rearview video 440. When the left FOV signal 444 is in the first state, the rearview display 116 is displayed on the left side. Also at 908, the display module 420 displays the video from the second predetermined FOV of the left rearview video 448, which was recorded with the left rearview camera 104.The left rear view video 448 includes a video within the predetermined FOV, but the display module 420 only displays a video within the second predetermined FOV of the left rear view video 448.

[0074] At 912, the parking module 412 may determine whether the parking event is complete. For example, the parking module 412 may determine whether the vehicle speed 456 is less than the second predetermined speed and / or the SWA 464 is less than the predetermined angle. If 912 is false, control may return to 908 to continue the video display within the second predetermined field of view. If 908 is true, control continues to 916.

[0075] At 916, the field of view module 416 may set the right and left FOV signals 436 and 444 to the second state. As mentioned above, when the right FOV signal 436 is in the second state, the display module 420 displays on the right rearview camera 120 the video from the first predetermined FOV of the right rearview video 440 captured with the right rearview camera 108. When the left FOV signal 444 is in the second state, the rearview display 116 is displayed on the left side, with the display module 420 displaying the video from the first predetermined FOV of the left rearview video 448 captured with the left rearview camera 104. While the example of Fig. 9 represents the termination after 916, the control can return to 904 for a next control loop.

[0076] Fig. 10 includes an exemplary representation of the FOV before and during a reverse parking event. As illustrated by 1004, the video from the first predetermined FOV is displayed before a parking event. As illustrated by 1008, the video from the second (larger) predetermined FOV is displayed on the left and right rearview views 116 and 120 during the parking event. While the example of Fig. 10 illustrates the example of the second predetermined FOV having an angle greater than the first predetermined FOV in the horizontal direction, the second predetermined FOV may also be having an angle greater than the first predetermined FOV in the vertical direction.

[0077] While the example of changing the FOV displayed for a parking event is provided, the field of view module 416 may additionally or alternatively display video from the second predetermined FOV when the vehicle is in reverse (and the SWA 464 is less than the predetermined angle) or the SWA 464 is greater than the predetermined angle (and regardless of whether the vehicle is in reverse, e.g., in a forward gear). If the only vehicle is in reverse (and the SWA 464 is less than the predetermined angle), the second predetermined FOV or another predetermined FOV (e.g., vertically larger than the first predetermined FOV or an FOV of a different area) may be displayed on both the left and right rearview displays 116 and 120. If only the SWA 464 is greater than the predetermined angle (and regardless of whether the vehicle is in reverse, e.g.,when the vehicle is in a forward gear), the second predetermined FOV or another predetermined FOV (e.g., vertically and / or horizontally larger than the first predetermined FOV, an FOV of a different area) may be displayed on both the left and right sides of the rearview displays 116 and 120, or on one of the left and right rearview displays 116 and 120 in the direction that the steering wheel is rotated relative to the predetermined reference angle.

[0078] Fig. 11 is a functional block diagram of an exemplary implementation of the display control module 112. In addition or alternatively to Fig. 4, the display control module 112 may include a camera actuator module 1104 and a driver input module 1108.

[0079] The display module 420 may additionally or alternatively display videos captured with the left rearview camera 104, the right rearview camera 108, and / or one or more other cameras of the vehicle, the center console display 132. The center console display 132 may include a touchscreen display that a user can touch to input various types of requests. The driver input module 1112 may generate a driver request 1112 indicating a user-input request, e.g., to the center console display 132.Based on request 1112, display module 420 may display content on center console display 132 using the left side of rearview video 448, the right side of rearview video 440, the front side of rearview video 1116 captured with forward-facing camera 136, the rear side of rearview video 1120 captured with rearward-facing camera 140, and / or other inputs 1124 from other types of vehicle environmental sensors.

[0080] For example, driver request 1112 may be a bowl view request, a video recording request, a top view request, a lane scanning request, or a learning request. However, other driver requests may be input via center console display 132.

[0081] If the driver request 1112 is for a bowl view, the display module 420 displays a driver-manipulable 360-degree view of the vehicle 100 and the vehicle surroundings, for example, by stitching the left rearview video 448, the right rearview video 440, the front video 1116 captured with the forward-facing camera 136, and the rearview video 1120 captured with the rearview camera 140. The display module 420 may also display the driver-manipulable 360-degree view of the vehicle 100 based on the other input 1124.

[0082] If the driver request 1112 is a top view, the display module 420 displays a top view of the vehicle 100 and the vehicle surroundings by, for example, stitching the left rear view video 448, the right rear view video 440, the front video 1116 captured with the forward-facing camera 136, and the rear video 1120 captured with the rear-facing camera 140. The display module 420 may also display the top view of the vehicle 100 based on the other input 1124.

[0083] If the driver request 1112 is a lane scanning request, the display module 420 (or another module) may identify lane lines on a road below the vehicle 100, e.g., using the left rearview video 448, the right rearview video 440, the forward-facing video 1116 captured by the forward-facing camera 136, and the rearward-facing video 1120 captured by the rearward-facing camera 140. The display module 420 may also display a representation of the relative position of the vehicle 100 and the lane lines on the center console display 132.

[0084] If the driver request 1112 is a video recording request, the display module 420 (or another module) may record and / or display videos of the surroundings of the vehicle. For example, the display module 420 may record and / or display the left rear view video 448, the right rear view video 440, the front video 1116 recorded with the forward-facing camera 136, and / or the rear video 1120 recorded with the rear-facing camera 140. Video recording requests may also be provided to the center stack display 132 independently of user input, for example, in response to a request from another module of the vehicle (e.g., a security system) or in response to a request external to the vehicle 100, for example, wirelessly from a computing device of an owner of the vehicle 100. Video recording requests may, for example,in an effort to capture images of people around the vehicle 100, such as a person damaging the vehicle 100 or attempting to steal the vehicle 100. If the driver request 1112 is a learning request, the display module 420 (or another module) may perform learning processes based on the left rear view video 448, the right rear view video 440, the front rear view video 1116 captured with the forward-facing camera 136, the rear video 1120 captured with the rear-facing camera 140, and / or the other inputs 1124. The display module 420 may display content on the center console display 132 (e.g., a top view of the vehicle 100, including the vehicle 100 and the vehicle surroundings) as a result of the learning.

[0085] The camera actuator module 1104 actuates the left and right rearview cameras 104 and 108 to vertically tilt the left and right rearview cameras 104 and 108 according to the driver request 1112. For example, the left and right rearview cameras 104 and 108 may include electric motors that vertically tilt the left and right rearview cameras 104 and 108. By vertically tilting the left and right rearview cameras 104 and 108, the area around the vehicle 100 that is within the predetermined field of view of the left and right rearview cameras 104 and 108 changes.

[0086] For example, the camera actuator module 1104 may move the left and right rearview cameras 104 and 108 to a predetermined upward position when the driver request 1112 is a bowl view request or a video recording request. The camera actuator module 1104 may move the left and right rearview cameras 104 and 108 to a predetermined downward position when the driver request 1112 is a lane scan request, an overhead view request, or a learning request.

[0087] The Fig. 12A and Fig. 12B are exemplary side views of the vehicle 100 and default FOVs. When the left rearview camera 104 is in the default up position, the default FOV of the left rearview camera 104 (top and bottom edges of the default FOV) is vertically higher than when the left rearview camera 104 is in the default down position. The same applies to the right rearview camera 108.

[0088] Fig. Figure 12A illustrates the default FOV 1204 of the left rear view camera 104 in the default upward position, while Fig. 12B illustrates the default FOV 1204 in the default down position. Although the example of the default up and down positions is provided, more than two different default positions may be used. For example, the camera actuator module 1104 may switch the left and right rearview cameras 104 and 108 to different, predetermined positions for each different type of driver request 1112.

[0089] It should be noted that one or more steps within a method may be performed in a different order (or simultaneously) without altering the principles of the present disclosure. Furthermore, although each of the embodiments is described above as having certain features, one or more of the features described with respect to each embodiment of the disclosure may be implemented and / or combined in any of the other embodiments, even if that combination is not explicitly described. In other words, the described embodiments are not mutually exclusive, and permutations of one or more embodiments relative to one another remain within the scope of this disclosure.

[0090] Spatial and functional relationships between elements (e.g., between modules, circuit elements, semiconductor layers, etc.) are described using various terms, including "connected," "locked," "coupled," "adjacent," "beside," "on top of," "over," "below," and "located." As described above, directional terms such as forward, backward, right, left, etc., refer to a normal forward (travel) direction of movement. Unless explicitly described as "direct," a relationship may be a direct relationship when a relationship is described between a first and second element in the above disclosure if no other intervening elements are present between the first and second elements, but may also be an indirect relationship if one or more intervening elements (either spatial or functional) are present between the first and second elements.As used herein, the phrase "at least one of A, B, and C" should be understood to mean a logic (A OR B OR C), using a non-exclusive logical OR, and should not be understood to mean "at least one of A, at least one of B, and at least one of C."

[0091] In the figures, the arrow directions, as indicated by the arrowhead, generally indicate the flow of information (such as data or commands) relevant to the context of the representation. For example, if element A and element B exchange a lot of information, but the information being passed from element A to element B is relevant to the representation, the arrow may point from element A to element B. These unidirectional arrows do not imply that no other information is being passed from element B to element A. Furthermore, in the context of information being sent from element A to element B, element B may send requests for or acknowledgments of that information to element A.

[0092] In this application, including the following definitions, the term "circuit" may be replaced with the term "module" or "controller" where appropriate. The term "module" may refer to, be part of, or include: an application-specific integrated circuit (ASIC); a digital, analog, or mixed analog / digital discrete circuit; a digital, analog, or mixed analog / digital integrated circuit; a combinational logic circuit; a field-programmable gate array (FPGA); processor circuitry (shared, dedicated, or group) that executes code; memory circuitry (shared, dedicated, or group) that stores code executed by the processor circuitry; other suitable hardware components that provide the described functionality; or a combination of some or all of the above, such as in a system-on-chip.

[0093] The module may include one or more interface circuits. In some examples, the interface circuits may include wired or wireless interfaces connected to a local area network (LAN), the Internet, a wide area network (WAN), or combinations thereof. The functionality of the modules mentioned in this disclosure may be distributed among multiple modules connected via interface circuits. For example, multiple modules may allow for load balancing. In another example, a server module (e.g., remote server or cloud) may assume certain functions of a client module.

[0094] The term code, as used above, may include software, firmware, and / or microcode and may refer to programs, routines, functions, classes, data structures, and / or objects. The term "common processor circuitry" refers to a single processor circuitry that executes some or all of the code from multiple modules. The term "grouped processor circuitry" refers to a processor circuitry that, in combination with additional processor circuitry, executes some or all of the code from, if applicable, multiple modules. References to multiple processor circuitry include multiple processor circuitry on discrete arrays, multiple processor circuitry on a single disk, multiple cores on a single processor circuitry, multiple threads of a single processor circuitry, or any combination of the above.The term "shared memory circuit" refers to a single memory circuit that stores specific or complete code from multiple modules. The term "grouped memory circuit" refers to a memory circuit that, in combination with additional memory, stores specific or complete code from possibly multiple modules.

[0095] The term memory circuit is subordinate to the term computer-readable medium. The term "computer-readable medium," as used herein, does not refer to transient electrical or electromagnetic signals propagated in a medium (e.g., in the case of a carrier wave); the term "computer-readable medium" is therefore to be understood as tangible and non-transitory. Non-limiting examples of a non-transitory tangible computer-readable medium include non-volatile memory circuits (e.g., flash memory circuits, erasable programmable read-only memory (ROM) circuits, or mask ROM circuits), volatile memory circuits (e.g., static or dynamic RAM circuits), magnetic storage media (e.g., analog or digital magnetic tape or a hard disk drive), and optical storage media (e.g., CD, DVD, or Blu-ray).

[0096] The devices and methods described in this application may be implemented, in part or in full, using a dedicated computer configured to perform specific computer program functions. The functional blocks, flowchart components, and elements described above serve as software specifications that can be implemented into computer programs by appropriately trained technicians or programmers.

[0097] The computer programs include processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. The computer programs may also include stored data or be based on stored data. The computer programs may include a basic input / output system (BIOS) that interacts with the hardware of the particular computer, device drivers that interact with specific devices of the particular computer, one or more operating systems, user applications, background services, background applications, etc.

[0098] The computer programs may include: (i) descriptive text that is parsed, such as HTML (hypertext markup language), XML (extensible markup language) or JSON (JavaScript Object Notation) (ii) assembly code, (iii) object code created from source code by a compiler, (iv) source code for execution by an interpreter, (v) source code for compilation and execution by a just-in-time compiler, etc. Solely by way of example, source code may contain a syntax of languages ​​such as C, C++, C#, Objective-C, Swift, Haskell, Go, SQL, R, Lisp, Java®, Fortran, Perl, Pascal, Curl, OCaml, Javascript®, HTML5 (Hypertext Markup Language 5th Revision), Ada, ASP (Active Server Pages), PHP (PHP: Hypertext Preprocessor), Scala, Eiffel, Smalltalk, Erlang, Ruby, Flash®, Visual Basic®, Lua, MATLAB, SIMULINK and Python®.

Claims

[1] Side view camera system comprising: a side view camera that captures video of an area at least adjacent to and behind a vehicle and that has a predetermined field of view (FOV), the predetermined FOV defined by a first predetermined horizontal angle of view (AOV) and a first predetermined vertical AOV; an advertisement; and a display module that displays: displays a first portion of the video within a first predetermined portion of the predetermined FOV, wherein the first predetermined portion of the predetermined FOV is defined by a second predetermined horizontal AOV and a second predetermined vertical AOV; and selectively displays a second portion of the video within a second predetermined portion of the predetermined FOV, wherein the second predetermined portion of the predetermined FOV is defined by a third predetermined horizontal AOV and a third predetermined vertical AOV, in which at least one of: the third specified horizontal AOV is greater than the second specified horizontal AOV; and the third predetermined vertical AOV is greater than the second predetermined vertical AOV, wherein the display module displays the second portion of the video within the second predetermined portion of the predetermined FOV when the vehicle is in reverse gear and when a steering wheel angle (SWA) is greater than a predetermined angle. [2] The side view camera system of claim 1, wherein the display module displays the second portion of the video within the second predetermined portion of the predetermined FOV for a merge event of the vehicle. [3] The side view camera system of claim 1, wherein the display module displays the second portion of the video within the second predetermined portion of the predetermined field of view for a lane change event of the vehicle. [4] The side view camera system of claim 3, further comprising a lane change module that indicates the occurrence of the lane change event when a vehicle speed is higher than a predetermined speed and a driver has activated a turn signal of the vehicle. [5] A side view camera system according to claim 1, wherein both: the third specified horizontal AOV is greater than the second specified horizontal AOV; and the third specified vertical AOV is greater than the second specified vertical AOV. [6] A side rear view camera system according to claim 1, wherein at least one of: the third specified horizontal AOV is smaller than the first specified horizontal AOV; and the third specified vertical AOV is smaller than the first specified vertical AOV. [7] A side view camera system according to claim 1, wherein both: the third specified horizontal AOV is smaller than the first specified horizontal AOV; and the third specified vertical AOV is smaller than the first specified vertical AOV. [8] The side rear view camera system of claim 1, further comprising: a camera actuator module that selectively tilts the side rear view camera vertically upward to a predetermined position in response to a user input, in which the area lies both next to and behind the vehicle, and wherein the display is located in a passenger compartment of the vehicle and is visible. [9] The side rear view camera system of claim 1, further comprising: a camera actuator module that selectively tilts the side rear view camera vertically downward to a predetermined position in response to a user input, in which the area lies both next to and behind the vehicle, and wherein the display is located in a passenger compartment of the vehicle and is visible.

Images