Camera monitor system with touch-based monitor control

Abstract

A method of providing views in a camera monitor system (CMS) for a vehicle includes a) activating a display view configuration mode on a primary display having a touchscreen and located within a vehicle, b) swiping the primary display to change between preconfigured layouts for at least one display including the primary display, the preconfigured layouts each depict at least a portion of an image from at least one field of view from the vehicle, c) selecting one of the preconfigured layouts to modify at least a portion of a displayed image on the at least one display.

Description

CAMERA MONITOR SYSTEM WITH TOUCH-BASED MONITOR CONTROLTECHNICAL FIELD

[0001] This disclosure relates to a camera monitor system (CMS), and more particularly, to a method and apparatus for a CMS having touchscreen-based control on a primary display of other displays in the CMS.BACKGROUND

[0002] Vehicle camera systems for mirror replacement or for supplementing mirror views are utilized in commercial vehicles to enhance the ability of a vehicle operator to see a surrounding environment of the commercial vehicle. Camera monitor systems (CMS) utilize one or more cameras to provide an enhanced field of view to a vehicle operator. In some examples, the mirror replacement systems cover a larger field of view than a conventional mirror, or include views that are not fully obtainable via a conventional mirror.

[0003] There is a desire to improve operator visibility to reduce risk. One approach is to add more cameras and more displays to increase the viewable area around the vehicle. While this approach may reduce blind spots, the operator is required to manage more information making it difficult fully take advantage of additional displayed views.SUMMARY

[0004] In one example embodiment, a method of providing views in a camera monitor system (CMS) for a vehicle includes a) activating a display view configuration mode on a primary display having a touchscreen and located within a vehicle, b) swiping the primary display to change between preconfigured layouts for at least one display including the primary display, the preconfigured layouts each depict at least a portion of an image from at least one field of view from the vehicle, c) selecting one of the155362055-1preconfigured layouts to modify at least a portion of a displayed image on the at least one display.

[0005] In a further example embodiment of any of the foregoing embodiments, step a) includes touching the primary display.

[0006] In a further example embodiment of any of the foregoing embodiments, step a) includes touching an icon of the primary display, and performing step b) changes the one of the preconfigured layouts of the primary display.

[0007] In a further example embodiment of any of the foregoing embodiments, the primary display includes one of a driver side display, a passenger side display, and a secondary information display. The driver side display and passenger side display are respectively mounted in close proximity to a driver side A-pillar and a passenger side A- pillar. Each of the driver side display and passenger side display provide a narrow angle view and a wide angle view of its respective side of the vehicle that is provided by the multiple fields of view. The secondary information display is located centrally in a bottom half of a vehicle cabin.

[0008] In a further example embodiment of any of the foregoing embodiments, the preconfigured layouts include at least one of a wide angle field of view of greater than 70°, a narrow angle field of view with an overlay that includes at least one of a vulnerable road user (VRU) overlay, a non-VRU overlay and a predicted trailer path overlay, a zoomed in view of at least one of a VRU and a non-VRU, a field of view of a front corner area of the vehicle on an opposite side of an operator, a field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay that includes at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay, a 270° bird’s eye view (BEV) of a front of the vehicle, a 270° BEV of a rear of the vehicle, a 360° BEV of the vehicle, and a rear-facing view from a trailer of the vehicle.

[0009] In a further example embodiment of any of the foregoing embodiments, step a) includes touching an icon of a cockpit that corresponds to multiple of the at least one display, and performing step b) changes the preconfigured layout of the multiple displays.255362055-1

[0010] In a further example embodiment of any of the foregoing embodiments, the multiple displays include a driver side display, a passenger side display, and a secondary information display. The driver side display and passenger side display are respectively mounted in close proximity to a driver side A-pillar and a passenger side A- pillar. Each of the driver side display and passenger side display provide a narrow angle view and a wide angle view of its respective side of the vehicle that is provided by the multiple fields of view. The secondary information display is located centrally in a bottom half of a vehicle cabin. The multiple displays include at least one of a primary information display that is located behind a steering wheel, a front passenger side corner display that is located centrally in a top half of the vehicle cabin, and a heads-up display (HUD).

[0011] In a further example embodiment of any of the foregoing embodiments, the preconfigured layouts include at least one of placing an overlay on at least one of the driver side display and passenger side display, the overlay includes at least one of a vulnerable road user (VRU) overlay, a non-VRU overlay and a predicted trailer path overlay, placing a predicted trailer path overlay on the HUD, and placing on a passenger side display a zoomed in field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay, the overlay includes at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay, placing a field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay, the overlay includes at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay, placing on the secondary information display a 270° bird’s eye view (BEV) of a front of the vehicle, and placing on the secondary information display a 270° BEV of a rear of the vehicle.

[0012] In a further example embodiment of any of the foregoing embodiments, the method includes a step of providing multiple vehicle-mounted cameras that are configured to capture multiple fields of view, and multiple displays that are configured to display the multiple fields of view.355362055-1

[0013] In a further example embodiment of any of the foregoing embodiments, the preconfigured layouts include providing a picture-in-picture (PIP) window that contains the at least a portion of the at least one field of view.

[0014] In a further example embodiment of any of the foregoing embodiments, the preconfigured layouts include at least one of a standard view in which the displayed image includes a legally prescribed view, a magnified view in which the displayed image is enlarged compared to the standard view and which is not a legally prescribed view, and a mirror view in which the displayed view is enlarged compared to the standard view but smaller than the magnified view.

[0015] In a further example embodiment of any of the foregoing embodiments, the method includes a step d) locking in the selected option for the other multiple display and returning the primary display to an original operational state.

[0016] In a further example embodiment of any of the foregoing embodiments, the method includes a step e) reverting the other multiple display to another field of view from the selected option in response to a triggering event.

[0017] In a further example embodiment of any of the foregoing embodiments, the triggering event is a change in vehicle operational state.

[0018] In a further example embodiment of any of the foregoing embodiments, the triggering event is a predetermined elapse of time.

[0019] In another example embodiment, a camera monitor system (CMS), includes multiple cameras that are configured to capture multiple fields of view in proximity to a commercial vehicle, multiple displays that are configured to display images from the captured multiple fields of view, the multiple displays include a primary display having a touchscreen, and another of the multiple displays is configured to illustrate a displayed field of view from the multiple fields of view, and a controller that is in communication with the multiple cameras and the multiple displays, the controller is configured to activate a display view configuration mode on the primary display, in response to swiping the primary display change between preconfigured layouts for at least one display that includes the primary display. The preconfigured layouts each depict455362055-1at least a portion of an image from at least one field of view from the vehicle, and in response to selecting one of the preconfigured layouts modify at least a portion of a displayed image on the at least one display.

[0020] The embodiments, examples, and alternatives of the preceding paragraphs, the claims, or the following description and drawings, including any of their various aspects or respective individual features, may be taken independently or in any combination. Features described in connection with one embodiment are applicable to all embodiments, unless such features are incompatible.BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The disclosure can be further understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:

[0022] Figure 1 is a schematic front view of a commercial truck with a camera mirror system (CMS) used to provide at least narrow and wide fields of view alongside the vehicle (e.g., Class II and Class IV views).

[0023] Figure 2 is a schematic birds-eye view of the commercial truck of Figure 1 with a CMS providing, for example, Class II, Class IV, Class V, Class VI, and Class VIII views.

[0024] Figure 3 is a schematic top view of an example vehicle cabin interior.

[0025] Figure 4 is a perspective view of an example vehicle cabin interior.

[0026] Figure 5A is a schematic view of a left-hand display from Figure 3.

[0027] Figure 5B is a schematic view of a right-hand display from Figure 3.

[0028] Figure 6 is a flowchart of an example method of quickly navigating between preconfigured layouts on one or more of the CMS displays.

[0029] Figures 7A, 7B and 7C respectively illustrate example layouts for a righthand side display, a secondary display and a left-hand side display.

[0030] Figure 8 schematically illustrates the method of swiping between preconfigured layouts for a display according to the method of Figure 6.555362055-1

[0031] Figure 9 illustrates example preconfigured layouts relating to a standard view, a mirror view, and a magnified view.

[0032] Figure 10 illustrates example preconfigured layouts relating to a standard view, a magnified view with a picture-in-picture (PIP) standard view, a mirror view with a PIP standard view, and a magnified view with a PIP mirror view.

[0033] Figure 11 illustrates example preconfigured layouts relating to a mirror view and a magnified view with a PIP mirror view.DETAILED DESCRIPTION

[0034] Schematic views of a commercial vehicle 10 are illustrated in Figures 1- 4. The commercial vehicle 10 includes a vehicle cab or “tractor” 12 for pulling a trailer 14, where the trailer 14 articulates with respect to the tractor 12 during turns. Although the commercial vehicle 10 is depicted as a commercial truck with a single trailer in this disclosure, it is understood that other commercial vehicle configurations may be used (e.g., different types or quantities of trailers).

[0035] A pair of camera arms 16A-B include a respective base that is secured to, for example, the tractor 12. A pivoting arm is supported by the base and may articulate relative thereto. Fixed cameras arms may be used instead, if desired. At least one rearward facing camera 20A-B is arranged respectively on or within each of the camera arms 16A-B. The exterior cameras 20A-B respectively provide an exterior field of view FOVEX-I , FOVEX2 that each include at least one of Class II and Class IV views (Fig. 2), which are example legally prescribed views in the commercial trucking industry.

[0036] The Class II view on a given side of the commercial vehicle 10 is a subset of the class IV view of the same side of the commercial vehicle 10. Multiple cameras also may be used in each camera arm 16A-B to provide these views, if desired. Class II (narrow) and Class IV (wide angle) views are defined in European R46 legislation, for example, and the United States and other countries may have similar driver visibility requirements for commercial trucks. Any reference to a “Class” view is not intended to be limiting, but is intended as an example of the type of view provided to a display from a655362055-1particular camera. For example, certain views may be prescribed in SAE J3155 or other regulations.

[0037] Each camera arm 16A-16B may also provide a housing that encloses electronics, e.g., a controller, that are configured to provide various features of the CMS 15. The camera arms 16A-B may be mounted either at a roof-mount location over the cab door (as shown), or on a door-mounted bracket or station, for example. If desired, the camera arms 16A-B may include conventional mirrors integrated with them as well, although the CMS 15 may be used to entirely replace mirrors. In additional examples, each side can include multiple camera arms, with each arm housing one or more cameras and / or mirrors.

[0038] If video of Class V and / or Class VI views is also desired (again, examples, of other types of legally prescribed views under R46, as an example), a camera housing 16C and camera 20C may be arranged at or near the front of the commercial vehicle 10 to provide those views (Fig. 2). Generally, Class V covers a passenger side of the vehicle (opposite operator) from a passenger vehicle cab corner aftward along a cab of the vehicle, and Class VI covers a passenger side of the vehicle from a passenger vehicle cab corner along a front of a cab of the vehicle. The Class V may be provided by a second camera incorporated into the camera arm 20B.

[0039] A backup camera 20D may be provided which provides a field of view FOVEX3 facing rearward from the trailer 14. The backup camera 20D may be mounted at a top / centerline of the trailer 14, at a bumper / bed level of the trailer, or at a top-corner of the back of the trailer, for example. Alternatively, or in addition to the rear trailer camera, a “fifth wheel camera” 20E may be provided that is mounted to a rear of the tractor 12 and that provides a field of view FOVEx4- The fifth wheel camera 20E may be mounted anywhere between the lateral plane of the fifth wheel fixture and the top / roof edge of the tractor, for example.

[0040] Figure 3 is a schematic top view of an example vehicle cabin interior 24, and Figure 4 is a perspective view of the vehicle cabin interior 24. Referring now to Figures 3-4 with continued reference to Figures 1-2, electronic displays 18A-E (e.g., 755362055-1which may be video displays, such as LCD displays) and cameras 20A-E are shown. The various electronic displays 18A-E and cameras 20A-E are part of a camera monitor system (CMS) 15, and therefore act as CMS displays and CMS cameras. As used herein, a “CMS camera” 20 is a camera configured to record images of an environment surrounding a commercial vehicle 10, and a “CMS display” 18 is an electronic display (e.g., an LCD, LED, OLED, etc.) that is configured to image or display feeds from those cameras.

[0041] Figure 4 illustrates additional or different displays 18F, 18G, 18H that may be used to display images from the cameras 20A-E or other cameras. For example, display 18F provides a heads-up-display (HUD) projected in the region of the driver side windshield. Displays 18G, 18H may be provided respectively on the A-pillars 19A, 19B to provide additional views to those of the displays 18A, 18B. An additional display (not shown) may be provided on the passenger side instrument panel. Fewer, more or different displays and / or configurations may be used.

[0042] The CMS 15 includes a CMS controller or electronic control unit (ECU) 22 that acts as a controller and includes processing circuitry that supports operation of the CMS 15. The CMS ECU 22 is operatively connected to memory (which may include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, VRAM, etc.)) and / or nonvolatile memory elements (e.g., ROM, hard drive, tape, CD-ROM, etc.). The processing circuitry may include one or more microprocessors, microcontrollers, application specific integrated circuits (ASICs), or the like.

[0043] The CMS displays 18A-B are arranged on each of the driver and passenger sides within the vehicle cab 12 on or near the A-pillars 19A-B to display Class II and Class IV views on its respective side of the commercial vehicle 10, which provide rear facing side views along the commercial vehicle 10 that are captured by the exterior cameras 20A-B. The Class II and Class IV views may be provided on separate displays or monitors, if desired, or depicted on a common display.855362055-1

[0044] As discussed above, if video of Class V and Class VI views are also desired, the camera housing 16C and camera 20C may be arranged at or near the front of the commercial vehicle 10 to provide those views (Fig. 2). In the example of Figure 3, additional displays 18C-E are provided. Display 18C is arranged in the vehicle cabin interior 24 near the top center of the windshield may be used to display the Class V and Class VI views, which are toward the front of the commercial vehicle 10, or a backup camera view (from camera 20D or 20E) to the driver. Display 18D is provided in a center console area of the vehicle cabin interior 24, generally located centrally in a bottom half of the vehicle cabin, and may be used for other purposes, such as navigation, infotainment, etc. (i.e., a secondary information display). Display 18E may be part of an instrument cluster (i.e., a primary information display) located behind the steering wheel, for example.

[0045] If video of Class VIII views is desired, camera housings can be disposed at the sides and rear of the commercial vehicle 10 to provide fields of view including some or all of the Class VIII zones of the commercial vehicle 10. In such examples, one of the displays 18C-E may include one or more frames displaying the Class VIII views. The displays 18A, 18B, 18C face a driver region 35 within the vehicle cabin interior 24 where an operator is seated on a driver seat 37.

[0046] Figure 5A is a schematic view of the left-hand side display 18A (on side of operator in left-hand drive (LHD) vehicles), and Figure 5B is a schematic view of the right-hand side display 18B (on side of passenger in LHD vehicles). Each display 18A-B includes a respective first display area 25A-B and a respective second display area 26A- B for displays in which both Class II and Class IV views are depicted on a single, common monitor. In the example of Figures 5A-B, display area 25A is configured to display a Class II (narrow) view from camera 16A, and display area 26A is configured to display a Class IV (wide) view from camera 16A (or an additional, wide angle camera situated on the same side of the commercial vehicle as camera 16A). Similarly, display area 25B is configured to display a Class II (narrow) view from camera 16B, and display area 26B is955362055-1configured to display a Class IV (wide) view from camera 16B (or an additional, wide angle camera situated on the same side of the commercial vehicle as camera 16B).

[0047] In various examples, the ECU 22 includes one or modules having algorithm(s), equation(s) and / or decision manager(s) that receive input(s) from sensors (e.g., cameras 20A-20E, ultrasonic, LiDar, radar, etc.) and / or stored values, as schematically illustrated in Figure 3. Example modules include Lane Detection Module 100, Object Detection Module 102, Trailer End Detection Module 104, Kinematic Module 106, Trailer Striking Area Prediction Module 108, Tractor Striking Area Prediction Module 110, and Collision Alert Module 112. Example inputs include one or more sensors 34, such as a steering angle sensor, a vehicle speed sensor, gear position sensor, and / or other sensor data. Vehicle configuration information 32, which may be stored in memory 30, relates to vehicle characteristics (e.g., trailer length, axle position, trailer type / wheelbase, tractor configuration / wheelbase, hitch point location etc.), provided by the manufacturer, operator, and / or determined by one or more of the modules. During vehicle operation, the ECU 22 may communicate information to the driver, fleet operator, or others using an output (e.g, displays 18, speaker, etc.). Example operation and uses of these modules are disclosed in International Application No. PCT / US2023 / 083416 filed on December 11 , 2023, entitled “CAMERA MONITOR SYSTEM WITH TRAILER CURB STRIKE ALERT AND TRAILER STRIKING AREA,” which is incorporated herein by reference in its entirety.

[0048] The lane detection module 100 also uses image processing of the captured images to identify markings on the roadway, such as lane markers that visually divide adjacent lanes. One example algorithm is described in United States Publication No. US2023 / 117,719, entitled “CAMERA MIRROR SYSTEM DISPLAY FOR COMMERCIAL VEHICLES INCLUDING SYSTEM FOR IDENTIFYING ROAD MARKINGS”, which is incorporated by reference in its entirely. In that publication, a lane detection module is described in which an object detection algorithm identifies a lane marking in a roadway by filtering a color of the lane marking from a surrounding portion1055362055-1of the captured image. Other techniques based upon deep learning technology or another computer vision method may be used, if desired.

[0049] The object detection module 102 includes one or more image processing algorithms configured to identify objects in the captured images. The algorithms may be used to identify vulnerable road users (VRU’s; e.g., pedestrians or cyclists), attributes of the tractor 12 and / or trailer 14, other vehicles, signs, curbs, trees, buildings and / or other inanimate objects (i.e., non-VRU’s).

[0050] The trailer end detection module 104 is another image processing module that extracts one or more trailer features from the captured images to determine the location of the end of the trailer in 3D space. These extracted attributes can be used to detect objects such as tractor wheels, trailer edges and other features. Example wheel detection algorithm techniques are disclosed in United States Publication No. US2023 / 202,394 entitled “CAMERA MONITOR SYSTEM FOR COMMERCIAL VEHICLES INCLUDING WHEEL POSITION ESTIMATION”, which is incorporated herein by reference in its entirety. Example trailer edge detection algorithm techniques are disclosed in United States Publication No. US2023 / 125,045 entitled “TRAILER END TRACKING IN CAMERA MONITORING SYSTEM”, which is incorporated herein by reference in its entirety. Other techniques may be used, if desired.

[0051] In one example operation, the CMS 15 utilizes the kinematics module 106 to predict a striking zone of the trailer 14 during a turn operation and generates a two dimensional overlay to digitally impose over at least one of the displayed Class ll / IV images thereby showing the vehicle operator an expected striking zone of the trailer 14 and allowing the vehicle operator adjust the vehicle operations accordingly. The CMS 15 uses the received captured images from the cameras 20A, 20B, as well as any other cameras and vehicle operation data received from a general vehicle controller through a data connection, such as a CAN or LIN bus, to estimate a predicted position of the tractor and / or trailer side at each of multiple side positions and multiple points in time. These positions are converted to a geometric area encompassing all the positions. In this way,1155362055-1the shape and size of the geometric area is not fixed, but rather reflects an actual predicted striking area of the trailer.

[0052] In order to avoid accidental strikes, the striking area prediction system uses the vehicle data (e.g. steering angle, steering rate, trailer angle, vehicle speed, trailer wheelbase, tractor wheelbase, hitch point location, yaw rate and the like) to generate a predicted striking zone over time. The predicted striking zone is a prediction of the path the trailer will take over the course of the turn and is re-calculated continuously as the turn progresses. The trailer striking area is also useful in a potential “curve cut” scenario when the vehicle 10 is traveling down a curved roadway. In a curvy road, it becomes more likely for the trailer end to cross the lane markers, indicating boundaries to adjacent lanes, creating a potentially dangerous situation.

[0053] The CMS 15 includes a Decision Manager or Collision Alert Module 112 that communicates with the modules 100-110 to evaluate the proximity between the predicted tractor and / or trailer paths (i.e. , the tractor and trailer striking areas) and one or more objects (e.g., predicting an imminent curb strike, curve cut, object collision etc.). The decision manager considers the estimated time to the event, severity (what the object is), closing rate between objects, etc. and may provide an overlay and / or alert.

[0054] While various overlays and alerts may useful in increasing operator awareness and enhancing safety, it is desirable to more easily and proactively manage awareness of vehicle surroundings. One such approach is to enable control and configuration of displays 18, including displays that are not within easy reach or access to operator. Centralized, accessible control that is intuitive enables the operator to change display settings as needed (e.g., based upon situation) to improve operation awareness using the CMS 15 while also limiting distractions.

[0055] As will be discussed below in greater detail, the CMS 15 includes functionality for providing operator selectable configurations to display CMS images based on touchscreen commands received through a touchscreen interface. The touchscreen interface may be provided on one of the CMS displays 18, or through a separate touchscreen interface. For example, a “bring your own device” configuration1255362055-1may be supported, in which a vehicle occupant can use their own personal device (e.g., a tablet) as a CMS display and / or a touchscreen interface (e.g., a tablet).

[0056] The touchscreen of at least one of the displays 18A-18D and 18G-18H, if so provided, can be used to enable modification of the primary display itself as well as the other displays. In one example, the driver side display 18A, passenger side display 18B, or secondary information display 18D are used as the primary display for managing desired display configurations (e.g., for permanently or temporarily modifying displayed views), as these displays are within easy reach of the operator. As one example, the lefthand display 18A servers as the primary display, and display area 25A and / or display area 26A provides the touchscreen.

[0057] Figure 6 is a flowchart of an example method 200 for the CMS 15. During operation of the vehicle 10, multiple fields of view (e.g., FOVEX-I , FOVEX2, FOVEXS, FOVEX ) are captured with the cameras (e.g., cameras 20A-20E) and displayed on the displays (e.g., displays 18A-18H) in a particular default configuration layouts (e.g., specific camera(s) view, narrow angle view, wide angle view, with or without overlays, and / or bird’s-eye-view (BEV), etc.). These default display configuration layouts typically correspond to views that best satisfy desired operator views for typical operating situations and / or providing legally prescribed views to the operator. But, the default layout for one or more displays 18 may not meet the operator’s preference or the needs of the particular operating situation.

[0058] To change one of more displayed layouts, the operator or passenger activates a display view configuration mode on a touchscreen of a primary display (e.g., displays 18A, 18B, 18D; block 202). In one example, when the operator or passenger touches the touchscreen on the primary display, an icon is depicted on the primary display representing the display(s) for which the layout can be modified (see, e.g., Fig. 7A-7C). In the example shown in Figure 7A, touching the display area 25A (e.g., left side Class II shown) of display 18A causes icon 300 to be depicted (representing “local” display 18A, i.e. , the display that was touched) as well as icon 302 to be depicted (representing multiple displays, or the “cockpit”, within the cabin 24). In the example shown in Figure 7B,1355362055-1touching the display 18D (e.g., 270° BEV of front of the vehicle 318 shown using stitched views 310, 312, 314) causes icon 300 to be depicted (representing “local” display 18D). In the example shown in Figure 7C, touching the display area 25B (e.g., right side Class 11 shown) of display 18B causes icon 300 to be depicted (representing “local” display 18B).

[0059] Returning to Figure 6, touching the icon 300 or 302 then enables the display(s) corresponding to the selected icon to be changed between preconfigured layouts by swiping the primary display (block 204; 400 in Fig. 8). Figure 8 schematically illustrate different preconfigured layouts 402, 404, 406, 408, 410, 412. Swiping from left to right on the touchscreen iterates through the preconfigured layouts in one order, while swiping from right to left iterates through the preconfigured layouts in an opposite order. Although six preconfigured layouts are schematically illustrated in Figure 8, there may be fewer or greater preconfigured layouts to choose from.

[0060] Returning to Figure 6, Once the desired modified view (i.e., selected preconfigured layout) has been selected, the selection can be locked in (e.g., by again touching the touchscreen) and the primary display returned to an original operational state, (block 206). Selected the desired preconfigured layout may be performed by touching the touchscreen in some manner, for example, again touching the icon 300 (or 302), double tapping the touchscreen, or some other method.

[0061] In some instances, it may be desirable to revert back to the default view (original view before changing to the preconfigured layout) or some other view. The newly modified other display may revert back to its original (or different) displayed field of view in response to a triggering event, for example, no longer displaying a legally prescribed view when a legally prescribed view may be needed. The may occur if there is a change in vehicle operational state (e.g., change in gear, change in vehicle speed, change in steering angle). Additionally or alternatively, the triggering event is a predetermined elapse of time (e.g., 15 seconds).

[0062] Figure 8 schematically illustrates swiping between various preconfigured layouts 400. Some example preconfigured layouts are described below.Example Driver-Side and / or Passenger Display Preconfiqured Layouts1455362055-1

[0063] Touching the “local” icon 300 (as an example) on either the left-hand display 18A or the right-hand display 18B (Figs. 7A, 7C) enables swiping between, for example, at least one of the following preconfigured layouts (or combinations or modifications thereof).

[0064] A. Providing a wide angle field of view on the narrow angle view screen (e.g., replacing Class II view on display area 25A / 26A). The wide angle field of view is greater than 70°, for example, in a range of 90° to 120°.

[0065] B. Modifying the narrow angle field of view (e.g., modifying Class II view on display area 25A / 26A) to include an overlay, such as at least one of a vulnerable road user (VRU) overlay, a non-VRU overlay and a predicted trailer path overlay. The VRU and non-VRU overlay may be provided by transparent, colored shading over the object(s) in the image, for example. The predicated trailer path overlay may be provided by a shaded and / or hatched area over the image that corresponds to the predicted trailer path.

[0066] C. Providing a zoomed in view of at least one of a VRU and a non-VRU (e.g., replacing Class II view on display area 25A / 26A). The zoomed in view may be provided as an enlarged (close up) view of the object using the same camera view (i.e., cropped and enlarged) or images from another camera, for example. Another example zoomed in view is providing a picture-in-picture PIP inset in an existing displayed view (e.g., modifying the displayed Class II view), with the PIP inset displaying an enlarged view of the object for better visibility.

[0067] D. Providing a field of view of a front corner area of the vehicle on an opposite side of an operator (e.g., replacing Class II view on display area 25A / 26A with a Class V view).

[0068] E. Providing a modified field of view of a front corner area of the vehicle on an opposite side of an operator (e.g., replacing Class II view on display area 25A / 26A with a Class V view) with an overlay including at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay.1555362055-1

[0069] F. Providing a 270° BEV of a front of the vehicle (replacing Class II view on display area 25A / 26A with similar to the view illustrated in Fig. 7B).

[0070] G. Providing a 270° BEV of a rear of the vehicle (e.g., replacing Class II view on display area 25A / 26A).

[0071] H. Providing a conventional narrow angle or wide angle view (e.g., Class II or Class IV view).

[0072] Selecting the preconfigured layout places that layout on the primary display (the display being touched and swiped) for viewing.Example Secondary Display Preconfiqured Layouts

[0073] Touching the “local” icon 300 (as an example) on the secondary information display 18D (Fig. 7B) enables swiping between, for example, at least one of the following preconfigured layouts (or combinations or modifications thereof).

[0074] A. Providing a rear view from trailer-mounted camera 20D.

[0075] B. Providing a 270° BEV of a front of the vehicle (Fig. 7B).

[0076] C. Providing a 270° BEV of a rear of the vehicle.

[0077] D. Providing a 360° BEV of the vehicle.

[0078] Selecting the preconfigured layout places that layout on the primary display (the display being touched and swiped) for viewing.Example Cockpit Multi-Display Preconfiqured Layouts

[0079] Touching the “cockpit” icon 302 (as an example) on the left-hand display 18A (Fig. 7A) enables changing to different preconfigured layouts on other display(s) and in some examples the primary display (here, display 18A) by swiping between, for example, at least one of the following preconfigured layouts (or combinations or modifications thereof).1655362055-1

[0080] A. Placing an overlay on at least one of the driver side display 18A and passenger side display 18B. For example, the overlay is at least one of a vulnerable road user (VRU) overlay, a non-VRU overlay and a predicted trailer path overlay.

[0081] B. Placing a predicted trailer path overlay on the HUD 18F, and placing on a passenger side display 18B a zoomed in field of view of a front corner area of the vehicle on an opposite side of an operator (zoomed Class V view) with an overlay. The overlay is at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay.

[0082] C. Placing on a passenger side display 18B a field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay (i.e. , Class V view with added overlay). The overlay including at least one of a VRU overlay, a non- VRU overlay and a predicted trailer path overlay.

[0083] D. Placing on the secondary information display 18D a 270° BEV of a front of the vehicle (shown in Fig. 7B).

[0084] E. Placing on the secondary information display 18D a 270° BEV of a rear of the vehicle.

[0085] Selecting the preconfigured layout places that layout on the modified display, which is one or more of the multiple displays 18A-18H.

[0086] Prefigured layouts may include providing views of different magnifications (zoomed / enlarged views) or zoomed out views (wider angle views), as shown in the Examines in Figures 9-11 .

[0087] Figure 9 illustrates as an example a left-hand display 18A with a “standard” view 500 in display area 25A. The standard view 500 provides a legally prescribed view for a Class ll / narrow view, which is a minimum FOV of about a 15°-20° field of view. In the example of a wide angle view (e.g., Class IV) the legally prescribed view is minimum FOV of about 50°-68°. In one example, a single camera is used to provide both the narrow and wide angle views, and the camera captures about 107° to also permit cropping of the image for panning during turning maneuvers. The1755362055-1preconfigured layouts available may also include a magnified view 504 (e.g. 4x magnification, or 10° FOV for Class II) in which the displayed image is enlarged compared to the standard view 500 and which is not a legally prescribed view. A mirror view 502 may be available in which the displayed view is enlarged compared to the standard view 500 but smaller than the magnified view 504, for example, halfway FOV between standard view and magnified view, which is more similar to the field of view that would be provided by a conventional mirror.

[0088] Prefigured layouts may also include adding a picture-in-picture (PIP) view 510 to the currently displayed view or a view different than the currently displayed view or any combination thereof (see, e.g., Figs 10 and 11 ).

[0089] The disclosed CMS 15 enables an operator to customize the displayed fields of view or other display attributes from a display easily within reach. The ability to select the display for modification is intuitive and quick, which permits the operator to create views that are safer or more preferred for particular vehicle maneuvers or operating states.

[0090] It should also be understood that although a particular component arrangement is disclosed in the illustrated embodiment, other arrangements will benefit herefrom. Although particular step sequences are shown, described, and claimed, it should be understood that steps may be performed in any order, separated or combined unless otherwise indicated and will still benefit from the present invention.

[0091] Although the different examples have specific components shown in the illustrations, embodiments of this invention are not limited to those particular combinations. It is possible to use some of the components or features from one of the examples in combination with features or components from another one of the examples.

[0092] Although an example embodiment has been disclosed, a worker of ordinary skill in this art would recognize that certain modifications would come within the scope of the claims. For that reason, the following claims should be studied to determine their true scope and content.1855362055-1

Claims

CLAIMS1. A method of providing views in a camera monitor system (CMS) for a vehicle, comprising: a) activating a display view configuration mode on a primary display having a touchscreen and located within a vehicle; b) swiping the primary display to change between preconfigured layouts for at least one display including the primary display, wherein the preconfigured layouts each depict at least a portion of an image from at least one field of view from the vehicle; c) selecting one of the preconfigured layouts to modify at least a portion of a displayed image on the at least one display.

2. The method of claim 1 , wherein step a) includes touching the primary display.

3. The method of claims 1 or 2, wherein step a) includes touching an icon of the primary display, and performing step b) changes the one of the preconfigured layouts of the primary display.

4. The method of any preceding claim, wherein the primary display includes one of a driver side display, a passenger side display, and a secondary information display, the driver side display and passenger side display respectively mounted in close proximity to a driver side A-pillar and a passenger side A-pillar, wherein each of the driver side display and passenger side display provide a narrow angle view and a wide angle view of its respective side of the vehicle that is provided by the multiple fields of view, the secondary information display located centrally in a bottom half of a vehicle cabin.

5. The method of any preceding claim, wherein the preconfigured layouts include at least one of:1955362055-1a wide angle field of view of greater than 70°; a narrow angle field of view with an overlay including at least one of a vulnerable road user (VRU) overlay, a non-VRU overlay and a predicted trailer path overlay; a zoomed in view of at least one of a VRU and a non-VRU; a field of view of a front corner area of the vehicle on an opposite side of an operator; a field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay including at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay; a 270° bird’s eye view (BEV) of a front of the vehicle; a 270° BEV of a rear of the vehicle; a 360° BEV of the vehicle; and a rear-facing view from a trailer of the vehicle.

6. The method of claim 2, wherein step a) includes touching an icon of a cockpit corresponding to multiple of the at least one display, and performing step b) changes the preconfigured layout of the multiple displays.

7. The method of claim 6, wherein the multiple displays include a driver side display, a passenger side display, and a secondary information display, the driver side display and passenger side display respectively mounted in close proximity to a driver side A-pillar and a passenger side A-pillar, wherein each of the driver side display and passenger side display provide a narrow angle view and a wide angle view of its respective side of the vehicle that is provided by the multiple fields of view, the secondary information display located centrally in a bottom half of a vehicle cabin; and wherein the multiple displays include at least one of a primary information display located behind a steering wheel, a front passenger side corner display located centrally in a top half of the vehicle cabin, and a heads-up display (HUD).2055362055-18. The method of claims 6 or 7, wherein the preconfigured layouts include at least one of: placing an overlay on at least one of the driver side display and passenger side display, the overlay including at least one of a vulnerable road user (VRU) overlay, a non- VRU overlay and a predicted trailer path overlay; placing a predicted trailer path overlay on the HUD, and placing on a passenger side display a zoomed in field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay, the overlay including at least one of a VRU overlay, a non-VRU overlay and a predicted trailer path overlay; placing a field of view of a front corner area of the vehicle on an opposite side of an operator with an overlay, the overlay including at least one of a VRU overlay, a non- VRU overlay and a predicted trailer path overlay; placing on the secondary information display a 270° bird’s eye view (BEV) of a front of the vehicle; and placing on the secondary information display a 270° BEV of a rear of the vehicle.

9. The method of any preceding claim, comprising a step of providing multiple vehicle-mounted cameras configured to capture multiple fields of view, and multiple displays configured to display the multiple fields of view.

10. The method of any preceding claim, wherein the preconfigured layouts include providing a picture-in-picture (PIP) window containing the at least a portion of the at least one field of view.

11. The method of any preceding claim, wherein the preconfigured layouts include at least one of: a standard view in which the displayed image comprises a legally prescribed view; a magnified view in which the displayed image is enlarged compared to the standard view and which is not a legally prescribed view; and2155362055-1a mirror view in which the displayed view is enlarged compared to the standard view but smaller than the magnified view.

12. The method of any preceding claim, comprising a step d) locking in the selected option for the other multiple display and returning the primary display to an original operational state.

13. The method of claim 12, comprising a step e) reverting the other multiple display to another field of view from the selected option in response to a triggering event.

14. The method of claim 13, wherein the triggering event is a change in vehicle operational state or a predetermined elapse of time.

15. A camera monitor system (CMS), comprising: multiple cameras configured to capture multiple fields of view in proximity to a commercial vehicle; multiple displays configured to display images from the captured multiple fields of view, the multiple displays including a primary display having a touchscreen, and another of the multiple displays is configured to illustrate a displayed field of view from the multiple fields of view; and a controller in communication with the multiple cameras and the multiple displays, the controller configured to activate a display view configuration mode on the primary display, in response to swiping the primary display change between preconfigured layouts for at least one display including the primary display, wherein the preconfigured layouts each depict at least a portion of an image from at least one field of view from the vehicle, and in response to selecting one of the preconfigured layouts modify at least a portion of a displayed image on the at least one display.2255362055-1

Images