Methods and systems for providing multiple image feeds on a display in a camera monitor system

Abstract

A camera monitor system (CMS), includes a first camera that has a first field of view that includes an external environment adjacent to a first side and first front corner of a tractor of a commercial vehicle, a second camera that has a second field of view that includes an external environment adjacent to a second side and a second front corner of the tractor, which are opposite the first side and first front corner, respectively, a third camera that has a third field of view that includes an external environment of a front of the commercial vehicle, a fourth camera that has a fourth field of view that includes an external environment of a rear of the commercial vehicle, and an electronic display that includes a left display area that is configured to depict a first image feed from the first camera, a right display area that is configured to depict a second image feed from the second camera, and a middle display area that is configured to toggle between depicting a third image feed from the third camera and a fourth image feed from the fourth camera based upon an operational state of the commercial vehicle.

Description

METHODS AND SYSTEMS FOR PROVIDING MULTIPLE IMAGE FEEDS ON A DISPLAY IN A CAMERA MONITOR SYSTEM PRIORITY CLAIM

[0001] This application claims priority to United States Patent Application No.19 / 230,609 filed June 6, 2025, and United States Provisional Patent Application No.63 / 721,007 filed November 15, 2024, incorporated herewith in its entirety.TECHNICAL FIELD

[0002] This disclosure relates to a camera monitor system (CMS), and more particularly, to a method and apparatus for a CMS displaying trailer blind spots and other blind spots.BACKGROUND

[0003] Vehicle camera systems for mirror replacement or for supplementing mirror views are utilized in commercial vehicles to enhance the ability of a vehicle operator to see a surrounding environment of the commercial vehicle. Camera monitor systems (CMS) utilize one or more cameras to provide an enhanced field of view to a vehicle operator. In some examples, the mirror replacement systems cover a larger field of view than a conventional mirror, or include views that are not fully obtainable via a conventional mirror.

[0004] There is a desire to improve operator visibility to reduce risk. One approach is to add more cameras and more displays to increase the viewable area around the vehicle. This approach is intended to reduce blind spots; however, it is desirable to illustrate those blind spots in a manner that maximizes operator awareness. That is, simply adding more cameras and more displays does not necessarily increase driver awareness if the information is not presented in an intuitive way that can by quickly assimilated by the operator.SUMMARY

[0005] In one example embodiment, a camera monitor system (CMS), includes a first camera that has a first field of view that includes an external environment adjacent to a first side and first front corner of a tractor of a commercial vehicle, a second camera that has a second field of view that includes an external environment adjacent to a second side and a second front corner of the tractor, which are opposite the first side and first front corner, respectively, a third camera that has a third field of view that includes an external environment of a front of the commercial vehicle, a fourth camera that has a fourth field of view that includes an external environment of a rear of the commercial vehicle, and an electronic display that includes a left display area that is configured to depict a first image feed from the first camera, a right display area that is configured to depict a second image feed from the second camera, and a middle display area that is configured to toggle between depicting a third image feed from the third camera and a fourth image feed from the fourth camera based upon an operational state of the commercial vehicle.

[0006] In a further embodiment of any of the foregoing embodiments, the electronic display includes at least one of a primary information display located behind a steering wheel, a secondary information display located centrally in a bottom half of avehicle cabin, a center high mount display located centrally in atop half of the vehicle cabin, and a heads-up display. The secondary information display and the center high mount display are each substantially evenly spaced between the first side and the second side of the tractor.

[0007] In a further embodiment of any of the foregoing embodiments, the electronic display is provided by the center high mount display disposed along an upper edge of a windshield of the commercial vehicle.

[0008] In a further embodiment of any of the foregoing embodiments, the electronic display is provided by the secondary information display.

[0009] In a further embodiment of any of the foregoing embodiments, the electronic display is provided by a single monitor.

[0010] In a further embodiment of any of the foregoing embodiments, the middle display area is disposed between the left display area and the right display area.

[0011] In a further embodiment of any of the foregoing embodiments, the third image feed is depicted during a first operational state, and the second image feed is depicted during a second operational state, and the left and right display areas respectively continue to depict the first and second image feeds after the middle display area is toggled.

[0012] In a further embodiment of any of the foregoing embodiments, the first operational state corresponds to a commercial vehicle speed below a speed threshold.

[0013] In a further embodiment of any of the foregoing embodiments, the first operational state corresponds to a forward gear, and the second operational state corresponds to a reverse gear.

[0014] In a further embodiment of any of the foregoing embodiments, the second operational state corresponds to a trailer angle above an angle threshold.

[0015] In a further embodiment of any of the foregoing embodiments, the CMS includes a fifth camera that has a fifth field of view that extends rearward along a trailer of the commercial vehicle along the first side, a sixth camera that has a sixth field of view that extends rearward along a trailer of the commercial vehicle along the second side, a second electronic display that is configured to depict a fifth image feed from the fifth camera, a third electronic display that is configured to depict a sixth image feed from the sixth camera, and the first electronic display is disposed between the second electronic display and the third electronic display.

[0016] In a further embodiment of any of the foregoing embodiments, the fifth camera is mounted on the first side of the trailer, and the sixth camera is mounted on the second side of the trailer. The fifth image feed is provided below the first image feed and immediately left adjacent the middle display area, and the sixth image feed is provided below the second image feed and immediately right adjacent the middle display area.

[0017] In a further embodiment of any of the foregoing embodiments, the second electronic display and third electronic display are mounted to respective A pillars of the commercial vehicle.

[0018] In another example embodiment, a method for a camera monitor system (CMS) includes depicting, in a left display area of an electronic display, a first image feed from a first camera, depicting, in a right display area of the electronic display, asecond image feed from a second camera, and in a middle display area of the electronic display that is disposed between the left display area and the right display area, toggling between depicting of a third image feed from a third camera and a fourth image feed from a fourth camera based upon on an operational state of a commercial vehicle, the first camera has a first field of view that includes an external environment adjacent to a first side and first front corner of a tractor of a commercial vehicle, the second camera has a second field of view that includes an external environment adjacent to a second side and a second front corner of the tractor, which are opposite the first side and first front corner, respectively, the third camera has a third field of view that includes an external environment of a front of the commercial vehicle, and the fourth camera has a fourth field of view that includes an external environment of a rear of the commercial vehicle.

[0019] In a further embodiment of any of the foregoing embodiments, the electronic display is disposed along an upper edge of a windshield of the commercial vehicle.

[0020] In a further embodiment of any of the foregoing embodiments, the electronic display is substantially evenly spaced between the first side and the second side of the tractor.

[0021] In a further embodiment of any of the foregoing embodiments, the electronic display is a first electronic display, the method includes depicting, on a second electronic display, an image feed from a fifth camera that has a field of view that extends rearward along a trailer of the commercial vehicle along the first side, and depicting, on a third electronic display, an image feed from a sixth camera that has a field of view that extends rearward along a trailer of the commercial vehicle along the second side, the first electronic display is disposed between the second electronic display and the third electronic display.

[0022] In a further embodiment of any of the foregoing embodiments, the second electronic display and third electronic display are mounted to respective A pillars of the commercial vehicle.BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The disclosure can be further understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:

[0024] Figure 1 is a schematic perspective front view of a commercial vehicle with a camera monitor system (CMS).

[0025] Figure 2 is a schematic birds-eye view of the commercial vehicle of Figure 1.

[0026] Figure 3 is another schematic birds-eye view of the commercial vehicle of Figure 1 .

[0027] Figure 4 is another schematic birds-eye view of the commercial vehicle of Figure 1 .

[0028] Figure 5A is a schematic top view of an example vehicle cabin interior of the commercial vehicle of Figure 1.

[0029] Figure 5B is a perspective view of the vehicle cabin interior of Figure 5A.

[0030] Figure 6 is another example perspective view of the vehicle cabin interior of Figure 5A.

[0031] Figure 7 is a schematic view of a first example display configuration.

[0032] Figure 8 is a schematic view of a second example display configuration.

[0033] Figure 9 is a schematic view of a third example display configuration.

[0034] Figure 10 is a flowchart of an example method for a CMS.

[0035] The embodiments, examples, and alternatives of the claims, and / or the following description and drawings, including any of their various aspects or respective individual features, may be taken independently or in any combination. Features described in connection with one embodiment are applicable to all embodiments, unless such features are incompatible.DETAILED DESCRIPTION

[0036] Schematic views of a commercial vehicle 10 are provided in Figures 1-6. Figure 1 , which provides a perspective view of the commercial vehicle 10, and Figures 2-4, which each provide birds-eye views of the commercial vehicle 10, will be discussed first. As shown in Figures 1 -4, the commercial vehicle 10 includes a vehicle cab or “tractor” 12 for pulling a trailer 14, where the trailer 14 pivots with respect to the tractor 12 during turns. Although the commercial vehicle 10 is depicted as a commercial truck with a single trailer 14 in this disclosure, it is understood that other commercial vehicle configurations may be used (e.g., different types or quantities of trailers).

[0037] A first pair of camera arms 16A-B are mounted to the tractor 12, and a second pair of camera arms 16C-D are mounted to the trailer 14. One, all, or a subset of the camera arms 16A-D may articulate relative to their base between a retracted position and an extended position (shown, e.g., in Figure 2). Each camera arm 16A-D includes at least one respective rearward facing camera 20A-D on or within the arm 16. The cameras 20A-B respectively provide an exterior fields of view FOVEXI , FOVEX2 that each include at least one of Class II and Class IV views (see Fig. 2), which are legally prescribed views in the commercial trucking industry. The exterior cameras 20C-D respectively provide exterior fields of view FOVEXS, FOVEX4 that have some overlap with the Class II and Class IV views. The field of view FOVEXS extends rearward along the trailer 14 of the commercial vehicle 10 along the first side 21 A. The field of view FOVEX4 extends rearward along the trailer 14 of the commercial vehicle 10 along the second side 21 B.

[0038] Although an example location for camera arms 16C, 16D is shown, it is understood that this is a non-limiting example, and that the cameras 16C-D may be mounted in other locations, even without an arm. For example, the cameras 16C-D may be mounted proximate to the lower front corners of the trailer 14 (see, e.g., location 40A in Figure 1 ) or approximately halfway between a front end 22A and rear end 22B of the trailer 14 (see, e.g., location 40B in Figure 1). As shown, the cameras 20C-D are aft of the cameras 20A-B.

[0039] As shown in Figure 2, the commercial vehicle 10 has a first side 21 A (driver’s side) and a second side 21 B (passenger side) that is opposite the first side 11. The commercial vehicle 10 also has a front end 22A and a rear end 22B that is opposite the front end 22A. The tractor 12 also has a first front corner 23A and a second front corner 23B that is opposite the first front corner 23A.

[0040] The Class II view on a given side of the commercial vehicle 10 is a subset of the class IV view of the same side of the commercial vehicle 10. Multiple cameras also may be used in each camera arm 16A-B to provide these views, if desired. Class II (narrow) and Class IV (wide angle) views are defined in European R46 legislation, for example, and the United States and other countries have similar drive visibility requirements for commercial trucks. Any reference to a “Class” view is not intended to be limiting, but rather is intended as an example of the type of view provided to a display from a particular camera.

[0041] Each camera arm 16A-16D may also provide a housing that encloses electronics, e.g., a controller, that are configured to provide various features of a camera monitor system (CMS) 15 (see Figure 5A). The camera arms 16A-B may be mounted either at a roof-mount location over the cab door (as shown), or on a doormounted bracket or station, for example. Similarly, the camera arms 16C-D may be mounted at a roof-mount location of the trailer 14, for example.

[0042] A backup camera 20F provides a field of view FOVEXS of rear area 28C behind the commercial vehicle 10, which overlaps the fields of view FOVEXI, FOVEX2, FOVEXS, FOVEX4. Thus, the field of view FOVEXS includes an external environment of the rear of the commercial vehicle 10. The backup camera 20F may be mounted at a top / centerline of the trailer, at a bumper / bed level of the trailer, or at a top-corner of the back of the trailer, for example.

[0043] Alternatively, or in addition to the rear trailer camera, a “fifth wheel camera” 20I may be provided that is mounted to a rear of the tractor 12 and that provides a field of view FOVEXS which, when the trailer 14 is disconnected from the cab 12, also overlaps the fields of view FOVEXI, FOVEX2, FOVEXS, FOVEX4. The fifth wheel camera 201 may be mounted anywhere between the lateral plane of the fifth wheel fixture and the top / roof edge of the tractor, for example. The cameras 20A-G are part of a camera monitor system (CMS) 15 (see Figure 4).

[0044] Referring to Figures 2 and 4, a camera housing 16E and camera 20E may be arranged at or near the front of the commercial vehicle 10 to provide a Class VI view. The camera 20E has a field of view corresponding to an external environment of a front of the commercial vehicle 10.

[0045] Cameras 20G and 20H (having respective housings 16G and 16H) may be utilized to provide respective Class V views, for each side 21 A, 21 B of the commercial vehicle. Camera 20G provides a field of view that corresponds to an external environment adjacent to the first side 21 A and first front corner 23A of the commercial vehicle 10. Camera 20H provides a field of view that corresponds to an external environment adjacent to the second side 21 B and second front corner 23B of the commercial vehicle 10. Although cameras 20G-H are not shown in Figures 1 -3 for simplicity, it is understood that they would be included on the commercial vehicle 10.

[0046] Figure 5A is a schematic top view of an example vehicle cabin interior 24, and Figures 5B and 6 are a perspective view of the vehicle cabin interior 24. Referring now to Figures 4-6 with continued reference to Figures 1-4, electronic displays 18A-I (e.g., which may be video displays, such as LCD displays, OLED, electrochromatic, etc.) and cameras 20A-I are shown. The various electronic displays 18A-I and cameras 20A-I are part of the CMS 15, and therefore act as CMS displays 18 and CMS cameras 20.

[0047] The CMS 15 includes an electronic control unit (ECU) 26 that acts as a controller and includes processing circuitry that supports operation of the CMS 15. The ECU 26 is operatively connected to memory (which may include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, VRAM, etc.)) and / or nonvolatile memory elements (e.g., ROM, hard drive, tape, CD-ROM, etc.). The processing circuitry may include one or more microprocessors, microcontrollers, application specific integrated circuits (ASICs), or the like.

[0048] The CMS displays 18A-B are arranged on each of the driver and passenger sides within the vehicle cab 12 on or near the A-pillars 19A-B to display Class II and Class IV views on its respective side of the commercial vehicle 10, which provide rearward facing side views along the commercial vehicle 10 that are captured by the exterior cameras 20A-B. In particular,

[0049] If desired, one or more of the camera arms 16A-B may include conventional mirrors integrated with them as well, although the CMS 15 may be used to entirely replace mirrors. In additional examples, each side can include multiple camera arms, with each arm housing one or more cameras and / or mirrors.

[0050] In the example of Figure 6, the display 18C is disposed along an upper edge 62 of a windshield 60 of the commercial vehicle 10, and is substantially evenly spaced between the first side 21 A and second side 21 B of the commercial vehicle (and correspondingly is also substantially evenly spaced between the A-pillars 19A-B).

[0051] Display 18A is configured to provide an image feed from camera 20A, and display 18B is configured to provide an image feed from camera 20B. Display 18C may be used to display the Class V and Class VI views (see Figure 4), which are toward the front of the commercial vehicle 10, or a backup camera view (from backup camera 20F or camera 20I) to the driver. Display 18D is provided in a center console area of the vehicle cabin interior 24, and may be used as a backup display or for other purposes, such as navigation, infotainment, etc. Display 18E may be part of an instrument cluster, for example, and may be used as a backup display.

[0052] As discussed in greater detail below, one or both of display 18C and display 18D are configured to toggle what views they provide depending on an operational state of the commercial vehicle 10.

[0053] Figures 7, 8, and 9 illustrate a plurality of CMS display configurations 68A-C for providing views from a plurality of the cameras 20. The display configurations 68A-C may be used for display 18D and / or display 18E, for example. Each of the display configurations 68 includes a middle display area 70A, a left display area 70B, and a right display area 70C.

[0054] In the display configuration 68A of Figure 7, display area 70A provides an image feed from camera 20E, display area 70A provides an image feed from tractor camera 20G, and display area 70C provides an image feed from tractor camera 20H. In one or more embodiments, the display configuration 68A is utilized when the commercial vehicle 10 is parked and / or when it is traveling forward below a predefined speed threshold (e.g., 10 miles per hour). The display configuration 68A is useful in these driving scenarios, because a driver of the commercial vehicle 10 willlikely have difficulty viewing these depicted areas around the commercial vehicle 10 when the commercial vehicle 10 is parked or moving forward slowly, because vulnerable road users (VRUs) may appear in these areas.

[0055] The display configuration 68B of Figure 8 is the same as the display configuration 68A of Figure 7 except that in the middle display area 70A an image feed from backup camera 20F is provided. In one or more embodiments, the display configuration 68B is utilized when the commercial vehicle 10 is driving forwards beyond the predefined speed threshold (e.g., over 10 miles per hour). In this situation, it is less likely that VRUs could quickly appear in front of the commercial vehicle 10 without the driver noticing, because due to the speed of the vehicle, the relevant VRUs are further in front of the commercial vehicle 10, and the driver can likely adequately view such VRUs through the windshield 60.

[0056] The display configuration 68C of Figure 9 subdivides includes the middle display area 70A, but subdivides the left display area 70B into an upper left display area 70B1 and a lower left display area 70B2, and also subdivides the right display area 70C into an upper right display area 70C1 and a lower right display area 70C2. An image feed from backup camera 20F is provided in display area 70A.

[0057] The image feed from tractor camera 20G is provided in the upper left display area 70B1 , and the image feed from tractor camera 20H is provided in the upper right display area 70C1 . Also, an image feed from trailer camera 20C is provided in the lower left display area 70B2, and an image feed from the trailer camera 20D is provided in the lower right display area 70C2.

[0058] In one or more embodiments, the display configuration 68C is used when the commercial vehicle 10 is driving in a reverse direction and / or has a trailer angle that exceeds a predefined trailer angle threshold (e.g., greater than 25° or 30°). As used herein, “trailer angle” refers to an angle between a central longitudinal axis A1 of the tractor 12 and a central longitudinal axis A2 of the trailer 14 (see Figure 4, which labels these axes, and where the trailer angle is zero). During these vehicle operational conditions (reverse driving an / or when the trailer angle exceeds the trailer angle threshold), the field of view FOVEXS is of high interest, because the driver will want to avoid collisions behind the vehicle. Also, when the commercial vehicle 10 is turning, and the trailer angle increases, the view of cameras 20A or 20B may beobstructed by side 21 A or 21 B of the trailer 14. However, providing the fields of view FOVEXS and FOVEX4, of cameras 20C and 20D respectively, compensates for this obstruction by providing a useful vantage point for reverse driving, so that the driver can better see the surrounding environment of the commercial vehicle 10.

[0059] The various display configurations 68A-C provide a useful way of displaying data to a driver, while minimizing distraction that may arrive from the use of an 3-5 additional displays that may be needed if each image feed shown in Figures 6-9 was presented on a different display.

[0060] As described above, in one or more embodiments, the ECU 26 is configured to toggle between the various display configurations 68A-C, e.g., based on the various operational conditions of the commercial vehicle 10 that are described above.

[0061] Figure 10 is a flowchart of an example method 100 for a CMS. The method 100 may be performed the ECU 26, for example. In the left display area 70B, a first image feed from a first camera (e.g., camera 20G) is displayed (step 102). In the right display area 70C, a second image feed from a second camera (e.g., camera 20H) is displayed (step 104). In the middle display area 70A, the ECU 26 toggles between display of a third image feed from a third camera (e.g., camera 20E) and a fourth image feed from a fourth camera (e.g., camera 20F) depending on an operational state of the commercial vehicle (step 106). Alternatively, in step 102 the ECU 26 may display two image fees in the left display area 70B, and in step 102 the ECU 26 may display two image feeds in the right display area 70C, e.g., as described above in connection with Figure 9.

[0062] Although example embodiments have been disclosed, a worker of ordinary skill in this art would recognize that certain modifications would come within the scope of the claims. For that reason, the following claims should be studied to determine their true scope and content.

Claims

CLAIMSWhat is claimed is:1 . A camera monitor system (CMS), comprising:a first camera having a first field of view that includes an external environment adjacent to a first side and first front corner of a tractor of a commercial vehicle;a second camera having a second field of view that includes an external environment adjacent to a second side and a second front corner of the tractor, which are opposite the first side and first front corner, respectively;a third camera having a third field of view that includes an external environment of a front of the commercial vehicle;a fourth camera having a fourth field of view that includes an external environment of a rear of the commercial vehicle; andan electronic display including:a left display area configured to depict a first image feed from the first camera;a right display area configured to depict a second image feed from the second camera; anda middle display area configured to toggle between depicting a third image feed from the third camera and a fourth image feed from the fourth camera based upon an operational state of the commercial vehicle.

2. The CMS of claim 1 , wherein the electronic display includes at least one of a primary information display located behind a steering wheel, a secondary information display located centrally in a bottom half of a vehicle cabin, a center high mount display located centrally in a top half of the vehicle cabin, and a heads-up display, wherein the secondary information display and the center high mount display are each substantially evenly spaced between the first side and the second side of the tractor.

3. The CMS of claim 2, wherein the electronic display is provided by the center high mount display disposed along an upper edge of a windshield of the commercial vehicle.

4. The CMS of claim 2, wherein the electronic display is provided by the secondary information display.

5. The CMS of claim 1 , wherein the electronic display is provided by a single monitor.

6. The CMS of claim 1 , wherein the middle display area is disposed between the left display area and the right display area.

7. The CMS of claim 1, wherein the third image feed is depicted during a first operational state, and the second image feed is depicted during a second operational state, and the left and right display areas respectively continue to depict the first and second image feeds after the middle display area is toggled.

8. The CMS of claim 7, wherein the first operational state corresponds to a commercial vehicle speed below a speed threshold.

9. The CMS of claim 7, wherein the first operational state corresponds to a forward gear, and the second operational state corresponds to a reverse gear.

10. The CMS of claim 7, wherein the second operational state corresponds to a trailer angle above an angle threshold.11 . The CMS of claim 1 , , the CMS comprising:a fifth camera having a fifth field of view that extends rearward along a trailer of the commercial vehicle along the first side;a sixth camera having a sixth field of view that extends rearward along a trailer of the commercial vehicle along the second side;a second electronic display configured to depict a fifth image feed from the fifth camera;a third electronic display configured to depict a sixth image feed from the sixth camera; andwherein the first electronic display is disposed between the second electronic display and the third electronic display.

12. The CMS of claim 11 , wherein the fifth camera is mounted on the first side of the trailer, and the sixth camera is mounted on the second side of the trailer, the fifth image feed is provided below the first image feed and immediately left adjacent the middle display area, and the sixth image feed is provided below the second image feed and immediately right adjacent the middle display area.

13. The CMS of claim 11 , wherein the second electronic display and third electronic display are mounted to respective A pillars of the commercial vehicle.

14. A method for a camera monitor system (CMS), comprising:depicting, in a left display area of an electronic display, a first image feed from a first camera;depicting, in a right display area of the electronic display, a second image feed from a second camera; andin a middle display area of the electronic display that is disposed between the left display area and the right display area, toggling between depicting of a third image feed from a third camera and a fourth image feed from a fourth camera based upon on an operational state of a commercial vehicle;wherein:the first camera has a first field of view that includes an external environment adjacent to a first side and first front corner of a tractor of a commercial vehicle;the second camera has a second field of view that includes an external environment adjacent to a second side and a second front corner of the tractor, which are opposite the first side and first front corner, respectively;the third camera has a third field of view that includes an external environment of a front of the commercial vehicle; andthe fourth camera has a fourth field of view that includes an external environment of a rear of the commercial vehicle.

15. The method of claim 14, wherein the electronic display is disposed along an upper edge of a windshield of the commercial vehicle.

16. The method of claim 15, wherein the electronic display is substantially evenly spaced between the first side and the second side of the tractor.

17. The method of claim 14, wherein the electronic display is a first electronic display, the method comprising:depicting, on a second electronic display, an image feed from a fifth camera having a field of view that extends rearward along a trailer of the commercial vehicle along the first side; anddepicting, on a third electronic display, an image feed from a sixth camera having a field of view that extends rearward along a trailer of the commercial vehicle along the second side;wherein the first electronic display is disposed between the second electronic display and the third electronic display.

18. The method of claim 17, wherein the second electronic display and third electronic display are mounted to respective A pillars of the commercial vehicle.

Images