Camera monitoring systems for motor vehicles

Abstract

The invention relates to a camera monitoring system for a motor vehicle. The camera monitoring system, or CMS, comprises: an image capture device (1102, 1112) associated with an exterior rearview mirror (110, 111), oriented rearward and located outside the vehicle (10), for capturing images from the external environment; an ECU (500) connected to the image capture device (1102, 1112) and configured to select an image area (210, 211) smaller than the captured image and movable therein; at least one display device (100, 101, 102) connected to the ECU (500) and comprising at least one screen located inside the vehicle (10). The screen of the display device (100, 101, 102) may be a touch screen (200), and the CMS further comprises a control surface in the touch screen (200).

Description

Technical Field

[0001] The invention finds application in a control system for a motor vehicle comprising an electronic (interior and / or exterior) rearview mirror assembly.

[0002] The present invention relates to a camera monitoring system (CMS) for managing the field of view to be displayed in one or more rear view mirrors of a vehicle. Background Art

[0003] Touch screens are well known in the art. They have a spatially resolved sensor associated with a display surface which detects a touch of the display surface, in particular at least one contact of a finger at a precise location, so that user interaction with the displayed touch screen content is possible.

[0004] US20130128047A1 discloses a touch-type display mirror, which includes a touch panel through which a user inputs a first signal, a photosensitive panel arranged on the rear surface side of the touch panel, and a display arranged on the rear surface side of the photosensitive panel and including a signal processing unit that processes the first signal input from the touch panel, wherein the signal electronic processing unit (ECU) is connected to an angle-adjustable rearview camera, and adjusts the shooting angle of the angle-adjustable rearview camera according to a second signal input from the touch panel. Therefore, a mechanical actuator is included to change the position (shooting angle) of the external rearview camera, wherein the mechanical actuator is responsible for the activation / deactivation of the camera based on a signal from the ECU, which is in turn connected to the touch panel, and the driver inputs the desired position of the rear view from the touch panel by touching the screen.

[0005] The problem with the prior art is that a mechanical actuator is required, which implies cost, complexity and the possibility of failure over time.

[0006] Therefore, it would be highly desirable to provide a motor vehicle having a control system that monitors an intelligent rearview mirror system to change the field of view of the rearview mirror without any mechanical actuators. Summary of the invention

[0007] The present invention solves the above problems and overcomes the previously explained working limitations of the prior art by providing a camera monitoring system for a motor vehicle, which camera monitoring system is configured to display images captured from a (external and / or side) rearview mirror of the motor vehicle into a control surface located inside the motor vehicle (e.g. on a screen located at the inner surface of a door visible to the driver). The proposed camera monitoring system (CMS) is capable of managing the field of view (FOV) of the device for capturing images (e.g. the camera of the rearview mirror) and of varying at least this field of view without any mechanical actuator.

[0008] The proposed CMS is capable of managing the FOV of the rearview mirror, for example by touching a control surface without dirtying the screen of the display provided by the rearview mirror. The control surface may be any surface (e.g., another display, another part of a display, etc.) that allows a user to manage the field of view of an image capture device (e.g., a camera) by touching the surface, the CMS using any touch detection technology.

[0009] Furthermore, the proposed CMS can even use any gesture detection technology, for example to manage the FOV of the rearview mirror by gestures without touching the control surface (i.e., by a non-touch screen). The non-touch control surface can be implemented in different ways, for example: i) by increasing the capacitive sensitivity of the screen (without using a camera), ii) by using a camera based on an image classifier.

[0010] A change of the displayed FOV may be performed by the CMS only under predetermined conditions. For example, the field of view may only be changed when the motor vehicle is stationary (i.e. not moving). To find out whether the vehicle is moving, the CMS may use an electronic control unit (ECU) of the vehicle, which is connected to a communication bus (e.g. CAN) of the vehicle. Alternatively, it may also be determined whether the motor vehicle is not moving by using at least one camera taking a plurality of frames (images) and a control unit comparing these frames (current frame with previous frame) to determine whether the difference between the frames is sufficient to determine whether there is movement.

[0011] One aspect of the invention relates to a camera monitoring system for a motor vehicle, comprising:

[0012] - An image capture device (e.g., a camera) associated with at least an exterior rearview mirror of the vehicle. In the context of the present invention, an exterior rearview mirror refers to a mounting assembly (e.g., a winglet or a shark fin) located on the exterior of the vehicle and at which an image capture device is located / mounted. The image capture device is configured to capture images from a field of view external to the vehicle, the field of view (FOV) extending at least laterally and rearwardly outside the vehicle and encompassing a portion of an exterior portion of the vehicle (preferably an outer side portion or side of the vehicle).

[0013] - An electronic control unit or ECU connected to said image capture device. The ECU is configured to select at least one image area (or image portion) from the image captured by the image capture device. The image area selected by the ECU is smaller than the image captured by the image capture device. And the selected image area can be moved within the captured image.

[0014] - at least one display device located inside the vehicle and connected to the ECU. The display device comprises at least one screen. The at least one screen of the display device may be a touch screen, and in this case the camera monitoring system further comprises a control surface in the touch screen configured to move an image area displayed by the at least one display device (in said screen or in another screen of the display device). Additionally or alternatively, the camera monitoring system further comprises a gesture detector to move the displayed image area.

[0015] Another aspect of the present invention relates to a motor vehicle comprising two camera monitoring systems (CMS) as described above, wherein one CMS is located on the left side of the vehicle (having an image capture device associated with the left side external rearview mirror) and the other CMS is located on the right side of the vehicle (having an image capture device associated with the right side external rearview mirror), and also includes an internal rearview mirror system, and the vehicle's ECU is the ECU that controls all of the two camera monitoring systems and the internal rearview mirror system.

[0016] The present invention has many advantages over the prior art, which can be summarized as follows:

[0017] - The present invention allows a vehicle vision system to adjust the displayed image according to user settings and / or current driving information.

[0018] - The invention allows FOV adjustment of external cameras fixed to the vehicle body without the need for actuators or mechanical movements on these cameras.

[0019] - The invention allows to reduce the size of the side mirrors, since the mirror elements of the side "mirrors" can be avoided and, as is known, the camera can be smaller than the entire mirror surface reflecting light. Furthermore, since the location of the screen (display) is changed from external to internal (e.g. the screen is located inside the car, preferably on the door), external screens are avoided.

[0020] - The invention allows to perform controls using a multi-touch sensitive display adapted to detect gestures. The control actions are then triggered by the driver's gestures, rather than pressing digital buttons located on top of the displayed image (overlay) or touching the display with a finger (which makes the screen dirty), and provides a larger action area, i.e. the driver can make relevant gestures in the air (with his / her head or fingers) rather than in a small / limited size screen.

[0021] These and other advantages will be apparent from the detailed description of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] To aid the understanding of the characteristics of the invention, according to a preferred practical embodiment of the invention and to complete this description, the following drawings are attached as an integral part thereof, having an illustrative and non-limiting character:

[0023] Figure 1 A motor vehicle with a camera monitoring system CMS using two external rear view mirrors or winglets and three internal displays according to a possible embodiment of the invention is shown.

[0024] Figure 2 A schematic representation of a touch screen in one of the displays divided into two parts by an ECU for a CMS is shown according to a possible embodiment of the invention.

[0025] Figure 3 An exploded view of a display with a touch screen and a frame cover according to another possible embodiment of the present invention is shown.

[0026] Figure 4 An exploded view of a display with a touch screen and a non-touch screen and a frame covering both screens is shown according to another possible embodiment of the present invention.

[0027] Figure 5 A frame with a screenprinted button for camera monitoring is shown.

[0028] Figure 6 A block diagram representing components of a CMS according to a preferred embodiment of the present invention is shown.

[0029] Figure 7 A left exterior winglet and associated interior display are shown according to a possible embodiment of the invention.

[0030] Figures 8 to 13 Shown is a schematic representation of different image parts of an image to be displayed controlled by a CMS according to a possible embodiment of the invention.

[0031] Fig.14 A motor vehicle is shown with different fields of view captured by external cameras of the vehicle. DETAILED DESCRIPTION

[0032] The subject matter defined in the detailed description is used to help fully understand the present invention. Therefore, those of ordinary skill in the art will recognize that the embodiments described herein may be varied and modified without departing from the scope and spirit of the present invention. In addition, for clarity and simplicity, descriptions of well-known functions and elements have been omitted.

[0033] Of course, embodiments of the present invention can be implemented in various architecture platforms, operating and server systems, devices, systems or applications.Any specific architecture layout or implementation presented herein is provided only for the purpose of illustration and understanding, and is not intended to limit aspects of the present invention.

[0034] Figure 1 A motor vehicle 10 is shown with a camera monitoring system CMS, which includes an image capture device (e.g., a camera) configured to capture images, the image capture device being associated with an external mounting assembly (e.g., a winglet or a sharkfin) that is located outside (on the body side of) the motor vehicle 10. The image capture device can be located outside the vehicle 10, or even fixed to the outside of the vehicle 10. The image capture device is configured to capture images from an external field of view of the motor vehicle 10, wherein the field of view extends at least laterally and rearwardly outside the vehicle 10. The field of view also includes a portion of the outer side portion of the body of the vehicle 10 where the mounting assembly is located. Preferably, the image capture device can capture a field of view extending at least 20 meters rearwardly and 4 meters laterally.

[0035] For example, Figure 1 Two exterior rear-view mirrors 110, 111 and an interior rear-view mirror 112 are shown on each side of the motor vehicle 10. Any exterior rear-view mirror 110, 111 may be a (mechanically) movable winglet or may be fixed (non-movable). In the fixed case, one option is to use (i) a winglet, which may be extendable; or (ii) a "shark fin", more specifically, two cameras (one for top-view and one for CMS) in the same mounting assembly housing. Figure 1 The illustrated CMS for vehicle 10 includes image capture devices located externally and associated with outside rearview mirrors 110 , 111 ; there is no image capture device for interior rearview mirror 112 .

[0036] The CMS also includes an electronic control unit or ECU connected to the image capture device, which is configured to select an image area from the image captured by the image capture device. The image area is smaller than the captured image; that is, it is obtained by cropping the image from the image capture device.

[0037] The CMS further comprises at least one (first) display device 100, 101, 102, which is located inside the motor vehicle 10, e.g. Figure 1As shown, and connected to an electronic control unit. The ECU inputs the image area into the display device 100, 101, 102 to be displayed as a cropped image, rather than displaying the entire captured image. That is, the ECU does not input the entire captured image into the display device 100, 101, 102. In addition, the image area can move within the captured image in response to a user's action, which can be: i) a user's touch on the control surface of the display device 100, 101, 102, and / or i) a user's gesture to a gesture detector, which can be implemented in the display device 100, 101, 102 or by another device using any gesture detection technology. This provides the driver with a variety of interactive options.

[0038] The control surface may be implemented in a touch screen 200 of the (first) display device 100, 101, 102, preferably operating as a multi-touch sensitive display configured to receive a user's touches for moving an image area within a captured image.

[0039] Preferably, the touch screen 200 is configured to detect a plurality of different locations touched simultaneously, in particular different locations touched by fingers. A multi-touch-sensitive display allows tracking of images and touches not only performed by one finger, but also complex actions that require operation with two or more fingers. It is particularly advantageous that a magnification of an image area can be further provided to the multi-touch-sensitive display by using two fingers, and the variation of the finger spacing during contact is adjustable. In particular, together with panning, a simple adjustment of the desired composition including the zoom level (zoom in / out) can be given by a simple movement of the fingers. Therefore, the CMS includes an associated touch screen controller, which is configured to detect the movement and / or touch of one or more fingers also by increasing the sensitive capacity of the touch screen 200.

[0040] In the case of exterior rearview mirrors 110, 111 and / or wing mirrors, as Figure 1 As shown, a touch screen 200 in the interior part of the motor vehicle 10 can be provided for only one of the external (or wing) rear view mirrors 110, 111. Via this touch screen 200, at least one parameter of said one external rear view mirror 110, 111 can be adjusted, in particular operating parameters related to the pivoting of the external camera and / or rendering parameters of the image portion / area of ​​the image captured by the external camera.

[0041] In another embodiment, the touch screen 200 may additionally be arranged for an interior rearview mirror 112 in the interior portion of the motor vehicle 10. Typically, the interior rearview mirror 112 and the exterior rearview mirrors 110, 111 are connected via an ECU of the vehicle 10.

[0042] The multi-touch sensitive screen 200 of the display device 100, 101, 102 may be configured as a "touch only" screen. That is, rather than having a "touch and drag" screen, the CMS provides the touch screen 200 with two different parts, as distinguished by the ECU 500: a first part of the touch screen 200 where the user / driver cannot perform "touch and drag" of the displayed image; and a second part where the user / driver can normally perform the "touch and drag" operations provided by the multi-touch sensitive screen 200.

[0043] According to this example, the user can perform only a "touch" in the first part or a "touch & drag" in the second part. The technical advantage of this is that the first part does not get dirty. In this example, the light (image) received by the second part comes from the same display image as the first part. Preferably, the first part is larger than the second part. Preferably, the area of ​​the second part is about 30% of the area of ​​the first part. Preferably, the length of the second part is 20% of the length of the first part, which length is defined along the X (horizontal) axis.

[0044] Thus, according to a possible embodiment, instead of having a screen on each side of the vehicle 10 (the inside of the door) that is fully “touch and drag” over its entire surface, a single touch screen 200 on each side of the vehicle 10 is connected to the ECU 500 that distinguishes between a first portion 2001 and a second portion 2002 of the touch screen 200, such as Figure 2 As shown. The ECU deactivates the first part 2001 of the touch screen 200, so that the user cannot "touch and drag" in the first part 2001 used as a "touch only" screen, while "touch and drag" is only activated by the ECU in the second part 2002. According to another embodiment, the ECU can even deactivate the entire "touch" function in the first part 2001 of the touch screen 200. The user can use the second part 2002 to adjust the FOV and the brightness and / or contrast and / or color parameters of the image area displayed in the first part 2001.

[0045] In a preferred embodiment, in order to implement the above two parts 2001, 2002 in the first display device 100, 101, 102, the CMS further includes a frame 300 partially covering the first display device 100, 101, 102, such as Figure 3 to Figure 4As shown. For example, on the inside of the door of the vehicle 10, there may be a housing 600 adapted to be coupled with a fixture 610 to secure the controller or ECU 500, the touch screen 200, and the frame 300 to the door or anywhere else inside the vehicle 10. Thus, the positioning order of these different elements is as follows: first, the housing 600; second, the ECU 500; third, the fixture 610 belonging to the housing; fourth, the screen 200 or multiple screens 200, 400 of the display device 100, 101, 102; and finally, the frame 300, which covers the entire display device and shows one or more parts of the one or more screens that can be seen by the user.

[0046] The frame has the same size as the touch screen 200 or a significantly larger size to cover at least the entire touch screen 200. The frame is a cover, preferably made of plastic or glass, which also protects the display device 100, 101, 102 from impact and damage because the touch screen 200 is relatively fragile. The frame is partially colored. Preferably, the coloring is black. The frame does not allow all light emitted by the touch screen 200 to pass. Therefore, the driver cannot see the light emitted by the display where the frame is colored (i.e., the silk screen). For example, the frame is placed on top of the touch screen 200, so the user sees the "frame" because it is placed between the screen and the user.

[0047] As mentioned above, the frame can be partially colored; more specifically, including: a (first) portion that is not colored, while the rest of the frame is colored. The transparent or uncolored portion of the frame, from which the light of the display is emitted and becomes visible to the user, can present different forms. Therefore, only the uncolored portion (image) of the frame is shown to the user / perceived by the user, rather than the entire image emitted by the display. According to a non-limiting example, Figure 3 As shown in , the size of the (first) non-colored part of the frame is about 60% of the total screen 200 and preferably its geometry 200 is rectangular. The geometry of the non-colored part is purely aesthetic.

[0048] The ECU 500 deactivates the first portion of the touch screen 200 according to the specific geometry of the (first) uncolored portion of the frame.

[0049] According to another possible embodiment, in addition to the multi-touch screen 200, the first display device 100, 101, 102 also has an additional second screen 400. With two screens, such as Figure 4As shown, the first part 2001 distinguished by the ECU500 can be implemented in the second screen 400, which can be non-touch and then cheaper, and the second part 2002 does not require deactivation of "touch and drag" in the touch screen 200. Moreover, this second part 2002 implemented in the touch screen 200, which is preferably smaller than the non-touch screen, can display parameters related to the brightness and / or contrast and / or color of the additional screen to be adjusted by the user's touch. One technical advantage is the cost of non-touch screens. The additional screen 400 only displays an image area selected by the ECU500 from the image captured by the image capture device. In this case, the controller or ECU500 can manage the image movement (i.e., "pan") of the image area displayed in the first part 2001 based on the data or instructions captured by the touch screen 200 in the second part 2002.

[0050] In another possible embodiment, the CMS may utilize a second portion 2002 (implemented in a single touch screen 200 or in an additional screen as described above) to indicate blind spot detection or BSD, i.e., if an object is detected in the blind spot, the CMS turns on an indicator (triangle, exclamation mark, etc.) in the second portion 2002 of the first display device 100, 101, 102.

[0051] The CMS may additionally be provided with at least one (second) display device (another touch screen) to display the parameters of the first display device 100, 101, 102, i.e. the operating parameters of the touch screen 200. The first display device 100, 101, 102 itself may also display the parameters to be adjusted. More specifically, the touch screen 200 allows the user to set the brightness and / or contrast and / or color parameters of the first display device 100, 101, 102 by his / her touch. Thus, the parameters can be adjusted directly on the touch screen of the display device for the optical impression of the image display parameters shown on the display. The driver can make the image brighter or darker to select contrast and other common parameters, in particular a color-related parameter set of the image displayed in the touch screen 200. In a possible embodiment, the CMS is designed to insert or superimpose a slide bar for presenting parameters on the display device.

[0052] Furthermore, at least one operating parameter of the first display device 100, 101, 102 may be used by the CMS to output information items and / or warnings, in particular information items and / or warnings used by driver assistance systems (e.g., lane change assistance systems and / or blind spot assistance systems and / or parking assistance systems and / or reversing assistance systems) provided in the vehicle 10. The output of the information and / or warnings may be adjustable according to inputs on the touch screen 200.

[0053] In addition, at least one item of additional information may be superimposed on the image displayed on the touch screen 200, and the additional information may be moved by interaction at the display position of the additional information in the touch screen 200. In another embodiment, a context-sensitive menu of items may be activated by the touch screen 200 and displayed on the display devices 100, 101, 102.

[0054] The ECU 500 or the control unit may provide some digital buttons to overlay on the image shown in the second part 2002 of the touch screen 200. For example, after selecting a particular adjustment possibility that can be done by means of a menu and / or a depicted control, a slider 200 is thus displayed on the control surface of the touch screen, which can be grasped, for example, by contact at the position of the slider, and manipulated to adjust the displayed parameter. Of course, other possibilities can be conceived to present a set of parameters, for example with "+" and / or "-", marked controls on the display area on the screen, which, in the case of sensing a touch, trigger an increase or decrease (zoom function) corresponding to the presented parameter. It is particularly advantageous when the touch screen 200 can also be used to set other parameters. The control unit may be configured to form a touch screen menu on the screen 200. Thus, when a menu is selected by touch, a menu may be displayed, allowing the parameters of the winglet to be set. The driver may touch the image portion on one of the marked symbols with a finger (or with a pen) and cause the setting menu to open different options (or additional information) in the image portion. Thus, the superimposed symbol is then placed together with a menu with a plurality of menu items related to the display parameters, in particular for contrast, brightness and color parameters. It is also conceivable that by tapping the touch screen displayed on the outside, the control / menu item returns to the default display. In addition, touching the additional information can generate a corresponding menu with settings for lane change assistance (ie, in particular operating parameters of lane change assistance).

[0055] Another option is to draw (or taint) a button 310 on the frame 300 , as depicted in FIG. 5 , so that the user can touch the drawn button (the button is not a moving mechanical part) to trigger a digital button on the screen 200 .

[0056] According to one example, the frame and the screen 200 are together and in contact. According to another example, there is a gap between the frame and the screen 200, and preferably, the gap is between 0.5mm-4mm. According to another example, a joystick including a typical mouse ball (non-optical) for a computer or a physical button can be used. The joystick and / or button can be located anywhere accessible to the driver while driving; for example, on the door, on the dashboard (center console), on the steering wheel, etc. The button can have a cross-shaped distribution so as to move up / down / left / right. The joystick can have a cross-shaped or circular movement that allows the image to be moved according to the movement of the joystick. A switch or auxiliary button can allow the user to select between different options (e.g., left CMS or right CMS). A trackball can also be used, which allows for higher precision when adjusting the position of the image because the trackball detects small movements of the ball. In addition, a touchpad can be used because the pressing of a button can be simulated by pressing the touchpad, so that the user can move a finger across the length and width of the touchpad to determine the movement of the image. Other types of elements that are sensitive to human touch can be used, such as plastic materials or smart textiles. All of these above-mentioned elements can be placed in different elements of the car (not limited to): doors, driver's side panel, center console, center console (center armrest), steering wheel, etc.

[0057] Figure 6 The image capture device used by the CMS is shown, which can be an external camera 1102, 1112 directed backward and located on opposite sides (outside) of the vehicle 10 for photographing the external environment. Each CMS camera 1102, 1112 is fixed to an external rearview mirror 110, 111 as a winglet, and preferably, the winglet is fixed to the outside of the door 601, 602. In addition, the winglets on both sides of the vehicle 10 include respective overhead cameras 1101, 1111, but the CMS does not use any of them. In addition, the vehicle 10 has a front camera 1300 and a rear camera 1400, which the ECU 500 uses to look down by stitching. In a specific example, only one display device 101 is associated with one of the corresponding wings, and only the left external rearview mirror 111 is actually touched by the driver in Europe and the United States. Therefore, it is very advantageous if the touch screen 200, such as the touch screen of the left display device 101, can control the image area displayed in another screen / part of the left display device 101 (e.g., field of view adjustment).

[0058] More specifically, Figure 7The left exterior rearview mirror 110 is shown, which is a small wing fixed on the outside of the left door 601 and combines two fixed cameras: a first camera downward for looking down 1111, and a second camera focused backward for CMS 1112. The left display device 101 is fixed on the other inside of the left door 601 so that the user (usually the driver) can adjust the FOV of the CMS camera by touch. The looking down camera 1111 is usually positioned at a relative angle (e.g., about 2-20°) relative to the direction perpendicular to the ground, and the angle varies depending on the model of the vehicle (the length of the car, the height of the car, the shape of the outer surface on which the mounted component housing is placed, such as the shape of the door, etc.).

[0059] In a possible embodiment, each right and left winglet of the CMS may include:

[0060] a) cameras that are perceptibly focused backwards, which are the so-called right and left CMS cameras 1102, 1112;

[0061] b) a camera that is perceptibly focused downward, which is a right or left top-down camera 1101, 1111);

[0062] c) A camera that is sensibly focused forward, which is useful, for example, when the driver is overtaking. In particular, when he / she is going to overtake a vehicle on the right in front, and cannot see ahead (e.g., in the adjacent area in front of the vehicle); then, thanks to this front camera, the image in front can be displayed in the second part 2002, preferably by the second screen 400.

[0063] Figure 8 The touch screen 200 of the left display device 101 which is usually used by the driver is shown. Fig. 9 The touch screen 200 of the right display device 100, which is usually fixed on the passenger side, is shown. The second part of the display device 100, 101 is implemented in the touch screen 200, and an image area 210, 211 of the image captured by the corresponding external CMS camera 1102, 1112 is displayed. The zoom level of the image area 210, 211 can be adjusted by positioning two fingers on the touch screen 200 and changing the distance between the fingers while touching.

[0064] Optionally, the image area 211 displayed in the second part of the left display device 101 may also include Fig.11 The additional image portion 232 obtained by the ECU 500 is shown as selected as follows Fig.10 The image 231 captured by the left exterior CMS camera 1112 is shown at the extreme end and reduces its width. Fig.11 The additional image portion 232 shown in FIG. Fig.10The narrowed image of the extreme end side of the captured image 231 shown in the figure significantly increases the FOV of the left outside CMS camera 1112 simulating the aspherical mirror in the left outside rearview mirror 110. The same effect of the outer aspherical mirror can be achieved in the right outside rearview mirror 100 for the co-pilot, showing a second additional image portion 230 corresponding to the narrower image of the extreme end side of the image captured by the right outside CMS camera 1102.

[0065] Optionally, for example, the left display device 101 and the right display device 100 are respectively Fig.12 and Fig.13 As shown in FIG. 14 , the touch screen 200 presents a third additional image portion 240 showing an image captured by the rear camera 1400, displayed on the side opposite to the image area 210, 211 of the image captured by the corresponding external CMS camera 1102, 1112. This third additional image portion 240, 241 allows the driver to see the rear of the vehicle through the display device 100, 101 associated with the external rearview mirror 110, 111, which minimizes the number of required displays. According to another example, the third additional image portion 240 is shown on the second portion 2002 of the display device. Moreover, the driver can see the adjacent area 1222 of the "side zone view", i.e., the area between the "rear zone" 1220 and the "side zone" 1221, as shown in FIG. 14, in a "single" image on the driver's display, typically the image associated with the left external rearview mirror 111.

[0066] According to a variation of the aforementioned embodiment, in the event that the rear camera 1400 has no image to be displayed in the second portion of the display device 100, 101, the image from the corresponding overhead camera 1101, 1111 of the display device 100, 101 can be used. This is useful when the image area 210, 211 is able to reach the edge (end) of the captured image when moving within the captured image. In this case, since the image area 210, 211 is shown on the first portion 2001, there is no image to be shown on the second portion 2002, however, when this occurs, the ECU 500 detects this image and selects a "top view" image to be shown on the second portion 2002. The ECU 500 can select: (i) the overhead view of the overhead camera of a single CMS device, or (ii) the overhead view of the surrounding field of view, that is, after "stitching" the four overhead images from the left, right, front and rear cameras. Alternatively, instead of showing a top view, the image captured by the rear camera 1400 from the area 1222 may be displayed on the second portion 2002 or second screen 400, i.e., it is not the entire rear image but part of an adjacent / complementary rear image.

[0067] In a possible embodiment, the display devices 100, 101, 102 can be controlled by the user, the driver or the co-driver, for example, via Bluetooth from a smartphone or tablet. The CMS can automatically load the settings previously entered by the driver into his / her smartphone or tablet (i.e., the user preferences of the device owner: default position, field of view, etc.) to the ECU 500.

[0068] In another embodiment, the controller or ECU 500 of the CMS is further configured to receive and process vehicle driving and / or user information, and the image areas 210, 211 are moved within the captured image according to the received information. The vehicle driving information corresponds to at least a change in driving direction from a forward driving direction to a backward driving direction or vice versa, an increase or decrease in driving speed relative to a predetermined driving speed value, a lane change, a change in steering angle, a change in pitch angle, a change in roll angle, and road monitoring information.

[0069] In one example, ECU 500 is further configured to:

[0070] - when the driving direction changes from the forward driving direction to the backward driving direction, the image areas 210, 211 are moved corresponding to a downward vertical displacement, so that the field of view FOV is vertically displaced in the downward direction, and

[0071] When the driving direction changes from the backward driving direction to the forward driving direction, the image areas 210 , 211 are moved corresponding to an upward vertical displacement, so that the field of view FOV is vertically displaced in the upward direction.

[0072] In yet another example, the ECU 500 is configured to determine the relative upward and downward movement of the exterior rearview mirrors 110, 111 based on the change in the pitch angle value, and is further configured to:

[0073] - when the exterior rearview mirrors 110 , 111 are moved downward, the image areas 210 , 211 are moved corresponding to the downward vertical displacement, so that the field of view FOV is vertically displaced in the downward direction, and

[0074] When the exterior rear view mirrors 110 , 111 are moved upwards, the image areas 210 , 211 are moved corresponding to the upward vertical displacement, so that the field of view FOV is vertically displaced in the upward direction.

[0075] In yet another example, the ECU 500 is configured to receive the lateral displacement of the vehicle, such as through a change in the steering angle value, and is further configured to:

[0076] - in the case of a left lane change, the image area 210, 211 is moved corresponding to a lateral displacement to the right, so that the field of view is displaced laterally in the left direction, and

[0077] In the case of a right lane change, the image regions 210 , 211 are moved corresponding to a lateral displacement to the left, so that the field of view is displaced laterally in the right direction.

[0078] In another example, the ECU 500 is configured to move the image areas 210, 211 so that the zoom of the displayed image is increased when the driving speed increases and so that it exceeds a predetermined driving speed value, while the area of ​​the image area is reduced when the vehicle speed drops below the predetermined driving speed value. Thus, a smaller portion of the captured image is selected as the image area 210, 211, and then the enlarged image is displayed when the ECU 500 detects speeding. In this way, the driver has a better view of the area of ​​interest, which in this case corresponds to a more detailed view of the area farthest from the vehicle.

[0079] Preferably, the ECU 500 is configured to receive an activation signal such as a turn signal, and is further configured to move the image areas 210 , 211 upon receiving the activation signal.

[0080] In another embodiment, the CMS may operate using speed or other measurements (e.g., if reverse gear is engaged in a parking situation) obtained from a CAN or another network (e.g., Ethernet, etc.) that communicates with the ECU 500. The same measured speed signal may be used to adjust the FOV of the entire system in the vehicle 10, such as Figure 1 and Figure 6 As shown, it includes: a "right CMS" corresponding to one or more cameras or image processing devices 1102 associated with the right and left exterior rearview mirrors 110, 111, a "left CMS" corresponding to one or more cameras or image processing devices 1112 associated with the left exterior rearview mirror 111, and an intelligent interior rearview mirror system or IRMS associated with the interior rearview mirror 112. The IRMS and CMS are controlled by the same ECU500. The ECU500 can be configured to compare the current image with the previous image to act as a "backup" in the event that the CAN does not work (because there is a wireless camera that cannot be physically connected to the CAN, or because the CAN is damaged, or because there is a value that cannot be correctly transmitted through the CAN). In addition, the CMS can store images in the event of an accident detection. The ECU500 can be connected to the CAN of the car and the CAN itself determines when an accident has occurred or not. Alternatively, the ECU500 also includes an accident detection device. Typically, the accident detection device includes an accelerometer. The accelerometer is configured so that it does not jump in the maximum acceleration or braking of the car, but there is vibration in the event of a greater deceleration. In no case is the image hidden by the overlay of the digital buttons.

[0081] The driver can adjust the FOV of the IRMS by "touch and drag", which is preferably provided by the second part 2002 of the CMS display device 100, 101, 102. Although the traditional central rear view mirror is tilted because the driver is on the left side of the car and wants to see what is behind, the internal rear view mirror of the IRMS is centered, and the IRMS provides the driver with a display showing the image of the rear camera 1400. There is no option to turn the rear view mirror in the IRMS, but the driver can perform "cropping & panning" on the rear camera through the "touch & drag" function in the second part 2002. In the "cropping & panning" function of the IRMS, the rear camera 1400 captures an image in which the controller, i.e., a single ECU of the vehicle, any ECU 500 of the CMS, or the ECU of the IRMS, selects a portion of the image or "image area" that appears on the IRMS display.

[0082] According to another preferred embodiment, as an alternative to the aforementioned method, the CMS includes a gesture detector based on a touch screen control surface or in addition to a touch screen control surface, for example, to move an image area within an image captured by an external image capture device by gestures of the driver's fingers, or to allow the driver to command the CMS to expand the FOV by head movements. There are three implementation options for the gesture detector:

[0083] i) In a possible embodiment, gestures may be identified in images of the user captured by an additional camera within the vehicle 10, for example, near the user's display or in an interior mirror, and the ECU is configured to avoid false positives and false negatives in detected gestures by using an image classifier.

[0084] ii) In another possible embodiment, no additional cameras are needed, gestures are performed on the display without touching it, and these gestures are detected by simply increasing the volume sensitivity of its screen.

[0085] iii) Another possible embodiment is based on an Electric Near Field (E-field) 3D gesture controller that enables user gesture detection and motion tracking using a single chip device that does not require host processing as required for embedded applications. Thus, just by turning his / her head or waving a hand, the CMS detects that the driver wants to open (enlarge) his / her FOV and thus increases the FOV of the external camera. Thus, this preferred embodiment provides multiple possible positions where the driver may make movements.

[0086] In another possible embodiment of the CMS using a gesture detector, the cropping and panning functions can be triggered by the driver's head movement. The driver's head movement can be tracked by a monitoring system, which is preferably located in the vehicle, more preferably fixed (i) in front of the driver, or (ii) in the internal rearview mirror, (iii) or close to the CMS display device. Preferably, the driver monitoring system may include a camera. The monitoring system is able to calculate the position and distance of the driver's head. Therefore, the image areas 210, 211 within the captured image can be manually controlled (e.g., by a screen sliding command O of a touch and drag function), but can also be controlled by the movement of the driver's head forward when the gesture detector captures the movement.

[0087] Note that, in this document, the term "include" and its derivatives (such as "including", etc.) should not be understood in an exclusive sense, that is, these terms should not be interpreted as excluding the possibility that the described and defined content may include additional elements, steps, etc.

Claims

1. A camera monitoring system for a motor vehicle (10), the camera monitoring system comprising: An image capture device (1102, 1112) associated with at least an exterior rearview mirror (110, 111) of a vehicle (10), the exterior rearview mirror (110, 111) being a mounting assembly located at an exterior portion of the vehicle (10), the image capture device (1102, 1112) being located at the mounting assembly and being configured to capture an image from an exterior field of view of the vehicle (10), wherein the exterior field of view extends at least laterally and rearwardly outside the vehicle (10) and encompasses a portion of the exterior portion of the vehicle (10); An electronic control unit, ECU (500), connected to the image capture device (1102, 1112); wherein the ECU (500) is configured to select at least one image region (210, 211) from the image captured by the image capture device (1102, 1112), the image region (210, 211) being smaller than the captured image and being movable within the captured image; And the camera monitoring system also includes: at least one display device (100, 101, 102), the at least one display device comprising at least a first screen, the first screen being located inside the vehicle (10) and connected to the ECU (500), wherein the first screen is a touch screen (200); and The invention is characterized in that the at least one display device (100, 101, 102) comprises: i) a first part, in which a touch-and-drag operation cannot be performed on the displayed image; and ii) a second part, in which the touch-and-drag operation provided by the touch screen (200) used as a control surface is configured to move the image area (210, 211) within the captured image, the image area (210, 211) being displayed by at least the first part of the at least one display device (100, 101, 102).

2. The camera monitoring system according to claim 1, wherein: The ECU (500) disables the touch-and-drag operation in the first portion, and the ECU (500) activates the touch-and-drag operation in the second portion.

3. The camera monitoring system according to claim 1 or 2, wherein: The camera monitoring system further comprises a frame partially covering the touch screen (200) to divide the at least one display device (100, 101, 102) into at least the first part and the second part.

4. The camera monitoring system according to claim 3, wherein: The frame is partially colored and comprises at least one uncolored portion corresponding to the second portion of the at least one display device (100, 101, 102).

5. The camera monitoring system according to claim 4, wherein: The frame includes two uncolored parts, namely, a first uncolored part and a second uncolored part, wherein the first uncolored part corresponds to the second part displaying the image area (210, 211), the size or position of which can be adjusted on the touch screen (200) by a user's touch; and the second uncolored part corresponds to the second part displaying a control item, wherein the control item is used to control a parameter through the control surface of the touch screen (200).

6. The camera monitoring system according to claim 5, wherein: The parameters controlled by the control surface of the touch screen (200) are selected from: brightness, contrast and color parameters of the image displayed by the at least one display device (100, 101, 102).

7. The camera monitoring system according to claim 6, wherein: The parameter controlled by the control surface of the touch screen (200) is selected from: a height of the field of view of the image capture device (1102, 1112) and a width of the field of view of the image capture device (1102, 1112).

8. The camera monitoring system according to claim 7, wherein: The control item is selected from: a digital button, a digital menu, and a button drawn on the frame.

9. The camera monitoring system according to claim 2, wherein: The first part and the second part of the at least one display device (100, 101, 102) are the same touch screen (200).

10. The camera monitoring system according to claim 2, wherein: The at least one display device (100, 101, 102) further comprises a non-touch-sensitive second screen (400), and the first portion of the at least one display device (100, 101, 102) is the second screen (400), and the second portion of the at least one display device (100, 101, 102) is the touch screen (200).

11. The camera monitoring system of claim 1, further comprising a gesture detector configured to move the image area (210, 211) within the captured image.

12. The camera monitoring system according to claim 11, further comprising an additional camera located inside the vehicle (10), the additional camera being configured to capture a driver's gesture, and the gesture detector being implemented by the ECU (500) using an image classifier.

13. The camera monitoring system according to claim 11 or 12, the gesture detector being implemented by a touch-sensitive screen of the at least one display device (100, 101, 102) with increased volume sensitivity.

14. The camera monitoring system according to claim 11 or 12, wherein the gesture detector is implemented by an electronic device based on an electronic near-field gesture controller.

15. The camera monitoring system according to claim 1 or 2, wherein: The image capture device (1102, 1112) is fixedly located outside the vehicle (10).

16. A motor vehicle (10) comprising an intelligent rear view monitoring system (IRMS) having an image capture device associated with an interior rear view mirror (112), characterized in that: The intelligent rearview monitoring system also includes: a first camera monitoring system, the first camera monitoring system being a camera monitoring system according to any one of claims 1 to 14, having an image capture device (1112) located on the left side of the vehicle (10) and associated with the left side exterior rearview mirror (111), a second camera monitoring system, the second camera monitoring system being a camera monitoring system according to any one of claims 1 to 14, having an image capture device (1102) located on the right side of the vehicle (10) and associated with the right side exterior rearview mirror (110), And wherein a single ECU (500) connected to all image capture devices (1102, 1112) is configured to control the first camera monitoring system and the second camera monitoring system, and is also configured to control the intelligent rear view monitoring system (IRMS).

Images