Side mirror system for a vehicle

Abstract

An in-vehicle rearview camera is positioned to monitor a field of view behind the vehicle. An operator monitoring device is positioned to dynamically monitor an operator's gaze. The controller communicates with a digital display screen, the rearview camera, and the operator monitoring device. The controller contains executable code that can be operated to: acquire an image of the vehicle's rear view via the camera; determine the operator's viewing direction via the operator monitoring device; determine an operating mode; and display, via the digital display screen, a portion of the rear view image, the portion of the rear view image being determined based on the operating mode and the operator's viewing direction.

Description

[0001] Vehicles are equipped with side mirrors that drivers can use to visually monitor the areas behind, to the left, and to the right of the vehicle. Such monitoring can be useful under various traffic conditions, including but not limited to lane changes, merging, exiting, turning at intersections, etc. Such monitoring can also be useful when a vehicle is reversing, that is, when traveling in a reverse direction.

[0002] There is a need to be able to determine a parameter relating to a vehicle operator's viewing direction and display an image on a proximal digital screen derived from a field of view (FOV) behind the vehicle. This is achieved to provide the operator with visual information useful when operating the vehicle.

[0003] DE 10 2023 002 197 A1 concerns the field of human-machine interaction in vehicles and provides a method for displaying images in a vehicle.

[0004] DE 10 2013 020 950 A1 concerns a method for operating a reversing camera system of a motor vehicle.

[0005] DE 10 2007 044 535 A1 describes a method for recording driver information in a motor vehicle, in which a recording device of the motor vehicle records an image stream containing images of at least part of the environment of the motor vehicle.

[0006] It can be considered an objective to provide an alternative side mirror system for a vehicle, thereby enabling better detection of hazards in the side mirror area. This objective is achieved by the subject matter of claim 1.

[0007] The concepts described herein comprise a method, a system and / or a device arranged and configured to provide a side mirror system for a vehicle, comprising a rear-view focused camera, a device for determining an operator's viewing direction, a digital display screen and a control capable of dynamically monitoring a field of view (FOV) located behind the vehicle and selecting a portion of the FOV to be displayed as an image on the digital display screen based at least partially on the operator's viewing direction.

[0008] One aspect of the disclosure may include an in-vehicle rearview-focused camera positioned to monitor a field of view located behind the vehicle. The operator monitoring device is positioned to dynamically monitor an operator's view. The controller communicates with a digital display screen, the rearview camera, and the operator monitoring device. The controller contains executable code that can be operated to: acquire an image of the vehicle's rear view via the camera; determine the operator's viewing direction via the operator monitoring device; determine an operating mode; and display, via the digital display screen, a portion of the rear view image, the portion of the rear view image being determined based on the operating mode and the operator's viewing direction.

[0009] The side mirror system according to the invention for a vehicle comprises a rear-view focused camera, wherein the rear-view focused camera is mounted on one side of a vehicle and is arranged to capture a field of view located behind the vehicle; an operator monitoring device arranged to dynamically determine the operator's viewing direction; a digital display screen; and a control unit. The control unit communicates with the digital display device, the rear-view camera, and the operator monitoring device.The control unit contains executable code that can be operated to: capture an image of the field of view behind the vehicle via the camera; capture the operator's current viewing direction via the operator monitoring device; determine an operating mode; and display, via the digital display screen, a portion of the image of the field of view behind the vehicle, the portion of the image being displayed being determined based on the operating mode and the operator's current viewing direction.

[0010] The operating mode includes either a mirror-like view, a hazard-based view, or a view based on a region of interest.

[0011] According to one embodiment, a displayed portion of the image in the field of view, which is determined based on the operating mode and the operator's current viewing direction, includes an image magnification that highlights a road hazard when the hazard-based view is selected.

[0012] In the side mirror system according to the invention, a displayed part of the image of the field of view, which is determined based on the operating mode and the current viewing direction of the operator, comprises an image magnification in which a region of interest is highlighted when the view based on the region of interest is selected.

[0013] According to one embodiment, the operating mode includes either an expanded view, an enlarged hazard view, or an extended enlarged hazard view.

[0014] According to one embodiment, the controller determines the operating mode based on an operator preference.

[0015] According to one embodiment, the operator monitoring device comprises a device arranged to determine the position of the operator's head in order to determine the operator's viewing direction.

[0016] According to one embodiment, the rear-view focused camera is mounted on an outer side surface of the vehicle near a side mirror.

[0017] According to one embodiment, the system comprises the rear-view focused camera mounted on a left outer side surface of the vehicle near a left side mirror.

[0018] According to one embodiment, the system comprises the rear-view focused camera, which is mounted on a right outer side surface of the vehicle near a right side mirror.

[0019] According to one embodiment, the controller determines the operating mode based on a region of interest to the operator.

[0020] According to one embodiment, the control system determines the operating mode based on the presence of a hazard near the vehicle.

[0021] According to one embodiment, the control can be operated in such a way that it performs an image distortion correction of the image of the rear field of view before displaying the part of the image of the rear field of view via the digital display device.

[0022] According to one embodiment, the control system can be operated in such a way that it detects a reversing operation of the vehicle and displays a part of the image of the field of vision located behind the vehicle via the digital display screen, wherein the part of the image of the field of vision is determined based on the operating mode, the current viewing direction of the operator and the reversing operation of the vehicle.

[0023] According to one embodiment, a side mirror system for a vehicle comprises the following: a rearview-focused camera, wherein the rearview-focused camera is mounted on one side of a vehicle and is arranged to capture a field of view located behind the vehicle; a passenger compartment comprising an operator seat, an operator monitoring device arranged to monitor an operator seated in the operator seat, and a display screen visible to the operator; and a controller communicating with the display device, the rearview camera, and the operator monitoring device.The control unit contains executable code, the executable code being operable to: capture an image of the field of view located behind the vehicle via the camera; capture the current viewing direction of the operator located in the operator's seat via the operator monitoring device; determine an operating mode; and display, via the digital display screen, a portion of the image of the field of view located behind the vehicle, the portion of the image of the field of view being determined based on the operating mode and the operator's current viewing direction.

[0024] One or more embodiments are now described by way of example with reference to the attached drawings, in which: Fig. Figure 1 schematically illustrates an embodiment of a forward-facing section of a passenger cabin for an embodiment of a subject vehicle according to the disclosure. Fig. 2 schematically illustrates a rear-view image generation process according to the disclosure. Fig. Figure 3 schematically illustrates a top view of a passenger compartment of a vehicle with an embodiment of a side mirror system according to the disclosure. Fig. Figure 4 schematically illustrates a top view of a passenger compartment of a vehicle with an embodiment of a side mirror system according to the disclosure. Fig. 5. Illustrations of display images for an embodiment of a side mirror system including a rear view image generation process according to the disclosure.

[0025] The accompanying drawings are not necessarily to scale and may represent a somewhat simplified depiction of various preferred features of the present disclosure, as disclosed herein, including, for example, specific dimensions, orientations, locations, and shapes. Details associated with such features are partly determined by the specific intended application and usage environment.

[0026] In the drawings, corresponding reference symbols indicate identical or corresponding parts and features.

[0027] As used here, the term “system” may refer to one or a combination of mechanical and electrical actuators, sensors, controllers, application-specific integrated circuits (ASICs), combinational logic circuits, software, firmware and / or other components arranged to provide the described functionality.

[0028] As used here, the term "actively connected" indicates a relationship in which one element actuates or otherwise controls the actuation of another element, which uses one or a combination of mechanical, fluidic, electrical, electronic, magnetic, digital, etc. forces to perform one or more tasks.

[0029] Referring to the drawings, in which identical reference symbols correspond to identical or similar components in the different figures, illustrates Fig. 1 figuratively an embodiment of a forward-facing section of a passenger cabin 20 for an embodiment of a vehicle 10 comprising a side mirror system 15 capable of generating an embodiment of a rear-view image generation process 200, which, with reference to Fig.The concepts illustrated and described in Sections 2 ff. are to be implemented and executed according to the disclosure. In one embodiment, vehicle 10 is arranged on a driving surface, such as a paved road surface, and can cross it. The concepts described here can be arranged on a variety of different land, air, and sea vehicle types, including, but not limited to, passenger cars, light trucks, semi-trailer trucks, motorhomes, construction vehicles, agricultural vehicles including tractors, combine harvesters, etc., boats, ships, aircraft, two-wheeled vehicles, commercial vehicles, and others, without exception.

[0030] As a non-limiting example, an embodiment of the side mirror system 15 with a rear-view image generation process 200 can be implemented on a passenger car to monitor traffic on a highway. As another non-limiting example, an embodiment of the side mirror system 15 with the rear-view image generation process 200 can be implemented to monitor the alignment of a grain truck driving alongside a combine harvester. In some embodiments, the side mirror system 15 can be referred to as a digital side mirror system.

[0031] With renewed reference to Fig.In one embodiment, the vehicle 10 comprises a passenger cabin 20 with a side mirror system 15 and a control unit 80. The side mirror system 15 includes an externally mounted left or operator-side side mirror 30, an externally mounted right or passenger-side side mirror 40, a first left display screen 35, a second right display screen 45, an operator information center 50 with a touchscreen 55, a biometric monitoring system 60, a gear selector 70, and other elements. The left side mirror 30 has a first digital camera system 32 mounted thereon, and the right side mirror 40 includes a second digital camera system 42 mounted thereon.It is understood that in some embodiments the left side mirror 30 may be assigned to and correspond to a passenger side of the vehicle, and a right side mirror 40 may be assigned to and correspond to an operator side of the vehicle 10. It is understood that in some embodiments the vehicle 10 is equipped with an operator seat and has no passenger seat. It is understood that in some embodiments the operator seat is centrally mounted.

[0032] The first digital camera system 32 and the second digital camera system 42 can be configured with two-dimensional imaging capability, three-dimensional imaging capability, black and white imaging capability, RGB color imaging capability, etc. The first digital camera system 32 and the second digital camera system 42 can use fisheye lenses to maximize their respective fields of view (FOVs) or other lens types. The first digital camera system 32 and the second digital camera system 42 can have a pixelated resolution of 2 megapixels or any other resolution without restriction.

[0033] The first digital camera system 32 and the second digital camera system 42, the operator information center 50 with touchscreen 55, the first, left display screen 35 and the second, right display screen 45, the biometric monitoring system 60 and the gear range selector 70 are in communication with and / or operatively connected with the control unit 80, which includes executable code for monitoring and processing information from it and displaying images on the first and second display screens 35, 45.

[0034] The first and second display screens 35, 45 are shown to be located inside the vehicle 10, in the respective operator door or passenger door, below the respective operator side mirror 30 or passenger side mirror 40. It is understood that the first and second display screens 35, 45 may instead be arranged on the respective operator door or passenger door in a plane horizontal to the respective operator side mirror 30 or passenger side mirror 40, or at another location easily visible to the operator.

[0035] In one embodiment, the first and second display screens 35, 45 can instead be arranged on an inner section of a roof support structure on either side of the vehicle's windshield, i.e., an A-pillar. Alternatively, the first and second display screens 35, 45 can be head-up displays (HUDs) projected onto sections of the windows of the respective operator door or passenger door. Furthermore, the first and second display screens 35, 45 can be arranged as the respective operator side mirror 30 and passenger side mirror 40 in Fig. Figure 1 is attached. In one embodiment, the first and second display screens 35, 45 can replace the respective operator side mirror 30 and passenger side mirror 40, wherein the operator side mirror 30 and / or passenger side mirror 40 are missing in one embodiment of the vehicle 10.

[0036] The Operator Information Center (DIC) 50 includes a touchscreen 55 and provides human-machine interaction for the purpose of controlling the operation of an infotainment system, a navigation system and the like.

[0037] The operator information center 50 can also communicate with one or more devices that monitor biometric monitoring devices 60 to determine data associated with the driver, including, for example, gaze direction, posture, and head position tracking, among other things. For the sake of simplicity, the operator information center 50 is shown as a single device, but in one embodiment of the system described herein, it can be configured as a plurality of controllers and associated sensing devices.

[0038] The biometric monitoring system 60 is positioned in the vehicle relative to the operator's gaze direction or a biometric equivalent. The term "gaze" refers to the orientation of an individual's eyes toward a specific focus area(s). In one embodiment, the biometric monitoring system 60 monitors parameters relating to the position and angle of an operator's head, which can be calibrated and adjusted to determine an operator's gaze direction. Alternatively or additionally, the biometric monitoring system 60 can be configured to monitor and track the operator's eye(s).The biometric monitoring system 60 can be used to dynamically determine the operator's direction of gaze, regardless of whether he is looking forward, looking at the left side mirror, looking at the right side mirror, looking at the dashboard, looking at the operator information center, etc.

[0039] In one embodiment, the spatial monitoring system 94 comprises one or a plurality of spatial sensors and systems arranged to monitor regions near the subject vehicle 10, and a spatial monitoring controller. The spatial sensors arranged to monitor the visible region include, for example, a lidar sensor, a radar sensor, a digital camera, or another device. Each of the spatial sensors is mounted inside the vehicle to monitor all or part of the visible region in order to detect distant objects in the vicinity, such as road features, lane markings, buildings, pedestrians, road signs, traffic lights and signs, other vehicles, road hazards, and geographical features located near the subject vehicle 10.The spatial monitoring control can generate digital representations of the visible region based on data inputs from the spatial sensors. The spatial monitoring control includes executable code for evaluating inputs from the spatial sensors to determine a linear range, relative velocity, and trajectory of the subject vehicle 10 with respect to each distant object in the vicinity. The spatial sensors can be located at various points on the subject vehicle 10, including the front corners, rear corners, rear sides, and mid-sides. In one embodiment, the spatial sensors may include a front radar sensor and a camera, although the disclosure is not limited thereto.

[0040] The placement of the spatial sensors is selected to enable the spatial monitoring control to monitor traffic flow, including nearby vehicles, intersections, lane markings, and other objects around the subject vehicle 10. The spatial sensors of the spatial monitoring system 94 may include object location detection devices, including area sensors such as FM-CW (Frequency Modulated Continuous Wave) radars, pulse and FSK (Frequency Shift Keying) radars, and LiDAR (Light Detection and Ranging) devices, as well as ultrasonic devices that rely on effects such as Doppler effect measurements to locate objects ahead.Possible object detection devices include CCD (Charged-Coupled Devices) or CMOS (Complementary Metal Oxide Semiconductor) video image sensors and other camera / video image processors that use digital photographic techniques to "see" forward objects, including one or more vehicles.

[0041] The term "controller" and related terms such as microcontroller, control unit, processor, and similar terms refer to one or more combinations of application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), electronic circuits, central processing units (CPUs), for example, microprocessors, and associated non-volatile memory components in the form of memory and storage devices (read-only memory, programmable read-only memory, direct access memory, hard disk, etc.). The non-volatile memory component stores machine-readable instructions in the form of one or more software or firmware programs or routines, combinational logic circuits, input / output circuits and devices, signal conditioning and buffering circuits, and other components that can be accessed by one or more processors to provide a described functionality.Input / output circuits and devices include analog-to-digital converters and related devices that monitor inputs from sensors, wherein such inputs are monitored at a preset sampling frequency or in response to a trigger event.

[0042] Software, firmware, programs, instructions, control routines, code, algorithms, and similar terms refer to sets of instructions, including calibrations and lookup tables, that can be executed by a controller. Every controller executes control routine(s) to provide desired functionality. Routines can be executed at regular intervals, for example, every 100 microseconds during normal operation. Alternatively, routines can be executed in response to a trigger event.

[0043] Communication between controllers, actuators, and / or sensors can be achieved using a direct wired point-to-point connection, a networked communication bus connection, a wireless connection, or another suitable communication link. This communication involves the exchange of data signals in a suitable form, including, for example, electrical signals over a conductive medium, electromagnetic signals over air, optical signals over optical waveguides, and the like. The data signals can include discrete analog or digitized analog signals representing sensor inputs, actuator commands, and communication between controllers.

[0044] The term "signal" refers to a physically detectable indicator that transmits information and can be a suitable waveform (for example, electrical, optical, magnetic, mechanical, or electromagnetic), such as direct current, alternating current, sine wave, triangle wave, square wave, vibration, and the like, capable of propagating through a medium. A parameter is defined as a measurable quantity that represents a physical property of a device or other element, detectable using one or more sensors and / or a physical model. A parameter can have a discrete value, for example, either "1" or "0," or it can be infinitely variable in value.

[0045] The terms “dynamic” and “dynamic” describe steps or processes that are executed in real time and are characterized by monitoring or otherwise determining the states of parameters and regularly or periodically updating the states of the parameters during the execution of a routine or between iterations of the routine's execution.

[0046] Fig. Figure 2 schematically illustrates an embodiment of a rear-view image generation process 200, which can be executed by the controller 80, with reference to Fig. 1 is described to capture and display an image of at least a part of the vehicle's rear field of view, responding to the vehicle operator's gaze while taking into account the current operating environment, which may include, among other things, traffic, road conditions such as intersections and lane merging, vehicle navigation, and direction of travel (forward or reverse).

[0047] The rear-view image generation process 200 is illustrated as a collection of blocks in a logical flowchart representing a sequence of operations that can be implemented in hardware, software, or a combination thereof. In the context of software, the blocks represent computer instructions which, when executed by one or more processors, perform the operations stated. For the sake of simplicity and clarity of illustration, the rear-view image generation process 200 is described with reference to vehicle 10, which is described with reference to Fig. 1 is described. Table 1 BLOCK BLOCK CONTENTS 201 Monitoring the rear area of ​​the vehicle via the camera and capturing an image of the field of view (FOV) 202 Monitoring the operator 203 Monitoring the road surface and driving conditions 204 Monitoring vehicle conditions 205 Monitoring vehicle position 206 Determining the operating mode 207 Selecting a part of the image from the FOV 208 Performing image distortion correction 209 Displaying the image on the screen

[0048] The execution of the rear-view image generation process (process) 200 can proceed as follows. The steps of process 200 can be performed regularly or periodically in a suitable sequence and are not limited to those referred to in Fig. The described sequence is limited.

[0049] The rear-view image generation process 200 comprises the regular, periodic, and continuous monitoring of a rear area of ​​the vehicle 10 by the first and / or the second digital camera 32, 42 and the acquisition of image(s) of the field of view (FOV) (step 201). In one embodiment, this may include acquiring an image of an FOV by the first digital camera 32. In another embodiment, this may include acquiring an image of an FOV by the second digital camera 42. In yet another embodiment, this may include acquiring a first image of a first FOV by the first digital camera 32, acquiring a second image of a second FOV by the second digital camera, and performing the fusion of the first and second images to derive a final image, which is processed as described herein.

[0050] Simultaneously, the biometric monitoring system 60 monitors the operator to capture information relating to the operator's gaze direction, for example, whether the operator is looking at or towards one of the left or right side mirrors 30, 40, or whether the operator is looking at or towards a centrally mounted rearview mirror, etc. (Step 202). This may include capturing the operator's head position.

[0051] Simultaneously, road and driving conditions can be monitored via image processing from the first and / or second digital camera 32, 42, supplemented by road and driving conditions detected by the navigation system 92, the spatial monitoring system 94 (on vehicles so equipped), and / or other in-vehicle or external systems (step 203). This includes monitoring the areas surrounding the subject vehicle 10 to detect nearby vehicles, distant objects such as road features, lane markings, buildings, pedestrians, road signs, traffic lights and signs, road hazards, and geographical features. Furthermore, the navigation system 92 can be used to monitor lanes, including but not limited to lane changes, merging, exits, etc. This can also include traffic levels, driving conditions, etc.This information can be supplemented with other information available without restriction to nearby vehicles via vehicle-to-vehicle (V2V) communication, connected highway systems, satellite communication, etc.

[0052] One or a multitude of vehicle conditions are monitored, including, but not limited to, the direction of travel requested by the operator via the transmission range selector 70, i.e., reverse operation and activation of an ADAS system, etc. (Step 204).

[0053] The position of subject vehicle 10 is monitored via the GPS sensor (step 205).

[0054] The information gathered in steps 201 through 205 is used to determine a side-view mirror operating mode (SVM operating mode) for the subject vehicle (step 206). The SVM operating mode can include a mirror-like view (MODE 1), a hazard-based view (MODE 2), a region of interest (ROI)-based view (MODE 3), a magnified hazard-based view (MODE 4), an enhanced view (MODE 5), and an enhanced magnified hazard view (MODE 6). One or more of these modes can be automatically selected based on operator preference under different driving conditions, for example, selecting MODE 4 when working on a highway or MODE 2 when working on a rural, congested road.In one embodiment, a machine learning algorithm can be used to classify the driving conditions and select a suitable mode based on them.

[0055] A portion of the field of view (FOV) image captured in step 201 is selected based on the selected operating mode and the operator's viewing direction or position (step 207).

[0056] An image distortion correction routine is executed on the selected portion of the image in the field of view (FOV) (step 208). Routines capable of image distortion correction are commercially available and are therefore not described in detail here.

[0057] The resulting image of the part of the field of view (FOV) with image distortion correction is projected onto the relevant display screen, that is, either the first display screen 35 to the left and / or the second display screen 45 to the right (step 209).

[0058] In one embodiment, the projected image of the portion of the field of view (FOV) with image distortion correction can include additional information, including augmented reality, which may include lane position(s), vehicle path, directional and / or navigation information, and the like.

[0059] Preferably, and in one embodiment, the steps of this process are performed at a rate of 30, 50, 60 or another number of frames per second.

[0060] The rear view image generation process 200 of Fig.2 is executed as algorithmic code in the controller 80. The rear-view image generation process 200 can be implemented by a computer algorithm, machine-executable code, a non-volatile, computer-readable medium, or software instructions programmed into the vehicle. Although the various steps shown in the flowchart appear to occur in a chronological sequence, at least some of the steps may occur in a different order, and some steps may be performed concurrently or not at all.

[0061] Fig. Figure 3 schematically illustrates a top view of a passenger compartment of a vehicle 10 with an embodiment of a side mirror system 15 comprising an operator 301 located on the left side of the vehicle 10.

[0062] In one embodiment, the vehicle 10 comprises the passenger cabin 20 with an externally mounted left or operator-side side mirror 330 with a first digital camera system 332, an externally mounted right or passenger-side side mirror 340 with a second digital camera system 342, a first left display screen 335, a second right display screen 345, an operator information center 350 with a display screen 355, a biometric monitoring system 360, and other elements. In this embodiment, the operator's direction of view, as indicated by a first head position 303, is shown as being directed to the right, which can be interpreted as indicating that the operator is on a highway.

[0063] A total FOV 336 for the first digital camera system 332 is shown having a triangular shape (in 2 dimensions) or a pyramidal or conical shape (in 3 dimensions) and is comprehensively represented as sub-areas ABCDEFGHIJKLMN. Based on the operation of the with reference to Fig. In the rear-view image generation process 200 described in section 2, a first part 337 of the total FOV 336 can be selected based on the operator 301 having the first, right-hand head position 303. As a non-restrictive example, the first part 337 of the total FOV 336 can be redefined to include sub-areas HIJKLM, with only sub-areas HIJKLM being displayed on the first, left-hand display screen 335, as illustrated.

[0064] Fig.Figure 4 schematically illustrates a top view of a passenger compartment of a vehicle 10 with an embodiment of the side mirror system 15, which includes an operator 301 located on the left side of the vehicle 10. In one embodiment, the vehicle 10 comprises the passenger compartment 20 with an externally mounted left or operator-side side mirror 330 with a first digital camera system 332, an externally mounted right or passenger-side side mirror 340 with a second digital camera system 342, a first left display screen 335, a second right display screen 345, an operator information center 350 with a display screen 355, a biometric monitoring system 360, and other elements.In this embodiment, the operator's direction of view, as indicated by a second head position 304, is shown as directed to the left, which can be interpreted as an indication that the operator is in an urban traffic situation.

[0065] The total FOV 336 for the first digital camera system 332 is shown having a triangular shape (in 2 dimensions) or a pyramidal or conical shape (in 3 dimensions) and is comprehensively represented as sub-areas ABCDEFGHIJKLMN. Based on the operation of the with reference to Fig.In the rear-view image generation process 200 described above, a second part 338 of the total FOV 336 can be selected based on the operator 301 having the second, left head position 304. As a non-restrictive example, the second part 338 of the total FOV 336 can be described to include sub-areas BCDEFG, with only sub-areas BCDEFG being displayed on the first, left display screen 335, as illustrated.

[0066] It goes without saying that the in Fig. 3 and Fig. 4 schematically illustrated concepts and situations for the opposite side of the vehicle 10, that is, the externally mounted right or passenger-side side mirror 340 with the second digital camera system 342 and the second, right-hand display screen 345, can be replicated based on the direction of view and the associated head position of the operator.

[0067] Thus, the vehicle system described here, which uses the rear view image generation process 200, is executable to detect hazards and enlarge threats in a camera image using computer vision algorithms and image selection based on multiple criteria (head movement, hazard, ROI, etc.) and / or operator preference, and to display part of the image on a digital display to help the operator better understand the side view environment.

[0068] Fig. Figure 5 illustrates display images for an embodiment of the side mirror system 15, which refers to Fig. 1 is described, which are associated with the execution of an embodiment of the rear-view image generation process 200, which is described with reference to Fig. 2, Fig. 3 and Fig. 4 is described.

[0069] Element 501 illustrates an original image of a field of view of a rear area of ​​vehicle 10, captured by one of the first or second digital cameras 32, 42. In this image 501, the subject vehicle is traveling on a multi-lane divided highway in a lane located to the right of a central barrier. Lanes shown include a lane to the left of the lane, the lane itself, at least three lanes to the right of the lane, and an on-ramp.

[0070] Element 502 illustrates a first partial image, that is, a part of the original image 501 of the field of view of the rear area of ​​the vehicle 10, in which the operator's head is located in a nominal central position. The first partial image 502 is generated by the rear view image generation process 200 and mainly comprises the lane.

[0071] Element 503 illustrates a second partial image, that is, a part of the original image 501 of the field of view of the rear area of ​​the vehicle 10, in which the operator's head is located in a nominal right-center position. The second partial image 503 is generated by the rear-view image generation process 200 and mainly comprises the lane to the right of the driving lane.

[0072] Element 504 illustrates a third partial image, that is, a part of the original image 501 of the field of view of the rear area of ​​the vehicle 10, in which the operator's head is located in a nominal left-center position. The third partial image 504 is generated by the rear-view image generation process 200 and mainly comprises the area to the left of the driving lane.

[0073] The flowcharts and block diagrams contained herein illustrate the architecture, functionality, and operation of possible implementations of systems, procedures, and computer program products according to various embodiments of the present disclosure. In this respect, each block in the flowcharts or block diagrams can represent a module, segment, or portion of code comprising one or more executable instructions for implementing the specified logical function(s). It is also noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, can be implemented by dedicated hardware systems that perform the specified functions or actions, or by combinations of dedicated hardware and computer instructions.These computer program instructions may also be stored in a computer-readable medium that can instruct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer-readable medium produce a manufactured item comprising a set of instructions that implements the function / action specified in the block or blocks of the flowcharts and / or block diagrams.

Claims

Side mirror system (15) for a vehicle (10), the system comprising: a rear-view focused camera (32, 42), wherein the rear-view focused camera (32, 42) is mounted on one side of the vehicle (10) and is arranged to capture a field of view located behind the vehicle (10); an operator monitoring device (60) arranged to dynamically determine the viewing direction of an operator (301); a digital display screen (35, 45); and a controller (80) in communication with the digital display screen (35, 45), the rearview-focused camera (32, 42) and the operator monitoring device (60); wherein the controller (80) contains executable code, the executable code being operable to: capture, via the rearview-focused camera (32, 42), an image of the field of view located behind the vehicle (10); capture, via the operator monitoring device (60), a current direction of view of the operator (301);Determining an operating mode; and displaying, via the digital display screen (35, 45), a portion of the image of the field of view located behind the vehicle (10), wherein the portion of the image of the field of view is determined based on the operating mode and the operator's current viewing direction (301); wherein the operating mode includes either a mirror-like view, a hazard-based view, or a region of interest-based view; and wherein a displayed portion of the image of the field of view, determined based on the operating mode and the operator's current viewing direction (301), includes image magnification, highlighting a region of interest when the region of interest-based view is selected. System (15) according to claim 1, wherein a displayed part of the image of the field of view, which is determined based on the operating mode and the current viewing direction of the operator (301), comprises an image magnification in which a road hazard is highlighted when the hazard-based view is selected. System (15) according to claim 1, wherein the operating mode comprises either an enhanced view, an enlarged hazard view or an enhanced enlarged hazard view. System (15) according to claim 1, wherein the controller (80) determines the operating mode based on an operator preference. System (15) according to claim 1, wherein the operator monitoring device (60) comprises a device arranged to determine the position of the operator's (301) head in order to determine the operator's (301) viewing direction. System (15) according to claim 1, wherein the rear-view focused camera (32, 42) is mounted on an outer side surface of the vehicle (10) near a side mirror (30, 40). System (15) according to claim 6, comprising the rear-view focused camera (32) mounted on a left outer side surface of the vehicle (10) near a left side mirror (30). System (15) according to claim 6, comprising the rearview focused camera (42) mounted on a right outer side surface of the vehicle (10) near a right side mirror (40).

Images