Focusing system to improve vehicle visibility
The vehicle vision system adjusts the depth of field based on the driver's gaze to blur objects outside the focal point, enhancing visibility and safety by focusing on the primary object of interest.
Patent Information
- Application Number
- DE102016114754
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2015-08-13
- Filing Date
- 2016-08-09
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2036-08-09
AI Technical Summary
Existing vehicle vision systems struggle to effectively manage depth of field, leading to distractions from objects outside the focal point, especially in adverse weather conditions, which can obstruct the driver's vision and reduce safety.
A vehicle vision system that adjusts the depth of field based on the driver's gaze, blurring objects outside the focal point to enhance the visibility of the primary object of interest, using techniques such as stereoscopic vision and adjustable aperture settings.
Enhances driver visibility by highlighting the focal point while reducing distractions from surrounding objects, improving safety in various weather conditions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
TECHNICAL FIELD
[0001] This application generally relates to a vision system in a vehicle that is configured to selectively adjust a field of focus to emphasize objects in a field of view. BACKGROUND
[0002] Vehicle drivers must observe and process an increasing amount of information to navigate safely while driving on the open road. Drivers must not only know and follow traffic laws, but they must also be aware of the activities of nearby vehicles and pedestrians. Weather conditions surrounding the vehicle, such as snow, rain, and fog, can reduce visibility and may affect the operation of some vehicle systems. Vision systems are typically designed to have a large depth of field, so that many objects within the field of view appear in focus in the image.
[0003] JP 2013 - 183 298 A describes the display of images from the surroundings of a vehicle, whereby the surroundings of detected objects are displayed less sharply depending on their distance from the vehicle in order to draw the driver's attention to this object.
[0004] US 2012 / 0 093 358 A1 discloses possibilities for extending the observation area from a vehicle, in which a display area on a display is changed depending on the driver's viewing angle on the display. SUMMARY
[0005] A vehicle includes an interface configured to display an image of objects in a vicinity of the vehicle, and at least one controller programmed to change a depth of field of the image based on a focal point associated with a direction of driver gaze relative to the image to change blur of the image outside the focal point.
[0006] A method for enhancing a digital image in a vehicle includes identifying a focal point on a screen associated with a driver's view of an image, and altering a depth of field associated with the image based on a distance between the vehicle and a physical location of an object represented by the image at the focal point to blur other objects in the image outside the focal point.
[0007] A vehicle includes a camera having an aperture and configured to output a signal indicative of a field of view, a screen configured to convert the signal into an image, and a driver camera assembly configured to output a focal point associated with a driver's gaze relative to the screen. The vehicle also includes at least one controller programmed to adjust an aperture of the aperture to alter a depth of field to blur objects outside the depth of field around the focal point. BRIEF DESCRIPTION OF THE DRAWINGS The Fig. 1A and Fig. 1B is an example block topology of a vehicle infotainment system. The Fig. 2A to 2C are illustrations of a vehicle display screen and a detection system that detects the gaze of a driver of the vehicle at an image on the screen. Fig. 3 is an illustration of a vehicle including a stereoscopic vision system configured to produce a blended image. The Fig. Figures 4A to 4D show a depth of field effect in images by adjusting the aperture of a camera. DETAILED DESCRIPTION
[0008] Embodiments of the present disclosure are described herein. However, it is to be understood that the disclosed embodiments are only examples, and further embodiments may take various and alternative forms. The figures are not necessarily to scale; some features may be greatly exaggerated or reduced to show details of particular components. Therefore, the specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art how to variously employ the embodiments.As will be understood by those of ordinary skill in the art, various features illustrated and described with respect to any of the figures may be combined with features illustrated in one or more other figures to produce embodiments not explicitly illustrated or described. The combinations of illustrated features provide representative examples of typical embodiments. However, for particular applications or implementations, numerous combinations and variations of the features may be desired consistent with the teachings of this disclosure.
[0009] In the embodiments of the present disclosure, a variety of circuits and other electrical devices are generally provided. All references to the circuits and other electrical devices, and the functionality provided by each, are not intended to be limited to encompassing only what is illustrated and described herein. Although specific labels may be assigned to the various disclosed circuits or other electrical devices, these labels are not intended to limit the scope of the functions of the circuits and other electrical devices. These circuits and other electrical devices may be combined and / or separated from one another in any manner based on the particular type of electrical implementation desired.It will be appreciated that any circuit or other electrical device disclosed herein may include any number of microprocessors, integrated circuits, memory devices (e.g., FLASH memory, Random Access Memory (RAM), Read Only Memory (ROM), Electrically Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read Only Memory (EEPROM), or other suitable variations thereof) and software that cooperate to perform the function(s) disclosed herein. Furthermore, any one or more of the electrical devices may be configured to execute a computer program embodied on a non-transitory computer-readable medium programmed to perform any number of the disclosed functions.
[0010] This disclosure proposes, among other things, vision systems and methods for operation in a vehicle, wherein the vision systems adjust the depth of field to blur out-of-focus objects. For example, while driving on a snowy road, the snow may attract the attention of a driver or a vehicle vision system. When a vehicle vision system has a large depth of field, many objects appear clearly in the image, and these objects may distract attention from a focal point. By decreasing the depth of field at the focal point, out-of-focus objects, such as snow, rain, etc., may become blurred.When objects outside the depth of field become blurrier, an area near the edges of the objects outside the depth of field appears to have a semi-transparent aspect, so the image at the focal point tends to appear highlighted, or as if it has been highlighted. This can also be vividly illustrated by observing a driver traveling in a vehicle at night in a blizzard. When the driver turns on the vehicle's headlights with the high beam setting, the snow near the front of the vehicle in the driver's field of view is illuminated and can obstruct the driver's view. When the driver returns the vehicle's headlights to a low beam setting, the snow near the front of the vehicle in the driver's field of view is no longer illuminated and appears semi-transparent, so the driver's field of view can appear clearer.Here, the depth of field of the driver changes due to the illumination of the snowflakes near the front of the vehicle.
[0011] Another aspect is that humans have the ability to quickly detect, distinguish, recognize, and characterize objects. Modern pedestrian detection systems, for example, can be configured to detect walking people; however, the pedestrian detection systems may have difficulty detecting a stroller, a child on a bicycle, a scooter, a skateboard, a tricycle, or a person wearing certain clothing with specific patterns, or a person standing still in a certain resting position. Combining vision systems that use an operator's gaze to control the depth of field can improve the performance of these vision systems. The vision systems may include pedestrian detection systems, collision detection systems, adaptive cruise control systems, or other dynamic vehicle systems.The driver's or operator's view may be integrated into a windshield display system (heads-up display, HUD), a vehicle infotainment system, a vehicle instrument cluster, a vehicle center console display, a driver information console, or a display connected to a rearview mirror or a side view mirror. These systems may display objects near the vehicle, such as objects in front of, to the side of, or behind the vehicle.
[0012] The Fig. 1A and Fig. 1B illustrate an example block diagram of a system 100 that may be used to provide telematics services to a vehicle 102. The vehicle 102 may be any of various types of passenger vehicles, such as a compact crossover utility vehicle (CUV), a sport utility vehicle (SUV), a truck, a recreational vehicle (RV), a boat, an aircraft, or other mobile machine for transporting people or goods. Telematics services may include, but are not limited to, navigation, turn-by-turn directions, vehicle health reports, a local business locator, accident notifications, and hands-free calling. In one example, the system 100 may include the SYNC system manufactured by The Ford Motor Company of Dearborn, MI.It is noted that the illustrated system 100 is only an example and more, fewer and / or differently arranged elements may be used.
[0013] The computing platform 104 may include one or more processors 106 configured to execute instructions, commands, and other routines in support of the processes described herein. For example, the computing platform 104 may be configured to execute instructions from vehicle applications 110 to provide features such as navigation, crash notifications, satellite radio decoding, and a hands-free system. These instructions and other data may be stored in non-transitory memory using a variety of types of computer-readable storage medium 112. The computer-readable medium 112 (also referred to as a processor-readable medium or processor-readable memory) includes any non-transitory medium (e.g., a tangible medium) incorporated in providing instructions or other data readable by the processor 106 of the computing platform 104.The processor may also consist of multiple processors in multiple computer units, each executing a portion of the overall driver warning system. For example, a processor housed in the audio module (122) may perform audible warning functions, while another processor in the video control unit (140) may handle the visual warning based on the same warning message. Computer-executable instructions may be translated or interpreted by computer programs created using a variety of programming languages and / or technologies, including, but not limited to, either alone or in combination, Java, C, C++, C#, Objective C, Fortran, Pascal, Java Script, Python, Perl, and PL / SQL.
[0014] The computing platform 104 may be provided with various features that allow vehicle occupants to interface with the computing platform 104. For example, the computing platform 104 may include an audio input 114 configured to receive voice commands from vehicle occupants via a connected microphone 116 and an auxiliary audio input 118 configured to receive audio signals from connected devices. The auxiliary audio input 118 may be a physical connection, such as an electrical cable or fiber optic cable, or a wireless input, such as a BLUETOOTH audio connection. In some examples, the audio input 114 may be configured to provide audio processing capabilities, such as pre-amplification of low-level signals and conversion of analog inputs to digital data for processing by the processor 106.
[0015] The computing platform 104 may also provide one or more audio outputs 120 to an input of an audio module 122 having audio playback functionality. In further examples, the computing platform 104 may provide the audio output to an occupant through the use of one or more dedicated speakers (not shown). The audio module 122 may include an input selector switch 124 configured to provide audio content from a selected audio source 126 to an audio amplifier 128 for playback through the vehicle speakers 130 or headphones (not shown). The audio sources 126 may include, as some examples, decoded amplitude-modulated (AM) or frequency-modulated (FM) radio signals and audio signals from an audio playback from a CD (compact disc) or a DVD (digital versatile disc).The audio sources 126 may also include audio signals received from the computing platform 104, such as audio content generated by the computing platform 104, audio content decoded by flash memory drives connected to a Universal Serial Bus (USB) subsystem 132 of the computing platform 104, and audio content passed through the computing platform 104 from the auxiliary audio input 118.
[0016] The computer platform 104 may use a voice interface 134 to provide a hands-free interface to the computer platform 104. The voice interface 134 may support speech recognition from the audio signal received via the microphone 116 according to a grammar associated with the available commands and voice message generation for output via the audio module 122. In some cases, the system may be configured to temporarily mute or otherwise override the audio source specified via the input selector switch 124 when an audio message is ready to be presented by the computer platform 104 and a different audio source 126 is selected for playback.
[0017] The computer platform 104 may also receive input from a human machine interface (HMI) control 136 configured to provide occupant dialogue with the vehicle 102. For example, the computer platform 104 may interface with one or more buttons or other HMI controls configured to invoke functions within the computer platform 104 (e.g., steering wheel audio buttons, a talk button, instrument panel controls, etc.). The computer platform 104 may also activate or otherwise communicate with one or more screens 138 configured to provide visual output to the vehicle occupants using a video control unit 140.In some cases, the screen 138 may be a touch-sensitive screen that is further configured to receive user touches via the video control unit 140, while in other cases, the screen 138 may be a pure screen without touch input capabilities.
[0018] The computing platform 104 may also be configured to communicate with other components of the vehicle 102 via one or more in-vehicle networks 142. The in-vehicle networks 142 may include, as some examples, a vehicle controller area network (CAN), an Ethernet network, and / or a media-oriented system transfer (MOST). The in-vehicle networks 142 may allow the computing platform 104 to communicate with other systems of the vehicle 102, such as a vehicle modem 144 (which may not be present in some configurations), a global positioning system (GPS) module 146 configured to provide the current location of the vehicle 102 and heading information, and various vehicle ECUs 148 configured to cooperate with the computing platform 104.As some non-limiting possibilities, the vehicle ECUs 148 may include: a powertrain control module configured to control engine operating components (e.g., idle control components, fuel delivery components, emission control components, etc.) and monitor engine operating components (e.g., the status of engine diagnostic codes); a body control module configured to control various power control functions such as exterior lighting, interior lighting, keyless entry, remote starting, and access point health checking (e.g.,the closure state of the hood, doors, and / or trunk of the vehicle 102); a radio transceiver module configured to communicate with smart car keys or other local devices of the vehicle 102; and an air conditioning control management module configured to provide control and monitoring of heating and cooling system components (e.g., control of a compressor clutch and blower fan, temperature sensor information, etc.).
[0019] As shown, the audio module 122 and the HMI controllers 136 may communicate with the computing platform 104 via a first in-vehicle network 142A, and the vehicle modem 144, the GPS module 146, and the vehicle ECUs 148 may communicate with the computing platform 104 via a second in-vehicle network 142B. In further examples, the computing platform 104 may be connected to more or fewer in-vehicle networks 142. Additionally or alternatively, one or more HMI controllers 136 or other components may be connected to the computing platform 104 via in-vehicle networks 142 other than those shown, or directly without an in-vehicle network 142.
[0020] However, the computing platform 104 may also be configured to communicate with cellular devices 152 of the vehicle occupants. The cellular devices 152 may be any of various types of portable computing devices, such as mobile phones, tablet computers, smartwatches, laptops, portable music players, or other devices capable of communicating with the computing platform 104. In some examples, the computing platform 104 may include a wireless transceiver 150 (e.g., a BLUETOOTH module, a ZIGBEE transceiver, a Wi-Fi transceiver, an IrDA transceiver, an RFID transceiver, etc.) configured to communicate with a compatible wireless transceiver 154 of the cellular device 152. The wireless modules may transmit data on a carrier frequency or a center frequency.The center frequency is an important aspect of a wireless system due to effective interference immunity and bandwidth. For example, typical remote keyless entry systems operate at 315 MHz in the United States and 433 MHz in Europe, while Wi-Fi and Bluetooth can operate at frequencies including frequencies above 2 GHz, such as 2.4 GHz. Additionally or alternatively, the computing platform 104 can communicate with the cellular device 152 via a wired connection, such as a USB connection between the cellular device 152 and the USB subsystem 132.
[0021] The communication network 156 may provide communication services, such as packet-switched network services (e.g., Internet access, VoIP communication services), to devices connected to the communication network 156. An example of a communication network 156 may include a cellular network. Mobile devices 152 may provide network connectivity to the communication network 156 via a device modem 158 of the mobile device 152. To facilitate communications over the communication network 156, the mobile devices 152 may be assigned unique device identifiers (e.g., Mobile Device Numbers (MDNs), Internet Protocol addresses (IP addresses), etc.) to identify the communications of the mobile devices 152 over the communication network 156.In some cases, the occupants of the vehicle 102 or the devices authorized to connect to the computing platform 104 may be identified by the computing platform 104 according to paired device data 160 maintained in the storage medium 112. For example, the paired device data 160 may indicate the unique device identifiers of the mobile devices 152 previously paired with the computing platform 104 of the vehicle 102 such that the computing platform 104 can automatically reconnect to the mobile devices 152 referenced in the paired device data 160 without user intervention.
[0022] When a cellular device 152 supporting network connectivity is paired with the computing platform 104, the cellular device 152 may allow the computing platform 104 to use the network connectivity of the device modem 158 to communicate with the distributed telematics services 162 via the communications network 156. In one example, the computing platform 104 may use an above-voiceband data plan or a cellular device 152 data plan to exchange information between the computing platform 104 and the communications network 156. Additionally or alternatively, the computing platform 104 may use the vehicle modem 144 to exchange information between the computing platform 104 and the communications network 156 without using the communications facilities of the cellular device 152.
[0023] Similar to the computing platform 104, the mobile device 152 may include one or more processors 164 configured to execute instructions from mobile applications 170 loaded into a memory 166 of the mobile device 152 from the storage medium 168 of the mobile device 152. In some examples, the mobile applications 170 may be configured to communicate with the computing platform 104 via the wireless transceiver 154 and with the distributed telematics services 162 or other network services via the device modem 158. The computing platform 104 may also include a device linking interface 172 to facilitate integrating functionality of the mobile applications 170 into the grammar of commands available via the voice interface 134 and into the display screen 138 of the computing platform 104.The device link interface 172 may also provide the cellular applications 170 with access to the vehicle information available to the computing platform 104 via the in-vehicle networks 142. Some examples of device link interfaces 172 include the SYNC APPLINK component of the SYNC System provided by The Ford Motor Company of Dearborn, MI, the CarPlay protocol provided by Apple Inc. of Cupertino, California, or the Android Auto protocol provided by Google, Inc. of Mountain View, California. The vehicle component interface application 174 may be one such application installed on the cellular device 152.
[0024] The vehicle component interface application 174 of the cellular device 152 may be configured to facilitate access to one or more features of the vehicle 102 that are made available for device configuration by the vehicle 102. In some cases, the available features of the vehicle 102 may be accessed through a single vehicle component interface application 174, in which case the vehicle component interface application 174 may be configured to be customized or to maintain configurations that support a specific make or model and option packages of the vehicle 102.In one example, the vehicle component interface application 174 may be configured to receive from the vehicle 102 a definition of the features available for control, to display a user interface describing the available features, and to provide user inputs on the user interface of the vehicle 102 to allow the user to control the displayed features. As described in more detail below in examples, a suitable cellular device 152 for displaying the vehicle component interface application 174 may be identified, and a definition of the user interface for display may be provided to the identified vehicle component interface application 174 for display to the user.
[0025] Systems such as system 100 may require the mobile device 152 to be paired with the computing platform 104 and / or may require other setup operations. However, as explained in more detail below, a system may be configured to allow vehicle occupants to seamlessly communicate with user interface elements in their vehicle or any other vehicle operating within the same framework, without requiring the mobile device 152 to be paired with or in communication with the computing platform 104.
[0026] Fig. 2A is an illustration of a vehicle interior 200 including a screen 202 and a detection system that detects a gaze 206 of a driver 204 of the vehicle at an image on the screen. Here, the screen displays a field of view near the vehicle, such as from the front of the vehicle, the rear of the vehicle, or a side of the vehicle. A truck 210 is located within the field of view. However, the field of view may include any object, such as a pedestrian, a traffic sign, a vehicle, or an object. The driver's gaze 206 is directed toward a desired focal point 208 of the image. The driver's gaze 206 is defined as looking at a fixed point for a predetermined period of time. A fixed gaze is when the driver's eyes are focused in one direction without movement.Detecting eye movement can compensate for eye tremor, which may be a congenital weakness or caused by intoxicants such as alcohol. Detection can use in-vehicle systems such as a driver-facing camera or multiple driver-facing cameras. There are several methods for detecting eye gaze; the camera or cameras can use any of these methods, including measuring eye blinking, pupil / iris alignment, and direction.The predetermined period of time may be a fixed period of time, such as 1 second, or it may be a variable period of time in which the period of time may change due to conditions such as vehicle speed, windshield wiper operation, or signals from other vehicle modules, including a pedestrian detection system, a collision detection system, an adaptive cruise control system, or other dynamic vehicle systems. The desired focal point 208 of the image includes an associated object near the vehicle. In this illustration, the desired focal point 208 shows, for example, the image of a truck 210. If the camera capturing this image is a side-view camera, the desired focal point 208 may be associated with the tractor-trailer located adjacent to the vehicle.
[0027] Fig. 2B is a representation of the vehicle interior 200, which includes a display screen 202 and a detection system that detects the view 206 of the vehicle driver 204 of the image on the display screen, where the image is divided into sections by a grid 214. A processing device or control unit may be used to identify the truck 210 located at the desired focal point 208 of the image on the display screen 202. The processing device or control unit may distinguish this truck 210 from a tractor-trailer 212 in the field of view. After detecting the truck 210, shown here as a tractor-trailer, a processor or control unit may use image processing techniques to determine a distance from the vehicle to the truck 210.The distance from the vehicle to the truck 210 may also be calculated by other sensors and modules in the vehicle using distance measurement techniques including radio detection and ranging (RADAR), acoustic detection and ranging, light detection and ranging (LIDAR), and vision. Once the distance is determined, the depth of field may be reduced to blur other objects, such as the tractor-trailer 212, in the image, thereby emphasizing the truck 210. Once a desired focus object, such as the truck 210, is determined, a trajectory of the truck, including a direction and a speed of the truck 210, may be determined.In the event that a collision is detected, a warning signal can be sent to other modules including the vehicle instrument cluster, ABS module or infotainment system.
[0028] Fig. 2C is a representation of the vehicle interior 200, including the display screen 202 and the detection system that detects the view 216 of the vehicle's driver 204. Here, the driver 204 has shifted their view 216 from the truck 210, which is closest to the vehicle, to the tractor-trailer 212, which is farther away from the vehicle. After detecting the truck 210, a processor or control unit may use image processing techniques to determine a distance from the vehicle to the truck 210. The distance from the vehicle to the tractor-trailer 212 may be calculated by sensors or modules in the vehicle using distance measurement techniques.
[0029] Once the distance has been determined, the reduction of the depth of field to a small area around the tractor unit 212 in focus can take place to blur other objects such as the truck 210 in the image, thereby emphasizing the tractor unit 212.
[0030] Fig. 3 is an illustration of a stereoscopic vision system 300 of a vehicle 302 configured to produce a blended image 322. The stereoscopic vision system 300 includes two cameras 304A and 304B located a predetermined distance 306 from each other. The cameras 304 capture an image of a field of view 308. Within the field of view 308, at a distance 310 from the cameras 304, is a desired object 312, which has been identified by a driver's gaze as the desired focal point of the image. A secondary object 314 is also shown within the field of view but not at the desired focal point. Because camera 304A is located a distance 306 from camera 304B, camera 304A captures an image 316A that is different from the image 316B captured by 304B.As shown, image 316A includes a representation 318A of object 312 and a secondary representation 320A of secondary object 314. As shown, image 316B includes a representation 318B of object 312 and a secondary representation 320B of secondary object 314. With the two different images 316A and 316B, object 312 has two representations 318A and 318B in the different images 316A and 316B. A processing unit or control unit can compare the two images 316A and 316B and the location of representations 318A and 318B. Based on the locations of representations 318 in images 316, a parallax distance 328 is calculated between representations 318. This parallax distance 328 is a function of the parallax angle. Parallax is a difference in the apparent position of an object viewed along two different lines of sight.The parallax is measured by the parallax angle between the two different lines of sight. Since the distance 306 between the cameras is fixed, a distance 310 from the cameras 304 to the desired object 312 can be determined by a storage unit or a processing unit by measuring the parallax distance 328 between the focal point representations 318A and 318B. Based on the distance 310, the images 316 can be blended or combined to create a single combined image 322. The combined image 322 can be a . Fig. of the desired object and an image of the secondary object 326. The images 316A, 316B, and 322 may be analog or digital images, and the images may be lossless, such as unprocessed or a bitmap, or they may be lossy, such as a compressed image. Fig. of the desired object, which is located in a depth of field, appears clearly, while the Fig. of the secondary object located outside the depth of field is a blurred image. Image blur means that the blurred objects have the effect of being semi-transparent. This can be enhanced through the use of image processing, which can be used to emphasize the representation 324 of the desired object and minimize the representation 326 of the secondary object. Along with using parallax to change the depth of field, the stereoscopic vision system can also adjust an aperture in each camera 304 to change the depth of field.
[0031] Fig. 4A is an illustration of a camera lens 406 having an aperture 408 set at f / 16, and a pedestrian image 402 is captured while a pedestrian is crossing a street during a snowstorm. In the context of optical systems, an f-number, also called an aperture ratio or relative aperture, is the ratio of a focal length of a lens to a diameter of an entrance pupil of the lens. The entrance pupil may be integrated into the lens or it may be a separate device coupled to the lens. Conventionally, the larger the f-number, such as f / 16, the smaller the entrance pupil, and the lower the f-number, such as f / 1.5, the larger the entrance pupil. When the aperture is set at an f / 16 setting, as shown, the depth of field is large, and many objects in the field of view are clearly depicted.Here, the pedestrian representation 402 is in focus, but this also applies to the snow representation 404. The resulting image 400 shows that the snow in focus obscures the desired focal point of the image, namely the pedestrian.
[0032] Fig. 4B is an illustration of a camera lens 406 having an aperture 410 set at f / 7.5, and a pedestrian representation 402 is captured while a pedestrian is crossing a street during a snowstorm. When the aperture is set at f / 7.5, as shown, the depth of field is shallower but still sufficiently large to clearly show many objects in the field of view. Here, the pedestrian representation 402 is in focus, but so is a substantial portion of the snow representation 404. The resulting image 420 shows that the in-focus snow obscures the pedestrian.
[0033] Fig. 4C is an illustration of a camera lens 406 having an aperture 412 set to f / 2.5, and a pedestrian representation 402 is captured while a pedestrian is crossing a street during a snowstorm. When the aperture is set to f / 2.5, as shown, the depth of field is even shallower, so many objects in the field of view have little emphasis, making the pedestrian representation 402 appear more distinct. Here, the pedestrian representation 402 and only a small portion of the snow representation 404 are in focus. The resulting image 440 shows the pedestrian in focus and highlighted, while the out-of-focus snow is attenuated.
[0034] Fig.4D is an illustration of a camera lens 406 having an aperture 414 set at f / 1.5, and a pedestrian representation 402 is captured while a pedestrian is crossing a street during a snowstorm. When the aperture is set at an f / 1.5 setting, as shown, the depth of field is large, and many objects in the field of view are blurred. Here, the pedestrian representation 402 is in focus, but most of the snow is blurred. The resulting image 460 shows the pedestrian in focus and stands out as the central subject of the image, while the snow, much of which is out of focus, appears to disappear.
[0035] The processes, methods, or algorithms disclosed herein may be passed to, or implemented by, a processing unit, a control unit, or a computer, which may include any existing programmable electronic storage device or a dedicated electronic control unit. Similarly, the processes, methods, or algorithms may be stored as data and instructions executable by a control unit or computer in many forms, including, but not limited to, information permanently stored on non-rewritable storage media such as read-only memory (ROM) devices and information modifiably stored on rewritable storage media such as floppy disks, magnetic tapes, CDs, RAM, and other magnetic and optical media.The processes, methods, or algorithms may also be implemented in a software-executing element. Alternatively, the processes, methods, and algorithms may be embodied, in whole or in part, using suitable hardware components such as application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), state machines, control units, or other hardware components or units, or a combination of hardware, software, and firmware components.
[0036] Although exemplary embodiments have been described above, these embodiments should not be construed as describing all possible forms encompassed by the claims. The terms used in this specification are terms of description, not limitations, and it is understood that numerous changes may be made without departing from the spirit and scope of the disclosure. As described above, the features of various embodiments may be combined to form further embodiments of the invention that may not be explicitly described or illustrated.Although numerous embodiments may have been described as providing advantages or being preferred over other prior art embodiments or implementations with respect to one or more desired characteristics, one of ordinary skill in the art will recognize that trade-offs may be made between one or more features or characteristics to achieve the desired overall system characteristics, each depending on the specific application and implementation. These features may include, but are not limited to, cost, durability, life cycle cost, marketability, appearance, packaging, size, convenience, weight, manufacturability, ease of assembly, etc.Therefore, embodiments that have been described as less desirable than other embodiments or prior art implementations with respect to one or more characteristics are not outside the scope of the disclosure and may be desirable for particular applications.
Claims
[1] Vehicle comprising: an interface configured to display an image of objects in a vicinity of the vehicle, and at least one control unit programmed to change a depth of field of the image based on a focal point corresponding to a direction of the driver's gaze relative to the image to change the blur of the image outside of the focal point, wherein the at least one control unit is further programmed to maximize a depth of field of the image in response to a driver's gaze being averted from the image, and to identify the focal point corresponding to a physical location represented by the image in the specific portion and decrease the depth of field of the image based on a distance between the vehicle and the physical location in response to the driver's gaze being directed to a specific portion of the image for a predetermined period of time. [2] The vehicle of claim 1, wherein the at least one control unit is further programmed to change the depth of field by adjusting an opening width of an aperture of a camera used to capture the image. [3] The vehicle of claim 1, wherein the at least one control unit is further programmed to change the depth of field by adjusting a parallax used to blend images from at least two cameras used to capture the image. [4] The vehicle of claim 3, wherein the at least one control unit is further programmed to adjust an opening width of an aperture of each of the at least two cameras used to capture the image. [5] The vehicle of claim 1, wherein the at least one control unit is further programmed to identify pedestrians in the vicinity of the vehicle and to issue a warning signal in response to identifying a nearby pedestrian intersecting a current path of travel of the vehicle. [6] The vehicle of claim 1, wherein the at least one control unit is further programmed to identify a nearby vehicle and a trajectory of that vehicle and to issue a warning signal in response to a trajectory of the nearby vehicle intersecting a current path of travel of the vehicle. [7] The vehicle of claim 1, wherein the interface is an instrument cluster, an infotainment system, or a windshield display. [8] A method for enhancing a digital image in a vehicle, comprising: Identifying a focal point on a screen associated with a driver’s gaze at an image; and determining a distance between the vehicle and a physical location of an object represented by the image at the focal point; Changing a depth of field associated with the image, which is based on a distance, in order to blur other objects in the image outside the focal point and in response to a driver's gaze being averted from the image, maximizing a depth of field of the image. [9] The method of claim 8, wherein changing the depth of field comprises adjusting an opening width of an aperture of a camera used to capture the image. [10] The method of claim 8, wherein changing the depth of field comprises adjusting a parallax used to blend images from at least two cameras used to capture the image. [11] The method of claim 10, wherein changing the depth of field comprises adjusting an opening width of an aperture of each of the at least two cameras used to capture the image. [12] The method of claim 8, further comprising issuing a warning based on classifying an object in the focal point as a pedestrian.
Citation Information
Patent Citations
Rearward visibility support device for vehicle and rearward visibility support method for vehicle
JP2013183298A
Control of rear-view and side-view mirrors and camera-coordinated displays via eye gaze
US20120093358A1
JP002013183298A
