Imaging and display system combining IR and color video streams

Abstract

An imaging and display system is provided for a vehicle having: a video display disposed in an interior of the vehicle; a visible light video camera configured to capture a visible light video stream of a scene in a visible region of the electromagnetic spectrum; a long -range IR video camera configured to capture an IR video stream of the scene in an IR region of the electromagnetic spectrum; and a processing circuit for receiving the visible light video stream and the IR video stream for generating a composite video stream including at least part of the visible light video stream superimposed with at least part of the IR video stream, the processing circuit configured to supply the composite video stream to the video display for display thereon.

Description

Atty.^Docket^No.^AUTO^03446T^(GEN010^FP1290AWO) ^ IMAGING^AND^DISPLAY^SYSTEM^COMBINING^IR^AND^COLOR^VIDEO^STREAMS^ ^ BACKGROUND^OF^THE^INVENTION^

[0001] The^ present^ invention^ generally^ relates^ to^ processing^ of^ video^ images^ streamed^ to^ a^ display,^and^more^specifically^ to^processing^of^streamed^video^ images^of^scenes^exterior^ to^a^ vehicle.^^ ^ SUMMARY^OF^THE^INVENTION^

[0002] According^ to^ one^ aspect^ of^ the^ present^ invention,^ an^ imaging^ and^ display^ system^ is^ provided^ for^a^vehicle^having:^a^video^display^disposed^ in^an^ interior^of^ the^vehicle;^a^visible^ light^ video^ camera^ configured^ to^ capture^ a^ visible^ light^ video^ stream^ of^ a^ scene^ in^ a^ visible^ region^of^the^electromagnetic^spectrum;^a^long^range^IR^video^camera^configured^to^capture^an^ IR^video^stream^of^the^scene^in^an^IR^region^of^the^electromagnetic^spectrum;^and^a^processing^ circuit^ for^ receiving^ the^ visible^ light^ video^ stream^ and^ the^ IR^ video^ stream^ for^ generating^ a^ composite^video^stream^ including^at^ least^part^of^the^visible^ light^video^stream^superimposed^ with^ at^ least^ part^ of^ the^ IR^ video^ stream,^ the^ processing^ circuit^ configured^ to^ supply^ the^ composite^video^stream^to^the^video^display^for^display^thereon.^

[0003] According^to^another^aspect^of^the^present^invention,^an^imaging^system^is^provided^for^ a^vehicle^having:^a^visible^light^video^camera^configured^to^capture^a^visible^light^video^stream^ of^a^scene^ in^a^visible^ region^of^ the^electromagnetic^spectrum;^a^ long^range^ IR^video^camera^ configured^ to^capture^an^ IR^video^stream^of^ the^scene^ in^an^ IR^region^of^ the^electromagnetic^ spectrum;^and^a^processing^circuit^for^receiving^the^visible^ light^video^stream^and^the^IR^video^ stream^for^generating^a^composite^video^stream^including^at^least^part^of^the^visible^light^video^ stream^superimposed^with^at^ least^part^of^the^ IR^video^stream,^wherein^the^processing^circuit^ dynamically^adjusts^a^weight^of^ transparency^of^at^ least^one^of^ the^visible^ light^and^ IR^video^ streams^in^the^superimposition.^

[0004] According^ to^ another^ aspect^ of^ the^ present^ invention,^ a^ method^ is^ provided^ of^ generating^a^composite^video^stream^for^display^in^a^vehicle,^the^method^including:^receiving^a^ visible^ light^ video^ stream^ of^ a^ scene^ in^ a^ visible^ region^ of^ the^ electromagnetic^ spectrum;^ receiving^ an^ IR^ video^ stream^ of^ the^ scene^ in^ an^ IR^ region^ of^ the^ electromagnetic^ spectrum;^ dynamically^adjusting^a^weight^of^transparency^of^at^ least^one^of^the^visible^ light^and^IR^video^ streams;^and^generating^a^ composite^ video^ stream^ including^at^ least^part^of^ the^visible^ light^ video^stream^superimposed^with^at^least^part^of^the^IR^video^stream.^

[0005] These^ and^ other^ aspects,^ objects,^ and^ features^ of^ the^ present^ invention^ will^ be^ understood^ and^ appreciated^ by^ those^ skilled^ in^ the^ art^ upon^ studying^ the^ following^ specification,^claims,^and^appended^drawings.^ ^ BRIEF^DESCRIPTION^OF^THE^DRAWINGS^

[0006] In^the^drawings:^

[0007] Fig.^1A^is^a^photographic^representation^of^an^example^of^an^image^frame^from^a^visible^ light^video^stream^taken^of^a^scene^in^dark^conditions;^

[0008] Fig.^1B^ is^a^photographic^ representation^of^an^example^of^an^ image^ frame^ from^an^ IR^ video^stream^taken^of^the^same^scene^in^Fig.^1A^also^in^dark^conditions;^

[0009] Fig.^ 2^ is^ a^ block^ diagram^ of^ an^ imaging^ system^ according^ to^ an^ embodiment^ of^ the^ invention;^

[0010] Fig.^3^ is^a^photographic^ representation^of^an^example^of^ image^ frames^ from^a^visible^ light^video^ stream,^an^ IR^video^ stream,^and^a^ resulting^ composite^video^ stream^ that^may^be^ generated^by^the^processing^circuit^shown^in^Fig.^2;^

[0011] Fig.^4A^is^a^photographic^representation^of^an^example^of^an^image^frame^from^a^visible^ light^video^stream^taken^of^a^scene^in^which^lens^flare^from^direct^sun^is^present;^

[0012] Fig.^4B^ is^a^photographic^ representation^of^an^example^of^an^ image^ frame^ from^an^ IR^ video^stream^taken^of^the^same^scene^in^Fig.^4A;^

[0013] Fig.^ 5^ is^ a^ photographic^ representation^ of^ another^ example^ of^ image^ frames^ from^ a^ visible^light^video^stream,^an^IR^video^stream,^and^a^resulting^composite^video^stream^that^may^be^ generated^by^ the^processing^ circuit^ shown^ in^ Fig.^ 2^where^ the^ scene^has^ lens^ flare^ from^ direct^sun^light^present;^

[0014] Fig.^ 6^ is^ a^ flow^ chart^ showing^ the^method^ steps^ performed^ by^ the^ processing^ circuit^ shown^in^Fig.^2;^^

[0015] Fig.^7A^ is^a^ front^and^ side^perspective^view^of^a^ rearview^assembly^ incorporating^ the^ imaging^system^of^Fig.^2;^and^

[0016] Fig.^7B^is^a^front^elevational^view^of^the^rearview^assembly^shown^in^Fig.^7A.^ ^ DETAILED^DESCRIPTION^OF^THE^PREFERRED^EMBODIMENTS^

[0017] ^As^ required,^ detailed^ embodiments^ of^ the^ present^ invention^ are^ disclosed^ herein.^^ However,^ it^ is^to^be^understood^that^the^disclosed^embodiments^are^merely^exemplary^of^the^ invention^ that^ may^ be^ embodied^ in^ various^ and^ alternative^ forms.^ The^ figures^ are^ not^ necessarily^ of^ a^ detailed^ design^ and^ some^ schematics^may^ be^ exaggerated^ or^minimized^ to^ show^ function^overview.^ ^Therefore,^specific^structural^and^ functional^details^disclosed^herein^ are^ not^ to^ be^ interpreted^ as^ limiting,^ but^merely^ as^ a^ representative^basis^ for^ teaching^ one^ skilled^in^the^art^to^variously^employ^the^present^invention.^

[0018] It^has^become^commonplace^to^provide^cameras^in^a^vehicle^to^capture^images^or^video^ streams^of^scenes^exterior^of^the^vehicle^in^order^to^detect^objects^and / or^display^the^captured^ images / video^streams^to^the^driver.^Current^color^video^cameras^provide^high^resolution^video^ with^ excellent^ color^ reproduction^ in^well^ illuminated^ scenes^ but^ struggle^ to^ provide^ usable^ video^ in^dark^conditions.^Fig.^1A^shows^an^example^of^an^ image^ frame^of^a^visible^ light^video^ stream^125^of^a^scene^captured^ in^dark^conditions.^Conversely,^ long^range^ infrared^ (IR)^video^ cameras^can^provide^video^in^full^darkness,^but^this^video^is^at^a^lower^resolution,^is^greyscale,^ and^is^not^“natural”^in^appearance.^Fig.^1B^shows^an^example^of^an^image^frame^of^an^IR^video^ stream^130^of^a^scene^captured^in^dark^conditions.^Since^long^range^IR^cameras^sense^thermal^ energy,^ they^ are^ capable^ of^ clearly^ imaging^ “living”^ objects^ (people,^ animals)^ in^ complete^ darkness.^Accordingly,^such^long^range^IR^cameras^have^also^been^implemented^in^vehicles.^The^embodiments^described^below^combine^the^strengths^of^each^camera^technology^into^a^single^ composite^video^stream^that^may^be^displayed^on^a^display.^

[0019] ^^ Fig.^ 2^ shows^ an^ imaging^ and^ display^ system^ 10^ according^ to^ a^ first^ embodiment.^ As^ shown,^imaging^and^display^system^10^includes^a^visible^light^video^camera^25^for^generating^a^ visible^light^video^stream^125^(Fig.^3)^of^a^scene^exterior^of^the^vehicle,^a^long^range^infrared^(IR)^ video^ camera^26^ for^ generating^ an^ IR^ video^ stream^ 130^ of^ the^ same^ exterior^ scene,^ and^ a^ display^ system^ 12,^which^ includes^ a^ processing^ circuit^ 30^ that^ receives^ the^ streamed^ video^ images^ and^ generates^ a^ composite^ video^ stream^ 120^ (as^ discussed^ in^ detail^ below),^ and^ a^ display^32^ that^displays^ the^ composite^ video^ stream^120.^The^ two^ video^ cameras^25^and^26^ have^at^least^overlapping^fields^of^view,^and^preferably,^the^same^field^of^view.^The^visible^light^ video^camera^25^may^be^a^color^camera^such^as^a^CMOS^color^video^camera^producing^a^RGGB,^ RCCB,^RCCG^or^RYYCy^video^stream.^

[0020] ^^ The^ processing^ circuit^ 30^ may^ be^ configured^ to^ generate^ the^ composite^ video^ stream^120^ as^ depicted^ in^ Fig.^ 3^ in^ response^ to^ one^ or^more^ triggering^mechanisms^ or^ in^ response^to^a^user^ input^or^user^default^selection.^One^such^triggering^mechanism^may^be^an^ ambient^light^level.^Another^may^be^a^region^of^the^visible^light^video^stream^125^that^is^dark^or^ has^ low^contrast.^ In^other^words,^the^composite^video^stream^120^ in^Fig.^3^may^be^generated^ and^displayed^on^demand.^^

[0021] The^manner^in^which^the^processing^circuit^30^may^generate^image^frames^forming^the^ composite^ video^ stream^120^may^ take^ several^ forms.^ In^a^ first^example^ shown^ in^Fig.^3,^ the^ processing^ circuit^ 30^ overlays^ image^ frames^ of^ the^ visible^ light^ video^ stream^ 125^ on^ top^ of^ image^ frames^ of^ the^ long^range^ IR^ video^ stream^ 130^ to^ produce^ the^ image^ frames^ of^ the^ composite^video^stream^120.^Adjusting^the^transparency^or^weight^of^each^image^frame^of^the^ visible^light^video^stream^125^and / or^IR^video^stream^130^allows^for^combined^image^frames^in^ the^ composite^ video^ stream^ 120^ that^ preserve^ the^ nighttime^ visibility^ of^ the^ IR^ video^ stream^130^and^adds^some^color^from^the^visible^light^video^stream^125.^

[0022] In^ a^ second^ example,^ when^ combining^ video^ streams^ from^ the^ visible^ light^ video^ camera^25^and^ the^ IR^ video^ camera^26,^ the^amount^of^weight^ that^ the^processing^ circuit^30^gives^to^the^image^data^of^each^camera^to^achieve^the^optimal^video^quality^may^depend^on^the^ scene^ content^ being^ imaged.^ This^ optimal^ balance^would^ be^ achieved^ by^ detecting^ various^ attributes^ in^ the^scene^ through^algorithms^and^ then^dynamically^adjusting^ the^weights^of^ the^ image^ data^ from^ each^ camera^ to^ achieve^ the^ optimal^ blending^ of^ the^ video^ streams.^ Additionally,^ if^ there^ is^a^ region^of^ the^color^ scene^ that^ is^occluded,^ the^ IR^video^ stream^130^ could^be^combined^selectively^only^in^the^occluded^region^of^the^visible^light^video^stream^125.^ Examples^of^various^scene^content^to^be^detected^and^adapted,^include^the^ambient^light^level,^ presence^of^glare^from^direct^or^indirect^sunlight,^fog,^and^heavy^rain^or^snow.^^

[0023] The^detection^of^the^ambient^ lighting^of^the^scene^can^be^achieved^by^the^visible^ light^ video^camera^25^or^an^ambient^ light^ sensor.^This^ information^can^be^used^by^ the^processing^ circuit^30^to^strengthen^the^weight^of^the^IR^ images^ in^very^dark^scenes^while^maintaining^the^ color^of^traffic^signals^and^details^of^illuminated^signs.^In^brighter^scenes,^the^visible^light^images^ would^be^weighted^more^heavily^leaving^only^the^darker^areas^to^be^enhanced^by^the^IR^images.^

[0024] Fog,^heavy^ rain^ and^ snow,^ and^ smoke^ can^be^detected^by^ a^ Fog^Detection^ algorithm^ and / or^ a^ Visibility^ Range^ Detection^ algorithm^ (both^ previously^ developed^ by^ Gentex^ Corporation)^to^favor^the^IR^ images^ in^the^ image^combination^for^the^composite^video^stream^ 120.^ Examples^ of^ such^ Fog^ Detection^ algorithms^ are^ disclosed^ in^ commonly^assigned^ U.S.^ Patent^Nos.^ 6,097,024;^ 6,681,163;^ and^ 9,514,373,^ and^ in^U.S.^ Patent^Application^ Publication^ No.^US^2014 / 0198213A1.^Examples^of^such^Visibility^Range^Detection^algorithms^are^disclosed^ in^commonly^assigned^U.S.^Patent^No.^10,380,154.^^

[0025] Regions^ in^ the^ images^of^ the^ visible^ light^ video^ stream^125^ that^ lack^ contrast^but^do^ contain^ content^ in^ the^ IR^ images^of^ the^ IR^video^ stream^130^ can^have^ the^ low^ contrast^area^ regionally^enhanced^by^the^IR^images.^Examples^include^lens^flare^from^direct^sun,^dark^regions^ in^shadows,^and^regional^smoke.^For^purposes^of^example,^Figs.^4A^and^5^show^two^examples^of^ image^frames^from^visible^light^video^streams^125^in^which^lens^flare^from^direct^sun^is^present^ that^ causes^ objects^ to^become^ difficult^ to^ see.^ Figs.^ 4B^ and^ 5^ show^ two^ examples^ of^ image^ frames^from^IR^video^streams^130^in^which^lens^flare^from^direct^sun^is^present^but^objects^are^ visible^that^are^barely^visible^in^the^corresponding^images^in^Figs.^4A^and^5.^Fig.^5^also^shows^an^example^of^an^image^frame^of^the^composite^video^stream^120^generated^from^superimposing^ the^two^visible^light^and^IR^image^frames^of^Fig.^5.^

[0026] It^may^also^be^possible^to^combine^the^visible^light^and^IR^video^streams^at^all^times^and^ adjust^the^level^of^strength^of^each^image^relative^to^ambient^light^level^or^fog.^

[0027] It^should^be^noted^that^the^video^cameras^25^and^26^may^be^mounted^so^as^to^capture^ video^ streams^125^and^130^of^a^ forward^exterior^ scene,^a^ rearward^exterior^ scene,^or^a^ side^ exterior^scene^relative^to^the^vehicle’s^direction^of^travel.^

[0028] Fig.^6^ is^a^ flowchart^showing^ the^steps^of^a^method^100^performed^by^ the^processing^ circuit^30.^In^step^102,^the^processing^circuit^30^receives^the^visible^light^video^stream^125^from^ the^ visible^ light^ video^ camera^ 25^ and,^ in^ step^ 104,^ receives^ the^ corresponding^ IR^ video^ stream^130^ from^ the^ IR^ video^ camera^ 26.^ In^ step^ 106,^ the^ processing^ circuit^ 30^ dynamically^ adjusts^a^weight^of^transparency^of^at^ least^one^of^the^received^visible^ light^video^stream^125^ and^the^received^IR^video^stream^130.^Then,^in^step^108,^the^processing^circuit^30^generates^the^ composite^ video^ stream^ 120^ from^ the^ video^ streams.^ The^ processing^ circuit^ 30^ may^ then^ optionally^ supply^ this^ composite^ video^ stream^ to^ the^ video^ display^ 32^ for^ display^ thereon.^ Steps^102,^ 104,^ 106,^ and^ 108^ are^ repeated^ for^ each^ sequential^ image^ frame^ received^ from^ visible^light^and^IR^video^cameras^25^and^26^in^order^to^generate^the^composite^video^stream.^

[0029] As^ discussed^ above,^ step^ 104^may^ involve^ analysis^ of^ the^ received^ image^ frames^ to^ dynamically^ adjust^ the^weight^ or^ region^ of^ the^ visible^ light^ images^ and / or^ IR^ images^ to^ be^ superimposed.^Moreover,^ a^ fog^ detection^ algorithm^ or^ a^ visibility^ range^ detection^ algorithm^ may^be^executed^on^the^received^images^to^determine^if^fog,^heavy^rain^and^snow,^or^smoke^is^ present.^^

[0030] The^processing^circuit^30^may^include^various^types^of^image^processing^circuitry,^digital^ and / or^ analog,^ and^ may^ include^ a^ microprocessor,^ microcontroller,^ application^specific^ integrated^ circuit^ (ASIC),^ graphics^ processing^ unit^ (GPU),^ or^ other^ circuitry^ configured^ to^ perform^various^input / output,^control,^analysis,^and^other^functions^to^be^described^herein.^In^ other^embodiments,^ the^ image^processor^30^may^be^a^system^on^a^chip^ (SoC)^ individually^or^ with^additional^hardware^components^described^herein.^

[0031] The^ display^ system^ 12^may^ be^ provided^ anywhere^ within^ the^ interior^ of^ a^ vehicle,^ particularly^the^processing^circuit^30.^The^video^display^32^may^be^located^where^it^is^visible^to^ the^ driver^ such^ as^ in^ the^ instrument^ panel,^ center^ console,^ rearview^ assembly,^ or^may^ be^ implemented^as^a^heads^up^or^projected^display.^^

[0032] Fig.^7A^is^a^front^and^side^perspective^view^of^a^rearview^assembly^50^incorporating^the^ imaging^and^display^system^10^of^Fig.^2,^and^Fig.^7B^ is^a^front^elevational^view^of^the^rearview^ assembly^ 50.^ The^ rearview^ assembly^ 50^ includes^ a^ housing^ 54^ and^ a^ transparent^ or^ semi^ transparent^ element^52^ extending^ across^ an^ opening^ in^ the^ housing^ 54.^ The^ display^ 32^ is^ provided^behind^the^transparent^or^semi^transparent^element^52^so^as^to^project^the^displayed^ composite^video^stream^120^therethrough^when^the^display^32^is^active.^The^display^32^may^be^ activated^in^response^to^a^toggle^switch^56.^^

[0033] The^transparent^or^semi^transparent^element^52^may^be^a^partially^reflective,^partially^ transmissive^ mirror^ element^ or^ a^ switchable^ reflective^ element.^ Examples^ of^ a^ switchable^ reflective^element^are^disclosed^ in^commonly^assigned^U.S.^Patent^Nos.^9,254,789;^9,637,054;^ and^ 9,834,146.^ Examples^ of^ partially^ reflective,^ partially^ transmissive^ mirror^ elements^ positioned^ in^ front^ of^ a^ display^ are^ disclosed^ in^ commonly^assigned^U.S.^ Patent^ Application^ Publication^No.^US^2015 / 0266427^A1.^

[0034] It^ is^ to^ be^ understood^ that^ variations^ and^ modifications^ can^ be^ made^ on^ the^ aforementioned^structure^without^departing^ from^the^concepts^of^the^present^ invention,^and^ further^ it^ is^to^be^understood^that^such^concepts^are^ intended^to^be^covered^by^the^following^ claims^unless^these^claims^by^their^language^expressly^state^otherwise.^

Claims

CLAIMS^ What^is^claimed^is:^ ^ 1.^^^ An^imaging^and^display^system^for^a^vehicle,^comprising:^ a^video^display^disposed^in^an^interior^of^the^vehicle;^ a^visible^light^video^camera^configured^to^capture^a^visible^light^video^stream^of^a^ scene^in^a^visible^region^of^the^electromagnetic^spectrum;^^ a^ long^range^ IR^ video^ camera^ configured^ to^ capture^ an^ IR^ video^ stream^ of^ the^ scene^in^an^IR^region^of^the^electromagnetic^spectrum;^and^ a^processing^circuit^ for^ receiving^ the^visible^ light^video^ stream^and^ the^ IR^video^ stream^for^generating^a^composite^video^stream^including^at^least^part^of^the^visible^light^ video^ stream^ superimposed^with^ at^ least^ part^ of^ the^ IR^ video^ stream,^ the^ processing^ circuit^configured^to^supply^the^composite^video^stream^to^the^video^display^for^display^ thereon.^ ^ 2.^ The^ imaging^ and^ display^ system^ of^ claim^ 1,^ wherein^ the^ processing^ circuit^ dynamically^adjusts^a^weight^of^at^least^one^of^the^visible^light^and^IR^video^streams^in^the^ superimposition.^ ^ 3.^^ The^ imaging^ and^ display^ system^ of^ claim^ 2,^ wherein^ the^ weight^ of^ the^ superimposition^is^adjusted^in^a^first^region^of^the^composite^video^stream^different^than^ in^a^second^region^of^the^composite^video^stream.^ ^ 4.^^ The^ imaging^ and^ display^ system^ of^ claim^ 3,^ wherein^ the^ weight^ of^ the^ superimposition^ is^ adjusted^ in^ the^ first^ region,^ increasing^ the^weight^ of^ the^ IR^ video^ stream^ to^better^display^an^object^more^visible^ in^ the^ IR^video^ stream^ than^ the^visible^ light^video^stream.^ ^ 5.^ The^imaging^and^display^system^of^any^one^of^claims^2^4,^wherein^the^weight^is^a^ transparency^weight^of^one^of^the^visible^light^and^IR^video^streams.^ ^6.^ The^imaging^and^display^system^of^any^one^of^claims^2^5,^wherein^the^weight^of^at^ least^one^of^ the^ visible^ light^ and^ IR^ video^ streams^ in^ the^ superimposition^depends^on^ scene^ content^ being^ imaged,^ wherein^ the^ scene^ content^ includes^ at^ least^ one^ of^ an^ ambient^light^level,^presence^of^glare^from^sunlight,^fog,^heavy^rain,^and^snow.^^ ^ 7.^ The^imaging^and^display^system^of^any^one^of^claims^1^6,^wherein^the^visible^light^ video^camera^is^a^color^video^camera^and^the^visible^light^video^stream^is^in^color.^ ^ 8.^ The^ imaging^ and^ display^ system^ of^ claim^ 1^7,^wherein^ the^ processing^ circuit^ is^ configured^to^generate^the^composite^video^stream^in^response^to^at^least^one^triggering^ mechanism.^^ ^ 9.^ The^ imaging^ and^display^ system^of^ claim^7,^wherein^ the^at^ least^one^ triggering^ mechanism^is^at^least^one^of:^a^user^input,^an^ambient^light^level,^a^region^of^the^visible^ light^video^stream^that^is^dark,^and^a^region^of^the^visible^light^video^stream^that^has^low^ contrast.^^ ^ 10.^ An^imaging^system^for^a^vehicle,^comprising:^ a^visible^light^video^camera^configured^to^capture^a^visible^light^video^stream^of^a^ scene^in^a^visible^region^of^the^electromagnetic^spectrum;^^ a^ long^range^ IR^ video^ camera^ configured^ to^ capture^ an^ IR^ video^ stream^ of^ the^ scene^in^an^IR^region^of^the^electromagnetic^spectrum;^and^ a^processing^circuit^ for^ receiving^ the^visible^ light^video^ stream^and^ the^ IR^video^ stream^for^generating^a^composite^video^stream^including^at^least^part^of^the^visible^light^ video^ stream^ superimposed^ with^ at^ least^ part^ of^ the^ IR^ video^ stream,^ wherein^ the^ processing^ circuit^ dynamically^ adjusts^ a^weight^ of^ transparency^ of^ at^ least^ one^ of^ the^ visible^light^and^IR^video^streams^in^the^superimposition.^ ^ ^11.^^ The^imaging^system^of^claim^10,^wherein^the^weight^of^transparency^is^adjusted^in^ a^ first^ region^ of^ the^ composite^ video^ stream^different^ than^ in^ a^ second^ region^ of^ the^ composite^video^stream.^ ^ 12.^^ The^ imaging^ system^ of^ claim^ 11,^ wherein^ the^ weight^ of^ the^ transparency^ is^ adjusted^in^the^first^region,^increasing^the^weight^of^the^IR^video^stream^to^better^display^ an^object^ in^ the^ first^ region^ that^ is^more^visible^ in^ the^ IR^video^stream^ than^ the^visible^ light^video^stream.^ ^ 13.^ The^ imaging^system^of^any^one^of^claims^10^12,^wherein^the^processing^circuit^is^ configured^to^generate^the^composite^video^stream^in^response^to^at^least^one^triggering^ mechanism,^wherein^ the^ at^ least^ one^ triggering^mechanism^ is^ at^ least^ one^ of:^ a^ user^ input,^an^ambient^light^level,^a^region^of^the^visible^light^video^stream^that^is^dark,^and^a^ region^of^the^visible^light^video^stream^that^has^low^contrast.^^ ^ 14.^ The^ imaging^ system^ of^ any^ one^ of^ claims^ 10^13,^ wherein^ the^ weight^ of^ transparency^ of^ at^ least^ one^ of^ the^ visible^ light^ and^ IR^ video^ streams^ in^ the^ superimposition^ depends^ on^ scene^ content^ being^ imaged,^wherein^ the^ scene^ content^ includes^at^least^one^of^an^ambient^light^level,^presence^of^glare^from^sunlight,^fog,^heavy^ rain,^and^snow.^^ ^ 15.^ A^method^of^ generating^ a^ composite^ video^ stream^ for^display^ in^ a^ vehicle,^ the^ method^comprising:^ ^ receiving^ a^ visible^ light^ video^ stream^ of^ a^ scene^ in^ a^ visible^ region^ of^ the^ electromagnetic^spectrum;^^ receiving^an^ IR^video^stream^of^the^scene^ in^an^ IR^region^of^the^electromagnetic^ spectrum;^^ dynamically^adjusting^a^weight^of^transparency^of^at^least^one^of^the^visible^light^ and^IR^video^streams;^and^ generating^ a^ composite^ video^ stream^ including^ at^ least^part^of^ the^ visible^ light^ video^stream^superimposed^with^at^least^part^of^the^IR^video^stream.^^ 16.^^ The^method^of^claim^15,^wherein^the^weight^of^transparency^is^adjusted^in^a^first^ region^of^the^composite^video^stream^different^than^in^a^second^region^of^the^composite^ video^stream.^ ^ 17.^^ The^method^of^claim^16,^wherein^the^weight^of^the^transparency^is^adjusted^in^the^ first^region,^increasing^the^weight^of^the^IR^video^stream^to^better^display^an^object^in^the^ first^region^that^is^more^visible^in^the^IR^video^stream^than^the^visible^light^video^stream.^ ^ 18.^ The^ method^ of^ any^ one^ of^ claims^ 15^17^ and^ further^ comprising^ detecting^ a^ triggering^mechanism^and^conditionally^performing^ the^generating^step^upon^detection^ of^a^triggering^mechanism.^ ^ 19.^ The^method^of^claim^18,^wherein^the^at^least^one^triggering^mechanism^is^at^least^ one^of:^a^user^input,^an^ambient^light^level,^a^region^of^the^visible^light^video^stream^that^ is^dark,^and^a^region^of^the^visible^light^video^stream^that^has^low^contrast.^^ ^ 20.^ The^method^of^any^one^of^claims^15^19,^wherein^the^weight^of^transparency^of^at^ least^one^of^ the^ visible^ light^ and^ IR^ video^ streams^ in^ the^ superimposition^depends^on^ scene^ content^ being^ imaged,^ wherein^ the^ scene^ content^ includes^ at^ least^ one^ of^ an^ ambient^light^level,^presence^of^glare^from^sunlight,^fog,^heavy^rain,^and^snow.^^ ^ ^ ^ ^ ^ ^

Images