UV system and method for generating an alpha channel

Abstract

The alpha channel is generated using image data acquisition that simultaneously captures, typically in real time, image data representing the visible portion of the light spectrum and image data representing the invisible portion of the light spectrum, in some embodiments the invisible portion of the light spectrum is generated by a fluorescent dye that is applied to an object or actor in the scene, while in other embodiments the invisible portion of the light spectrum is generated by a light source located behind the object or actor.

Description

[Technical field]

[0001] This application claims priority to a co-pending U.S. provisional patent application having serial number 63 / 286,860, filed on December 7, 2021, and incorporated herein by reference.

[0002] The field of the invention is directed to systems and methods for acquiring image data of an object, and in particular to generating an alpha channel. [Background technology]

[0003] The Background Description contains information that may be useful in understanding the present invention. None of the information provided herein is prior art or relevant to the presently claimed invention, or an admission that any publication specifically or implicitly referenced is prior art.

[0004] All publications and patent applications herein are incorporated by reference to the same extent as if each individual publication or patent application was specifically and individually indicated to be incorporated by reference. If the definition or use of a term in an incorporated reference is inconsistent with or contrary to the definition of that term provided herein, the definition of that term provided herein applies and the definition of that term in the reference does not apply.

[0005] In the film industry, green screens or video walls have been used for decades as scene backdrops for video and film productions. To handle these backgrounds, time-intensive or error-prone post-production processes such as chroma keying and rotoscoping are used.

[0006] Rotoscoping is the process of cutting an image from one film and compositing it onto another. It began as a rudimentary method that relied on razor blades to cut out the footage and re-expose it onto a background plate, but today software like Mocha can be used. One advantage of rotoscoping is that it allows scenes to be shot in places or ways where a green screen would not be an option. It allows the scene to be lit without the director having to compromise for a green stage, thus giving the shoot an authentic feel. These tools are also used to clean up scenes that were shot with a green screen, which can "spill" unwanted green color onto the subject. But even with the incorporation of software, the method is essentially the same. It is a tedious task that can take a talented "artist" hours, days, or even weeks to clean up the green spill and build an alpha channel, even for a few minutes of footage. When the footage is cut out from the background, the footage is considered to have an "alpha channel" or mask.

[0007] Green or blue screens are utilized in the process where a scene is shot in a single color (e.g., green). In post-production, the green is removed and an alpha channel for the shot is created. This can be done in real-time using hardware (e.g., weather boards, traffic maps, etc.). While green screens make the shots manageable and resources are readily available, the shots can suffer from unwanted green "spill" on the subject. The background color is then reflected on the subject. This can require thousands of hours to remove on high-end film. Additionally, DPs (directors of photography) and directors are limited in lighting options to strike a balance between properly lighting the scene for their own vision and lighting the scene for a good "key." Additionally, partially transparent or reflective objects in the scene, such as shadows, smoke, water, partials, animals, fog, chrome, and hair, allow the green to show through. Additionally, motion blur, depth of field, or other cinematic effects affect the "key." Many of these issues can cause smaller shoots to go over budget or make great shows with fair budgets look cheap.

[0008] In further known attempts, a subject can be filmed in front of a video wall, such as a 360-degree LED screen, on which a background image is constructed and rendered in 3D. In particular, the 3D scene is generated in real time as a function of the live camera position via a potentiometer or magnetometer, so that the live camera movement matches the background. A relatively large LED screen lights the scene and fits the live objects into the environment. Furthermore, such techniques completely avoid green spill, leaving no edges to clean up. However, despite their sophistication, alpha channel generation has not been realized with such techniques.

[0009] In yet another approach to tracking and animating a subject (e.g., a computer-generated character based on a live actor), motion capture can be performed by applying phosphorescent make-up to the subject, exposing the subject to a light panel, and tracking the subject using a grayscale camera (see, e.g., WO20120 / 141770). While such methods provide improved tracking and animation of the subject, they do not affect the objects and background in the scene in their final form. In yet another known method, motion capture is improved by using infrared and visible light to generate infrared and color images of the subject. An infrared mask is generated to predict the foreground and background of the image (see U.S. Patent Application Publication No. 2010 / 0302376). However, such methods suffer from interference from other infrared light generating devices (e.g., incandescent light bulbs) and cannot account for the illumination of the subject. Thus, the resulting images once again require significant post-production work to account for illumination variations and interference.

[0010] Thus, although various systems and methods for acquiring image data of objects are known in the art, all or nearly all of them suffer from certain drawbacks. Thus, there remains a need for systems and methods for acquiring image data of objects. Summary of the Invention

[0011] The present subject matter is directed to various systems and methods for acquiring image data to facilitate generation of an alpha channel for an object. In some embodiments, the image data is of an object representing the visible portion of the light spectrum reflected by the object, and additional image data representing the non-visible portion of the light spectrum derived from the same object or from the background behind the object.

[0012] In one aspect of the present subject matter, there is provided a method of acquiring image data of an object, comprising the steps of providing an image acquisition setup configured to simultaneously acquire image data of the object representing the visible portion of the light spectrum and image data representing the invisible portion of the light spectrum, and the further step of coating the object with a fluorescent dye that fluoresces at wavelengths in the invisible portion of the light spectrum upon illumination with an excitation light. In yet another step, a scene including the object is simultaneously illuminated with (a) natural and / or artificial light, (b) an excitation light, and image data is captured using the image acquisition setup, thereby generating color data representing the visible portion of the light spectrum of the scene, grayscale data representing the object and the invisible portion of the light spectrum of the object.

[0013] Preferably, but not necessarily, the visible portion has a wavelength in the range of 400-700 nanometers (nm) and / or the invisible portion has a wavelength less than 400 nm. Most typically, the fluorescent dye comprises a fluorophore, a fluorescent energy transfer dye, a fluorescent pigment, a fluorescent polymer, a fluorescent protein, or a combination thereof. Most typically, the wavelength range of the excitation light is different from the wavelength range of the fluorescence emitted by the fluorescent dye. For example, a fluorescent dye can be excited by an excitation light of a wavelength of 360 nm and emit a fluorescence of a wavelength of 381 nm.

[0014] In the contemplated method, the image acquisition setup comprises at least one camera configured to acquire image data of the object representing the visible portion and / or image data of the object representing the invisible portion. Optionally, the at least one camera may comprise one or more image sensors configured to generate color data, grayscale data, or a combination thereof. Most typically, the image sensor comprises a red / green / blue (RGB) sensor, an ultraviolet (UV) sensor, an infrared (IR) sensor, or a combination thereof. Furthermore, the image acquisition setup may further comprise an auxiliary camera configured to track a portion of the object, where the excitation light does not illuminate the portion of the object.

[0015] Thus, in another aspect of the present subject matter, the inventors contemplate a method of acquiring image data of an object, comprising the steps of simultaneously illuminating the object with (a) natural and / or artificial light, and (b) an excitation light, and the further step of capturing image data using an image acquisition setup that generates color data representative of the visible portion of the light spectrum of the object and generates grayscale data representative of the invisible portion of the light spectrum of the object. In the method, it is contemplated that the object comprises a fluorescent dye that fluoresces at wavelengths in the invisible portion of the light spectrum upon illumination with the excitation light, the excitation light and the fluorescence being in the invisible portion of the light spectrum. For example, the visible portion can include wavelengths in the range of 400-700 nanometers (nm), and / or the invisible portion can include wavelengths less than 400 nm. As noted above, suitable fluorescent dyes include various fluorophores, fluorescent energy transfer dyes, fluorescent dyes, fluorescent polymers, fluorescent proteins, or combinations thereof. Most typically, the wavelength range of the excitation light is different from the wavelength range of the fluorescence emitted by the fluorescent dye (eg, a fluorescent dye is excited by excitation light of a wavelength of 360 nm and emits fluorescence of a wavelength of 381 nm).

[0016] In a further aspect of such contemplated method, the image acquisition setup comprises at least one camera configured to acquire image data of the object representing the visible portion and / or image data of the object representing the non-visible portion. Thus, such a camera may include one or more image sensors configured to generate color data, grayscale data, or a combination thereof. For example, suitable image sensors include red / green / blue (RGB) sensors, ultraviolet (UV) sensors, infrared (IR) sensors, or a combination thereof.

[0017] Accordingly, the inventors also contemplate a method of generating an alpha channel for an object in image data of a scene including the object. Such a method typically includes the step of providing image data of a scene including the object, the image data including color data representing the visible portion of the light spectrum of the object and the scene, and grayscale data representing the non-visible portion of the light spectrum of the object. In a separate step, the grayscale data is then used to separate the object from the scene, thereby generating a separated object, and the color data for the separated object is used to generate an alpha channel for the object.

[0018] Viewed from a different perspective, therefore, the inventor also contemplates a method of processing image data of an object comprising the step of providing image data of a scene including the object, the image data comprising colour data representing a visible part of the light spectrum of the scene and greyscale data representing an invisible part of the light spectrum of the object, In a further step an alpha channel for the object is created using the greyscale data.

[0019] Thus, in a further aspect of the subject matter of the present invention, the inventor also contemplates an image acquisition system for capturing image data of objects in a scene. The system preferably comprises a first camera having a first image sensor configured to generate color data representative of the visible portion of the light spectrum of the objects in the scene, and a second camera having a second image sensor configured to generate grayscale data representative of the invisible portion of the light spectrum of the objects. Most typically, a filter is coupled to the second camera, which allows light in the invisible portion of the light spectrum to travel to the second image sensor and reduces or blocks light in the visible portion of the light spectrum from traveling to the second image sensor. Furthermore, the first and second cameras are preferably coupled to a carrier and configured to capture objects in the scene along substantially the same line of sight and zoom factor. The light source is then configured to provide successive excitation light for fluorescent dyes that fluoresce in the invisible portion of the light spectrum. With regard to dyes and wavelengths, the same considerations as above apply.

[0020] Most typically, the first image sensor includes a red / green / blue (RGB) sensor and the second image sensor includes an ultraviolet (UV) sensor. Optionally, the auxiliary camera may be configured to track a portion of the object, where the excitation light does not illuminate the portion of the object based on the tracking of the portion of the object.

[0021] Thus, an image acquisition system for capturing image data of objects in a scene can include a camera having an image sensor configured to generate color data representative of the visible portion of the light spectrum of the objects in the scene and generate grayscale data representative of the invisible portion of the light spectrum of the objects. The system further includes a light source configured to continuously provide excitation light for a fluorescent dye that fluoresces in the invisible portion of the light spectrum. The same considerations as above apply with respect to the image sensor, dyes, and wavelengths.

[0022] In yet a further aspect of the present subject matter, the inventors further contemplate a method of acquiring image data of an object in front of a background comprising the steps of: providing an image acquisition setup configured to simultaneously acquire image data of the object representing the visible portion of the light spectrum and image data of the background representing the invisible portion of the light spectrum; (1) illuminating the object with natural and / or artificial light while simultaneously (2) illuminating the background with light having wavelengths in the invisible portion of the light spectrum. In another step of such a method, image data is captured using the image acquisition setup, thereby generating color data representing the visible portion of the light spectrum of the object and scene, and grayscale data representing the invisible portion of the light spectrum of the object.

[0023] Most preferably, the visible portion has a wavelength in the range of 400-700 nanometers (nm) and the invisible portion has a wavelength less than 400 nm. Furthermore, it is typically preferred that the image acquisition setup comprises a first and a second sensor, the first sensor acquiring image data of the object representing the visible portion of the light spectrum and the second sensor acquiring image data of the background representing the invisible portion of the light spectrum. In some embodiments, the background may comprise a flat surface, which may be illuminated using a light source located remotely relative to the flat surface. In other embodiments, the background comprises a flat surface, which is illuminated using a light source coupled to the flat surface. In a further embodiment, the background comprises a video screen, which comprises a plurality of UV LEDs that illuminate the background.

[0024] Accordingly, the inventors also contemplate a method of generating an alpha channel for an object in image data of a scene including an object in front of a background, comprising the steps of providing image data of a scene including the object and a background, the image data including color data representing a visible portion of the light spectrum of the object and grayscale data representing an invisible portion of the light spectrum of the background, in a separate step the grayscale data is used to separate the object from the background, thereby generating a separated object, and the color data is used on the separated object to generate an alpha channel for the object.

[0025] For example, the visible portion may include wavelengths in the range of 400-700 nanometers (nm) and the invisible portion may include wavelengths below 400 nm. In a further example, the image data includes, in separate files, color data representing the visible portion of the light spectrum of the object and grayscale data representing the invisible portion of the light spectrum of the background. As will be readily appreciated, the grayscale data in such a method may then be used as a track matte for the color data. Preferably, but not necessarily, the object is isolated from the background in real time.

[0026] Viewed from a different perspective, the inventors also contemplate a method of processing image data of an object comprising the step of providing image data of a scene including an object in front of a background, the image data including color data representing a visible portion of the light spectrum of the object and grayscale data representing an invisible portion of the light spectrum of the background, In a separate step an alpha channel for the object is then generated using the grayscale data.

[0027] In some embodiments, the image data includes, in separate files, color data representing the visible portion of the light spectrum for the object and grayscale data representing the non-visible portion of the light spectrum for the background. If desired, an alpha channel can be generated in real time.

[0028] Therefore, the inventor also contemplates an image acquisition system for capturing image data of an object in a scene, the object being in front of a background technology. The system typically includes a first camera having a first image sensor configured to generate color data representative of the visible portion of the light spectrum of the object, and a second camera having a second image sensor configured to generate grayscale data representative of the invisible portion of the light spectrum of the background. Most typically, a filter is coupled to the second camera, which allows light in the invisible portion of the light spectrum to travel to the second image sensor and reduces or blocks light in the visible portion of the light spectrum from traveling to the second image sensor. As mentioned above, the first and second cameras are typically and preferably coupled to a carrier and configured to capture the object in the scene along substantially the same line of sight and zoom factor. The light source is then configured to continuously illuminate the background with light in the invisible portion of the light spectrum.

[0029] Among other options, it is contemplated that the carrier may comprise a stereoscopic camera carrier, and / or the carrier is configured to coordinate simultaneous catadioptric focusing and / or zooming for the first and second cameras. In some embodiments, the light source is a medium pressure UV bulb or a UV emitting LED. Most typically, the first and second cameras are configured to operate synchronously to generate a video stream having the same timecode for simultaneously acquired frames, the visible portion having a wavelength in the range of 400-700 nanometers (nm) and the non-visible portion having a wavelength less than 400 nm.

[0030] Accordingly, the inventors also contemplate an image acquisition system for capturing image data of an object in a scene, the object being in front of a background. The system may include a camera having a first image sensor configured to generate color data representative of a visible portion of the light spectrum of the object in the scene, and a second image sensor to generate grayscale data representative of an invisible portion of the light spectrum of the background. As previously discussed, the light source is configured to illuminate the background with light in the invisible portion of the light spectrum. In at least some embodiments, the first and second sensors use the same lens (e.g., when the camera includes a beam splitting mirror).

[0031] In yet another aspect of the inventive subject matter, the inventors also contemplate a video wall comprising a first plurality of light-emitting pixels that emit light in the visible portion of the light spectrum and a second plurality of light-emitting pixels that emit light in the non-visible portion of the light spectrum. Most preferably, the second plurality of pixels is electronically coupled to a circuit that controls the illumination of the second plurality of pixels independently of the illumination of the first plurality of light-emitting pixels. For example, the first plurality of light-emitting pixels may be LED or OLED pixels, and / or the second plurality of light-emitting pixels are UV-emitting LED or OLED pixels. Without limiting the inventive subject matter, the first plurality of pixels and the second plurality of pixels are evenly distributed across at least 70% of the video wall. Furthermore, it is generally preferred that the circuitry allows for continuous illumination of the second plurality of pixels at a constant power level while allowing video content to be displayed via the first plurality of pixels. Among other options, such a video wall may be configured as a 360-degree video wall.

[0032] Additionally, the inventors also contemplate a video composite wall that includes a display area configured to display video content and a transparent layer coupled to the display area such that the displayed video content is viewable through the transparent layer. Most preferably, the transparent layer is reflective to light in the invisible portion of the light spectrum and / or can include a fluorescent dye that emits light in the invisible portion of the light spectrum upon excitation.

[0033] In some embodiments, the display area may be a reflective surface on which video content is displayed. In further embodiments, the transparent layer includes a transparent polymer that may include a UV-UV fluorescent dye. In further embodiments, the transparent layer may be bonded to a frame that includes a UV light source.

[0034] Various objects, features, aspects and advantages of the present subject matter will become more apparent from the following detailed description of preferred embodiments, taken in conjunction with the accompanying drawings in which like numerals represent like elements. [Brief description of the drawings]

[0035] [Figure 1] FIG. 1 is a schematic diagram illustrating an embodiment of a system for acquiring image data of an object in a scene.

[0036] [Figure 2A] Composite spectrum for 4,4-bis-di-tertbutyl-carbazole-biphenyl, showing distinct UV-UV excitation and emission maxima.

[0037] [Figure 2B] Composite spectrum of 2-naphthylamine showing distinct UV-UV excitation and emission maxima.

[0038] [Figure 2C] 1 is a composite spectrum of 9-phenylcarbazole showing distinct UV-UV excitation and emission maxima. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] The present inventors have discovered various systems and methods for acquiring image data of an object. In various embodiments, the image data may be utilized to separate the object from a background. Advantageously, such separation may be performed without the need for a green screen, reducing or completely eliminating the need for post-production editing of the isolated object. Additionally, the image data of the isolated object may include lighting information that may be used to match a new background.

[0040] To that end, the image acquisition setup simultaneously captures light in the visible portion of the spectrum, and the light forms the invisible portion of the spectrum, thereby generating two separate settings. In some embodiments, the object or actor may be coated with a fluorescent dye that is excited with light in the invisible portion of the spectrum (e.g., UV at 360 nm) and fluoresces with light in the invisible portion of the spectrum (e.g., UV at 381 nm), thus optically identifying the object or actor in the invisible portion of the spectrum, while in other embodiments, the background is illuminated with light in the invisible portion of the spectrum (e.g., UV at 360 nm) and obscured by the object or optically identifying the object or actor as a shadow in the invisible portion of the spectrum. Most typically, the image data from the light in the invisible portion of the spectrum is in the form of grayscale data. Regardless of the mode of illumination (foreground or background), the same object or actor is also illuminated with light in the visible portion of the spectrum to provide color data. As can be easily understood, the image data can be easily used to generate an alpha channel, since both image data represent the same scene simultaneously, but are represented in different color space representations.

[0041] FIG. 1 is a schematic diagram illustrating one embodiment of a system 10 for acquiring image data 12, 14 of an object 16 in a scene 18. The system 10 includes an image acquisition setup 20 configured to simultaneously acquire image data 12 of the object 16 representing a visible portion 22 of the light spectrum (e.g., visible light having a wavelength in the range of 400-700 nanometers (nm)) and image data 14 representing an invisible portion 24 of the light spectrum (e.g., ultraviolet light having a wavelength less than 400 nm or infrared light having a wavelength greater than 700 nm). As used herein, the term "simultaneously" means that the image data 12 and the image data 14 are acquired within 1,000 milliseconds (ms), 100 ms, 50 ms, 25 ms, 10 ms, 5 ms, 1 ms, or 0.1 ms of each other. Thus, from different perspectives, both image data of objects in a scene at a given time can share the same time code.

[0042] The system 10 further includes natural and / or artificial light 26 and excitation light 28. It should be understood that the natural light may include excitation light 28 (e.g., daylight having wavelengths in the visible and ultraviolet light ranges). It should also be understood that illumination by the natural and / or artificial light 26 and excitation light 28 may be direct or indirect. At least one of the artificial light 26 and excitation light 28 may be provided by a light source 42 configured to continuously provide at least one of the artificial light 26 and excitation light 28. The light source 42 may have a high wattage (e.g., 100 watts to 2000 watts for visible light) or an LED equivalent of such a light source (e.g., for visible and / or UV light). As will be readily understood, the light source 42 may include a DX control for a standard DX board, and / or a simple RF remote, and a high / low pass-through filter setup. Thus, the light source 42 may be small or large. Non-limiting examples of smaller lights include higher end GOBO style lights (e.g., about 30 cm to about 40 cm long).Light source 42 may be powered via battery, DC power, or AC power as is known in the art.

[0043] Natural light may be provided in the form of sunlight from the sun. Artificial light 26 may be provided by any light source capable of generating at least a portion of the visible portion 22 of the light spectrum (e.g., visible light having a wavelength in the range of 400-700 nanometers (nm)), such as incandescent light bulbs, fluorescent lamps, halogen lamps, and light emitting diodes (LEDs). Excitation light 28 may be provided by any light source capable of generating the invisible portion 24 of the light spectrum (e.g., ultraviolet light having a wavelength less than 400 nm or infrared light having a wavelength greater than 700 nm), such as UV-emitting LEDs, UVA bulbs, UVB bulbs, UVC bulbs, infrared-emitting LEDs, and infrared incandescent bulbs.

[0044] In the example of FIG. 1, the object 16 is coated with a fluorescent dye (not shown) that fluoresces at wavelengths in the invisible portion 24 of the light spectrum (e.g., ultraviolet light having a wavelength less than 400) upon illumination with excitation light 28. Any fluorescent dye known in the art can be utilized as long as it is excited in the invisible portion 24 of the light spectrum and fluoresces in the invisible portion 24 of the light spectrum. For example, the fluorescent dye may be from or include rare earth minerals and / or various organic (poly)aromatic compounds. In a typical embodiment, the wavelength range of the light exciting the fluorescent dye is different from the wavelength range of the light emitted by the fluorescent dye to minimize interference generated by the excitation light 28 during acquisition of the image data 14 (i.e., have a significant Stokes shift). For example, the object 16 may be treated with a fluorescent dye that is excited by light with a wavelength of 360 nm and emits light with a wavelength of 381 nm. However, it should be understood that in various embodiments, the dyes can be excited by light having any wavelength less than 400 and can emit light at any wavelength less than 400 nm, so long as the wavelengths do not overlap.

[0045] In this context, it should be noted that the term "wavelength" in conjunction with fluorescence excitation or emission herein is not meant to refer to a single wavelength, but rather to a peak in the excitation or emission spectrum, which is typically bell-shaped. Thus, if a fluorescent dye has an excitation wavelength of 360 nm, excitation at 350 nm or 370 nm is not excluded. However, most typically the peak has flanks that extend 5-25 nm or less on either side.

[0046] In certain embodiments, the object 16 can have a first region coated with a first fluorescent dye and a second region coated with a second fluorescent dye different from the first fluorescent dye. Alternatively or additionally, a second object (not shown) may be included and coated with a second fluorescent dye different from the first fluorescent dye. In various embodiments, the first and second fluorescent dyes fluoresce at different wavelengths in the non-visible portion 24 of the light spectrum upon illumination with excitation light 28. Thus, more than one alpha channel can be generated (e.g., one alpha channel for a first area of ​​the object and a second alpha channel for a second area of ​​the object, or one alpha channel or another alpha channel for one object and another object). It should be appreciated that such multiple alpha channels can be generated simultaneously, typically in the same scene, using the same image acquisition setup. It should be appreciated that more than one alpha channel can be generated utilizing more than two fluorescent dyes for more than two areas of the object 16 (or multiple objects).

[0047] The fluorescent dye may include a fluorophore, a fluorescent energy transfer dye, a fluorescent pigment, a fluorescent polymer, a fluorescent protein, or a combination thereof. The term "fluorophore" as used herein means a fluorescent chemical compound that can re-emit light upon light excitation. The phrase "fluorescent energy transfer dye" as used herein means a fluorescent dye that includes a donor fluorophore and an acceptor fluorophore, and when the donor fluorophore and the acceptor fluorophore are located close to each other and have a proper orientation relative to each other, the energy emission from the donor fluorophore is absorbed by the acceptor fluorophore, causing the acceptor fluorophore to fluoresce. The phrase "fluorescent pigment" as used herein means that the fluorophore is dissolved in a polymer matrix. Non-limiting examples of suitable fluorescent dyes include coumarins, pyrenes, perylenes, terrylenes, quaterrylenes, naphthalimides, cyanines, xanthenes, oxazines, anthracenes, naphthacenes, anthraquinones, thiazines, fluoresceins, rhodamines, asymmetric benzoxanthenes, xanthenes, phthalocyanines, squaraines, and combinations thereof.

[0048] From a different perspective, the present inventors particularly contemplate fluorescent dyes that have excitation maxima in the UV band of light (preferably invisible to the human eye) and fluorescence emission maxima in the longer wavelength portion of the UV band of light (preferably invisible to the human eye). Therefore, it should be understood that the preferred compounds presented herein are UV-to-UV fluorescent dyes. Therefore, even when illuminated with a relatively high excitation intensity, fluorescence cannot be perceived by the observer. Fluorescence is not adversely affected by simultaneous illumination with visible wavelength light.

[0049] Figures 2A-C provide examples suitable for use in conjunction with the teachings presented herein. Here, Figure 2A shows a composite spectrum of 4,4-bis-di-tertbutyl-carbazole biphenyl with an excitation maximum of about 365 nm and a fluorescence emission maximum of about 381 nm. Similarly, Figure 2B shows a composite spectrum of 2-naphthylamine with an excitation maximum of about 370 nm and a fluorescence emission maximum of about 397 nm. In yet another example, as shown in Figure 2C, a composite spectrum is shown for 9-phenylcarbazole with an excitation maximum of about 350 nm and a fluorescence emission maximum of about 365 nm. As can be seen from the composite spectrum, there is some overlap between the excitation and fluorescence spectra, leading to some loss of quantum efficiency. However, in practical use as described herein, all of the compounds tested performed well for their intended effects. Of course, it should be recognized that the compounds in Figures 2A-C are merely exemplary of fluorescent dyes, and all fluorescent dyes are considered suitable for use herein (especially UV-UV fluorescent dyes).

[0050] With regard to the specific compounds and methods of use of the fluorescent dyes, it is noted that the dyes can be used as fine (micronized) powders dissolved in a suitable solvent to form clear solutions or suspensions, etc., that allow for topical application as a spray (which may or may not evaporate to deposit the dye). Alternatively or additionally, other liquids, creams, gels, or solid agents can be used as carriers for the fluorescent dyes, with the appropriate selection typically depending on the type of surface to be treated. Thus, carriers typically include sprayable liquids, cosmetic formulations, etc. Of course, it is also noted that the fluorescent dyes may be incorporated (e.g., via machining, 3D printing, etc.) into the particular material from which the object is formed. If the fluorescence is applied to a large polymer (e.g., Mylar or polyethylene terephthalate) or a tare sheet, the material may be brushed or sprayed, or such a sheet may be manufactured to incorporate the fluorescent dye.

[0051] If desired, the fluorescent material can also be applied to a surface that has been pretreated with a UV absorbing agent. Advantageously, such agents are beneficial in reducing the exposure of live tissue to the UV excitation light or reducing or eliminating the reflection of the deactivating light from reflective (e.g., metal) surfaces that have been treated with the UV-UV fluorescent dye. Thus, in some embodiments, surfaces to be coated with the fluorescent dye can include a base coat (e.g., sunscreen) or base layer (e.g., clothing) applied to them to block UV light from the surface of interest. For example, UVA wavelengths are easily blocked by conventional sunscreens and clothing, and therefore the excitation light 28 can be configured to generate only UVA wavelengths.

[0052] 1, the system 10 is configured to simultaneously illuminate a scene 18 including the object 16 with natural and / or artificial light 26, and excitation light 28. As used herein, the term "simultaneously" means that the natural and / or artificial light 26 and the excitation light 28 each illuminate the scene 18 within 1,000 milliseconds (ms), within 100 ms, within 50 ms, within 25 ms, within 10 ms, within 5 ms, within 1 ms, or within 0.1 ms of each other. Most typically, both light sources operate simultaneously for at least some time interval.

[0053] The image data 12 and the image data 14 are captured using an image acquisition setup 20, thereby generating color data 30 representative of the visible portion 22 of the light spectrum of the scene 18 and the object 16, and grayscale data 32 (resulting from the fluorescence of fluorescent dyes on the object) representative of the non-visible portion 24 of the light spectrum of the object 16. The image acquisition setup 20 may include at least one camera 34A and / or 34B configured to acquire at least one of the image data 12 and the image data 14. The at least one camera 34A and / or 34B may include one or more image sensors 36A and / or 36B configured to generate the color data 30, the grayscale data 32, or a combination thereof. Examples of suitable image sensors 36 include red / green / blue (RGB) sensors, ultraviolet (UV) sensors, infrared (IR) sensors, or combinations thereof.

[0054] The RGB sensor may include one or more image detector elements, such as a charge-coupled element (CCD) detector element, a complementary metal-oxide semiconductor (CMOS) detector element, an electron-multiplying charge-coupled element (EMCCD) detector element, a scientific CMOS (sCMOS) detector element, or other types of visible light detector elements. It is understood that the RGB sensor may be combined with an IR sensor to improve acquisition in low light environments. In certain embodiments, the RGB sensor includes a CMOS detector element, such as those found in Canon brand SLR / DSLR cameras.

[0055] The UV sensor may include one or more image detector elements, such as an electron multiplying charge-coupled device (EMCCD) detector element, a scientific complementary metal oxide semiconductor (sCMOS) detector element, a gallium nitride (GaN) detector element, or other types of ultraviolet light detector elements. In some embodiments, the UV sensor may have enhanced responsivity in a portion of the UV region of the light spectrum, such as the UVA band (e.g., 315-400 nanometers) or the UVB band (e.g., 280-315 nanometers), to detect the emission of fluorescent dyes that emit in the UVA or UVB bands. In other embodiments, the UV sensor may be configured to have enhanced responsivity in a portion of the UV region of the light spectrum, such as the UVC band (e.g., 100-280 nanometers), to reduce solar background for daytime imaging, as well as artificial background in near-UV, visible, and infrared wavelengths that contribute to the background seen by silicon sensors.

[0056] The IR sensor may include one or more image detector elements adapted to detect infrared light and provide detection data and information, such as infrared photodetector elements (e.g., any type of multi-pixel infrared detector) for acquiring infrared image data, including an imager operative to sense reflected visible, near infrared (NIR), short wave infrared (SWIR) light, mid wave infrared (MWIR) light, long wave infrared (LWIR) radiation, or a combination thereof. Non-limiting examples include strained layer superlattice (SLS) detectors, uncooled detector elements, cooled detector elements, InSb detector elements, quantum structure detector elements, InGaAs detector elements, or arrays of other types of infrared photodetector elements.

[0057] As will be readily appreciated, the at least one camera 34 may be adjustable for frames per second (FPS), depth of field (DOF), focal length, motion blur, aperture, or combinations thereof. The at least one camera 34 may include a variety of communication channels, including digital line in and out (e.g., USB, etc.), wireless connectivity (e.g., Bluetooth, WIFI, NFC, etc.), and any other communication channel known in the art for a camera.

[0058] In a particular embodiment, the image acquisition setup 20 includes a first camera 34A having a first image sensor 36A (e.g., an RGB sensor) configured to generate color data 30 representative of the visible portion 22 of the light spectrum of the object 16 in the scene 18, and a second camera 34B having a second image sensor 36B (e.g., a UV sensor) configured to generate grayscale data 32 representative of the non-visible portion 24 of the light spectrum of the object 16. However, it is contemplated that the image acquisition setup 20 may include any combination of sensors associated with one or more cameras. For example, in an embodiment, when the object 16 is excited by light of a wavelength of 360 nm and treated with a fluorescent dye that emits light of a wavelength of 381 nm, the second image sensor 36B has a UV sensor such that the second image sensor 36B can generate grayscale data 32 representative of the non-visible portion 24 of the light spectrum (i.e., 381 nm) of the object 16.

[0059] The first and second cameras 34A, 34B may be coupled to a (e.g., stereo) carrier and configured to capture an object 16 in a scene 18 along substantially the same line of sight and zoom factor. The term "substantially" as used herein with respect to line of sight means that the line of sight of each of the first and second cameras 34A, 34B is within 10°, 5°, 4°, 3°, 2°, 1°, or 0.1° of each other. The term "substantially" as used herein with respect to zoom factor means that the zoom factor of each of the first and second cameras 34A, 34B is within 10%, 5%, 4%, 3%, 2%, 1%, or 0.1% of each other. In further embodiments, software may be used to account for parallax. Additionally, it is noted that the operation of the cameras may be synchronized using controls well known in the art.

[0060] In another embodiment, the image acquisition setup 20 includes a camera 34 having an integrated image sensor 36 configured to generate both color data 30 representing the visible portion 22 of the light spectrum of the object 16 in the scene 18 and grayscale data 32 representing the non-visible portion 24 of the light spectrum of the object 16.

[0061] In some embodiments, the image acquisition setup 20 further includes a filter 38. The filter 38 may be coupled to the second camera 34B to allow light in the invisible portion 24 of the light spectrum to travel to the second image sensor 36B and reduce or block light in the visible portion 22 of the light spectrum from traveling to the second image sensor 36B. In certain embodiments, the filter 38 includes a bandpass filter that transmits UVA radiation and rejects other wavelengths of light, such as light having wavelengths less than 315 nm and greater than 400 nm. For example, in an embodiment in which the object 16 is excited by light of a wavelength of 360 nm and treated with a fluorescent dye that emits light of a wavelength of 381 nm, the filter 38 may transmit UVA radiation with a transmission of at least 10% or more in the center of the desired wavelength range for emission by the fluorescent dye (e.g., between 370 nm and 390 nm). It should be appreciated that the image acquisition setup 20 may include more than one filter, such as two filters, three filters, four filters, or more filters. Similarly, additional filters may be used with camera 34A to block or significantly reduce fluorescence excitation and / or emission light.

[0062] The system 10 may further be configured to use the grayscale data 32 to isolate the object 16 from the scene 18, thereby generating an isolated object, and to use the color data 30 of the isolated object to generate an alpha channel for the object. In particular, the system 10 may be configured to use the grayscale data 32 to generate an alpha channel for the object 16. In various embodiments, the alpha channel allows for one image to be alpha blended with another. This alpha channel may be utilized to isolate the object 16 from the scene 18, thereby generating an isolated object.

[0063] It should be appreciated that there are numerous software packages available on the market that can perform the various functions required for alpha channel generation and video compositing. For example, various 2D compositing programs, animation platforms, or motion graphics and video editing programs may be suitable for use. Also, most 3D software packages come bundled with the necessary tools. While such packages are suitable, particularly preferred software packages also have dedicated functionality for performing compositing, rotoscoping, color keying, and / or green screen production. For example, specifically contemplated packages are Adobe After Effects, Premiere, Avid Media composer, Shake, Nuke, Combustion, Primatt, Wondershare Filmora X, Fusion Studio, Autodesk Flame, Natron. Mocha and Sythe eyes are particularly useful in rotoscoping, but they all create alpha channels. Lightwave, Max Maya are all 3D programs that incorporate chromakey into their software packages.

[0064] Continuing with FIG. 1, in an exemplary embodiment, the object 16 is treated with a fluorescent dye that is excited by light at a wavelength of 360 nm and emits light at a wavelength of 381 nm. The first camera 34A has an RGB sensor for the first image sensor 36A, and the second camera 34B has a UV sensor for the second image sensor 36B. The second camera 34B includes a filter 38 that allows light in the invisible portion 24 of the light spectrum at a wavelength of 381 nm to travel and blocks light in the visible portion 22 of the light spectrum and the invisible portion 24 at a wavelength of about 360 nm. The object 16 is illuminated with artificial light 26 that generates the visible portion 22 of the light spectrum. The object 16 is further illuminated with excitation light 28 that generates the invisible portion 24 of the light spectrum that includes light at least at a wavelength of about 360 nm but does not include light at a wavelength of 381 nm, thereby minimizing interference during acquisition by the second camera 34B. The first camera 34A generates color data 30 representing the visible portion 22 of the light spectrum of the object 16 in the scene 18 in response to acquisition of image data 12 resulting from illumination of the object 16 with artificial light 26. The second camera 34B generates grayscale data 32 representing light at a wavelength of 381 nm in the invisible portion 24 of the light spectrum in response to acquisition of image data 14 resulting from illumination of the object 16 with excitation light 28. Without being bound by theory, the inventors have surprisingly discovered that the image data 14 representing the invisible portion 24 of the light spectrum can be utilized to isolate the object 16 from the scene 18 without requiring significant post-production steps. Even more advantageously, the simultaneous use of two different modes of image acquisition allows the scene and object to be captured using illumination desired by the director while simultaneously generating data to generate an alpha channel at substantially the same view and perspective. Furthermore, since the alpha channel is generated using light invisible to the naked human eye, no "green spill" is observed.

[0065] Furthermore, the inventors have surprisingly discovered that the image data 14 provides illumination information of the object 16 that is substantially independent of the material of the object 16 that is illuminated, the color of the object 16, or any other attribute of the object 16 that may affect the illumination of the object 16. In contrast to conventional acquisition techniques that rely on visible light, the image data 14 results solely from the excitation of the fluorescent dyes upon the illumination of the object 16. From a different perspective, attributes of the object 16 that may affect the illumination information resulting from the artificial light 26 do not affect the illumination information resulting from the excitation light 28.

[0066] The system 10 may further have a computing device 40 capable of controlling the natural and / or artificial light 26, the excitation light 28, and the image acquisition setup 20 to synchronize the acquisition of the image data 12 and the image data 14. Additionally, the computing device 40 may be capable of analyzing the image data 12 and the image data 14 acquired by the image acquisition setup 20 and the color data 30 and the grayscale data 32 generated by the image acquisition setup 20 to generate isolated objects and generate alpha channels for the objects. In various embodiments, the computing device 40 includes hardware and software (e.g., Adobe creative suite, Resulume, etc.) capable of controlling components of the system 10 (e.g., a high-end workstation PC).

[0067] The system 10 may be further configured to operate in a live mode and a rehearsal / action mode. The live mode includes the configuration of the system 10 described above, where the object 16 is exposed to the excitation light 28 to acquire the image data 14. On the other hand, the rehearsal / action mode may be utilized when a scene is scripted as an action scene. Generally, during an action scene, the subject's face may not be exposed, or the subject wears sunglasses, helmets, or costumes that cover their face. Alternatively, the scene may be a long shot.

[0068] During rehearsal / action mode, the natural and / or artificial lights 26 and excitation lights 28 are positioned at an angle to the subject, and the image acquisition setup 20 is positioned to ensure that the subject is completely covered from the camera's point of view. The rehearsal / action mode may be activated by an operator at a control console (e.g., computing device 40) or by using a remote for the lights 26, 28. When the lights 26, 28 are in rehearsal / action mode, the lights 26, 28 emit visible light (e.g., using a three-color RGB chip allowing for thousands of colors).

[0069] The scene is then rehearsed to see if the subject requiring the alpha channel is completely covered with light emitted from the lights 26, 28. The position of the lights 26, 28 can then be adjusted, additional lights 26, 28 can be added, or portions of the lights 26, 28 can be removed to obtain the desired conditions. During this rehearsal / action mode, neither the subject nor the staff are exposed to UV light. Once the scene is ready to be shot, the operator places the lights 26, 28 in live mode, the colored visible light of the lights 28 is disabled, and the lights 28 emit invisible light (e.g., UV light) covering the same area with the same relative brightness or density as achieved during the rehearsal / action mode. The UV lead is in the same housing as the RGB lead relative to the light 28, therefore all light settings, door flags, positions, etc. apply to the UV lead just as they apply to the RGB lead.

[0070] For scenes where the subject's face is seen in a close-up or medium shot, the system 10 provides full coverage of the subject to generate an alpha channel that includes the entire face of the subject. This may be accomplished by capturing the alpha channel in two parts and then combining them using the computing device 40 using well-known compositing software. The lighting setup is primarily the same as for the live mode with the addition of at least one projector instead of the at least one light 28. The projector may emit invisible light of the same wavelength as the light 28 and may have a rehearsal mode.

[0071] The projector may include an auxiliary camera, such as a webcam or other video capture device coupled to the projector, positioned such that the focus / field of view is the same relative to the light 28. In other embodiments, the auxiliary camera is positioned such that the focus / field of view is the same relative to the second camera 34B. It should be understood that the projector may include multiple auxiliary cameras positioned such that the focus / field of view is the same relative to the light 28 and the second camera 34B. The computing device 40 may use tracking software in the auxiliary camera to draw a tracking region of the subject and create a unique mask around the subject's face in real time. The same tracking region is then used to create a real time mask for the projector. An LCD chip in the projector uses a black and white face recognition tracking region to block that portion of the UV light from the projector that hits the subject's face. The remainder of the subject is still illuminated by the projector. During rehearsals, the mask may be adjusted to be as tight as possible around the subject's face. The same mask used to block UV from the subject's face may be recorded as a separate track with the same timecode as the main UV and color tracks. Then combine the two tracks to create one clean alpha channel.

[0072] For this configuration, fluorescent dye make-up can be applied to most of the exposed skin, if desired. It can be applied to the sides of the face, neck, nose, chin, forehead, and cheeks, if desired. Hair, wardrobe, and any other props that require an alpha channel can be treated. During rehearsal mode, the light projects highly saturated bright colors, as described above. Facial mask / tracking can be adjusted as far as latency and shape.

[0073] It should be appreciated that in further contemplated embodiments, the use of visible and invisible light may be implemented in a manner that does not require the object or actor to be covered with a fluorescent dye. Instead, the background provides a preferably homogeneous illumination area, generated using a light source that emits light in the invisible part of the spectrum. Of course, as in the above-described embodiment, the actor's object in the scene is also typically illuminated with natural or artificial light in the visible part of the spectrum. It should therefore be understood that when the actor's object is in front of a homogeneous illumination area, generated using a light source that emits light in the invisible part of the spectrum, the invisible light sensitive camera records image data in which the background is visible and the object / actor is invisible. Thus, the object or actor can be easily separated using the alpha channel generated from the invisible light sensitive camera.

[0074] For example, system 10 may include a fluorescent panel that is substantially transparent under visible light. The fluorescent panel may be treated with a fluorescent dye that fluoresces under certain wavelengths of light but remains transparent under visible light. As will be readily understood, the panel may then be illuminated with excitation light from a desired location away from the panel, or from a light source (e.g., LED strips) integrated into the top and / or bottom of the panel (e.g., in a frame that holds the panel, minimizing spillage of the excitation light). The fluorescent panel may be an alpha channel, and thus object 16 may be isolated from the fluorescent panel. The fluorescent panel may include clear plastic, mylar, or tulle that has been treated with a fluorescent dye. In these and other embodiments, excitation light 28 may be behind the centerline of the action and point toward the fluorescent panel. It is understood that excitation light 28 may require a wide range. Alternatively, in some embodiments system 10 does not include a fluorescent panel, or only one or more portions of the fluorescent panel are used. In these and other embodiments, the background may be illuminated and thus function as an alpha channel, thereby minimizing exposure of the subject to UV light.

[0075] In addition, as described in more detail below, the fluorescent panel may also be replaced by an LED screen (e.g., a 360 degree LED screen) that comprises LED elements that emit light in the non-visible portion of the spectrum in addition to the LED components that emit visible light. Such LED elements may be implemented as separately controlled pixels throughout the LED screen, or may be provided in separately controlled rows or columns.

[0076] During rehearsal mode, the excitation lights 28 project highly saturated bright colors, as described above, ensuring that staff and talent are out of range of the illumination of the excitation lights 28 and that the fluorescent panels are covered. To maximize the effectiveness of the resulting alpha channel, a UV absorber may be applied to any objects, staff, talent, surfaces, etc.

[0077] As discussed above, a method of acquiring image data 12, 14 of an object 16 is provided. The method includes providing an image acquisition setup 20 configured to simultaneously acquire image data 12 of the object 16 representing a visible portion 22 of the light spectrum and image data 14 representing an invisible portion 24 of the light spectrum. The method further includes coating the object 16 with a fluorescent dye that fluoresces at wavelengths in the invisible portion 24 of the light spectrum upon illumination with an excitation light 28. The method further includes simultaneously illuminating a scene 18 including the object 16 with (a) natural and / or artificial light 26, and (b) the excitation light 28. The method further includes capturing the image data 12, 14 using the image acquisition setup 20, thereby generating color data 30 representing the visible portion 22 of the light spectrum of the object 16 and the scene 18, and grayscale data 32 representing the invisible portion 24 of the light spectrum of the object 16.

[0078] Another method of acquiring image data 12, 14 of an object 16 is provided. The method includes simultaneously illuminating the object 16 with (a) natural and / or artificial light 26, and (b) an excitation light 28. The method further includes capturing the image data 12 using an image acquisition setup 20 that generates color data 30 representative of the visible portion 22 of the light spectrum of the object 16 and generates grayscale data 32 representative of the invisible portion 24 of the light spectrum of the object 16. The object 16 is coated with a fluorescent dye that fluoresces at wavelengths in the invisible portion 24 of the light spectrum upon illumination with the excitation light 28. The excitation light 28 and the fluorescent light are in the ultraviolet portion of the light spectrum.

[0079] A method of generating an alpha channel for an object 16 in image data 12 of a scene 18 including the object 16 is also provided. The method includes providing image data 12, 14 of a scene 18 including the object 16. The image data 12 includes color data 30 representing a visible portion 22 of the light spectrum of the object 16 and the scene 18, and grayscale data 32 representing an invisible portion 24 of the light spectrum of the object 16. The method further includes using the grayscale data 32 to isolate the object 16 from the scene 18, thereby generating an isolated object. The method further includes using the color data 30 for the isolated object 16 to generate an alpha channel for the object.

[0080] A method of processing image data of an object is also provided. The method includes providing image data 12, 14 of a scene 18 including an object 16. The image data 12, 14 includes color data 30 representing a visible portion 22 of the light spectrum of the scene 18 and the object 16, and grayscale data 32 representing a non-visible portion 24 of the light spectrum of the object 16. The method further includes generating an alpha channel for the object 16 using the grayscale data 32.

[0081] In view of the above, it should be appreciated that the alpha channel generation system and method presented herein generates an alpha channel simultaneously with the color video being shot. Most typically, both video streams are stored (e.g., separately) with the same timecode. The alpha channel can be recorded in real time and viewed live and played back on location, saving considerable production and set-up time. The recorded alpha channel can then be used as any other track matte in post-production using conventional software tools well known in the art. Furthermore, the alpha channel generator does not need to be used on a "green stage" and can, in fact, be used anywhere, since it generates an alpha channel in the non-visible spectrum of light and renders the alpha channel generation independent of specific lighting needs. Thus, the scene can be shot in the real world and does not need to be specifically illuminated for a green screen. Furthermore, it should be appreciated that the light that the UV capture camera uses to generate the alpha channel does not affect the scene and is not visible to the naked eye.

[0082] As a result, it should be appreciated that the director / director of photography can light the scene as desired and generate an alpha channel outdoors, in sunlight, at night, on a green stage, and even on a stage with a video wall. Furthermore, the contemplated systems and methods allow for multiple people and subjects to be in the scene and allow only one actor or a portion of an actor to be selected and turned into an alpha channel without the entire cast being on a green stage. Furthermore, the contemplated systems and methods presented herein can create an alpha channel behind objects that do not require an alpha channel themselves, thereby eliminating the difficult rotoscoping procedure for non-tracked scenes. Finally, it should be appreciated that the systems and methods presented herein do not have "green spill" and therefore require minimal, if not zero, rendering time.

[0083] As an additional benefit, the movie can be played even from a low-end projector on the wall behind the talent where normally a green screen would be used. In front of that wall, a transparent screen with UV-UV compound can be placed to allow for background alpha channel generation to be used to generate the alpha channel while still taking advantage of proper lighting from the projected video.

[0084] In the following examples, two general setup configurations of the systems and methods presented herein were used: a foreground alpha channel generation configuration (with one example provided in more detail below) and a background alpha channel generation configuration (with three examples provided in more detail below). What is common to both systems is that the alpha channel generation uses two cameras, as described in more detail below: a standard RBG video camera and a camera that captures one or more narrow bands of light in the UV A range (here wavelengths between 400 nm and 330 nm).

[0085] Foreground Alpha Setup: A subject needing an alpha channel is treated with a compound that only fluoresces in the non-visible range. Whatever the compound is applied to and illuminated with UV light becomes the alpha channel.

[0086] Background Alpha Setup: This setup is similar to how a traditional green screen setup is shot. The background becomes the alpha channel, with the subject in the background. In post production, the alpha channel is inverted. Such a general setup can be used in three different variations:

[0087] Background Alpha Setup A: The scene has a UV-UV fluorescent backdrop created on some type of transparent substrate such as tulle or a polymer film that is coated with a UV-UV fluorescent compound. The compound is then excited by a UV excitation light, and the entire scene shows fluorescence except when the object is in front of the fluorescent backdrop.

[0088] Background Alpha Setup B: The scene has a UV-UV fluorescent backdrop as described above. If a subject is in the foreground, it will be silhouetted by the UV light coming off the backdrop. If there are multiple subjects in the scene and they overlap, they can be assigned separate alpha channels. A UV-UV fluorescent compound can be applied to objects that excite at the same wavelength as the backdrop but emit at a different wavelength. Software is then used to assign colors to the different fluorescent wavelengths the compound is emitting. Alpha channels can also be generated for objects that do not have a UV-UV fluorescent compound. Their alpha channel is generated by the light that reflects off the surface and into the UV capture camera. This is not exact, but works well if nothing else is going on. For example, creating an alpha channel for trees in a park at night.

[0089] Background Alpha Setup C: The scene has a partial or full fluorescent backdrop using UV-UV fluorescent compounds or embedded LEDs or a combination thereof on the video playback wall or screen. In a further preferred embodiment, UV emitting LEDs are embedded in the video playback wall and the embedded UV-LEDs are controlled by a separate control circuit. Regardless of the particular setup, subjects requiring an alpha channel are silhouetted against the video screen.

[0090] Cameras and Rigs: A typical alpha channel generator system uses two cameras mounted on some sort of rig that allows for simultaneous filming of the same scene with relatively little or zero parallax, such as a stereoscopic rig. One of the cameras is set up to capture UVA. Ideally the cameras have the same make and model and use the same lens. Both cameras have filters attached to their lenses. The RGB camera has a standard UV blocking filter on it, allowing only visible light to pass (400 / 405nm to 700+ nm). The filter on the UV camera is usually a bandpass filter with a narrow bandwidth (10nm) the same as the wavelength at which the UV-UV compound fluoresces, thereby filtering out the excitation light and allowing the fluorescence to be recorded.

[0091] In a typical embodiment, the cameras were mounted on a rig, such as a side-by-side rig or a stereo rig. The RGB and UV camera captures were adjusted to have the same field of view with little or no parallax between them (e.g., using a stereo rig). Most typically, the rig has transfer wheels, gears, and wires that coordinate the movement of the two lenses for each camera, thereby facilitating focusing and zooming of the lenses simultaneously. As will be appreciated, the settings of the RGB cameras (exposure white balance, etc.) can be set remotely or manually.

[0092] In one example, the inventors used a setup of two identical Cannon 8ti rebels. This setup does not achieve 0 degrees parallax, which would be ideal, but identical cameras and lenses were used. In the UV capture camera, only the capture chip and some internal filters were modified to capture light in the non-visible part of the spectrum. Alternatively, to achieve zero parallax, the cameras are mounted on a rig similar to those used to shoot 3D or VR, which are commercially available and will fit almost any professional camera. In such a setup, one camera shoots through a (semi-transparent) one-way or beam-splitting mirror, while the other camera captures the reflected scene. Not important, the UV capture camera is the unit that captures the reflected image.

[0093] In yet another example, since there are few professional UV video cameras available at this time, alternative setups are considered where the two cameras are not identical. Lens distortion may be observed, but the compositing software can accommodate such distortion. Alternatively, a small form factor fixed focus UV capture camera could be used, such as for use with a Go-Pro or a handheld camera of similar dimensions.

[0094] For illumination in general, it is contemplated that the alpha channel generator light is UV light. Their wavelength can be full band UVA narrowed via filters or UV LEDs tuned to narrow wavelengths.

[0095] Lighting for Foreground Alpha Setup: At least one to several high wattage UVA standalone filtered or narrow bandwidth lights are used. If lighting issues exist (e.g. highlights, reflective surfaces, etc.) a UV softbox emitting a narrow bandwidth can be used. Subjects needing an alpha channel are sufficiently illuminated by UV which excites the UV-UV compounds. As will be appreciated, these factors and consideration of the scene being shot will determine how many lights and what configurations are used.

[0096] Lighting for Background Alpha Setup: At least one large flat reflector bounce light setup with a narrow UV band or a clear UV background screen covering the background in the shot, or a very large UV light meant to illuminate specific elements in the background that are not treated with UV-UV compounds. It is best to have even coverage on the background to create an alpha that is uniform in value. These factors and consideration of the scene being shot will determine how many lights and what configuration are needed.

[0097] Workstation PC and Control Software: Camera remote control and viewing software, such as from the camera manufacturer, are suitable for use herein. Preferably, a PC with a high speed video card, or two PCs, capable of viewing both the RGB and UV cameras simultaneously, are used. The primary function of the workstation is to check and adjust the registration of the two video streams so that the streams line up properly. In most cases, the workstation also runs conventional post-production software for playing back and compiling the alpha channel.

[0098] Suitable software for generating an alpha channel is widely available commercially and is typically provided by the camera manufacturer (e.g., Adobe, Avid, etc.). In addition to being able to composite video streams to generate an alpha channel, the preferred software packages also provide the ability to align and register two video streams, and most free remote software bundled with the camera is sufficient for this purpose. If more complex functionality is required, high-end compositing software often has a large array of camera and lens setups included in their packages. These setups are provided by the camera manufacturers for the purpose of removing or adding lens distortions and camera characteristics so that the elements incorporated in the computer-generated domain match the environment captured by a particular camera and lens setup in the real-world domain. If the scene is photographed and the RGB and UV alpha images do not align exactly, final fine-tuning to correct the alignment can be performed in post-production. Software such as Adobe After Effects makes it easy to remove parallax or manually adjust the frame so that the video streams line up.

[0099] UV-to-UV Compounds: Specific UV-to-UV compounds were selected for the desired purpose, with 4,4-bis-di-tertbutyl-carbazole-biphenyl, 2-naphthylamine, and 9-phenylcarbazole showing excellent results in all settings. These compounds were mixed with several different media (e.g., polyethylene terephthalate, PVA, ethanol) and applied as paints.

[0100] When image capture begins and the RGB camera is recording, the second UV camera is also recording a grayscale image in real time, typically as a separate file, with the same timecode as the RGB camera. This grayscale image is the alpha channel. Both cameras have live feeds to a workstation where both the camera playback and remote control are located. The result is a video of the same scene as the RGB video of the subject, but in grayscale provided by each synchronized camera. The grayscale image is the alpha channel. If the compound is fully opaque in grayscale, the image is 255 (white). If no compound is present, the image is 0 (black). If there are transparent areas in the subject, a grayscale of varying alpha intensity is displayed. When the alpha channel is applied to the RGB image, it can be seen that the subject has been cut out from the background.

[0101] Foreground Alpha Setup and Action Configuration Setup / Rehearsal Mode: This configuration and studio setup are used when a scene is scripted as an action scene or when a single object requires alpha for removal. For example, island shots of talent or heroes with wire removal, scaffolding, limbs, etc. These are scenes where the person's face is not exposed, they are wearing sunglasses, helmets, costumes that cover their face, or are shot for an extreme long period of time. This configuration primarily uses a UV-UV compound on foreground objects that need to be isolated.

[0102] During setup, the lights are positioned at an angle to the subject and camera to ensure the subject is completely covered from the camera POV. During prelights and rehearsals, the lights are in rehearsal mode. This is done by the operator at the control console (laptop) or using the lights' remote. When the lights are in rehearsal mode, they are emitting visible light using a three-color RGB chip that allows for thousands of colors. The colors from each light can be highly saturated, red-yellow-green, etc.

[0103] The scene is rehearsed. In this mode it is easy to see if the subject requiring the alpha channel is completely covered with light from the light. The position of the light can then be tweaked, lights can be added or removed, and the scene and key can be fine-tuned without exposing crew or talent to UV. When the scene is ready to be shot the operator puts the light into live mode, the colored visible light is turned off and the UV is turned on covering the same area with the same relative brightness or density as the RGB LEDs. In such a scenario the UV LEDs are in the same housing as the RGB LEDs, therefore all the light setup, door flags, positions etc. apply to the UV just as they apply to the visible colored light. If the camera tracks, pans or zooms there may also be a primary UV light pointed directly from the camera POV of the subject (e.g. mounted on a rig).

[0104] Background Alpha Setup

[0105] A background alpha setup can be conceptually seen as a green screen where the background is the alpha channel, but instead of a green screen, the background fluoresces outside the visible range. Among other options, a background alpha setup can be based on a large piece of clear plastic, mylar, or tulle that has been treated with a UV-UV fluorescent compound.

[0106] For example, a transparent screen could be illuminated by rows of UV emitting LEDs at the top and bottom of the screen, or by a larger stage type light. The advantage of this configuration is that the UV used to illuminate the transparent screen is focused only on the UV-UV compound. This modular / mobile transparent backdrop can be deployed almost anywhere and easily disassembled or destroyed.

[0107] An alternative background setup is one that relies on having a very large light. This setup can be used outdoors at night, and possibly even in sunlight, without using a UV screen as a reflective backdrop. In this scenario, the UV light is behind the centerline of action and points towards the background. In this case, the UV light can use a broader wavelength range than discussed above (or be filtered to a wavelength closer to the fluorescent emission of the UV-UV compound). In fact, and depending on what is in the background and visual goals to achieve, this setup may not require a UV-UV compound as there is enough light reflecting off the object.

[0108] Yet another option for the alpha channel generator system described herein is related to rear-projection video screens or LED walls. Recently, production companies have been building custom stages that run 360-degree video walls around the perimeter of the studio. This is specifically built to be used instead of using a green screen. By adding UV LEDs to the array of RGB LEDs in the video wall, a clean alpha channel can be generated without affecting the image displayed on the video wall. When manufacturing the video wall, narrow wavelength UV LEDs (e.g., 381 nm emission) can be integrated with each pixel assembly. Alternatively, arrangements other than UV LED pixels are also considered appropriate, including horizontal or vertical narrow LED bars that do not interfere with the video display. Another solution is to use a UV-UV transparent screen that is placed in front of the LED video screen and appropriately illuminated with UV excitation light. Regardless of the specific configuration, these UV LEDs are on a separate circuit from the color LEDs and all light up with the same amount or brightness. The remainder of the dual camera pickup and ACG setup is the same as described in this document. This requires that the UV camera is mounted on the same rig as the live camera. In such cases, a UV-to-UV compound is not required.

[0109] In some embodiments, the numbers expressing properties such as amounts of ingredients, concentrations, reaction conditions, etc., used to describe and claim certain embodiments of the present invention should be understood as being modified in some instances by the term "about". Thus, in some embodiments, the numerical parameters set forth in the written description and the accompanying claims are approximations that may vary depending on the desired properties sought to be obtained by a particular embodiment. The recitation of ranges of values ​​herein is merely intended to serve as a shorthand method of individually referring to each separate value falling within the range. Unless otherwise indicated herein, each separate value is incorporated herein as if it were individually recited herein.

[0110] All methods described herein may be performed in any suitable order unless otherwise indicated herein or clearly contradicted by context. Any and all examples provided with respect to specific embodiments herein, or the use of exemplary language (e.g., "etc.") are intended merely to make the invention more clear and are not intended to limit the scope of the invention as claimed. No language in the specification should be construed as indicating any non-claimed element essential to the practice of the invention.

[0111] As used throughout this description and the claims that follow, the meanings of "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Also, as used in this description, the meaning of "in" includes "in" and "on," unless the context clearly dictates otherwise. Also, as used herein, unless the context dictates otherwise, the term "coupled to" is intended to include both direct coupling (wherein the two elements that are coupled to each other contact each other) and indirect coupling (wherein at least one additional element is located between the two elements). Thus, the terms "coupled to" and "coupled to" are used interchangeably.

[0112] It will be apparent to those skilled in the art that many more modifications beyond those already described are possible without departing from the inventive concept herein. Thus, the subject matter of the present invention should not be limited, except as provided by the appended claims. Moreover, in interpreting both the specification and the claims, all terms should be interpreted in the broadest possible manner consistent with the context. In particular, the terms "comprises" and "comprising" should be interpreted as referring to components, ingredients, or steps in a non-exclusive manner, indicating that a mentioned component, ingredient, or step may be present, utilized, or combined with other components, ingredients, or steps not expressly mentioned. When a specification or claim refers to at least one selected from the group consisting of A, B, C ... and N, the text should be interpreted as requiring only one element from the group, not A+N, or B+N, etc.

Claims

1. 1. A method for acquiring image data of an object, comprising: providing an image acquisition setup configured to simultaneously acquire image data of the object representing a visible part of the light spectrum and image data representing a non-visible part of the light spectrum; coating the object with a fluorescent dye that fluoresces at wavelengths in the non-visible portion of the light spectrum upon illumination with excitation light; (a) simultaneously illuminating a scene containing said object with natural and / or artificial light, and (b) an excitation light; capturing image data using said image acquisition setup, thereby generating colour data representative of the visible part of the light spectrum of said scene and said object, and greyscale data representative of the non-visible part of the light spectrum of said object; The method according to claim 1,

2. The method of claim 1 , wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

3. The method of claim 1 , wherein the non-visible portion has a wavelength of less than 400 nm.

4. The method of claim 1 , wherein the fluorescent dye comprises a fluorophore, a fluorescent energy transfer dye, a fluorescent dye, a fluorescent polymer, a fluorescent protein, or a combination thereof.

5. The method of claim 1 , wherein the wavelength range of the excitation light is different from the wavelength range of the fluorescence emitted by the fluorescent dye.

6. The method according to claim 5 , wherein the fluorescent dye is excited by excitation light having a wavelength of 360 nm and emits fluorescent light having a wavelength of 381 nm.

7. The method of claim 1 , wherein the image acquisition setup comprises at least one camera configured to acquire the image data of the object representing the visible portion and / or the image data of the object representing the non-visible portion.

8. The method of claim 7 , wherein the at least one camera comprises one or more image sensors configured to generate the color data, the grayscale data, or a combination thereof.

9. The method of claim 8 , wherein the image sensor comprises a red / green / blue (RGB) sensor, an ultraviolet (UV) sensor, an infrared (IR) sensor, or a combination thereof.

10. The method of claim 1 , wherein the image acquisition setup further comprises an auxiliary camera configured to track a portion of the object, and wherein the excitation light does not illuminate the portion of the object.

11. 1. A method for acquiring image data of an object, comprising: (a) simultaneously illuminating the object with natural and / or artificial light, and (b) an excitation light; acquiring image data using an image acquisition setup, generating colour data representative of the visible part of the light spectrum of the object and generating greyscale data representative of the non-visible part of the light spectrum of the object; having the object comprises a fluorescent dye that, when irradiated with the excitation light, emits fluorescence at a wavelength in the invisible portion of the light spectrum; the excitation light and the fluorescent light are in the non-visible portion of the light spectrum; method.

12. The method of claim 11, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

13. The method of claim 11 , wherein the non-visible portion has a wavelength of less than 400 nm.

14. The method of claim 11 , wherein the fluorescent dye comprises a fluorophore, a fluorescent energy transfer dye, a fluorescent dye, a fluorescent polymer, a fluorescent protein, or a combination thereof.

15. The method of claim 11 , wherein the wavelength range of the excitation light is different from the wavelength range of the fluorescent light emitted by the fluorescent dye.

16. The method of claim 15, wherein the fluorescent dye is excited by the excitation light having a wavelength of 360 nm and emits the fluorescent light having a wavelength of 381 nm.

17. The method of claim 11 , wherein the image acquisition setup comprises at least one camera configured to acquire the image data of the object representing the visible portion and / or the image data of the object representing the non-visible portion.

18. The method of claim 17 , wherein the at least one camera comprises one or more image sensors configured to generate the color data, the grayscale data, or a combination thereof.

19. 20. The method of claim 18, wherein the image sensor comprises a red / green / blue (RGB) sensor, an ultraviolet (UV) sensor, an infrared (IR) sensor, or a combination thereof.

20. The method of claim 11 , wherein the image acquisition setup further comprises an auxiliary camera configured to track a portion of the object, and wherein the excitation light does not illuminate the portion of the object.

21. 1. A method for generating an alpha channel for an object in image data of a scene including the object, comprising: providing image data of the scene including the object, the image data including color data representing a visible portion of the light spectrum of the scene and the object, and grayscale data representing a non-visible portion of the light spectrum of the object; using the greyscale data to separate the object from the scene, thereby generating a separated object; generating an alpha channel for the subject using the color data of the separated object; The method according to claim 1,

22. The method of claim 11, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

23. The method of claim 11 , wherein the non-visible portion has a wavelength of less than 400 nm.

24. 1. A method for processing image data of an object, comprising the steps of: providing image data of a scene including the object, the image data including color data representing a visible portion of the light spectrum of the scene and the object, and grayscale data representing a non-visible portion of the light spectrum of the object; generating an alpha channel for the object using the grayscale data; The method according to claim 1,

25. The method of claim 11, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

26. The method of claim 11 , wherein the non-visible portion has a wavelength of less than 400 nm.

27. 1. An image acquisition system for capturing image data of an object in a scene, comprising: a first camera having a first image sensor configured to generate color data representative of a visible portion of the light spectrum of the objects in the scene; a second camera having a second image sensor configured to generate grayscale data representative of the non-visible portion of the light spectrum of the object; a filter coupled to the second camera that allows light in the invisible portion of the light spectrum to pass to the second image sensor and reduces or blocks light in the visible portion of the light spectrum from passing to the second image sensor; Equipped with the first camera and the second camera are coupled to a carrier and configured to capture the object in the scene along substantially the same line of sight and zoom factor; The system further comprises a light source configured to continuously provide excitation light for a fluorescent dye that fluoresces in the non-visible portion of the light spectrum. Image acquisition system.

28. 28. The image acquisition system of claim 27, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

29. 28. The image acquisition system of claim 27, wherein the non-visible portion has a wavelength of less than 400 nm.

30. 28. The image acquisition system of claim 27, wherein the fluorescent dye comprises a fluorophore, a fluorescent energy transfer dye, a fluorescent pigment, a fluorescent polymer, a fluorescent protein, or a combination thereof.

31. 28. The image acquisition system of claim 27, wherein the wavelength range of the excitation light is different from the wavelength range of the fluorescence emitted by the fluorescent dye.

32. 32. The image acquisition system of claim 31, wherein the fluorescent dye is excited by the excitation light having a wavelength of 360 nm and emits the fluorescent light having a wavelength of 381 nm.

33. 30. The image acquisition system of claim 27, wherein the first image sensor comprises a red / green / blue (RGB) sensor.

34. 30. The image acquisition system of claim 27, wherein the second image sensor comprises an ultraviolet (UV) sensor.

35. 30. The image acquisition system of claim 27, further comprising an auxiliary camera configured to track a portion of the object, wherein the excitation light does not illuminate the portion of the object.

36. 1. An image acquisition system for capturing image data of an object in a scene, comprising: a camera having an image sensor configured to generate color data representative of a visible portion of the light spectrum of the objects in the scene and to generate grayscale data representative of a non-visible portion of the light spectrum of the objects; a light source configured to continuously provide excitation light for a fluorescent dye that fluoresces in the non-visible portion of the light spectrum; An image acquisition system comprising:

37. 37. The image acquisition system of claim 36, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm).

38. 37. The image acquisition system of claim 36, wherein the non-visible portion has a wavelength of less than 400 nm.

39. 37. The image acquisition system of claim 36, wherein the fluorescent dye comprises a fluorophore, a fluorescent energy transfer dye, a fluorescent dye, a fluorescent polymer, a fluorescent protein, or a combination thereof.

40. 37. The image acquisition system of claim 36, wherein the wavelength range of the excitation light is different from the wavelength range of the fluorescence emitted by the fluorescent dye.

41. 37. The image acquisition system of claim 36, wherein the fluorescent dye is excited by the excitation light having a wavelength of 360 nm and emits the fluorescent light having a wavelength of 381 nm.

42. 37. The image acquisition system of claim 36, wherein the image sensor comprises a red / green / blue (RGB) sensor, an ultraviolet (UV) sensor, an infrared (IR) sensor, or a combination thereof.

43. 37. The image acquisition system of claim 36, further comprising an auxiliary camera configured to track a portion of the object, wherein the excitation light does not illuminate the portion of the object.

44. 1. A method for acquiring image data of an object in front of a background, comprising: providing an image acquisition setup configured to simultaneously acquire image data of the object representing a visible part of the light spectrum and image data of the background representing a non-visible part of the light spectrum; (1) illuminating the object with natural and / or artificial light while (2) illuminating the background with light having wavelengths in the non-visible portion of the light spectrum; capturing image data using the image acquisition setup, thereby generating colour data representative of the visible portion of the light spectrum of the scene and greyscale data representative of the non-visible portion of the light spectrum of the object; The method according to claim 1,

45. 45. The method of claim 44, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm) and the invisible portion has a wavelength less than 400 nm.

46. 45. The method of claim 44, wherein the image acquisition setup comprises a first and a second sensor, the first sensor acquiring image data of the object representing a visible portion of the light spectrum, and the second sensor acquiring image data of the background representing an invisible portion of the light spectrum.

47. 45. The method of claim 44, wherein the background includes a flat surface, the flat surface being illuminated with a light source positioned remotely relative to the flat surface.

48. 45. The method of claim 44, wherein the background includes a flat surface, the flat surface being illuminated using a light source coupled to the flat surface.

49. 45. The method of claim 44, wherein the backdrop comprises a video screen, the video screen comprising a plurality of UV LEDs that illuminate the backdrop.

50. 1. A method for generating an alpha channel for an object in image data of a scene including the object in front of a background, comprising: providing image data of the scene including the object and the background, the image data including color data representing a visible portion of the light spectrum of the object and grayscale data representing a non-visible portion of the light spectrum of the background; using the greyscale data to separate the subject from a background, thereby generating a separated object; generating an alpha channel for the subject using the color data of the separated object; The method according to claim 1,

51. 51. The method of claim 50, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm) and the invisible portion has a wavelength less than 400 nm.

52. 51. The method of claim 50, wherein the image data includes the color data representing the visible portion of the light spectrum of the object and the grayscale data representing the non-visible portion of the light spectrum of the background in separate files.

53. 51. The method of claim 50, wherein the grayscale data is used as a track matte for the color data.

54. 51. The method of claim 50, wherein the object is separated from the background in real time.

55. 1. A method for processing image data of an object, comprising the steps of: providing image data of a scene including an object in front of a background, the image data including color data representing a visible portion of the light spectrum of the object and grayscale data representing a non-visible portion of the light spectrum of the background; generating an alpha channel for the object using the grayscale data; The method according to claim 1,

56. 56. The method of claim 55, wherein the image data includes the color data representing the visible portion of the light spectrum of the object and the grayscale data representing the non-visible portion of the light spectrum of the background in separate files.

57. 56. The method of claim 55, wherein the alpha channel is generated in real time.

58. 1. An image capture system for capturing image data of an object in a scene, the object being in front of a background, the image capture system comprising: a first camera having a first image sensor configured to generate color data representative of a visible portion of the light spectrum of the object; a second camera having a second image sensor configured to generate grayscale data representative of the non-visible portion of the light spectrum of the background; a filter coupled to the second camera that allows light in the invisible portion of the light spectrum to pass to the second image sensor and reduces or blocks light in the visible portion of the light spectrum from passing to the second image sensor; Equipped with the first and second cameras are coupled to a carrier and configured to capture the object in the scene along substantially the same line of sight and zoom factor; The system further comprises a light source configured to continuously illuminate the background with light in the non-visible portion of the light spectrum. Image acquisition system.

59. 60. The image acquisition system of claim 58, wherein the carrier comprises a stereo camera carrier.

60. 60. The image capture system of claim 58, wherein the carrier is configured to accommodate simultaneous lens focusing and / or zoom for the first and second cameras.

61. 59. The image acquisition system of claim 58, wherein the light source is a medium pressure UV bulb or a UV emitting LED.

62. 60. The image capture system of claim 58, wherein the first and second cameras are configured to operate synchronously to produce video streams having the same timecode for simultaneously captured frames.

63. 59. The image acquisition system of claim 58, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm) and the invisible portion has a wavelength less than 400 nm.

64. 1. An image capture system for capturing image data of an object in a scene, the object being in front of a background, the image capture system comprising: a camera comprising a first image sensor configured to generate color data representative of a visible portion of the light spectrum of the objects in the scene, and a second image sensor configured to generate grayscale data representative of a non-visible portion of the light spectrum of the background; a light source configured to illuminate the background with light in the non-visible portion of the light spectrum; An image acquisition system comprising:

65. 65. The image acquisition system of claim 64, wherein the visible portion has a wavelength in the range of 400 to 700 nanometers (nm) and the invisible portion has a wavelength less than 400 nm.

66. 65. The image acquisition system of claim 64, wherein the first and second sensors use the same lens.

67. 65. The image acquisition system of claim 64, wherein the camera comprises a beam splitting mirror.

68. A video wall, a first plurality of light emitting pixels emitting light in the visible portion of the light spectrum; a second plurality of light-emitting pixels that emit light in the non-visible portion of the light spectrum; Equipped with the second plurality of pixels being electronically coupled to a circuit that controls illumination of the second plurality of pixels independently of illumination of the first plurality of light emitting pixels. Video wall.

69. 70. The video wall of claim 69, wherein the first plurality of light emitting pixels are LED or OLED pixels.

70. 70. The video wall of claim 69, wherein the second plurality of light emitting pixels are UV emitting LED or OLED pixels.

71. 70. The video wall of claim 69, wherein the first and second plurality of pixels are evenly distributed across at least 70% of the video wall.

72. 70. The video wall of claim 69, wherein the circuitry enables continuous illumination of the second plurality of pixels at a constant power level while enabling video content to be displayed via the first plurality of pixels.

73. 70. The video wall of claim 69, wherein the wall is configured as a 360 degree video wall.

74. 1. A video combining wall, comprising: a display area configured to display video content; a transparent layer coupled to the display area such that displayed video content is visible through the transparent layer; Equipped with the transparent layer is reflective to light in the non-visible portion of the light spectrum and / or contains a fluorescent dye that emits light in the non-visible portion of the light spectrum upon excitation; Video composite wall.

75. 75. The video composite wall of claim 74, wherein the display area is a reflective surface.

76. 75. The video composite wall of claim 74, wherein the transparent layer comprises a transparent polymer.

77. 75. The video composite wall of claim 74, wherein said transparent layer comprises a UV-UV fluorescent dye.

78. 75. The video composite wall of claim 74, wherein the transparent layer is bonded to a frame that contains a UV light source.

Images