Multi-halftone imaging and dual-modulation projection or dual-modulation laser projection

Abstract

To provide a favorable dual modulation projection system.SOLUTION: Smaller halftone tiles are implemented on a first modulator of a dual modulation projection system. This techniques use multiple halftones per frame in a pre-modulator, synchronized with a modified bit sequence in the primary modulator to effectively increase the number of levels provided by a given tile size in the halftone modulator. It addresses the issue of reduced contrast ratio at low light levels for small tile sizes and allows the use of smaller PSFs which reduce halo artifacts in the projected image and may be utilized in 3D projecting and viewing.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to display devices, and more particularly to dual modulation projectors (including laser projectors) and the creation of halftone images in a projector's pre-modulator. [Background technology]

[0002] Dual modulation projectors and displays include display devices (eg, US Pat. No. 6,393,323 to Whitehead and US Pat. No. 6,393,323 to Daly) and projectors (eg, US Pat. No. 6,393,323 to Sayag). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] U.S. Patent No. 7,403,332 [Patent Document 2] U.S. Patent No. 7,064,740 [Patent Document 3] U.S. Patent No. 7002533 Summary of the Invention [Means for solving the problem]

[0004] The inventors have realized what is needed to improve the halftones of the image on the pre-modulator. This invention allows the use of smaller halftone tiles on the first modulator of a dual modulation projection system. This technique uses multiple halftones per frame on the pre-modulator synchronized with a modified bit sequence on the primary modulator to effectively increase the number of levels available for a given tile size on the halftone modulator. This addresses the issue of low contrast ratio at low light levels with small tile sizes and allows the use of smaller PSFs that reduce halo artifacts in the projected image. Halftones can also be used to improve color projection or polarization separated 3D images.

[0005] Portions of both the device and the method may be conveniently implemented when programmed on a general purpose computer, or a networked computer, and the results may be displayed on an output device connected to either the general purpose computer, or the networked computer, or transmitted to a remote device for output or display. Additionally, any elements of the invention appearing in the computer program, data sequences, and / or control signals may be embodied (or transmitted) as electronic signal transmissions at any frequency, in any medium, such as, but not limited to, wireless broadcast, and transmission over copper wire(s), fiber optic cable(s), coaxial cable(s), and the like.

[0006] A more complete understanding of the present invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description, when considered in conjunction with the accompanying drawings, in which: [Brief description of the drawings]

[0007] [Figure 1] FIG. 13 illustrates the effect of the number of discrete premodulation levels on local contrast. [Diagram 2] FIG. 13 illustrates the improvement obtained when a halftone image is distributed over four sub-frames. [Diagram 3] FIG. 2 is a diagram of an example PSF and a modified PSF. [Figure 4] FIG. 2 is a diagram of an exemplary bit sequence. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Current dual modulation POC EDR projectors use one halftone image per frame in the premodulator. A small PSF is desirable to limit the halo size of small bright features and to achieve high local contrast. The first non-zero premodulation level is achieved by overlapping fields of the PSF to achieve a relatively flat field of light. For a given (small) PSF size, the spacing of the halftone non-zero pixels must be smaller than the PSF and small enough to achieve this flat field. This limits the percentage of pixels that must be non-zero to a constant level, which determines the first average non-zero level and the number of discrete linear pre-modulation levels. For example, a PSF that must repeat on a 5x5 grid would require 1 out of 25 pre-modulator pixels to be turned on, resulting in a minimum of 1 / 25 non-zero levels and 25 discrete pre-modulation levels.

[0009] The image from the described system can have a contrast ratio (CR) of about 25 times that of the primary modulator. If the original CR of the primary modulator was 1800, the CR of the final image will be 45,000:1. This assumes that one of the 25 pixels is always on. Since the premodulation DMD can have a CR greater than 1800:1 with the premodulation pixels off, the black level can be much better than 1 / 45000 of peak white. However, turning off all the premodulation pixels can have deleterious effects. Such effects can also be seen in images with low light levels even though some pixels are on. For example, some image features vary with spatial frequencies beyond the features that can be represented by the premodulation light field. For these image features, the premodulation light field is constant and not modulated. The level of the premodulation light field is calculated by the locally largest image feature. The primary DMD must reduce the premodulation light field to produce the full level of the local image feature. In response to a non-zero first premodulation level, the primary DMD may not have enough contrast to produce the lowest level, limiting the local contrast of that image feature enough to affect its appearance, especially around areas where the last pixel in the premodulation tile is turned off.

[0010] In this region, the local contrast drops to about 20. Such issues can potentially be solved by increasing the PSF and tile size, but this will increase the halo size, which may also introduce visible artifacts.

[0011] Figure 1 illustrates the problem in a clear way. The blue line (starting on the horizontal axis between 10E-6 and 10E-5) represents the best contrast ratio that can be achieved in this particular auditorium with a projector capable of an ideal infinite contrast ratio of 100 nits. This limitation arises due to the room having a dark level of 0.0005 nits as measured at the screen. This is due to the room ambient light reaching and reflecting from the screen to the observer. The red line (starting on the horizontal axis between 10E-4 and 10E-3) represents one modulating projector. The projector has a contrast ratio of 1800:1 (simultaneous and sequential). As the peak level of the local image gets darker with this projector, the contrast ratio in the local image decreases proportionally because the dark level remains constant. This is natural and expected behavior.

[0012] The light green line (thinner line) represents the contrast ratio possible with a dual modulation projector with high spatial frequency content (premodulation is locally constant). When the projected image is locally darkened just out of peak white, the contrast ratio curves match exactly with the previous case. However, when (in this example) the level reaches about 24 / 25 of peak white, the premodulation can change its value from 25 / 25 pixels turned on to 24 / 25 pixels, and the primary modulator can use its full range again.

[0013] So, at this low light level, we get the full local contrast ratio of 1800:1 again. In the situation just before the premodulation changes its value (to 23 / 25), the local contrast ratio drops to 24 / 25*1800. This situation progresses with each change in the premodulation, with the maximum possible CR resetting back to 1800 after each change. For example, when two pixels are active, the CR drops to 144 (2 / 25*1800). When only one pixel is active, the premodulation cannot be changed until the leakage light through the premodulator is high enough to reach the desired output level with the primary modulator alone (fully on). In this illustrative example, this level is 1 / 1800 of the output peak. There is a large gap between the lowest modulation level achieved with a 1 / 25 halftone and 1 / 1800, and in this region the premodulation must be maintained at the 1 / 25 level. The primary modulator is the only modulator for this region, and the contrast ratio drops to a level of about 1 / 25 before the premodulation halftones can be set to zero, which is much lower (one quarter of the blue line) than could be obtained in a room with an ideal projector.

[0014] [Table 1] One objective of the present invention is to reduce the effect of these artifacts by increasing the number of levels in the pre-modulator but without increasing the tile size or PSF size. The concept is relatively simple, using more than one halftone image per frame. In the previous description, 5X5 tiles were considered. In the following, we will use 5X5 tiles but with 4 subframe halftones per frame. In this example, on a separate pixel basis for each tile, the pixel can take on 5 consecutive values, which are 0, 1, 2, 3, or 4 subframes (0, 1 / 4 frame, 1 / 2 frame, 3 / 4 frame, or 1 frame). This allows the 5X5 tile to represent 100 positive values ​​(and 0) instead of the original 25 values ​​(and 0). If a DMD (Digital Mirror Device by TI (Texas Instruments)) is used for the primary modulator, a modification of the bit sequence to the modulation chip is required. The DMD modulates the light using a form of pulse width modulation. Therefore, the light is expected to be constant over the entire frame period. Changing the premodulation halftone during the frame (4x) would create non-constant light and disrupt the PWM result.

[0015] Typically, DMDs are used with one sequence per frame to obtain 16 bits per pixel modulation. We propose to modify the bit sequence so that the most significant bits are spread over the frame period. Thus, the most significant bits are repeated many times. For example, if the most significant 14 bits (of 16 bits) are repeated, this results in a pattern in which the most significant 14 bits are repeated four times. The significant less significant bits are left unaffected (spread over the entire frame period). This kind of repeating sequence has been described in the literature and is used to reduce motion artifacts with DMD-based projection systems. A similar technique is described in US Patent No. 5,986,640. The halftone image of the pre-modulator is synchronized with the repeating sequence of the primary modulator, so that both modulators change to the new sequence at the same time.

[0016] FIG. 2 shows the improvement obtained when the halftone image is distributed over four subframes as described above.

[0017] [Table 2] In this situation, the minimum contrast ratio produced by the projector is approximately the same as that obtained with an ideal projector in this room. This technique reduces the unwanted contrast ratio degradation without increasing the tile size and the corresponding PSF size.

[0018] In the preferred embodiment of the invention shown and described in the drawings, specific terminology is used for the sake of clarity. However, the invention is not limited to the specific terminology as selected. It should also be understood that each specific element includes all technical equivalents that operate in a similar manner. Furthermore, the inventors recognize that newly developed and non-publicly known technologies may be substituted for the described parts and still fall within the scope of the invention. All other items described should also be considered in the light of any and all available equivalents, including but not limited to modulators, frames, subframes, etc.

[0019] Portions of the present invention may conveniently be implemented using a conventional general purpose digital computer or microprocessor, or a specialized digital computer or microprocessor programmed according to the techniques of the present disclosure, as will be apparent to those skilled in the computer art.

[0020] Appropriate software coding can be readily prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software arts. The invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art based on this disclosure.

[0021] The present invention includes a computer program product, which is a storage medium(s) having instructions stored thereon, which can be used to control a computer or cause a computer to perform any of the processes of the present invention. The storage medium may include, but is not limited to, any type of disk, such as a floppy disk, a mini disk (MD), an optical disk, a DVD, a CD-ROM, a CD or DVDRW+ / -, a microdrive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device (such as a flash card, a memory stick), a magnetic or optical card, a SIM card, a MEMS, a nanosystem (such as a molecular memory IC), a RAID device, a remote data storage / archive / warehousing, or any type of medium or device suitable for storing instructions and / or data.

[0022] The present invention, stored on one of the computer readable medium(s), comprises software for controlling the hardware of both general purpose computers or microprocessors and specialized computers or microprocessors, and for enabling the computers or microprocessors to interact with human users or other mechanisms that utilize the results of the present invention. Such software may include, but is not limited to, device drivers, operating systems, and user applications. Finally, such computer readable media further comprises software for carrying out the present invention as previously described.

[0023] Included in the programming (software) of a general purpose / specialized computer or microprocessor are software modules for carrying out the teachings of the present invention, such as, but not limited to, preparing a halftone image corresponding to image data, splitting a frame, synchronously applying a bit sequence to a DMD, and displaying, storing or communicating results from the process of the present invention. Also, the laser light source of the projector is modulated locally and globally. The laser light source is configured to emit at least two sets of wavelengths of light. The at least two sets of wavelengths of light include red, green and blue wavelengths of light, respectively. At least one of the different sets of wavelengths of the same color are separated by a minimum bandwidth required to achieve off-axis viewing without crosstalk through the passband of the glasses at normal and off-axis viewing angles seen in a standard movie theater or theme park movie screening or as part of a theme park ride. The off-axis viewing angle is one of approximately 20 degrees, less than 20 degrees and a maximum angle typically seen during a screening. The technical concepts that can be understood from the above embodiments will be described below. (Appendix 1) 1. A method comprising: generating dual modulation control signals including a primary modulator control signal for controlling a primary modulator of a dual modulation display system and a secondary modulator control signal for controlling a secondary modulator of the dual modulation display system; The premodulator control signal is and configured to cause the pre-modulator to generate two or more half-tone images synchronously with the primary modulator control signal during a single frame period of the primary modulator control signal. (Appendix 2) 2. The method of claim 1, wherein the preliminary modulator control signal includes a plurality of sub-frames each generating the two or more halftone images synchronized with a single frame of the primary modulator control signal. (Appendix 3) the premodulator control signal includes a plurality of subframes each producing one of the two or more halftone images; 2. The method of claim 1, wherein each of the plurality of subframes is set with its own subframe time interval synchronized with a control interval of the primary modulator and a signal of the primary modulator. (Appendix 4) 4. The method according to any one of claims 1 to 3, wherein the method is implemented in a cinema projector having a laser light source that illuminates the pre-modulator. (Appendix 5) 5. The method of claim 4, wherein the laser light source is locally or globally modulated.

[0024] The present invention may suitably comprise, consist of, or consist essentially of any element (various portions or features of the invention and their equivalents described herein). Moreover, the invention illustratively disclosed herein can be practiced in the absence of any element, whether or not specifically disclosed herein. Of course, many modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that, within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.

Claims

1. 1. A method performed by a controller for causing a dual modulation projector to display an input image, comprising: The dual modulation projector includes: a plurality of laser light sources illuminating a plurality of tiles of the pre-modulator to display a plurality of pre-modulator halftone images; a pre-modulator for illuminating a primary modulator with the plurality of pre-modulator halftone images; a primary modulator for displaying a plurality of primary modulator images; each tile of the auxiliary modulator corresponds to an image area of ​​the primary modulator; The method comprises: receiving an input image to be displayed during a single frame period; Dividing the single frame period into a plurality of sub-frame periods; For each tile of the premodulator: generating a portion of the premodulator halftone image based on a corresponding portion of the input image, the generating portion including calculating amounts of a plurality of premodulator pixels that are turned on over successive subframe periods of the single frame period; generating an image region of the primary modulator image corresponding to each tile based on a corresponding portion of the input image, wherein generating the image region of the primary modulator image includes calculating, for each pixel of the image region, a modulation value, the modulation value being selected such that a most significant bit component of a corresponding modulation value is spread across the single frame period by repeating a most significant component of the modulation value in each of the plurality of sub-frame periods; outputting a preliminary modulator control signal to the preliminary modulator to cause the generated preliminary modulator halftone image to be displayed, and outputting a primary modulator control signal to the primary modulator to cause the generated primary modulator image to be displayed synchronously with a corresponding preliminary modulator halftone image; As the amount of the plurality of pre-modulator pixels that are turned on decreases, the dark level of the generated image approaches the dark level of the environment in the room in which the image is generated.

2. 1. A controller for causing a dual modulation projector to display an input image, comprising: The dual modulation projector comprises: a plurality of laser light sources illuminating a plurality of tiles of the pre-modulator to display a plurality of pre-modulator halftone images; a pre-modulator for illuminating a primary modulator with the plurality of pre-modulator halftone images; a primary modulator for displaying the plurality of primary modulator images; each tile of the auxiliary modulator corresponds to an image area of ​​the primary modulator; The controller is configured to perform the method of claim 1 .

3. 1. A dual modulation projector, comprising: a plurality of laser light sources illuminating a plurality of tiles of the pre-modulator to display a plurality of pre-modulator halftone images; a pre-modulator for illuminating a primary modulator with the plurality of pre-modulator halftone images; a primary modulator for displaying the plurality of primary modulator images, each tile of the auxiliary modulator corresponding to an image area of ​​the primary modulator; A dual modulation projector comprising: a controller according to claim 2.

Images