Projector light source dimming using future frame metadata

Abstract

To reduce a perceptibility of a visual artifact in a projector.SOLUTION: A projection display system comprises: a light source configured to emit a light in response to a content data; an optical modulator configured to modulate the light; and a controller configured to adjust a light level of the projection display system based on the content data and a metadata relating to a future frame, thereby to reduce a perceptibility of a visual artifact.SELECTED DRAWING: Figure 12

Description

Technical Field

[0001] Cross - reference to Related Applications This application claims priority based on U.S. Provisional Patent Application No. 62 / 882,894 filed on August 5, 2019, and U.S. Provisional Patent Application No. 62 / 737,015 filed on September 26, 2018, and the entire contents of these applications are incorporated herein by reference.

[0002] Broadly speaking, this application relates to a projector display system.

Background Art

[0003] A projector display system typically includes a light source that irradiates an image modulated by some optical system inside or outside the projector onto a screen. The projector may include a light source that includes one or more light - emitting elements such as a laser, a xenon lamp, an arc lamp, a light - emitting diode, etc. The light from the light source can be guided along an optical path that may include one or more optical elements such as lenses, modulators, beam expanders, beam splitters, irises, filters, etc.

[0004] The light emerging from the projector display system can be directed onto a two - dimensional screen such as a movie theater screen. One or more modulators that may be included in the projector display system selectively direct light to specific locations on the screen, thereby generating an image that may include relatively bright and relatively dark portions. The contrast ratio of a projector is one measure of the performance of the projector display system and is defined as the ratio of the peak luminance level to the dark level of its display. Since an infinite contrast ratio is technically impossible to achieve, it can be technically difficult for a projector to display a very bright image portion and an absolutely black image portion simultaneously.

[0005] Projectors or other display systems that include or are related to global dimming are described in the patents and patent applications of the same applicant that include the following. U.S. Patent Publication No. 2018 / 0217485, entitled "Single and Multi-Modulator Projector Systems with Global Dimming" U.S. Patent Publication No. 2018 / 0211440, entitled "Surround Ambient Light Sensing, Processing, and Adjustment" U.S. Patent Publication No. 2018 / 0164665, entitled "Light Recycling for Projectors with High Dynamic Range" U.S. Patent Publication No. 2018 / 0098, entitled "Targeted Display Color Volume Specification via Color Remapping Information (CRI) Messaging" No. 046 U.S. Patent Publication No. 2018 / 006863, entitled "Dynamic Power Management for an HDR Display" No. 7 U.S. Patent Publication No. 2018 / 0011365, entitled "High Dynamic Range Displays Using Filterless LCD(s) for Increasing Contrast and Resolution" U.S. Patent Publication No. 2, entitled "Methods and Systems for High Dynamic Range Image Projectors" Issue 018 / 0007327 U.S. Patent Publication No. 2017 / 0316758, entitled "High Dynamic Range Display Using LED Backlighting, Stacked Optical Films, and LCD Drive Signals Based on a Low Resolution Light Field Simulation" U.S. Patent Publication No. 2017 / 0186380, entitled "Power Management for Modulated Backlights" U.S. Patent Publication No. 2016 / 0261832, entitled "Single and Multi-Modulator Projector Systems with Global Dimming" U.S. Patent Publication No. 2016 / 0139560, entitled "Projector Display Systems Having Non-Mechanical Mirror Beam Steering" U.S. Patent Publication No. 2015 / 0365580, entitled "Global Display Management Based Light Modulation" United States Patent Publication No. 201, entitled "Enhanced Global Dimming for Projector Display Systems" 5 / 0124176 issue U.S. Patent Publication No. 2014 / 0333660, entitled "Mapping for Display Emulation Based on Image Characteristics" U.S. Patent Publication No. 2014 / 0168287, entitled "Power Management for Modulated Backlights" A US publication titled "Display, Imaging System and Controller for Eyewear Display Device" National Patent Publication No. 2014 / 0085190 U.S. Patent Publication No. 2013 / 0335682, entitled "High Contrast Grayscale and Color Displays" U.S. Patent Publication No. 2013 / 0120234, entitled "High Dynamic Range Display Using LED Backlighting, Stacked Optical Films, and LCD Drive Signals Based on a Low Resolution Light Field Simulation" U.S. Patent Publication No. 2012 / 0224121, entitled "High Dynamic Range Displays Using Filterless LCD(s) for Increasing Contrast and Resolution" U.S. Patent Publication No. 2011 / 0175949, entitled "Power Management for Modulated Backlights" U.S. Patent Publication No. 2009 / 0322800, entitled "Method and Apparatus in Various Embodiments for HDR Implementation in Display Devices" The full texts of these documents are incorporated herein by reference. [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] Summary of the disclosed information Various aspects of this disclosure relate to apparatus, systems, and methods for performing global dimming in a projector to reduce the perceived likelihood of visual artifacts. [Means for solving the problem]

[0007] In one exemplary embodiment of the present disclosure, a projection display system is provided, comprising: a light source configured to emit light in response to content data; an optical modulator configured to modulate the light; and a controller configured to reduce the perceptibility of visual artifacts by adjusting the light level of the projection display system based on the content data and metadata relating to future frames.

[0008] In another exemplary embodiment of the present disclosure, a non-temporary computer-readable medium is provided which stores instructions causing a projection display system, comprising a light source and an optical modulator, to perform a process that, when executed by a processor of the projection display system, includes receiving content data, emitting light from the light source in accordance with the content data, modulating the light with the optical modulator, and reducing the perceptibility of visual artifacts by adjusting the light level of the projection display system based on the content data and metadata relating to future frames.

[0009] Thus, various aspects of this disclosure provide global dimming in projector display systems using psychovisual masking and bring about improvements in at least the technical fields of image projection and signal processing. [Brief explanation of the drawing]

[0010] Various other and more detailed specific features of the above aspects are more fully disclosed in the following description with reference to the attached drawings. [Figure 1] Graphs illustrating exemplary dimming techniques in various aspects of this disclosure are shown. [Figure 2] This disclosure shows graphs illustrating exemplary relationships between projectors and rooms in various aspects. [Figure 3] A graph illustrating another exemplary dimming technique in various aspects of this disclosure is shown. [Figure 4] Graphs illustrating exemplary tone curves in various aspects of this disclosure are shown. [Figure 5] This disclosure shows graphs of various dark levels for exemplary projectors in various aspects. [Figure 6] This disclosure shows graphs of various dark levels for exemplary projectors in various aspects. [Figure 7] This disclosure shows graphs of various dark levels for exemplary projectors in various aspects. [Figure 8] Graphs of various dark levels of an exemplary projector according to various aspects of the present disclosure are shown. [Figure 9] Graphs of various dark levels of an exemplary projector according to various aspects of the present disclosure are shown. [Figure 10] Graphs of various dark levels of an exemplary projector according to various aspects of the present disclosure are shown. [Figure 11] A block diagram of an exemplary projector display system according to various aspects of the present disclosure is shown. [Figure 12] A processing flow of an exemplary projector display method according to various aspects of the present disclosure is shown.

Embodiments for Carrying Out the Invention

[0011] The present disclosure and its aspects can be implemented in various forms including a hardware or circuit controlled by a computer-implemented method, a computer program product, a computer system and a network, a user interface and an application programming interface, as well as a hardware-implemented method, a signal processing circuit, a memory array, an application-specific integrated circuit, a field programmable gate array, etc. The above summary only shows the outline of various aspects of the present disclosure and does not limit the scope of the present disclosure in any way.

[0012] To assist in understanding one or more aspects of the present disclosure, numerous detailed matters such as circuit configurations, waveform timings, circuit operations, etc. are described in the following description. It is obvious to those skilled in the art that these specific details are only examples and do not limit the scope of the present application.

[0013] Furthermore, while this disclosure primarily focuses on examples of the use of various circuits in digital projection systems, it will be understood that this represents only one possible embodiment. Moreover, it will be understood that the disclosed systems and methods are applicable to any device where it is necessary to reduce or minimize the perceptibility of visual artifacts (e.g., microscopes, image sensing, telecommunications, non-projection image displays, etc.).

[0014] Dimming technique In this specification, “global dimming” refers to a technique that changes the overall light level of a projector’s light source in response to content. This involves increasing the light level of the light source in bright scenes and decreasing it in dimly lit scenes. This can be achieved in various ways, including by using an aperture, passing the light through a variable density filter, or modulating the light source itself. Furthermore, this can be done using hardware elements, software elements, firmware, or a combination thereof. As an example, global dimming (such as any one or more of the techniques described below) can be implemented by a variable multi-input analog or digital low-pass filter function that takes metadata parameters as input.

[0015] In global dimming systems, undesirable visual artifacts can occur. For example, consider a very dark scene with a small, bright light, such as a traffic light, slowly blinking. In this case, undesirable artifacts can exist due to pumping of the dark level. If the modulator's dynamic range is limited, the dark level in this scene increases when the signal is lit and decreases when the signal dims. In other words, the projector dark level is proportional to the source level. Because the bright light is small, it does not provide significant masking to the rest of the scene, and changes in the projector dark level are easily visible. With projectors that have a higher base (simultaneous) contrast, the artifact is less visible, but it may still be easily seen. Projectors typically used in digital cinema (DCI) projectors have a contrast ratio of about 2000:1, but enhanced DCI projectors can have a ratio of 8000:1 or higher. For example, a projector with a base simultaneous contrast ratio exceeding 1,000,000:1 may not benefit much from global dimming, and the resulting artifacts may not be visible. However, a projector with a contrast ratio (CR) of approximately 50,000:1 will benefit from global dimming, and projector dark level pumping may still be perceptible.

[0016] However, it is possible to mask these visual artifacts so that they are either not perceived by the observer or are only slightly perceived. This masking can be achieved using various techniques based on the human visual system, thereby reducing the visibility of these effects.

[0017] Technique 1 - Slow Dimming According to the "slow dimming" technique, when a bright light appears, the source light is increased so that the brightest part of the scene reaches the correct or desired brightness. Figure 1 illustrates the slow dimming technique. Specifically, Figure 1 shows the brightness levels of a projector display system as a function of time. In Figure 1, a series of peak levels 101 are shown, corresponding to the peak brightness levels of an image in a given frame. Curve 102 shows the performance of a projector display system, i.e., the peak white level that the projector display system can display at a given time. Curve 103 shows the dark level that the projector display system can display at that given time. In the specific example shown in Figure 1, this projector display system has a base contrast ratio of 1000:1, and the dark level curve 103 is 1 / 1000 of the peak white level curve 102. When this light disappears, the source light level slowly decreases. When a bright light reappears in the scene, the source light is quickly increased so that bright objects can be shown at the correct level. In this way, the source light is adjusted so that the rate of change in brightness is smooth. Projector dark level pumping can still be noticeable, especially during rapid dark-to-bright transitions, but it is often imperceptible because humans are less perceptive of slow changes than of rapid changes. Furthermore, it is not necessary to dim the light source so that the brightest parts of a scene are just covered. For example, if a scene changes from a bright area of ​​100 nits to 0.01 nits, the source light does not need to be reduced to 1 / 10,000th. Smaller reductions (partial dimming) can be used, which reduces the pumping effect, but partial dimming may have a less significant effect on reducing the projector dark level.

[0018] When bright areas are small, it may be advantageous to use a lower source light level than the one used to reproduce those areas with full detail. This results in bright objects becoming saturated and losing detail, but the projector dark level is lower. This is often a desirable trade-off, as the details of small, bright objects are difficult for observers to perceive. Based on image analysis and knowledge of the human visual system, the appropriate level to use can be determined. This is called small bright object (SBO) compensation.

[0019] Another point to consider is that light from the screen reflects off the walls of the auditorium and returns to the screen. As a result, the dark level is proportional to the total energy of the image on the screen. It is not strictly necessary to make the projector's dark level significantly lower than the room reflectance dark level, and this can be taken into consideration when adjusting the algorithm that determines the source level. This is called "room reflectance compensation." Since the amount of light reflected from the auditorium walls is at least partly based on the amount of light reflected from the screen, the room reflectance compensation algorithm may incorporate adjustments based on the screen gain.

[0020] The dimming speed may vary depending on one or more internal or external factors. For example, when there is a small, bright object, and the average pixel level (APL) is high, and / or the level of room reflection or ambient light is high, it may be preferable to provide relatively "fast" dimming compared to when the APL is low, and / or the level of room reflection or ambient light is low.

[0021] In addition to room reflection compensation, it is also possible to compensate for the dark level from the projector, which depends on the total energy of the image the projector is producing. This level is caused, for example, by scattering on the optical surfaces within the projector (e.g., by the projection lens). This can be called "lens veiling glare" or "lens veiling dark light." Since both room reflection dark light and veiling dark light depend on the APL, For the purposes of analysis and compensation, these effects may be combined into a single term.

[0022] Furthermore, it is possible to compensate for the effects of ambient light or "room ambient light" within the theater. When the ambient light level is high, there is less need to provide a large intensity of global dimming, as the ambient light effect will be dominant. The intensity of dimming can also be affected by the contrast ratio of the projected image. That is, if the projector / room system generates an image with a significantly higher contrast than the contrast specified in the image data, the return will decrease. From the image data, the darkest pixels in the scene can be calculated to determine the dark level that should actually be displayed on the screen. The result of this calculation can be added to the data used to calculate the amount of dimming.

[0023] The global dimming algorithm may be reset or reinitialized when there is a scene change in the image data. For example, the source level may be immediately reset to the peak level of the image when there is a scene change, and various parameters of the low-pass filter may be changed as appropriate to match the new image sequence. The timing of scene changes may be determined dynamically (for example, by monitoring the image data in the current or future frame), or by flagging them using metadata included with the image data.

[0024] The perceptibility of visual artifacts can also be influenced by sound. For example, higher sound pressure (e.g., loud explosion scenes) can reduce the human visual system's ability to perceive low-level dark areas. Therefore, during periods of high soundtrack volume, a lower intensity of global dimming may be used. Thus, an additional parameter that influences global dimming can be the sound pressure level.

[0025] Preferably, many or all of the above factors should be considered when determining the specific intensity and type of global dimming to apply. That is, the intensity and type of global dimming should be calculated to be the minimum amount of dimming necessary to match the total dark level generated by the system. Figure 2 shows an example of this for a specific (and arbitrary) frame sequence. In Figure 2, the upper line 201 represents the total light on the screen, i.e., APL. The lower line 202 represents the light reflected from the room and scattered from the projection lens onto the screen. As shown in Figure 2, reflected light provides a contribution of approximately 0.7%, representing typical audience conditions.

[0026] Technique 2 - Slow dimming using lookahead In the "look-ahead slow dimming" technique, the projector has information about the future peak level of each frame. This information may be included in metadata or determined by looking up each frame prior to playback. As with general slow dimming techniques, the source light changes slowly. Because the projector has information about future frames, it is possible to slowly increase the source light before bright light appears, further reducing the visibility of dark pumping. Furthermore, the gradient or speed of the change from one state to another may differ for different levels and different content (the correct transition speed and shape are determined by measurement and viewer observation). The transition can be very slow, sometimes in minutes, to track the adaptation speed of the human visual system. Partial dimming, SBO compensation, and room reflection compensation can also be used in this technique.

[0027] Figure 3 shows the brightness levels of the projector display system, including partial dimming and SBO clipping, as a function of time. Figure 3 shows a series of peak levels 301, which is , corresponds to the peak luminance level in the image in a given frame. Curve 302 shows the performance of the projector display system, i.e., the peak white level that the projector display system can display at a given time. Curve 303 shows the dark level that the projector display system can display at a given time. In the specific example shown in Figure 3, the projector display system has a base contrast ratio of 1000:1, so the dark level curve 303 is 1 / 1000 of the peak white level curve 302. Compared to the technique shown in Figure 1, Figure 3 shows that the luminance level of the projector display system can be increased prior to relatively bright frames or portions of frames. By increasing in this way, slower changes, and consequently, less perceptible intensity of projector dark level pumping, may be possible. In Figure 3, the two peak levels 304 correspond to SBOs. Using future frame data, the projector display system clips the SBOs such that the peak white level of the frame containing the SBO is lower than the actual peak level 304. This could potentially allow for frame regeneration with lower dark levels, and consequently, fewer visual artifacts for the viewer.

[0028] Technique 3 - Dimming using Dynamic Range Compression Techniques 1 and 2 both relate to "slow dimming," which yields a single image with the dynamic range of the base projector under steady-state conditions (except when partial dimming is used). In dimming techniques using "dynamic range compression," the dynamic range decreases, especially during transitions. This results in an image where dark area detail appears and disappears depending on the global dimming level. In bright scenes with high source levels, the dark area detail becomes obscured by the projector dark level. At lower levels, when there is no bright light and both the source level and projector dark level decrease, the dark area detail reappears. One solution to mitigate this effect is to dynamically change the shape of the tone curve during transitions and under different steady-state conditions. Figure 4 shows such a tone curve. In Figure 4, luminance (i.e., output level) is shown as a function of the image input level of a single frame at maximum luminance. The dashed line 401 corresponds to the projector dark level, and the dashed line 402 corresponds to the projector peak level. If the uncorrected tone curve 403 is implemented, luminance will simply correspond linearly to the image input level. However, the corrected tone curve 404 enables enhanced dark image detail (for low image input levels) and / or SBO detail (for high image input levels).

[0029] In other words, one example is increasing the level of the dark areas of an image that would normally be obscured by the projector dark level when (small area) high-luminance content is present on the screen and the source level is high. When there is no high-luminance content and the source level (and projector dark level) is low, the tone curve will return to linear. Variations using different shaped tone curves, including shapes that affect high-luminance content, may also be advantageous. For example, when small, bright objects are present, it may be advantageous to use an S-shape that allows detail of those small, bright objects (at lower modulation depths), while using a lower source level (but without losing detail) as described in Technique 1.

[0030] Technique 4 - Tuned Dimming It is also possible to incorporate "human-tuned" dimming. This can be achieved by generating metadata in mastering or color grading processes that explicitly adjust source levels using any of the above techniques, as well as human tuning. Alternatively, metadata can be provided that guides the in-projector algorithm that determines the appropriate level for the source using any of the above techniques and human tuning. The metadata provided above can be used by professionals with different functions. The metadata may include information for using multiple techniques to enable projector functionality. For example, the metadata provided may include a first set of information for use with projectors that support look-ahead, a second set of information for use with projectors that support partial dimming, and a third set of information for use with projectors that do not have additional feature support.

[0031] The above techniques can be used together. For example, slow dimming techniques (with or without lookahead) can be used in combination with dynamic range compression and / or human tuning. The above combination techniques can be further refined by including one or more of SBO compensation, partial dimming, and room reflection compensation.

[0032] Furthermore, Figures 1 and 3-4 show tone curves illustrating the illumination level of an image compared to the peak and dark levels of a projector. However, it is also possible to individually change the color components of an image while maintaining their hue. For example, if a small, bright object is red, the tone curves shown in Figures 1 and 3-4 can be applied to the red light in the projector, but not to the blue or green light.

[0033] In each of the above technologies, various parameters (e.g., characteristics related to room reflection, ambient light, etc.) can be measured and input into the algorithm to calculate dimming in real time. Alternatively, various parameters can be measured and manually input into the algorithm during calibration. In some embodiments of this disclosure, some parameters may be measured and input during calibration, while other parameters may be measured and input in real time.

[0034] Examples Figures 5 to 10 show examples of dark level contributions for a series of specific projectors and rooms. Details of the projector and room configurations are shown in Table 1 below. TIFF0007855643000001.tif25152

[0035] In Table 1, "MPPL" represents the maximum projector peak level (in nits), PBCR represents the projector base contrast ratio (1600:1 for DCI 4K), RRR represents the room reflectance ratio (APL: room reflectance dark level) (including the baying glare term), ADL represents the ambient dark level, and SFRR represents the safety factor for room reflectance and ambient light. The safety factor is the margin used by a particular global dimming algorithm to determine how far away the projector dark light is from the total dark level. This specifies how much more dark light (of the total dark light) is contributed by the projector. The above values ​​are just examples.

[0036] Figure 5 shows the total dark level contribution of Example 1, which is a high-contrast (50000) projector. Specifically, Figure 5 shows the room reflection / bailing glare dark level contribution (dashed line 501), projector dark level contribution (dotted line 502), ambient room dark level contribution (long dashed line 503), image dark level contribution (short dashed line 504), and total dark level contribution (solid line 505).

[0037] Figure 6 shows the effect of basic global dimming in Example 1. (Specific illustrations in Figure 6) In this context, the global dimming algorithm corresponds to an instantaneous method in which the peak level of the image in each frame is directly tracked by the source level. This may be called instantaneous global dimming or "highest peak" global dimming. The instantaneous method is chosen for convenience of explanation. Figure 6 shows the projector peak level and image peak level (solid line 601), APL (short dashed line 602), room reflection / bailing glare dark level contribution (dotted line 603), image dark level contribution (single dashed line 604), ambient dark level contribution (double dashed line 605), projector dark level contribution (single double dashed line 606), and total dark level contribution (dashed line 607).

[0038] As seen in Figure 6, the projector system provides an image close to what could be achieved in the room for most frames. The projector dark level contribution 606 does not significantly contribute to the total 607. For the most part, the room reflection / bailing glare dark level contribution 603 dominates the system. In frames 1-4, the image dark level contribution 604 is dominant. In this figure, the global dimming algorithm makes a large change to the projector peak level 601. For example, the ratio of frame 14 to frame 12 is 100:1. This can result in visible dark level pumping in darker scenes.

[0039] For comparison, Figure 7 shows the effect of compensation for room reflection / bailing glare, ambient and image dark level contributions in the global dimming algorithm in Example 1. Figure 7 shows the projector peak level and image peak level (solid line 701), APL (short dashed line 702), room reflection / bailing glare dark level contribution (dotted line 703), image dark level contribution (single dashed line 704), ambient dark level contribution (double dashed line 705), projector dark level contribution (single dashed line 706), and total dark level contribution (dashed line 707). Comparing APL702 in Figure 7 with APL602 in Figure 6, it can be seen that the results are substantially the same. That is, the image peak levels are roughly the same in Figure 6 and Figure 7, but in the case of Figure 7, the projector achieves the same objective without implementing a much higher intensity of source dimming. This can be called the "minimal dimming" principle. The underlying idea of ​​the minimal dimming principle is to take into account other dark light sources on the screen and dim the projector only by the minimum amount necessary to achieve substantially the same result as that obtained by full dimming.

[0040] Figures 8 to 10 show simplified versions of the dark level contribution, instantaneous global dimming, and compensated global dimming ("minimal dimming") for Example 2, which is a relatively low-contrast (5000) projector compared to Example 1. Figures 8 to 10 can be considered simplified analogues of Figures 5 to 7, respectively.

[0041] Figure 8 shows the desired dark level of the image (dotted line 801), the actual dark level on the screen (dashed line 802), and the ambient dark level (double dotted line 803). In Figure 8, no global dimming is performed. Figure 9 shows the desired dark level of the image (dotted line 901), the actual dark level on the screen (dashed line 902), the ambient dark level (double dotted line 903), and the projector peak level (solid line 904). In Figure 9, instantaneous global dimming is performed. Figure 10 shows the desired dark level of the image (dotted line 1001), the actual dark level on the screen (dashed line 1002), the ambient dark level (double dotted line 1003), and the projector peak level (solid line 1004). In Figure 10, minimal global dimming is performed.

[0042] Overall, Figures 8-10 show that minimal global dimming, with relatively little source dimming, delivers roughly the same performance as peak global dimming. However, for lower contrast ratio projectors (Example 2), The minimal global dimming algorithm involves more modulation than the high contrast ratio projector (Example 1). In situations where the room is very dark and the content is high contrast, and the projector base contrast ratio is low, the minimal dimming algorithm approaches the maximum peak dimming algorithm even more closely. Also, in situations where the room is not dark or the image content is low contrast and a high base contrast ratio projector is used, the minimal dimming algorithm completely stops modulation as needed.

[0043] Projector display system Figure 11 illustrates an exemplary projection system in various aspects of the present disclosure. Specifically, Figure 11 shows a projector 1110 comprising a light source 1111, an optical modulator 1112, a controller 1113 operably connected to the light source 1111, and projection optics 1114. The projector 1110 projects light toward a screen 1120. In practice, the projector 1110 may include additional elements such as memory, input / output ports, communication circuits, and a power supply. Furthermore, the projector 1110 may include additional optical elements such as mirrors, lenses, waveguides, optical fibers, beam splitters, diffusers, and additional spatial light modulators (SLMs). For convenience of explanation, these additional elements are not shown here.

[0044] The light source 1111 may be, for example, a laser light source, a high-voltage discharge lamp, an LED, etc. In some embodiments of this disclosure, the light source 1111 may include a plurality of light sources 1111, each corresponding to a different wavelength or wavelength band. The light source 1111 emits light in response to an image signal provided by the controller 1113. The controller 1113 may be, for example, a processor such as the central processing unit (CPU) of the projector 1110. In one example, the optical modulator 1112 may be an SLM including a reflective SLM or a transmissive SLM. The optical modulator 1112 may be a liquid crystal on silicon (LCOS) SLM, a digital micromirror device (DMD), a light bulb, etc. The controller 1113 also controls the optical modulator 1112 that receives light from the light source 1111. The optical modulator 1112 modulates the light with spatial changes such as phase modulation and directs the modulated light toward the projection optical system 1114. The projection optical system 1114 may include one or more lenses and / or other optical elements, so that light from the light source 1111 forms an image on the screen 1120.

[0045] In some embodiments of this disclosure, the projector 1110 may include one or more sensors for determining various parameters (e.g., characteristics related to room reflection, ambient light, etc.) in real time. In other embodiments of this disclosure, one or more sensors may be located outside the projector 1110, and the projector may include elements (e.g., the input / output ports described above) for receiving parameter data from the sensors in real time. Parameters detected in real time may be stored in memory such as RAM. If parameters are not detected or determined in real time, the data may be manually entered during calibration and stored in memory such as a hard disk. Different parameters may be detected or determined in different ways, such as some parameters being determined by internal sensors, others by external sensors, and still others being manually entered during calibration.

[0046] Projector display method Figure 12 shows an exemplary projector display method. This exemplary method is performed, or can be performed, using a non-temporary computer-readable medium that stores instructions that, when executed by an electronic processor, cause one or more of the processes described in Figure 12 to be performed. Non-temporary computer-readable mediums include, for example, removable storage devices such as RAM, hard disks, flash memory, and optical disks, which can store data temporarily, permanently, and This includes any elements configured to be preserved semi-permanently. This exemplary method can be carried out in a projector display device such as the projector 1110 described in relation to Figure 11.

[0047] In step 1201, the projector display device receives content data. The content data may be received from an external data source, for example, by a wired or wireless connection. Alternatively, the content data may be received from an internal data source, such as an internal storage device or a removable storage device. In some embodiments of this disclosure, the content data is received by a controller of the projector display device, such as the controller 1113 described in relation to Figure 11. After receiving the content data, in step 1202, the projector display device emits light according to the content data. In one example, the controller 1113 causes the light source 1111 to emit light with a brightness determined by the content data.

[0048] In step 1203, the projector display device modulates the emitted light. For example, the controller 1113 causes the optical modulator 1112 to perform spatially modulated modulation on the light emitted from the light source 1111. In step 1204, the projector display device adjusts the light level based on content data and metadata about future frames. In this way, the projection display device reduces the perceived likelihood of visual artifacts. For example, the controller 1113 can receive metadata from an internal or external data source and adjust the light source 1111 accordingly.

[0049] The controller 1113 can be configured to adjust the light source 1111 in various ways. For example, the controller can adjust the light level emitted from the light source 1111 by performing partial dimming, SBO compensation, or dynamic range compression. When adjusting the light level, the controller 1113 can perform pulse skipping on the light source 1111 itself, amplitude modulation on the light source 1111 itself, or attenuation of the light emitted from the light source 1111. If the light source 1111 consists of multiple individual light sources, the controller 1113 can adjust the light level of each light source collectively or individually. In some examples, steps 1202 to 1204 may be repeated frame by frame to display a moving image (video). Specific adjustments can be implemented using any one or more of the dimming techniques described above.

[0050] conclusion With respect to the processes, systems, methods, heuristics, etc., described herein, each step of such process, etc., has been described as occurring in a certain sequence, but it should be understood that the process can also be carried out by performing each step in an order other than that described herein. Furthermore, it should be understood that it is possible to perform certain steps simultaneously, to add other steps, or to omit certain steps described herein. In other words, the descriptions of processes herein are provided for the purpose of illustrating certain aspects of this disclosure and should not be construed in any way as limiting the scope of the claims.

[0051] Therefore, it should be understood that the above description is illustrative and not restrictive. Many other embodiments and uses beyond those described will become apparent upon reading the above description. The above scope should be determined not by referring to the above description, but by referring to the appended claims and the entire scope of equivalents to which said claims are entitled. It is anticipated and intended that the technology discussed herein will develop further and that the systems and methods disclosed herein will be incorporated into such future embodiments. In short, this application is intended to be modified and transformed It should be understood that this is possible.

[0052] Various aspects of this disclosure may take any one or more of the following configurations:

[0053] (1) A projection display system comprising: a light source configured to emit light in accordance with content data; an optical modulator configured to modulate the light; and a controller configured to reduce the likelihood of visual artifacts being perceived by adjusting the light level of the projection display system based on the content data and metadata relating to future frames.

[0054] (2) The projection display system according to (1), wherein the content data includes image data and at least one of ambient condition data, metadata relating to the future frame, mastering metadata, color grading metadata, or projector performance data.

[0055] (3) The projection display system according to (2), wherein the projector performance data includes data corresponding to the baling glare characteristics of the projection display system.

[0056] (4) The projection display system according to (2) or (3), wherein the ambient condition data includes at least one of data corresponding to room reflection characteristics, data corresponding to screen gain, or data corresponding to ambient light level.

[0057] (5) The projection display system according to any one of (1) to (4), wherein the controller is configured to adjust the light level of the projection display system by performing partial dimming.

[0058] (6) The projection display system according to any one of (1) to (5), wherein the controller is configured to adjust the light level of the projection display system by adjusting at least one of the brightness of the light source or the rate of change of the brightness of the light source.

[0059] (7) The projection display system according to any one of (1) to (6), wherein the controller is configured to adjust the light level of the projection display system by performing compensation for small, bright objects.

[0060] (8) The projection display system according to any one of (1) to (7), wherein the controller is configured to adjust the light level of the projection display system by compressing the dynamic range.

[0061] (9) The projection display system according to any one of (1) to (8), wherein the light source is a laser light source configured to emit the light.

[0062] (10) The projection display system according to (9), wherein the controller is configured to adjust the light level of the projection display system by performing at least one of the following: pulse skipping with respect to the laser light source, amplitude modulation with respect to the laser light source, or attenuation of the light.

[0063] (11) The light source comprises a first light-emitting device configured to emit light of a first color, a second light-emitting device configured to emit light of a second color, and a device configured to emit light of a third color A projection display system according to any one of (1) to (10), comprising a third light-emitting device.

[0064] (12) The projection display system according to (11), wherein the controller is configured to individually adjust the light levels of the first color light, the second color light, and the third color light.

[0065] (13) The projection display system according to (11), wherein the controller is configured to adjust the light levels of the first color light, the second color light, and the third color light all at once.

[0066] (14) The projection display system according to any one of (1) to (13), wherein the visual artifact is a dark pumping effect.

[0067] (15) When performed by the processor of a projection display system equipped with a light source and an optical modulator, receiving content data, Reducing the perceptibility of visual artifacts by emitting light from the light source in accordance with the content data, modulating the light with the optical modulator, and adjusting the light level of the projection display system based on the content data and metadata relating to future frames, A non-temporary computer-readable medium storing instructions for causing the projection display system to perform a process that includes the above.

[0068] (16) The non-temporary computer-readable medium as in (15), wherein the content data includes image data and at least one of ambient conditions data, metadata relating to the future frame, mastering metadata, color grading metadata, or projector performance data.

[0069] (17) The projector performance data includes data corresponding to the baying glare characteristics of the projection display system, in a non-temporary computer-readable medium as described in (16).

[0070] (18) The ambient condition data includes at least one of data corresponding to room reflectance characteristics, data corresponding to screen gain, or data corresponding to ambient light level, in a non-temporary computer-readable medium as described in (16) or (17).

[0071] (19) Adjustment of the light level of the projection display system includes partial dimming, as described in any one of paragraphs (15) to (18) for non-transient computer-readable media.

[0072] (20) A non-temporary computer-readable medium according to any one of (15) to (19), wherein the adjustment of the light level of the projection display system includes adjusting at least one of the brightness of the light source or the rate of change of the brightness of the light source.

[0073] (21) The adjustment of the light level of the projection display system includes providing compensation for small, bright objects, as described in any one of paragraphs (15) to (20), for a non-transient computer-readable medium.

[0074] (22) Adjustment of the light level of the projection display system includes compressing the dynamic range, which is a non-temporary compression as described in any one of paragraphs (15) to (21). A computer-readable medium.

[0075] (23) The non-transient computer-readable medium according to any one of (15) to (22), wherein the light source is a laser light source configured to emit the light.

[0076] (24) A non-transient computer-readable medium according to (23), wherein the adjustment of the light level of the projection display system includes performing at least one of pulse skipping, amplitude modulation, or attenuation of the light with respect to the laser light source.

[0077] (25) A non-temporary computer-readable medium according to any one of (15) to (24), wherein the emission of light includes emission of a first color of light from a first light-emitting device of the light source, emission of a second color of light from a second light-emitting device of the light source, and emission of a third color of light from a third light-emitting device of the light source.

[0078] (26) The non-temporary computer-readable media according to (25), wherein the adjustment of the light levels of the projection display system includes adjusting the light levels of the first color light, the second color light and the third color light individually.

[0079] (27) The non-temporary computer-readable medium according to (25), wherein the adjustment of the light level of the projection display system includes adjusting the light levels of the first color light, the second color light and the third color light together.

[0080] (28) The projection display system according to any one of (15) to (27), wherein the visual artifact is a dark pumping effect.

Claims

1. A light source configured to emit light according to content data including the volume of the soundtrack, An optical modulator configured to modulate the aforementioned light, A controller that performs global dimming by adjusting the brightness of the light source in accordance with the content data, the controller configured to reduce the perceived likelihood of visual artifacts caused by fluctuations in the brightness of dark areas in an image formed by the optical modulator during global dimming by adjusting the rate of change of the brightness of the light source based on the content data and performing global dimming of a lower intensity during periods when the volume of the soundtrack is higher, A projection display system equipped with [a specific feature].

2. The projection display system according to claim 1, wherein the controller is configured to adjust the rate of change of the brightness of the light source based on the content data and metadata relating to future frames.

3. The projection display system according to claim 1, wherein the light source includes a first light-emitting device configured to emit light of a first color, a second light-emitting device configured to emit light of a second color, and a third light-emitting device configured to emit light of a third color.

4. The projection display system according to claim 3, wherein the controller is configured to individually adjust the light levels of the first color light, the second color light, and the third color light.

5. The projection display system according to claim 3, wherein the controller is configured to adjust the light levels of the first color light, the second color light, and the third color light all at once.

Images