Method and system for activating an active display

Abstract

The present invention relates to a method for operating an active display having an array of active light emitting elements, the method comprising: The first image data sequence (F0 k providing a first feed of A second image data sequence (F1 k ,C1 k ;F2 k ,C2 k ;F3 k ,C3 k ) providing at least one second feed of each image combination (F1 k and C1 k ;F2 k and C2 k ;F3 k and C3 k ) results in a homogenous gray image. k ;F2 k ;F3 k ) and a second complementary image data sequence (C1 k ;C2 k ;C3 k ) in at least a second feed; selecting a reference frame rate (SFR) at which the first and at least second sequences of image data are presented to an active display; Operate an active display at a display high frame rate (HDFR) containing nd HDFR image slots / slice in a reference frame rate time interval ΔT=1 / SFR of a reference frame rate (SFR), each HDFR image slot being: [0080] Duration τ according to TIFF2024521230000009.tif54166 i and presenting image data of the first feed and at least the second feed in a time slice multiplexed manner in nd HDFR image slots of each reference frame rate time interval to an active display; At least two feeds, the first feed and at least one second feed, are a combination of image data and complementary image data (F1 k and C1 k ;F2 k and C2 k ;F3 k and C3 k ) and the gray images are presented to the active display with equal luminance and uniformly distributed within the nd HDFR image slots in such a way that luminance changes in the active display occur at a frequency greater than or equal to twice the reference frame rate (SFR).

Description

[Technical Field]

[0001] The present invention relates to a method and system for operating an active display, particularly an LED display, wherein two or more image data sequences are displayed on the active display in a time-slice multiplexing manner. [Background technology]

[0002] In recent years, active displays such as light-emitting diode (LED) displays have been found in a variety of applications, ranging from computer displays or television screens in office or home environments where a single display or two or three independent displays are typically used, to large-scale applications in the advertising or entertainment industry where numerous LED panels are seamlessly joined to form LED rows or LED walls. In the context of this application, LED displays are primarily referred to as a general example of active displays, but it will be apparent that the techniques described herein can also be applied to other types of active displays, particularly pixel-based active displays such as active-matrix organic light-emitting diode (AMOLED) displays, plasma displays, or quantum dot displays. Furthermore, in the context of this application, horizontal or vertical LED display rows or LED panels refer to individual LED displays / panels joined in one dimension (e.g., as horizontal rows or vertical columns), while an LED wall refers to a number of LED panels joined in two dimensions. In addition to displaying the same image data / video content on each panel, appropriate control equipment is generally used to distribute each image frame to the available number of LED panels, so that the viewer gets the impression of a single display with enormous dimensions. Furthermore, in the context of the present invention, a sequence of image data displayed on an active display is also referred to as a “video stream.” Generally, the term “video stream” refers to any type of image content displayed on an LED display, such as an actual video stream of a sequence of continuously displayed image frames, or a still image, a monochrome still image. In this sense, “video stream” also includes cases in which a single still image is presented on an LED display only once, that is, without the need to change the image content or retransmitted image content, at a certain frame rate.

[0003] LED or OLED (AMOLED) displays are common display technologies found in a wide variety of applications, from TV or computer screens to media displays in vehicles and mobile phones. LED displays in wall, row, or column configurations are widely used as billboards or signs to convey information or advertisements to viewers. Furthermore, LED walls have recently become increasingly popular in the entertainment industry for providing backgrounds and lighting in virtual studio facilities.

[0004] In the past, a single, dedicated image data sequence (or a single video stream) was displayed on the active display. However, in recent years, new technological developments have necessitated the insertion of additional image content into image data sequences, resulting in individual images (or frames) from different image data sequences being arranged alternately. In these cases, only one image data sequence (referred to here as the "first image data sequence") is intended to be seen in the sense that it is directly perceived by the viewer, while the additional image data sequences arranged alternately are usually hidden so that they are not directly seen or perceived by the viewer.

[0005] In typical applications, an active display is part of a scene captured / photographed by a camera, such as a video camera or a still camera.

[0006] One of these applications relates to a virtual studio in which a wall made of LED displays, particularly fine-pitch displays, replaces conventional green or blue screen background panels / screens. This allows the background scene to be presented on the LED wall while the foreground is being filmed along with the background (i.e., as a first processing of the image data), which significantly reduces the amount of video post-production. As described in Patent Document 1 by the applicant, it may be beneficial to present additional image data sequences, such as chroma key image data and / or tracking pattern image data, on the LED display, alternating with the first image data sequence, in order to determine the position and relative orientation of the LED display and the camera capturing the scene within the scene.

[0007] In other applications, it may be required that viewers directly see features or information that should not be captured by the camera, such as text prompting or some kind of locator that is unnecessary for recording a scene with a camera.

[0008] Another application relates to so-called "virtual advertising." At sporting events such as football matches, numerous LED displays are typically installed in the stadium to show advertising content during the event. When footage of sporting events is broadcast worldwide, specific advertising content from the event will also be visible in the video. However, some advertisements are relevant only to the audience in a particular location, and more importantly, an advertisement permitted in one country may even be prohibited by law in another. Virtual advertising solves these problems by identifying the LED displays in the captured video and replacing the actual content shown in the stadium with alternative content, depending on the target audience. In this regard, it is necessary not only to identify the location of the LED displays in the image, but also to identify the position and orientation of the camera relative to specific LED displays. Therefore, in the context of virtual advertising, the same problems as in video studios arise at sporting events; for example, by introducing additional image content such as chroma key images and tracking patterns, the location of the LED displays and the orientation of the camera can be identified.

[0009] As an alternative solution to the virtual advertising technology described above, the applicant has developed a method that enables different image content targeting different audiences to be displayed on an active display such as an LED sign using a time-slice multiplexing scheme. One or more video cameras generate video of a scene synchronized to different image data sequences displayed on the active display, so that multiple video recordings of scenes are created that show different images on the LED sign, although the overall scene is identical. This technology is described, for example, in the applicant's Patent Document 2.

[0010] The technologies described above demonstrate that active displays, such as LED panels, have numerous applications where they are part of a scene recorded by a video camera, TV camera, still camera, or mobile phone / tablet camera, and these active displays show different image content in a time-slice multiplexing manner. In all of these applications, the camera is not only recording the scene, but also a person (hereinafter referred to as "person" or "direct viewer") who is part of the scene, for example, an audience member at a sporting or entertainment event, an actor, or a studio staff member at a film studio, and therefore a person (hereinafter referred to as "person" or "direct viewer") is viewing the scene, including the active displays present in the scene. When these active displays are operated in a way that different image data sequences are presented in a time-slice multiplexing manner, generally only one of these image sequences is intended to be seen or recognized by a person present in or near the scene. Patent Document 3 proposes that the additional image data sequence is presented only for a small portion of the time interval of the recording frame rate, so that the person does not see or recognize the relevant image content. In Patent Document 2 by the applicant of the present application, this concept is further developed by proposing that additional image data sequences be presented as images and corresponding inverse / interpolated image sequences. [Prior art documents] [Patent Documents]

[0011] [Patent Document 1] European Patent Application Publication No. 21169258.7 Specification [Patent Document 2] International Publication No. 2018 / 138366 [Patent Document 3] U.S. Patent Application Publication No. 2009 / 102957 [Overview of the project] [Problems that the invention aims to solve]

[0012] However, several problems can arise when two or more unrelated image data sequences are arranged alternately. Even the introduction of very short additional image data can cause noticeable flickering of the active display, even if the image data itself is not perceptible. Furthermore, because the human eye integrates images within its temporal resolution (typically in the range of 40 milliseconds), the introduction of additional image data will result in a noticeable increase in the black level of the first image data sequence that the viewer directly sees or perceives, particularly in the dark areas of the image. [Means for solving the problem]

[0013] Therefore, the object of the present invention is to provide a method and system for presenting different image data sequences in a time-slice multiplexing manner on one or more active displays that are part of a scene, in such a way that a person present in or near the scene can obtain an improved viewing experience of a first image data sequence that they are intended to see, particularly in terms of minimizing flicker and avoiding a significant increase in the black level, while enabling the recording of a scene synchronized with one or more image data sequences under a wide range of ambient lighting conditions. Furthermore, modern video or film studios employ control systems that can bring all light sources to the same level through a single control device. To avoid flicker, vibration, fading effects, etc., it is necessary to synchronize all of these light sources.

[0014] This technical problem is solved by the method specified in claim 1 of this application. Further embodiments of the present invention are subject to the dependent claims.

[0015] Therefore, the present invention relates to a method for operating an active display comprising an array of active light-emitting elements, the method being, The first image data sequence (F0) is intended to be viewed directly by the viewer. k The steps include providing the first feed of ) and Step of providing at least one second feed of a second image data sequence (F1 k , C1 k ; F2 k , C2 k ; F3 k , C3 k ), wherein for each combination of images (F1 k and C1 k , F2 k and C2 k , F3 k and C3 k ), a homogeneous gray image is obtained as a result, the second image data sequence (F1 k ; F2 k ; F3 k ) and a second complementary image data sequence consisting of the reverse / complementary image data of the second image data sequence (C1 k ; C2 k ; C3 k ) are included in at least the second feed, Step of selecting a reference frame rate (SFR) when the first and at least the second image data sequences are presented on an active display, At the reference frame rate time interval ΔT = 1 / SFR of the reference frame rate (SFR), the active display is operated at a display high frame rate (HDFR) including nd HDFR image slots / slices, and each HDFR image slot

Number

[0016] According to the present invention, an "active display" is an array of active optical elements capable of emitting light when an electric current passes through them, such as LEDs, AMOLED arrays, plasma cell arrays, or quantum dot arrays. In the sense of the present invention, the term "light" refers to electromagnetic radiation, as normally written using the term "light," particularly visible light having wavelengths in the range of 400 nm to 700 nm, as well as infrared radiation with longer wavelengths and ultraviolet radiation with shorter wavelengths.

[0017] In the context of this invention, “feed” refers to a sequence of related image data, which may be a sequence of image data frames of a video. A feed is characterized by a rate, which is referred to as “image data” in this invention, but a new data content instance is presented that can also be considered as individual images or “frames.” In the context of video, the frame rate of the feed defines the “reference frame rate.” In the context of this invention, the minimum reference frame rate is around the fusion rate of the human eye, that is, the rate at which the human eye can no longer distinguish individual images and views them as a video stream. Generally, the minimum reference frame rate in this context is around 24Hz or 25Hz. However, higher reference frame rates such as 50Hz or 60Hz are more common. "Image data sequence" in the sense of the present invention Fx kThis is a sequence of two-dimensional image information x (x=1,2,3,...) transmitted to or stored on an active display. One element k of the image data sequence generally represents a single individual image shown on the active display, and subsequent images (k+1,k+2,...) of a given image data sequence are presented on the physical display at subsequent reference frame rate time intervals ΔT=1 / SFR. In the reference frame rate time interval ΔT, a given image of each image data sequence may be presented one or more times. Each individual image data sequence generally represents a video stream shown on the active display, where the image content may change from one image in the sequence to subsequent images in the sequence. The image content from one image to a subsequent image may, however, remain unchanged if, for example, no movement is observed in the video stream. In other embodiments, the image data sequence may also include still images shown over several reference frame rate time intervals ΔT. In other embodiments, the image data sequence may include only a single type of image that does not change at all throughout the entire image data sequence, such as a monochrome image or a tracking pattern image.

[0018] In the concept of this invention, the term "direct viewer" refers to a person who is present in the venue / scene where the active display is operating and is able to directly view the active display.

[0019] The phrase "intended to be seen directly by the viewer" means, for example, in the form of a still image or a sequence of still images, or in a manner in which the image data sequence is presented in such a way that the viewer can directly see / recognize it as part of the video, such as when the image data sequence is presented in a manner in which the individual images are not temporally separated, such as the first image data sequence F0 k This means that the first image data sequence F0 k This feed is also referred to as the "venue feed."

[0020] The phrase "not intended to be seen directly by the viewer" refers to an additional image data sequence F1 in which light emitted from the active display corresponding to the images in the image data sequence reaches the viewer's eyes directly, but the corresponding images are presented in a way that the human eye cannot see / recognize the image data. k ,C1 k ;F2 k ,C2 k ;F3 k ,C3 k This indicates the presentation of the image. This refers not only to the temporal resolution of the image presentation, but more broadly to the fact that the image data is presented in a way that makes it impossible to see or recognize individual images or image sequences. Additional image data sequence F1 k F2 k F3 k This is referred to as "parallel feed".

[0021] To effectively "hide" at least one additional image data sequence from being directly recognized or perceived by the viewer, the time-integrated luminance of the image of the first image data sequence presented at a reference frame rate time interval ΔT=1 / SFR is preferably higher than the time-integrated luminance of the image of at least one additional image data sequence presented at that time interval. If additional image data sequences are presented multiple times, the time-integrated luminance of the first image data sequence intended for the direct viewer is preferably higher than the sum of the time-integrated luminances of all additional image data sequences not intended for direct viewer viewing. Preferably, the time-integrated luminance of the first image data sequence is at least twice, more preferably at least four times higher.

[0022] To further reduce the influence of additional image data sequences on the first image data sequence, at least one additional image data sequence may be at least the second image data sequence (F1 k ;F2 k ;F3 k ) and at least a second complementary image data sequence (C1) consisting of the reverse or complementary image data of the second image data sequence.k ;C2 k ;C3 k ) includes. Therefore, each image F1 of the second image data sequence k This is the inverse / interpolated image C1 within the same reference frame rate time interval ΔT=1 / SFR. k These are arranged alternately. The introduction of inverse images to reduce flicker of the active display to the direct viewer has already been described in detail in the applicant's Patent Document 2. In one embodiment, the additional image data sequence includes a pair sequence of image data and an inverse / interpolated image, and the time-integrated luminance when the image of the first image data sequence is presented at a reference frame rate time interval ΔT=1 / SFR is lower than the time-integrated luminance of the image of at least one additional image data sequence presented at that time interval. Despite the generally significant increase in the gray level resulting from the combination of the images of the additional image data sequence and the inverse image, the first image data sequence is still visible / perceptible to the direct viewer. For example, the first image data sequence may be presented in only a portion, for example, half or one-third of the reference frame rate time interval.

[0023] According to the method of the present invention, an appropriate reference frame rate for when the image data is presented on the active display is selected based on a first and at least a second feed of the image data sequence. If the feed represents video data, the appropriate reference frame rate corresponds to the reference frame rate for recording the video.

[0024] The Active Display operates at a Display High Frame Rate (HDFR) higher than the reference frame rate, such that a certain number of nd HDFR image slots / slice can be presented in each reference frame rate time interval. As mentioned above, each reference frame rate time interval presents at least a first feed directed at the direct viewer and a second feed not directed at the direct viewer. Consequently, the number of nd HDFR image slots / slice per reference frame rate time interval is at least 2, preferably when the complementary image data of the second feed is mixed with the images directed at the direct viewer and the nd is much higher, at least 4, 8, 12, 16, or 24. Thus, each reference frame rate time interval is subdivided into P nd slots / slice, each of which can present different image data. Within the range of nd image slots / slice in a given reference frame rate time interval, only the image data corresponding to this frame at the reference frame rate of the original feed is presented, although each image content instance can be presented multiple times. Preferably, each image data content instance of the first feed directed at the direct viewer is presented in a number of available nd HDFR image slots / slice.

[0025] According to the present invention, image data from a first feed and at least a second feed, i.e., corresponding image data content instances for each reference frame rate time interval, are presented in a time slice multiplexing scheme and distributed within the nd HDFR image slots for each reference frame rate time interval.

[0026] To further reduce flicker, the present invention proposes that at least two feeds, the at least first feed and the at least one second feed, include the gray image obtained from a combination of image data and interpolated / inverse image data. The gray images of the at least two feeds are presented on the active display at equal brightness and are uniformly distributed within the HDFR image slots such that the brightness changes of the active display occur at a frequency of at least twice the reference frame rate.

[0027] According to the present invention, one feed intended for direct viewing is always provided, and the insertion of image data not intended for direct viewing causes flickering of the impression of the first feed. In the first step already described in the prior art, flickering is reduced by presenting these additional feeds as a combination of image data and complementary image data. Nevertheless, some noticeable flickering remains, and the present invention proposes to further reduce flickering to the direct viewer by ensuring the provision of at least two feeds, including gray images resulting from the combination of an image and its respective inverse / complementary image. When presenting gray images to the active display, the present invention proposes to ensure that each gray image, even if derived from a different feed, is presented to the active display at equal brightness. Furthermore, according to the present invention, gray images are uniformly distributed within the HDFR image slots / slice in such a manner that the brightness changes of the active display occur at a frequency of at least twice the reference frame rate (SFR). Uniform distribution means that for the gray image distribution within each reference frame rate time interval, even considering subsequent reference frame rate time intervals, it occurs at a frequency of at least twice the reference frame rate. This means that the resulting grayscale image will not end up with multiple frequency components, but will be distributed using only a single frequency that is an integer multiple of the reference frame rate.

[0028] The term "luminance" is also known as "nit," which is candela per square meter (cd / m²). 2This refers to a photometric measure of the luminous intensity per unit area of ​​an active display, measured by ). In contrast, "brightness" refers to the subjective impression of objective luminance, but is therefore closely related to luminance. In the context of this invention, the term "luminance" also has a temporal component that takes into account the duration of individual slots / slice within a reference frame rate time interval. The temporal component may be ignored when each reference frame rate time interval is subdivided into slots / slice of equal duration, but when slots / slice of different durations are compared with each other, "luminance" in the sense of this invention refers to the luminous intensity per unit area of ​​an active display multiplied by the individual length of each slot / slice.

[0029] In the physiology of the human eye, it is known that the critical fusion frequency (i.e., the lowest frequency at which flicker disappears) is proportional to the logarithm of the light intensity (Ferry-Porter law). In the context of the present invention, the applicant has found that the flicker experience depends on the brightness of both the content intended to be directly viewed by the viewer (first image data sequence) and the "hidden content" (subsequent image data sequence) that is captured by the human eye but not intended to be directly viewed / perceived by the viewer. The applicant has found that at frequencies of 100 Hz or higher, flicker is not perceived by the human eye of the direct viewer. However, in dark light conditions and / or when displaying dark content, low frequencies are also generally accepted by the human eye without usually introducing flicker. Therefore, preferably, the brightness changes of the active display occur at frequencies higher than 100 Hz, preferably higher than 120 Hz, and particularly preferably higher than 200 Hz.

[0030] In many embodiments of the present invention, there will be a first feed intended for direct viewing and a plurality of second feeds not intended for direct viewing, such as a second feed and a third feed. Since the second feeds (i.e., second feed, third feed, fourth feed, etc.) are always presented as a combination of an image and an inverted image, the above requirement that at least two feeds containing grayscale images are provided can be satisfied.

[0031] However, in certain embodiments of the present invention, the above requirement of providing two feeds, one containing an image and an inverse image that create a grayscale image, particularly in embodiments where there is only a first feed and one second feed, i.e., no additional second feed (no additional third, fourth, etc. feeds), can only be satisfied when the first feed also contains the image and its respective complementary / inverse image. Since a mere combination of an image and an inverse image "hides" the image itself so that it is not perceived by the direct viewer, in such embodiments, the image data of the first feed is presented in more HDFR image slots than the complementary image so that a net visible image remains for the direct viewer of the first feed. However, the combination of an image and its respective complementary / inverse image in the first feed ensures that the criterion of uniformly distributing the grayscale image within the HDFR slots so that luminance changes occur at a rate of more than twice the reference frame rate is satisfied.

[0032] According to a preferred embodiment of the present invention, the second image data sequence (F1 k ;F2 k ;F3 k ) image and the second complementary image data sequence (C1 k ;C2 k ;C3 k Each pair (F1) with the inverse / interpolated image of ) k ,C1 k ;F2 k ,C2 k ;F3 k ,C3 kThe images are presented within a time interval of 3.3 milliseconds or less. Active display flicker and motion blur for the direct viewer can be minimized particularly effectively when the corresponding image and the interpolated / reverse image are presented within the aforementioned 3.3-millisecond time interval. In many applications of the concept of the present invention, the second image data sequence includes images intended to be captured by a properly synchronized video camera (see Patent Document 2). To enable the capture of bright images, the duration for which the images in the second image data sequence are presented is preferably as long as possible. To satisfy the 3.3-millisecond constraint, interpolated images may also be presented in time slots immediately before and after the HDFR time slot of the second image data sequence.

[0033] In one embodiment of the present invention, a corresponding complementary image data sequence is provided for each additional image data sequence.

[0034] The additional image data sequence may include various image or video streams. For example, the additional image data sequence may include alternative advertising content captured by a properly synchronized video camera. Generally, the video camera captures images (F1 k ;F2 k ;F3 k ) is synchronized to capture only the reverse / interpolated image (C1 k ;C2 k ;C3 k Images corresponding to ) will not be recorded.

[0035] In one embodiment, each of the nd HDFR slots is

number

[0036] In another embodiment, the nd HDFR slots with a reference frame rate time interval ΔT = 1 / SFR are independent of each other, and therefore the duration τ of the nd HDFR slots iThe sum of these corresponds to the duration of the reference frame rate time interval 1 / SFR, that is,

number

[0037] In a preferred practical implementation of the method of the present invention, each presentation of an image within an HDFR image slot consists of one or more basic pulse-width modulation frames (PWM frames, also referred to as "scrambled"), during which no new image data is presented. However, the brightness of the image presented within the HDFR slot is controlled by operating individual active elements of an active display, such as LED elements, according to the pulse-width modulation scheme.

[0038] Preferably, the duration τ of each of the nd HDFR slots iτ is generated via a pulse counter supplied by the G clock (GCLK). Therefore, instead of employing a conventional LED driver that receives an external PWM signal via the driver's OE (Output Enable) pin, the present invention preferably uses an active display equipped with an LED control circuit (LED driver) that generates a PWM frame (scrambled) from an internally generated G clock (GCLK) signal supplied to the circuit's pulse counter. The actual brightness of the LED is controlled by the PWM duty cycle, that is, by the ratio of the LED in "on" mode to "off" mode at each PWM time interval. In addition to, or as an alternative to, pulse width modulation, the brightness of the HDFR image slot can also be controlled via the current when individual active elements, such as LED elements, are operating. As will be described in more detail below, by controlling the PWM frame via the G clock, it is possible to generate not only HDFR slots of equal duration but also HDFR slots of variable duration. The PWM signal controls the color gradation and brightness of the LED. The external PWM signal is distorted and attenuated during long-distance transmission, resulting in changes in color and brightness. In contrast, using internally generated G-clock and PWM signals to determine the duration and brightness of HDFR slots results in higher accuracy for the corresponding image frames.

[0039] This is particularly useful when the pair of image and interpolated / reverse image has a different duration than the variable duration scheme mentioned above. In a preferred embodiment of the present invention, the different durations τ of the HDFR image slots can be changed by varying the frequency of the G clock while counting the same predetermined number of pulses via a pulse counter. i This is obtained. Therefore, the method of the present invention ensures that both images are combined to form a precisely homogeneous gray image.

[0040] When synchronizing cameras that capture a scene containing one or more active displays, either the front or rear end of the HDFR slot is used as the trigger point, and the variable length can be adjusted to the left or right of the trigger point.

[0041] When a video camera is used to capture one of an additional image data sequences, a synchronization procedure between the camera and the display must typically be performed to ensure that only the desired HDFR image slot is captured, without capturing portions of adjacent image slots that show, for example, an interpolated / reverse image. A preferred procedure involves setting the camera to a shutter time much shorter than what is actually needed for shooting, so that only a portion of the HDFR image slot is captured. The captured image will be quite dark due to the short shutter time, but it will be highly sensitive to interference with adjacent HDFR image slots so that proper synchronization is achieved immediately. Then, the desired shutter speed can be selected according to the lighting conditions, and shooting can begin.

[0042] In one embodiment of the present invention, at least one of the HDFR image slots includes a black phase. The term "black phase" refers to a time interval in which the physical display is dark, for example, in the case of an LED display, all LEDs are off. This can be achieved by turning off the G clock (CLK) for the duration of the black phase. The black phase has the duration of a typical HDFR image slot, but preferably the black phase has a duration of up to 50% of the HDFR image slot. More preferably the black phase has a duration of τ of each HDFR image slot. i It has a substantially shorter duration. The term "substantially shorter" means that the duration of the black phase is less than 20%, preferably less than 10%, and particularly preferably less than 5%, of the duration of each nd HDFR image slot. Generally, when a reference frame time interval of, for example, 20 milliseconds (50Hz) or 16.7 milliseconds (60Hz) is adopted, the HDFR image slots have a duration in the millisecond range, and the inserted black phase has a duration in the 0.1 millisecond range. Additional image data sequence (F1) intended to be captured by the video camera k ;F2 k ;F3 kIn the initial portion of the HDFR image slot associated with the first image data sequence (F0), the insertion of a black phase is particularly preferable. Thus, during the transient oscillation of the amplifier in the control circuit of the active display (during the settling time of the control circuit components), the active display is black, and therefore the video camera is able to capture a sharp image that already exhibits the desired color and emission values. The black phase is the first image data sequence (F0 k Although it is also inserted into the initial phase of the image, in this case, since there is generally no inverse / interpolated image of the first image data sequence, slight deviations in color and brightness are not very important.

[0043] Active display flicker can be further reduced if at least six HDFR image slots are provided in a reference frame rate time interval ΔT = 1 / SFT. Preferred slot counts in the reference frame rate time interval ΔT are 12, 24, and 36 HDFR slots.

[0044] As mentioned above, the additional image data sequence (F1k,C1) shown in the reference frame rate time interval ΔT=1 / SFR k ;F2 k ,C2 k ;F3 k ,C3 k ) is the first image data sequence (F0) that is intended to be viewed directly by the viewer. k This tends to increase the black level of the image. This inevitable increase in level is particularly problematic in bright environments, such as outdoor sporting events where the sun shines directly on LED advertising signs. Under such conditions, additional image data sequences intended to be captured by the video camera, namely image data sequence F1 k ;F2 k ;F3 kThe brightness increases, exacerbating the problem of the black level increase in the first image data sequence. As a result, the direct viewers participating in the event perceive the first image data sequence as a video feed including a certain grayish overlay. To minimize the black level increase in the first image data sequence, the present invention provides at least a second complementary image data sequence C1 k ;C2 k ;C3 k such that the HDFR image slots presenting the images of C1 k ) include the image data of the first image data sequence (F0

[0045] An active display typically operates at a certain brightness, such as 8 bits (256 brightness levels), 9 bits (512 brightness levels), 10 bits (1024 brightness levels), 12 bits, or even 16 bits or 24 bits. For example, due to a bright environment, when the images of additional image data sequences F1 k ;F2 k ;F3 k must be presented at a high brightness, the corresponding complementary image data sequences C1 k ,C1 k ;F2 k ,C2 k ;F3 k ,C3 k must also be presented at a high brightness so that the combined images F1 k ;C2 k ;C3 k form a homogeneous gray image in total. Usually, the corresponding additional image data sequences F1 k ;F2 k ;F3 kInterpolated image data is presented in shorter HDFR image slots, and therefore the interpolated image data sequence requires higher brightness. Consequently, it is difficult to include additional image data from the first image data sequence without saturating the corresponding HDFR image slots. Therefore, in a preferred embodiment of the present invention, the active light-emitting element of the active display operates with an increased current, while the brightness (bit-based brightness level) of the interpolated image component decreases proportionally. In a certain embodiment, the driver chip for the active element (e.g., LED or OLED) can reduce the nominal current (i.e., the 100% current value) of the active light-emitting element, for example, via an adjustable register, so that the LED can operate safely even at 100-200% of its nominal current.

[0046] Typically, active elements such as LEDs have a nonlinear power-current relationship. Therefore, when current regulation is performed according to the present invention, a correction for this nonlinear behavior must be applied to ensure that color changes that would otherwise affect the image intended for the direct viewer, either directly (first image data sequence) or indirectly, are not affected due to insufficient cancellation between the image of the additional image data sequence and the inverse / interpolated image. Each power-current relationship is usually provided by the active element manufacturer and can therefore be implemented in the hardware for controlling the display. Generally, sufficient results can be obtained by interpolating / extrapolating over the operating range using two (linear approximation), three, or four data points.

[0047] In another embodiment, at least the second complementary image data sequence (C1 k ;C2 k ;C3 k The image slot presenting the image in the HDFR image slot includes the image component immediately before or after the HDFR image slot.

[0048] Preferably, the display used in the method of the present invention is an LED or an OLED (AMOLED) display.

[0049] The present invention also relates to a system for operating an active display comprising an array of active light-emitting elements, the system comprising a control unit configured to carry out the above method. [Brief explanation of the drawing]

[0050] The present invention will now be described in more detail with reference to the attached drawings. [Figure 1] Figure 1 is a schematic diagram of a studio environment in which the method of the present invention can be put into practice. [Figure 2] Figure 2 is a schematic diagram of a sports stadium in which the method of the present invention can be put into practice. [Figure 3] Figure 3 is a schematic diagram of the present invention method employing two feeds. [Figure 4] Figure 4 is a schematic diagram of the present invention method employing three feeds. [Figure 5] Figure 5 is a schematic diagram of a frame sequence in which each slot has a variable length. [Figure 6] Figure 6 shows a frame sequence similar to the sequence in Figure 5, but with black phase insertion. [Figure 7] Figure 7 shows a frame sequence illustrating the ratio increase of the first image data sequence. [Figure 8] Figure 8 shows an alternative embodiment of the scheme in Figure 7. [Modes for carrying out the invention]

[0051] Figure 1 shows a schematic diagram of a digital video studio 10, which has an LED background wall 11 made of numerous individual LED panels 12. The LED wall 11 is essentially a seamless wall when viewed from the front side 13, but when viewed from the rear side 14 of the wall 11, which is partially visible, it consists of individual panels 12 fixed to a suitable mounting structure 15. The studio 10 further includes an LED ceiling 17, also made of individual LED panels, along with an LED floor 16, also made of individual LED panels. The studio 10 further includes conventional lighting equipment such as overhead lighting 18 and floor lighting 19, and one or more digital cameras, schematically represented by camera 20 in Figure 1. Figure 1 also shows the field of view of camera 20, indicated by a frustum of a cone 21. In the field of view of the camera frustum of a cone, an actor 22 is shown in front of camera 20. In the example shown in Figure 1, camera 22 is equipped with an auxiliary camera 23 that is pointed towards the LED ceiling. The tracking pattern captured by the auxiliary camera 23 attached to the main camera 20 can be presented, from which the position and orientation of camera 20 can be derived.

[0052] Figure 2 shows a sports stadium—in the example shown in Figure 2, a soccer stadium 30—having a soccer field 31 and a stand structure 32 surrounding the soccer field 31. Around the soccer field 31, 33, an LED array 34 consisting of individual LED panels 35 is provided to display advertisements. In the method of the present invention, advertisements seen by viewers in the stadium are presented as a first image data sequence, while a chroma key image may be presented as a second image data sequence. To reduce disturbances caused by on-site viewers in the stadium, the present invention provides a third image data sequence consisting of image frames representing complementary / inverse images of the chroma key image in the second image data sequence. In one embodiment, the first image data sequence may also include a tracking pattern, while the third image data sequence may include complementary images of the tracking pattern.

[0053] The method of the present invention will be explained in more detail below with reference to a typical HDFR image slot sequence. In the example presented below, it is assumed that the reference frame rate corresponds to 50 Hz, and consequently the reference frame rate time interval ΔT = 1 / SFR corresponds to 20 milliseconds. Figures 3 to 8 show only one reference frame rate time interval k, but it should be understood that corresponding time intervals k-1, k-2, ... extend to the left of the depicted time interval, and corresponding time intervals k+1, k+2, ... extend to the right of the depicted time interval. Furthermore, in many applications, the number of HDFR image slots is greater than the number of image slots depicted in this example for simplification.

[0054] Figure 3 is a schematic diagram of an embodiment of the method of the present invention in which two different feeds are presented on the active display in a time-slice multiplexing scheme. In the embodiment of Figure 3, a reference frame rate time interval of 20 milliseconds (50 Hz) is subdivided into 12 slots / slice, each having a duration of 1.67 milliseconds. In the first column, e is the number of slots, and L is the relative brightness in which each slot is presented. F0 refers to the first feed intended for direct viewers, and F1 refers to the feed not intended for direct viewers. In the embodiment of Figure 3, only two feeds are provided primarily in each reference frame rate time interval (in slots 1, 2, 3, 6, 7, 8, 9, 10, and 12), and image data content instances intended for viewing by direct viewers are displayed on the active display. The image data of the second feed F1 is presented only in slots 4 and 5 as a combination of image F1 and the interpolated / inverse image C1, so that a gray image is perceived (though not consciously) as a result of the combined effect of slots 4 and 5. To further conceal the insertion of image content F1, the brightness of slots 4 and 5 is only 30 percent of the brightness of the slot where image data F0 is presented. According to the present invention, in order to ensure that grayscale images are presented in both feeds, slots 10 and 11 are not occupied by the "normal" representation of image data F0 of the first feed, and slots 10 and 11 are used to present the image and inverse image of the image data of the first feed. Furthermore, in order to ensure that brightness changes occur at a specified frequency higher than the reference frame rate, the relative brightness of slots 10 and 11 is also reduced to 30 percent of the brightness of slots 1, 2, 3, 6, 7, 8, 9, and 12. The fact that one slot of image data intended for direct viewing is "hidden," namely slot 10, is counterintuitive by presenting the corresponding interpolation / inverse image in slot 11, but effectively reduces the flicker resulting from the insertion of the second feed of image data.

[0055] Figure 4 shows an example similar to Figure 3, but in addition to the first feed intended for direct viewing, two additional "second" feeds, namely the second feed F1 and the third feed F2, are presented as combinations of images F1 and F2 and their respective complementary / inverse images C1 and C2. As with the embodiment in Figure 3, the combination of images and inverse images is presented at a lower relative brightness than the image intended for direct viewing so that brightness changes occur at a specified frequency greater than the reference frame rate of 50 Hz, and the resulting grayscale images are uniformly distributed within the 12 HDFR image slots.

[0056] The concept of having variable-length HDFR image slots is described in detail below. The minimum duration of an image slot is equal to the sum of the minimum transmission time and the vertical synchronization signal. The GCLK frequency should be modified to show the entire image within a given time. Assuming there are up to 12 image slots, F1 is F1 Gain G for 2 milliseconds = F1 This shows that = 0.5. And t C1 = Minimum time of 1.67 milliseconds

number

[0057] Figure 5 shows a schematic diagram of a frame sequence in which each slot has a variable duration. Figure 5a) shows an actual sequence with nine HDFR image slots, where a large proportion of the frame time interval is due to the first image data sequence F0, which is intended to be viewed directly by the viewer. Three additional image data sequences F1, F2, and F3 are provided, each accompanied by its complementary / inverse image data sequences C1, C2, and C3. Figure 5b) shows the data clock (DCLK) sequence that governs the transmission of image data. As can be seen, during the presentation of a slot, e.g., F1, the image data of the subsequent slot C1 is transmitted to the active display, etc. The image data includes the brightness values ​​of each LED in the active display. As an example, an LED display with 10-bit resolution (1024 brightness levels) is equipped with LEDs that are to operate at 50% of their maximum intensity according to the data clock information. Therefore, the brightness information transmitted (in the range of 0 to 1023) corresponds to 511 values. Figure 5c) shows how this value is transmitted to a suitable pulse-width modulation (PWM). For example, a G clock (CLK) is generated at a normal frequency of 10 MHz. In a simple embodiment, a pulse counter counts the number of pulses until a desired value (511 in this example) is reached for this image slot. The PWM signal is off for the remaining pulses of the G clock. Thus, the PWM signal operates with a 50% duty cycle. However, in a preferred embodiment, the active pulses are evenly distributed over the time interval of the slot.

[0058] Figure 6 shows a frame sequence similar to the sequence in Figure 5 with a black phase inserted. As can be seen from Figure 6a), a black phase with a duration of 0.1 milliseconds is inserted into the first part of each of the first image data sequences F1, F2, and F3. As can be seen from Figure 6b), the black phase is generated by switching the G clock off during the desired black phase.

[0059] The concept of increasing the brightness of the venue feed, i.e., the first image data sequence F0 intended to be viewed directly by the audience, is described in detail below. The inverse image is displayed with a higher current, but therefore the brightness level decreases. In this way, headroom is left in the color / luminance space, and content for the human eye of the direct viewer can be added to the image. Figure 7 shows an example of this concept assuming a 10-bit brightness range by PWM control, i.e., an intensity from 0 (black) to 1023 (maximum). The image gain coefficient is the ratio of the image brightness by PWM control within that range, i.e., gain=0 corresponds to a 10-bit value of "0", and gain=1 corresponds to a 10-bit value of "1023". The actual brightness of the active light-emitting element (e.g., LED) of an active display can be determined by multiplying the current when the element is operating by the gain coefficient. In the basic embodiment of the method of the present invention shown in Figure 7a), F1 is displayed with a gain of 0.5 (i.e., a 511-bit PWM level) and a current of 0.2, and the interpolated / inverse image C1 is displayed with the same gain and current, so that the sum of F1 and C1 is a monotonous gray image. In the embodiment shown in Figure 7b), F1 is also displayed with a gain of 0.5 and a current of 0.2, and C1 is displayed with a gain of 0.25 and a current of 0.4, so that the sum of F1 and C1 is also a monotonous gray image, although an additional gain of 0.75 may be added to the venue feed F0 for direct viewers so that the overall ratio of the venue feed increases. However, it must be noted that the current-intensity relationship of the R, G, B LEDs changes. Therefore, color correction is necessary. It must be ensured that the brightness level remains constant when the image content is interpolated. Any current setting can be selected for the inverse image slot. It is helpful to note here that the amount of light (essentially the number of photons) is proportional to the brightness / luminance level B and gain G, and the image is displayed as follows with respect to current c (the coefficient can be determined by the driver chip current setting, so c ∈ [0,2]) and time t.

number

[0060] Figure 8 shows an extension of the scheme in Figure 7, where two inverse images immediately before and after a given additional image data sequence F0 (venue feed), F1 (first parallel feed), and F2 (second parallel feed), along with additional image content from the venue feed, are combined in a single HDFR image slot to obtain a frame sequence with an increased proportion of the first image data sequence F0. This enables greater flexibility and performance, especially in low-slot systems such as the "Black Marble" LED floor system sold by ROE Visual.

[0061] Furthermore, this approach for HDFR image data slots with variable duration can be combined with the concept of increasing the brightness of the first image data sequence (venue feed). Therefore, the gain of the inverse image is:

number

[0062] 10 Digital Video Studio 11 LED Background Wall 12 LED panels 13 Front view 14. Rear side 15. Mounting structure 16 LED floor 17 LED ceiling 18. Upper lighting 19 Floor lighting 20 cameras 21. Truncated cone 22 Actor 23 Auxiliary Camera 30 Soccer Stadiums 31 Soccer field 32 Stand Structure 33. Around the soccer field 34 LED row 35 LED panels

Claims

1. A method for operating an active display comprising an array of active light-emitting elements, The aforementioned method, The first image data sequence (F0) is intended to be viewed directly by the viewer. ｋ The steps include providing the first feed of ) and providing at least one second feed of a second image data sequence (F1 ｋ , C1 ｋ ; F2 ｋ , C2 ｋ ; F3 ｋ , C3 ｋ ), which is not intended to be viewed by the direct viewer, wherein the at least second feed includes a second image data sequence (F1 ｋ ; F2 ｋ ; F3 ｋ ) and a second complementary image data sequence (C1 ｋ ; C2 ｋ ; C3 ｋ ) consisting of the reverse or complementary image data of the second image data sequence, so that a second homogeneous gray image is obtained as a result of a combination of each image of the second image data sequence and the second complementary image data sequence (F1 k and C1 k; F2 k and C2 k; F3 k and C3 k); The first image data sequence and at least the second image data sequence include the step of selecting a reference frame rate (SFR) when they are presented on the active display, The step of operating the active display at a display high frame rate (HDFR) that includes nd HDFR image slots in the reference frame rate time interval ΔT = 1 / SFR of the reference frame rate (SFR), wherein each HDFR image slot is [Number 7] Duration τ ｉ Steps having, A step of presenting the image data of the first feed and at least the second feed to the active display in the nd HDFR image slot of each reference frame rate time interval using a time slice multiplexing scheme, wherein the time integral brightness of the first image data sequence presented in the reference frame rate time interval is higher than the sum of the time integral brightness of the second image data sequence. It includes, At least two feeds, the first feed and the at least one second feed, are the combination of the second image data sequence and the second complementary image data sequence (F1 ｋ and C1 ｋ F2 ｋ and C2 ｋ F3 ｋ and C3 ｋ The second homogeneous gray image obtained from ) is included, and the second homogeneous gray image is presented to the active display at equal brightness and uniformly distributed within the nd HDFR image slot, such that the brightness changes of the active display occur at a frequency of twice or more than the reference frame rate (SFR). Here, The first image data sequence (F0 ｋ The first feed of ) is a first complementary image data sequence (C0) consisting of the inverse / complementary images of the first image data sequence. ｋ By further incorporating ), a homogeneous grayscale image is obtained as a result of the combination of each image (F0 k and C0 k) of the second image data sequence and the second complementary image data sequence. The gray images of the at least two feeds are the first feed (F0 ｋ and C0 ｋ ) First homogeneous gray image from and the second feed (F1 ｋ and C1 ｋ ) encompasses a second homogeneous gray image from, wherein at least one of the nd HDFR image slots represents a regular expression of the first image data sequence at a first brightness, one of the nd HDFR image slots represents a representation of the second image data sequence, one of the nd HDFR image slots represents a representation of the second interpolated image data sequence, one of the nd HDFR image data slots represents a representation of the first image data sequence at a brightness lower than the first brightness, and one of the nd HDFR image slots represents the first interpolated image data sequence at a brightness lower than the first brightness. A method characterized by the following features.

2. The method according to claim 1, wherein the brightness change of the active display occurs at a frequency greater than 100 Hz.

3. The second image data sequence (F1 ｋ F2 ｋ F3 ｋ ) image and the second complementary image data sequence (C1 ｋ ; C2 ｋ ; C3 ｋ Each pair (F0) with the inverse / interpolated image of ) ｋ , C0 ｋ F1 ｋ , C1 ｋ F2 ｋ , C2 ｋ F3 ｋ , C3 ｋ The method according to claim 1 or claim 2, wherein the present is presented within a time interval of 3.3 milliseconds or less.

4. The method according to claim 1 or 2, wherein the HDFR image slots for a reference frame rate time interval ΔT have the same length τ.

5. The HDFR image slots with a reference frame rate time interval ΔT have a variable length τ ｉ The method according to claim 1 or claim 2, comprising:

6. The length τ of each of the HDFR image slots ｉ The method according to claim 1 or claim 2, wherein τ is generated via a pulse counter supplied by a G clock (GCLK).

7. By changing the frequency of the G-clock (GCLK) while counting the same predetermined number of pulses via a pulse counter, different durations τ of the HDFR image slot can be obtained. ｉ The method according to claim 6, which yields the following result.

8. At least one of the HDFR image slots has a duration τ of each HDFR image slot. ｉ The method according to claim 1 or 2, comprising a black phase having a shorter duration.

9. The method according to claim 8, wherein the duration of the black phase is shorter than 20% of the duration of the HDFR image slot.

10. The method according to claim 1 or 2, wherein at least six HDFR image slots are provided in a reference frame rate time interval ΔT = 1 / SFR.

11. The aforementioned at least second complementary image data sequence (C1 ｋ ; C2 ｋ ; C3 ｋ The HDFR image slot that displays the image of the first image data sequence (F0 ｋ The method according to claim 1 or claim 2, comprising image data of ).

12. The method according to claim 11, comprising operating the active light-emitting element of the active display with a high current while proportionally reducing the brightness of the complementary image component.

13. The aforementioned at least second complementary image data sequence (C1 ｋ ; C2 ｋ ; C3 ｋ The method according to claim 11, wherein the HDFR image slot presenting the image of ) includes the image components of the preceding and succeeding HDFR image slots.

14. The method according to claim 1 or 2, wherein the active display is an LED or OLED display.

15. A system for operating an active display having an array of active light-emitting elements, comprising a control unit configured to perform the method according to claim 1 or claim 2.

Images