System and method for PWM control of video display screens

By acquiring the camera shutter timing and calculating the PWM timing control signal, the brightness of the LED video screen is adjusted, thus solving the visual artifact problem during camera shooting and achieving artifact-free synchronous display.

CN116569248BActive Publication Date: 2026-11-17BROMPTON TECH LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180079650.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-09-28
Filing Date
2021-09-28
Publication Date
2026-11-17
Estimated Expiration
2041-09-28

AI Technical Summary

Technical Problem

Existing LED video screens are prone to visual artifacts when photographed by cameras, such as black bars, dark lines, bright lines, and stripes, and cannot simultaneously meet the viewing needs of both cameras and human eyes.

Method used

By acquiring the camera's shutter opening time, a PWM timing control signal is calculated and sent to control the brightness of the video display during the camera's shutter opening time, adjust the PWM period and duty cycle, and ensure synchronization and matching of the camera's frame rate and shutter speed.

Benefits of technology

It effectively reduces or eliminates visual artifacts during camera shooting, while ensuring flicker-free viewing for the human eye, achieving an LED video screen display with no artifacts for either the camera or the human eye.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116569248B_ABST
    Figure CN116569248B_ABST
Patent Text Reader

Abstract

A PWM control system includes a memory and a processor. The processor obtains camera characteristics (402) related to a camera configured to capture an image displayed on a video display. These camera characteristics include the duration of the period during which the camera's shutter is open. The processor also calculates PWM timing control for the video display (404). This PWM timing control specifies a PWM cycle duration based on the period during which the camera's shutter is open. The processor further sends a signal (406) to the video display. This signal includes the PWM timing control and is configured to cause the video display to control its brightness according to the PWM timing control during the period during which the camera's shutter is open. The LED screen can be viewed simultaneously by both the camera and a human observer without either observer perceiving artifacts or flicker.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-reference with related patent applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 084,354, filed September 28, 2020, entitled "System and Method for PWM Control of Video Display Screen," which is incorporated herein by reference in its entirety. Technical Field

[0003] This disclosure generally relates to light-emitting diode (LED) video screens, and more specifically, to a method for controlling the pulse width modulation (PWM) refresh cycle of the LEDs of an LED video screen to reduce visual distortion when the screen is viewed by a camera. Background Technology

[0004] LED video screens can use driver chips to control the LEDs on the screen. These driver chips can use PWM (Pulse Width Modulation) to adjust the brightness of individual LEDs, where the LED switches between fully on (when fully on, current drives the LED, and the LED emits light at full brightness) and fully off (when fully off, no current drives the LED, and the LED does not emit light). The ratio of the time the LED is on to the time it is off determines the average brightness, which can be seen by the human eye or a video camera. For example, if an LED is on 50% of the time and off 50% of the time, and this change occurs frequently enough to go unnoticed, then the LED will appear to be at 50% of its full brightness. When the viewer is the human eye, this PWM frequency can be selected high enough that the eye perceives a constantly dimming light output rather than flickering pulses. Summary of the Invention

[0005] In a first embodiment, a PWM control system includes a memory configured to store instructions and a processor coupled to and configured to execute the instructions stored in the memory. The processor obtains camera characteristics related to a camera configured to capture an image displayed by a video display. The camera characteristics include the duration of the period during which the camera's shutter is open. The processor also calculates PWM timing control for the video display. The PWM timing control specifies a PWM cycle duration based on the period during which the camera's shutter is open. The processor further sends a signal to the video display. The signal includes the PWM timing control and is configured to cause the video display to control its brightness according to the PWM timing control during the period during which the camera's shutter is open.

[0006] In a second embodiment, the method of controlling a PWM in a video display includes obtaining camera characteristics related to a camera configured to capture an image displayed by the video display. The camera characteristics include the duration of a period during which the camera's shutter is open. The method further includes calculating PWM timing control for the video display. This PWM timing control specifies a PWM cycle duration based on the period during which the camera's shutter is open. The method further includes sending a signal to the video display. This signal is configured to cause the video display to control its brightness according to the PWM timing control during the period during which the camera's shutter is open. Attached Figure Description

[0007] To gain a more complete understanding of this disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which similar reference numerals denote similar features, wherein:

[0008] Figure 1 This is a block diagram of a PWM control system according to an embodiment of the present disclosure.

[0009] Figure 2A These are examples of video and PWM timing signals.

[0010] Figure 2B Examples of video and PWM timing signals according to embodiments of this disclosure.

[0011] Figure 3 This is a block diagram of a controller in a PWM control system according to embodiments of the present disclosure.

[0012] Figure 4 This is a flowchart of a method for controlling PWM in a video display according to an embodiment of the present disclosure. Detailed Implementation

[0013] The described embodiments are shown in the figures, and similar numbers are used to refer to similar and corresponding parts in the figures.

[0014] When the "viewer" of a video display is a video camera—for example, the video display provides images that will be used as a background for video shooting, or provides other images such as advertising or information display screens in a stadium—then it may be desirable to take into account the frame rate and shutter (or shutter timing) speed of the video camera when determining the PWM control signal used to control the brightness of the video display. That is, the PWM control system according to the invention matches the PWM control of the video display to the operating characteristics of one or more video cameras that are capturing the content displayed on the video display.

[0015] As used herein, the term PWM period refers to a digital waveform of a selected duration that alternates between off ('0') and on ('1') states, with the time spent in each state controlled to achieve some desired average output value (e.g., 0.25, or equivalently 25%) of the waveform between 0 and 1 (inclusive). The term PWM duty cycle refers to the ratio of the on-time to the duration of the PWM period, and therefore also represents the average output value within the PWM period. As used herein, PWM control signals can include two types of PWM control. The first type of PWM control is PWM modulation, which can be applied to either the PWM period or the PWM duty cycle. An example of this PWM modulation is a control value that compensates for changes in LED operating temperature by adjusting the duty cycle to accommodate variations in LED efficiency. The second type of PWM control is PWM timing control, which can specify parameters such as the time to start the PWM period and / or the duration of the PWM period (or the time period during which the PWM period completes).

[0016] Digital video and film cameras typically have a light sensor located behind the lens, which focuses incoming light onto the sensor. Such cameras are usually configured to the desired frame rate. For example, film shooting might use a frame rate of 24 frames per second (fps), broadcast applications might use 50 / 60 fps, and slow-motion visual effects shooting would use even higher frame rates. Shutter speed, along with lens settings such as aperture and possibly a neutral density (ND) filter, is selected to achieve the desired exposure level and the desired motion appearance in the scene. Shutter speed can also be described by shutter angles, where 360 ​​degrees corresponds to a full frame period, 180 degrees to a half frame period, and so on. The camera frame rate and shutter speed together define when the camera shutter is open and sensing light, and when it is closed and not receiving any incoming light. In some embodiments, the open and closed states of the shutter are further defined in conjunction with an external frame synchronization signal. The period during which the camera shutter is open can also be referred to as the exposure time.

[0017] LED video screens can be viewed by a video camera using any of a range of camera frame rates, which in some embodiments may range from 24fps to 250fps. In some systems, the PWM output of the LED video screen control system is synchronized with the video frame rate of the video camera. However, if such a system neglects shutter timing, visual artifacts can still occur in the captured image. These artifacts may manifest as black bars, dark lines, bright lines, bands, or other brightness variations across the entire image captured by the video camera. These artifacts may become more or less noticeable depending on the type of lens, lens settings, and / or other camera settings. The artifacts may also depend on whether the camera uses a global shutter (where all pixels in the camera's image sensor are exposed simultaneously) or a rolling shutter (where a row of the sensor is exposed as the pixels of that row are read). An improved PWM control system for an LED video screen would eliminate or minimize visual artifacts when the camera views the screen. A further improvement would be that the system controlling the LED screen can be viewed simultaneously by both a camera and a human observer, without either observer perceiving any artifacts or flickering.

[0018] LED video screens (and / or their LED panels) can adjust their PWM refresh rate to closely match the timing of incoming video signals, aiming for an integer number of PWM cycles within a single signal video frame period. For some systems, the single signal video frame period can be any value from approximately 1 / 24th of a second to approximately 1 / 250th of a second. When filming the LED screen, matching the video frame rate to the camera frame rate and genlocking them together to ensure frequency and phase consistency between the two systems can be a further benefit. Such genlocking ensures that the camera frame precisely captures a video frame.

[0019] In some systems, the camera does not operate for the entire frame period when its shutter is open. For example, a shutter angle of 180 degrees can be used (in a sync-locked system, the shutter will be open for half the video frame period), but other shutter angles can be used in other systems. For example, when shooting at 24fps with incandescent light in Europe, a shutter angle of 172.8 degrees can be used to avoid flickering of the light, thus making the shutter period of the 24fps camera frame rate 1 / 50 second.

[0020] This change in shutter angle can cause artifacts to be observed on the LED video screen by the video camera, similar to those in systems described above that do not take shutter speed into account. These artifacts are typically an interaction between the LED PWM rate, the scan multiplexing of LED rows in the LED video screen or LED panel, and the camera's shutter settings (e.g., camera frame rate, global or rolling shutter speed, and shutter angle). In some systems, these artifacts can be avoided by adjusting the camera shutter settings. However, in other systems, it may be impossible to change the camera settings (e.g., due to technical limitations or because changing the shutter speed would affect other creative options, such as motion blur).

[0021] Figure 1 A block diagram of a PWM control system 100 according to an embodiment of the present disclosure is shown. A video display screen 102 includes an array of individual pixels, each pixel consisting of at least one LED. In some embodiments, the video display screen 102 includes a plurality of LED panels comprising an array of individual LED pixels. Pixels in the video display screen 102 or the LED panels may include LEDs of three colors (e.g., red, green, and blue) or any number of LEDs of any number of colors.

[0022] The video display screen 102 is controlled by a screen processor 104. The screen processor 104 includes a control system that sends data to the video display screen 102, indicating which pixels should be illuminated and the color and intensity of these pixels (e.g., PWM control signals). For a video display, these values ​​may be updated at rates including, but not limited to, 24, 25, 30, 60, or more times per second. Furthermore, the video display screen 102 may include an internal processing system capable of further modifying the intensity and color of individual pixels, either in response to instructions from the screen processor 104 or autonomously. In embodiments including multiple LED panels, a single LED panel may include such an internal processing system. In other embodiments, the video screen includes a single internal processing system for all its LED panels or LEDs.

[0023] The screen processor 104 can obtain information related to video data and camera features associated with a camera configured to capture images displayed on the video display screen 102. The video data may include, but is not limited to, video data 118, video frame rate 106, and video synchronization 108. The camera features may include, but are not limited to, camera frame rate 110, camera shutter speed 112, camera shutter type 114, and shutter speed adjustment 116. Video data 118 is data representing an image to be displayed on the video display screen 102. Video frame rate 106 is data indicating the frame rate of the incoming video data 118. For example, video frame rate 106 might be 25fps or 24fps. Video synchronization 108 is a signal or data indicating the start of a video frame from video data 118. Video frame rate 106, video synchronization 108, and video data 118 are collectively referred to herein as video features.

[0024] External synchronization 109 is a signal or data that directly or indirectly instructs the desired phase and frequency of the video display screen 102. Its phase and / or frequency may differ from video synchronization 108 and may be related to the camera shutter phase and / or frequency. Such signals are generally available and may be referred to as phase-locked synchronization or frame synchronization, or can be inferred from related signals such as the camera's video output signal.

[0025] Camera frame rate 110 is data indicating the frame rate of the camera viewing the video display screen 102. Camera shutter speed 112 is data indicating the shutter speed of the camera viewing the video display screen 102. When described as "shutter speed" or "shutter timing," this feature represents the exposure time. When described as "shutter angle," the exposure time is a function of the frame rate and the shutter angle. Camera shutter type 114 is data indicating the type of shutter used by the camera viewing the video display screen 102. Example camera shutter types could be global or scrolling. The actual camera shutter speed may not perfectly match the indicated shutter speed; therefore, some form of fine control or adjustment can be provided as shutter speed adjustment 116. This could be in the form of supporting high-precision, non-integer shutter speeds (e.g., 1 / 50.0001), or it could be specified as an absolute time, such as +100 microseconds (μs), or perhaps a fraction of the shutter speed, such as +0.01%. The camera frame rate 110, camera shutter speed 112, camera shutter type 114, and shutter speed adjustment 116 are collectively referred to here as camera features.

[0026] Features 106, 110, 112, 114, and 116 can be obtained in different ways. For example, in some embodiments, any or all of these features can be provided by a user via a digital input pad or by control operations on screen processor 104. In other embodiments, screen processor 104 can request or read one or more features from one or more external data sources. Alternatively, in another embodiment of this disclosure, any or all of these features (including video synchronization 108 and external synchronization 109) can be provided as separate data or synchronization signals. Alternatively, in another embodiment of this disclosure, any or all of these features can be obtained from composite data. For example, in some embodiments, video frame rate 106 and video synchronization 108 can be derived by screen processor 104 from video data 118. In another embodiment, camera shutter speed 112 can be derived from a signal or camera data feed. In another embodiment, any or all of these features can be inferred, simulated, or assumed based on prior knowledge of common operational choices or other such heuristics.

[0027] The screen control signal 120 sent from the screen processor 104 to the video display screen 102 includes a PWM control signal for the LEDs of the video display screen 102. The PWM timing, including but not limited to the bit depth, frequency, duration, activation, and phase of the required PWM signal, can be generated by the screen processor 104 or by a system belonging to the video display screen 102. The PWM timing, controlled by the screen control signal 120, can be explicit (e.g., directly specifying a PWM timing synchronized with the frames of the video data 118) or implicit (e.g., specifying the camera exposure time; the PWM timing can be derived from the video data 118 by the video display screen 102). The screen control signal 120 is configured to cause the video display screen 102 to control the brightness of the LEDs using the PWM timing when displaying video data during the camera shutter's open period.

[0028] In some embodiments, the synchronization packet of screen control signal 120 is configured to provide PWM timing control. The panel is locked to the synchronization packet, resulting in screen processor 104 being able to adjust the frequency and phase of the synchronization packet to control the start time of the PWM cycle in the video display screen 102. Screen processor 104 can select the frequency of the synchronization packet based on the settings of its timing reference (e.g., video input or sync input). Between two synchronization packets, the panel can start the PWM cycle at a certain time based on the camera shutter opening period (which can in turn be based on the camera shutter speed 112, and also, where appropriate, the camera frame rate 110).

[0029] In some embodiments, the screen control signal 120 also includes video data 118. In some such embodiments, the video data received from the video data 118 is converted from a format (e.g., gamma encoding level) to another format (e.g., linear brightness level) before being incorporated into the screen control signal 120. In some such embodiments, the screen processor 104 may adjust the frame rate of the video data 118 to match or maintain some other user-specified relationship with the camera exposure time, such that the exposure time can subsequently be recovered from the timing of the screen control signal 120, and from there, the necessary timing-related properties of the PWM signal can be recovered.

[0030] In some embodiments, any or all of the video data 118, video frame rate 106, video synchronization 108, external synchronization 109, camera frame rate 110, camera shutter speed 112, camera shutter type 114, shutter speed adjustment 116, and video data 118 may be provided from their respective sources to the video display screen 102 or its composite LED panel. In some such embodiments, this information is provided to both the screen processor 104 and the video display screen 102. As described above, the PWM control process described herein may be executed entirely in the screen processor 104, entirely in the video display screen 102, or different portions of the process may be executed by the screen processor 104 and the video display screen 102.

[0031] Figure 2A and Figure 2B The timing sequence of video frames, LED PWM timing and arrangement, camera frame timing, and camera shutter timing are introduced from top to bottom.

[0032] Figure 2A This is a timing diagram 200 of the video and PWM timing signals. PWM signal 202 (including PWM cycles 1 and 2) is synchronized with video frame signal 204 (including video frames 1 and 2), which in turn is synchronized with camera frame signal 206 (including camera frames 1 and 2). PWM cycle 1 lasts for the duration of video frame 1 and consists of multiple discrete pulses. During video frame 1, the pulse sequence of PWM cycle 1 (e.g., its duty cycle or the presence or absence of pulses at certain times in the cycle) may vary depending on the LED driver chip that generates PWM signal 202. The configuration and control parameters of the LED driver chip cause the chip to produce a total average duty cycle over the duration of PWM cycle 1 to achieve the ideal brightness level for the eye to view.

[0033] As shown in camera shutter signal 208 (including open and close portions), a portion of PWM signal 202 occurs when the camera shutter is closed. For example, when camera frame 1 begins, PWM cycle 1 begins, and the camera shutter is open. During camera frame 1, the camera shutter closes, but PWM cycle 1 continues until the end of camera frame 1.

[0034] As described above, the LED driver chip that generates the PWM signal 202 can change the PWM period to achieve a specified average duty cycle. Figure 2A and Figure 2B In the example shown, the PWM period changes near the end of the frame period. This change in the PWM period after the shutter closes in timing diagram 200 is not seen by the camera, causing the duty cycle of the camera's shutter-open signal to differ from the average duty cycle throughout the frame period. This can potentially lead to artifacts in the signal captured by the camera.

[0035] Figure 2B This is a timing diagram 210 of the video and PWM timing signals according to an embodiment of the present disclosure. The video frame signal 204, camera frame signal 206, and camera shutter signal 208 are... Figure 2A The same applies. However, the increased speed of the PWM signal 212 (including PWM cycles 3 to 6) causes PWM cycle 3 to be completed within the exposure time of camera frame 3, rather than extending to the entire period of camera frame 3, in order to reduce or eliminate the artifacts discussed above. This may be due to the fact that the open camera shutter only captures a portion of the full PWM duty cycle.

[0036] PWM cycles 3 and 5 begin when the camera shutter opens and end when the camera shutter closes. When the shutter is closed, the camera does not capture anything on the video display screen 102. However, if the video display screen 102 remains closed when the camera shutter is closed, it may cause discomfort to users, performers, and operators viewing the video display screen 102, as it may appear to be flickering. To mitigate this effect, in other embodiments of this disclosure, PWM cycles 4 and 6 may be initiated when the shutter is closed. Cycles such as PWM cycle 4 are not seen by the camera, but only by those viewing the video display screen 102.

[0037] In a further embodiment, to improve the display refresh rate, PWM cycle 3 has a shorter duration and repeats within the exposure time. To align with the camera shutter, this set of multiple shorter PWM cycles is treated as the same as a single longer cycle, ensuring that all these shorter PWM cycles are captured completely by the camera to avoid visual artifacts. In some such embodiments, the duration of these shorter PWM cycles is a fraction of the shutter opening period (i.e., 1 / 2, 1 / 3, 1 / 4, etc.) to be completely repeated during the camera shutter opening period. In other such embodiments, a set of shorter PWM cycles has a combined duration equal to the camera shutter opening period (e.g., 50%, 25%, and 25% of the duration of the camera shutter opening period). Similarly, some shorter PWM cycles can be output during the shutter closing period. In some such embodiments, different numbers of PWM cycles are output during the shutter opening and shutter closing periods.

[0038] As previously described, in some embodiments, the shutter speed is determined to be at a high precision level in order to more closely synchronize the PWM period with the shutter speed. Extending or shortening the duration of the PWM period on the video display screen 102 to more closely match the PWM modulation in the screen control signal 120 for this high-precision shutter timing information can include adjusting the PWM clock rate, adjusting the PWM bit depth, extending or shortening one or more portions of the PWM signal that turns off the LED, truncating the PWM signal before it completes, and other suitable techniques for precisely adjusting the duration of the PWM period.

[0039] In embodiments where the limitation of the LED driver clock generator on the video display screen 102 prevents the achievement of the desired duration, PWM modulation in the screen control signal 120 can result in the use of dithering techniques in multiple PWM cycles corresponding to multiple camera shutter opening periods. In this way, some of the multiple PWM cycles have a different duration than the others, resulting in an average duration of the PWM cycles more closely matching the desired camera shutter opening time.

[0040] In some situations, such as very fast shutter speeds, it may not be possible to directly align the full PWM cycle with the shutter opening period, as the resulting PWM clock may exceed the capabilities of the LED driver chip or other components of the PWM control system 100. In such cases, other embodiments may align a subset of the PWM cycle with the shutter opening period. This subset is chosen to minimize visual artifacts, for example, by aligning a specific integral number of the PWM pulse with the shutter opening period (thus avoiding partial pulses being seen by the camera at the beginning or end of the exposure period). In other embodiments, the scan-multiplexed driver chip (where multiple scan lines are driven sequentially to form the resulting image) can be controlled to activate each scan line an equal number of times and for the same duration each time during the shutter opening period, reducing the likelihood of the camera sensing bright or dark lines.

[0041] Such embodiments, which align a subset of the PWM cycle with the shutter opening period, may result in a reduction in bit depth because the full bit depth is typically achieved when viewing the entire PWM cycle, not just a subset. In such embodiments, to minimize this effect, the phase of the PWM signal can be adjusted according to the specific PWM implementation within the driver chip; for example, allowing the camera to sense some shorter pulses as well as some longer pulses, rather than only the shorter ones. If the bit depth is still somewhat reduced, this embodiment can adjust the PWM drive level sent to the driver chip. For example, if some longer (brighter) pulses will occur when the camera shutter is closed, the drive level may be artificially increased, resulting in additional longer pulses when the camera shutter is open, achieving an LED brightness closer to the desired brightness during the camera shutter opening period. In other embodiments, the reduction in bit depth can be compensated for additionally or alternatively through spatial and temporal jitter or other suitable techniques.

[0042] In some embodiments, when the exposure time is less than half the video frame period (e.g.) Figure 2B As shown, the video display screen 102 may dim at the end of a video frame because PWM cycle 4 has been completed, and the PWM control system 100 waits for the next video frame to begin before starting PWM cycle 5. The dark video display screen 102 may not be captured by the camera because the camera shutter is closed during this period; however, the brief period of darkness on the video display screen 102 may cause flickering when viewed with the eye. In such an embodiment, the PWM control system 100 can start driving an additional PWM cycle during the dark period and then truncate the additional PWM cycle at the beginning of the next video frame. This can reduce noticeable flickering, especially in the brighter areas of the image.

[0043] While the foregoing discussion has focused primarily on global shutter cameras, embodiments of this disclosure can accommodate rolling shutters by specifying that the same PWM cycle repeats at least twice within a video frame period. The advantage of this is that as the camera shutter “rolls” across the screen, the individual sensor lines capture a complete PWM cycle, regardless of which phase the sensor lines are operating on. Therefore, in some embodiments, the camera shutter type 114 (global or rolling) is specified by the user or received from the camera by the PWM control system 100 to help achieve a uniform output. In some such embodiments, specifying or receiving the readout rate of the camera sensors (the speed at which the shutter “rolls”) yields better results because a faster readout rate results in a smaller phase shift between the top and bottom of the camera sensors. In such embodiments, the PWM signal may continue to replicate the beginning of the frame only for a short period of time.

[0044] As an alternative to the dynamic approach presented herein, where information such as shutter angle, sensor type, and readout speed is provided by the user at runtime via a user interface or received from a camera or other data source, embodiments of this disclosure can achieve similar functionality "offline," wherein a static configuration is pre-generated based on a series of predefined shutter angles of a specific type (or multiple types) for the LED video screen 102 that may be frequently encountered. The advantage of this approach is reduced runtime complexity while still providing LED PWM output (frequency, phase, waveform shape, etc.) independent of the video frame rate, based on some other specified timing parameters, such as camera shutter speed tuning.

[0045] According to some embodiments of the PWM control system disclosed herein, a PWM matching signal can also be sent to the user to indicate how well the output of the PWM control system is tuned. Such a signal can be as simple as a "traffic light" status indicator. In one example, green indicates that the entire PWM cycle (or a set of PWM cycles) has been properly matched to the specified shutter timing or shutter opening period, yellow indicates that an integer number of PWM pulses has been matched to the shutter timing (but due to some reason the entire PWM cycle cannot be matched, resulting in some reduction in the effective bit depth), and red indicates that the PWM output cannot be tuned for the specified shutter timing (e.g., if the shutter speed is very fast, even a single PWM pulse cannot complete all the scan lines).

[0046] In some embodiments of this disclosure, the camera frame rate 110 and video frame rate 106 are mismatched, for example, when a high-speed camera is used with a video screen displaying video content at normal speeds, such as in a sporting event. The camera is high-speed to provide clear images of fast-moving action and allow for slow-motion replay, while the video display on a billboard, scoreboard, or action replay screen operates at a normal video frame rate. High-speed cameras typically operate at faster shutter speeds than normal cameras, therefore, flickering and other artifacts are more likely to occur if the LED display is not properly coordinated with it. In such embodiments, the user can specify the camera frame rate 110. The PWM control system 100 of such embodiments will then use the camera frame rate 110 and camera shutter speed 112 to better match the PWM timing with single shutter exposure periods and subsequent shutter exposure periods within the same video frame period.

[0047] In some embodiments, the PWM control system 100 indirectly determines appropriate timing information, for example, by monitoring the video output from the camera and detecting any visual artifacts present in the camera video output. Such embodiments can adjust the PWM timing of the LED video display screen 102 until the visibility of such artifacts (if any) in the camera video signal is minimized. This adjustment can be determined when displaying regular video content on the LED video display screen 102 or when displaying specially designed test patterns. Some such embodiments use separate test settings to measure camera characteristics (e.g., in an optical laboratory) to determine the necessary adjustment information.

[0048] In other embodiments, the "on time" of the PWM control system 100 is adjusted to control the motion blur and / or flicker effect of a fast-moving object moving in front of the LED video display screen 102. The outline of such an object is visible, but only when the LEDs are lit. Such embodiments can, based on user input, increase or decrease the duration of the PWM cycle, independent of the video frame rate, to increase or decrease the amount of motion blur, making it appear natural or eliminated, depending on the user input.

[0049] Other embodiments can support timing information from multiple cameras, with the PWM control system 100 optimizing its settings as much as possible to accommodate all cameras. This adaptation can be weighted based on user input indicating the importance of each camera, favoring one or more cameras over others. Multiple cameras may operate at different camera frame rates and / or shutter speeds, as may be encountered with a mix of high-speed and regular-speed cameras.

[0050] In some cases, the video image to be displayed during the exposure period of each camera may be the same, such as when using a high-speed camera and a regular speed camera together. In such an example, the PWM control system 100 considers the exposure periods of all cameras and finds the “most suitable” solution based on these constraints. For example, a regular speed camera with an exposure time of 16.7 milliseconds (ms) and a high-speed camera with an exposure time of 2 ms may require the PWM output to operate at a frequency of 500 Hz (to match the shorter 2 ms exposure time). During the longer 16.7 ms exposure time of the regular camera, multiple PWM cycles occur in sequence – there may be 8 repetitions totaling 16 ms, plus a 0.7 ms “off time” to complete the full 16.7 ms cycle, instead of needing to truncate the 9th repetition (which would cause visual artifacts). In this way, artifacts from both cameras can be minimized.

[0051] In other cases, the video image displayed for the first camera may differ from the video image displayed for the second camera (e.g., a tracking camera). In one such example, the PWM control system 100 displays the first video image during the exposure period of the main camera, while displaying a second video image including a machine-readable tracking pattern during the exposure period of the tracking camera (e.g., when the main camera's shutter is closed). In embodiments suitable for this situation, the techniques described herein can be used to minimize artifacts on both cameras, as these artifacts degrade the image quality visible to the main camera or a human viewer, and also cause problems when the tracking camera uses machine-readable patterns.

[0052] While this disclosure refers to LED video display screens, it should be understood that it is not so limited. In other embodiments, the PWM control system 100 can be used with other video display types to control screen brightness using PWM without producing noticeable artifacts for the viewer of the display. Such other video display types include organic LED (OLED), micro LED, liquid crystal display (LCD), plasma display, and other such light-emitting devices. In other embodiments, the PWM control system 100 can be used with projection video displays such as digital light processing (DLP) projectors, liquid crystal on silicon (LCoS) projectors, and laser projectors.

[0053] Figure 3This is a block diagram of a controller 300 in a PWM control system 100 according to the present disclosure. The controller 300 is suitable for use with a screen processor 104, a video display screen 102, and an LED panel of the video display screen 102. The controller 300 includes a processor 302 electrically connected to a memory 304. The processor 302 is implemented in hardware and software. The processor 302 can be implemented as one or more central processing unit (CPU) chips, cores (e.g., as a multi-core processor), field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), and digital signal processors (DSPs).

[0054] The processor 302 is further electrically connected to and communicates with the communication interface 306, the user display screen 310, and the user interface 312. The communication interface 306 is configured to receive video signals (e.g., video data 118) via one or more communication links 308a. The communication interface 306 is also configured to communicate with external devices via one or more Ethernet or other digital communication links 308b for control purposes. Such control data may include video frame rate 106, video synchronization 108, external synchronization 109, camera frame rate 110, camera shutter speed 112, camera shutter type 114, and shutter speed adjustment 116. The communication interface 306 is also configured to send and / or receive video display or LED panel control signals (e.g., screen control signals 120) via one or more additional Ethernet or other digital communication links 308c. Some of the links 308a, 308b, and 308c may optionally share a single physical connection. In other embodiments, the video signals, control data, and video data may be combined or separated into fewer or more than three communication links.

[0055] The processor 302 is configured to display system information to the user via the user display screen 310 and to output and receive user control information via the user interface 312. Although the controller 300 includes the user display screen 310 and the user interface 312, other embodiments do not include a user display screen and a user interface, and user control information can be sent and received via one or more Ethernet communication links 308b or other suitable communication links.

[0056] The controller 300 is suitable for implementing process, PWM matching control, and other functions disclosed herein, which can be implemented as instructions stored in memory 304 and executed by processor 302.

[0057] Memory 304 includes one or more disk, tape, and / or solid-state drives and can be used as an overflow data storage device to store programs when selected for execution, and to store instructions and data read during program execution. Memory 304 can be volatile and / or non-volatile, and can be read-only memory (ROM), random access memory (RAM), and / or static random access memory (SRAM). Memory 304 is configured to store software or firmware, including instructions that, when executed by processor 302, provide the PWM matching functionality described herein.

[0058] Figure 4 This is a flowchart of a method 400 for controlling a PWM in a video display according to an embodiment of the present disclosure. (See also...) Figure 1 , Figure 2B and Figure 3 The components shown indicate that method 400 is adapted for use by controller 300 of screen processor 104 to control the PWM of LED pixels in video display screen 102. Processor 302 executes instructions stored in memory 304 to perform method 400.

[0059] In step 402, the screen processor 104 obtains camera characteristics related to a camera configured to capture images displayed on the LED video display screen 102. These camera characteristics include the duration of the camera's shutter opening period. In step 404, the screen processor 104 calculates PWM timing control for the LED video display screen 102. This PWM timing control specifies the PWM cycle duration based on the camera's shutter opening period. In step 406, the screen processor 104 sends a screen control signal 120 to the LED video display screen 102. The screen control signal 120 is configured to control the brightness of the LED video display screen 102 according to the PWM timing control during the camera's shutter opening period.

[0060] As used herein, the term "PWM control system" refers to a system according to this disclosure that matches the PWM control of a video display to the operating characteristics of one or more video cameras. In various embodiments, elements of the PWM control system according to this disclosure may include internal processing systems within screen processor 104 and video display screen 102 and / or its LED panels (if any). In various embodiments, processing attributable to the PWM control system according to this disclosure may be performed in a single element of the system or distributed across multiple elements of the system.

[0061] While only some embodiments of this disclosure have been described herein, those skilled in the art will understand, with the benefit of this disclosure, that other embodiments can be devised without departing from the scope of this disclosure. Although the contents of this disclosure have been described in detail, it should be understood that various changes, substitutions, and modifications can be made therein without departing from the spirit and scope of this disclosure.

Claims

1. A pulse width modulation (PWM) control system, comprising: A memory configured to store instructions; as well as A processor, connected to the memory, configured to execute the instructions stored in the memory, to: Obtain camera features related to a camera configured to capture images displayed on a video display, the camera features including the duration of the period during which the camera's shutter is open, the camera features being dynamically determined based on information received from the camera or other data sources; Calculate PWM timing control for the video display, the PWM timing control specifying the PWM cycle duration according to the period when the shutter of the camera is open; as well as A signal is sent to the video display, the signal including the PWM timing control, and configured to cause the video display to control its brightness according to the PWM timing control during the period when the camera's shutter is open. Wherein, the PWM timing control is the first PWM timing control, and the PWM period duration is the first PWM period duration. The processor is configured to execute the instructions stored in the memory to calculate a third PWM timing control, the third PWM timing control specifying the duration of the third PWM cycle based on the period when the camera's shutter closes, and The signal further includes the third PWM timing control and is further configured to cause the video display to control the brightness of the video display according to the third PWM timing control during the period when the camera's shutter is closed.

2. The PWM control system of claim 1, wherein, The signal includes an indication of the start time of the PWM cycle.

3. The PWM control system of claim 1, wherein, The duration of the PWM cycle specified by the PWM timing control is less than the duration of the period during which the camera's shutter is open.

4. The PWM control system of claim 1, wherein, The signal further includes PWM regulation.

5. The PWM control system according to claim 4, wherein, The PWM adjustment is configured to extend or shorten the duration of the PWM cycle by one of the following methods: adjusting the PWM clock rate, adjusting the PWM bit depth, extending or shortening one or more periods during which the video display is off in the PWM cycle, and truncating the PWM cycle before it is completed.

6. The PWM control system according to claim 1, wherein, The signal is a first signal, the period during which the camera's shutter opens is a first period, and the processor is configured to execute the instructions stored in the memory to: Calculate a second PWM timing control for the video display, the second PWM timing control specifying a second PWM cycle duration, wherein the average of the first PWM cycle duration and the second PWM cycle duration matches more closely than the average of the first PWM cycle duration during the first period of shutter opening of the camera; and A second signal is sent to the video display, the second signal including the second PWM timing control, and configured to cause the video display to control the brightness of the video display according to the second PWM timing control during a second period when the shutter of the camera is open.

7. The PWM control system according to claim 1, wherein, The camera features further include a camera shutter type, and the processor is configured to execute the instructions stored in the memory to further calculate the PWM timing control based on the camera shutter type.

8. The PWM control system according to claim 1, wherein, The processor is configured to execute the instructions stored in the memory to send a PWM matching signal to a user of the PWM control system, the PWM matching signal being configured to indicate the degree of matching between the duration of the PWM cycle and the period during which the camera's shutter is open.

9. The PWM control system according to claim 1, wherein, The camera feature is a first camera feature related to a first camera, including a first duration of the first period of the first period of shutter opening of the first camera, and the processor is configured to execute the instructions stored in the memory to: Obtain second camera features in relation to a second camera configured to capture images displayed by the video display, the second camera features including a second duration of a second period of shutter opening of the second camera; as well as The PWM timing control is calculated based on the first camera features and the second camera features.

Citation Information

Patent Citations

  • Multi-view display system and method therefor

    CN103026717A

  • Drive device and display device

    WO2018164105A1