A method and apparatus for enhancing the broadcast of a live event

Abstract

Pan, tilt and zoom sensors are coupled to a broadcast camera in order to determine the field of view of the broadcast camera and to make a rough estimate of a target's location in the broadcast camera's field of view. Pattern recognition techniques can be used to determine the exact location of the target in the broadcast camera's field of view. If a preselected target is at least partially within the field of view of the broadcast camera, all or part of the target's image is enhanced. The enhancements include replacing the target image with a second image, overlaying the target image or highlighting the target image. Examples of a target include a billboard, a portion of a playing field or another location at a live event. The enhancements made to the target's image can be seen by the television viewer but are not visible to persons at the live event.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application is a continuation of U.S. patent application Ser. No. 09 / 844,524, filed on Apr. 27, 2001, which is a continuation of U.S. patent application Ser. No. 09 / 627,106, filed on Jul. 27, 2000, which is a continuation of U.S. patent application Ser. No. 09 / 264,138, filed Mar. 5, 1999, now U.S. Pat. No. 6,141,060, which is a continuation of U.S. patent application Ser. No. 08 / 735,020, filed Oct. 22, 1996, now U.S. Pat. No. 5,917,553, incorporated herein by reference.BACKGROUND OF THE INVENTION [0002] 1. Field of the Invention [0003] The present invention is directed to a method and apparatus for enhancing a television broadcast of a live event. [0004] 2. Description of the Related Art [0005] The television presentation of live events could be improved by enhancing the video in real time to make the presentation more interesting to the viewer. For example, television viewers cannot see the entire playing field during a sporting e...

AI Technical Summary

Benefits of technology

[0011] One embodiment of the present invention includes one or more field of view sensors coupled to a camera such that the sensors can detect data from which the field of view of the camera can be determined. The field of view sensors could include pan, tilt and / or zoom sensors. The system also includes a processor, a memory and a video modification unit. The memory stores a location of the target and, optionally, data representing at least a portion of the video image of the target. The processor, which is in communication with the memory and the field of view sensors, is programmed to determine whether the target is within the field of view of the camera and, if so, the position of the target within a frame of video of the camera. Alternate embodiments allow for the processor to determine the position of the target in the frame of video using field of view data, pattern (or image) recognition technology, electromagnetic signals and / or other appropriate means. One exemplar embodiment uses field of view data to find a rough location of the target and then uses pattern recognition to find the exact location. Such a combination of field of view data with pattern recognition technology provides for faster resolution of the target's location than using pattern recognition alone.

[0013] An alternate embodiment contemplates replacing either the field of view sensors and / or the pattern recognition technology with electromagnetic transmitters and sensors. That is, the target can be used to emit an electromagnetic signal. A sensor can be placed at the camera, or the camera can be used as a sensor, to detect the signal from the target in order to locate the target. Once the target is located within the video frame, the system can enhance the video image of the target. A further alternative includes treating the target with spectral coatings so that the target will reflect (or emit) a distinct signal which can be detected by a camera with a filter or other sensor.

Problems solved by technology

For example, television viewers cannot see the entire playing field during a sporting event; therefore, the viewer may lose perspective as to where one of the players or objects are on the field in relation to the rest of the field, players or objects.

Because the viewer can only see a small portion of the field a viewer may not know where a particular player is in relation to the pertinent locations on the field.

While the professional golfer is aware of these trouble spots and hits the ball to avoid those spots, the television viewer may not be aware of those trouble spots and may wonder why a particular golfer is hitting the ball in a certain direction.

Furthermore, live events do not take advantage of the scope of the television audience with respect to advertising.

First, advertisements on display at a stadium can be televised; however, many of those advertisements are not applicable to the television audience.

However, viewers in other parts of the United States or in other countries receiving the broadcast may not have access to that store and, thus, the broadcast of the advertisement is not effective.

Second, some of the space at a stadium is not used because such use would interfere with the view of the players or the spectators at the stadium.

However, such advertisements would block the view of spectators at the stadium.

Previous attempts to enhance the video presentation of live events have not been satisfactory.

Some broadcasters superimpose advertisements on the screen; however, these advertisements tend to block the view of the event.

The problem with this solution is that the software is too slow and cannot be effectively used in conjunction with a live event.

Such systems are even slower when they account for occlusions.

Images