Method and system for broadcasting and screening event

Abstract

A method for broadcasting and screening an event, which is performed by one or more electronic apparatuses, according to embodiments of the present disclosure, may comprise the steps of: generating one or more captured videos by capturing an event by using one or more photographing apparatuses; encoding the one or more captured videos into a synchronized single video stream and transmitting same; setting one or more playback target areas on the one or more captured videos, and generating a plurality of playback videos from the captured videos, on the basis of the stream and the one or more playback target areas; and playing back each of the plurality of playback videos via each of a plurality of display apparatuses.

Description

Event Broadcasting and Screening Methods and Systems

[0001] The present disclosure relates to a method and system for event broadcasting and screening, and specifically to a method and system for event broadcasting and screening capable of providing realistic images and various information through a plurality of display devices in a screening room based on event footage filmed at the site.

[0002] Large-scale events such as sports matches, concerts, and e-sports tournaments are broadcast through various media, allowing viewers around the world to watch them in real time, in addition to on-site attendance. Traditional event broadcasts were primarily provided through TV broadcasts and online streaming platforms, which were viewed mainly at home or on personal devices.

[0003] Recently, driven by advancements in high-resolution display and network transmission technologies, there is a growing demand to watch events in movie theaters and screening rooms equipped with large screens and high-quality sound, moving beyond traditional broadcasting environments. Audiences desire more than simply watching videos; they want to enjoy an immersive experience that makes them feel as if they are at the scene, along with various additional information.

[0004] However, most existing theater broadcasting methods provide the same video on a single screen, and features such as screen separation by area of ​​interest, real-time data provision, and audience participation are limited. As a result, there are limitations in that it is difficult for the audience to simultaneously receive desired information or videos from various perspectives.

[0005] Therefore, there is a growing need for event broadcasting and screening technologies that enhance realism and immersion by combining ultra-high-resolution multi-screens, real-time data, and interactive features in large theater environments.

[0006] The purpose of the present disclosure is to provide an event broadcasting and screening method and system capable of broadcasting an event with a sense of realism and simultaneously providing realistic images and various additional information by utilizing multiple display devices of a screening room.

[0007] The purpose of the present disclosure is to enable the audience to more easily determine and provide the desired point in time and scene through AI-based area of ​​interest analysis, and to enable an immersive and participatory viewing experience beyond simple viewing by combining the provision of event information and interaction functions with the audience.

[0008] An event relay and screening method performed by one or more electronic devices according to embodiments of the present disclosure may include: a step of generating one or more captured images by capturing an event using one or more capturing devices; a step of encoding the one or more captured images into a stream of synchronized single images and transmitting them; a step of setting one or more playback target areas on the one or more captured images and generating a plurality of playback images from the captured images based on the stream and the one or more playback target areas; and a step of playing each of the plurality of playback images through each of a plurality of display devices.

[0009] In one embodiment, the method further includes the step of detecting one or more regions of interest on the captured image using an artificial intelligence model and generating metadata regarding the one or more regions of interest, and the step of setting the one or more playback target regions may include the step of setting the one or more playback target regions among the one or more regions of interest based on the metadata.

[0010] In one embodiment, the region of interest is an area that the viewer is interested in in relation to the event, and the artificial intelligence model may be a model trained to detect the region of interest in a video related to the event.

[0011] In one embodiment, the metadata includes information regarding the location of the region of interest on the captured image and the recommended playback location of the region of interest, and the recommended playback location may be information regarding which of the plurality of display devices will play the image of the region of interest.

[0012] In one embodiment, each of the plurality of playback images may be configured to be played on a display device selected among the plurality of display devices based on information regarding a recommended playback location corresponding to the playback image.

[0013] In one embodiment, at least one of the one or more captured images has a first resolution, and the resolution of the playback image may have a second resolution that is 1 / 4 or less of the first resolution.

[0014] In one embodiment, the first resolution may be 8K or higher, and the second resolution may be FHD or lower.

[0015] In one embodiment, the region of interest may have a size corresponding to the second resolution.

[0016] In one embodiment, the display portions of the plurality of display devices may be arranged visually in a continuous manner.

[0017] In one embodiment, the display portion of each of the plurality of display devices may be at least one of the screen of the screening room or the wall surface adjacent to the screen.

[0018] In one embodiment, the one or more shooting devices include a main camera and a sub-camera, and the step of playing each of the plurality of playback images may include the step of playing a playback image corresponding to a shooting image captured by the main camera through a display device located at the center among the plurality of display devices, and the step of playing a playback image corresponding to a shooting image captured by the sub-camera through a display device located at the periphery among the plurality of display devices.

[0019] In one embodiment, the method may further include the step of generating one or more event information images based on data containing information regarding the event, and the step of playing the event information images through one or more of the plurality of display devices.

[0020] In one embodiment, the step of generating the plurality of playback videos may include receiving an input from an operator regarding which of the plurality of display devices to play each of the plurality of playback videos through, and controlling the plurality of display devices based on the input.

[0021] In one embodiment, the step of generating the plurality of playback images may include: displaying the one or more captured images and the one or more images of the regions of interest on a monitoring device so as to be distinguishable from one another; receiving input from an operator selecting two or more of the displayed plurality of images; and generating playback images based on each of the two or more images based on the input.

[0022] In one embodiment, in the step of displaying the one or more captured images on a monitoring device so as to be distinguishable from one another, if the resolution of the captured image is higher than the resolution of the playback image, the captured image may be divided into a plurality of segmented captured images of a size corresponding to the resolution of the playback image and displayed so as to be distinguishable from one another.

[0023] In one embodiment, the method may further include the step of receiving an operator's input regarding the switching of a playback video and the step of switching the playback video based on the input.

[0024] An event relay and screening system according to embodiments of the present disclosure may include: one or more shooting devices configured to capture an event and generate one or more captured images; a transmission device configured to encode and transmit the one or more captured images into a stream of synchronized single images; a playback server configured to generate metadata regarding one or more regions of interest on the captured images using an artificial intelligence model, set one or more playback target regions based on the metadata, and generate a plurality of playback images from the captured images based on the stream and the one or more playback target regions; and a plurality of display devices configured to play each of the plurality of playback images.

[0025] In one embodiment, the electronic device is further configured to detect one or more regions of interest on the captured image using an artificial intelligence model and to generate metadata regarding the one or more regions of interest, and the playback server may be further configured to set one or more playback target regions among the one or more regions of interest based on the metadata.

[0026] According to embodiments of the present disclosure, by synchronizing and providing ultra-high resolution and high frame rate video footage to a plurality of display devices, the audience can experience a vivid sense of immersion as if they were at the actual event site. For example, by playing high-resolution video captured by a main camera on a central display device in the theater and synchronizing and playing auxiliary video captured by a sub-camera on peripheral display devices, the entire screen and a specific scene can be displayed simultaneously, thereby maximizing the richness of visual information.

[0027] According to embodiments of the present disclosure, an artificial intelligence model can be utilized to automatically detect areas in a filmed video that are likely to attract the audience's interest, and metadata regarding these areas can be generated to create a playback video. By doing so, key players, specific scenes, and important parts of a game can be extracted into separate playback videos, allowing those scenes to be provided intensively on multiple display devices. Through this configuration, the audience can enjoy the desired scenes in real time without missing them.

[0028] According to embodiments of the present disclosure, by providing not only regions of interest detected using an artificial intelligence model in captured video footage, but also video footage from various viewpoints acquired by multiple capturing devices and video regarding various event information data such as game statistics, player information, and progress status, on multiple display devices, the audience can obtain a rich and multi-layered viewing experience that is difficult to experience with a single screen. That is, by placing the entire flow of the game on the main screen and video of the surrounding areas of the game or additional information on peripheral screens and displaying them simultaneously, the sense of presence can be enhanced while the ability to convey information can be strengthened.

[0029] According to embodiments of the present disclosure, an operator can receive input to select or switch a specific video among a plurality of playback videos and control the playback device accordingly. Through this, the operator can directly select a screen they wish to play during a screening or immediately switch to and watch a player or scene of interest, thereby enabling active and participatory viewing rather than one-way passive viewing.

[0030] According to embodiments of the present disclosure, the system provides a structure capable of transmitting video in real time to multiple theaters without delay or degradation of image quality while maintaining the same quality and configuration. Since the same timecode-based synchronization is possible even in multiple theaters with different network environments, stability is ensured even when large-scale events are screened simultaneously on a national or global scale.

[0031] FIG. 1 is a block diagram showing an event relay and screening system according to embodiments of the present disclosure.

[0032] FIG. 2 is a drawing for explaining the operation of each component included in an event relay and screening system according to embodiments of the present disclosure.

[0033] FIGS. 3a and 3b are flowcharts illustrating examples of event relay and screening methods according to embodiments of the present disclosure.

[0034] FIG. 4 is a drawing for explaining the resolution of the captured image and the reproduced image in the embodiments of the present disclosure.

[0035] FIG. 5 is a drawing showing an example of a captured image in embodiments of the present disclosure.

[0036] FIGS. 6a and 6b are drawings illustrating examples of images captured by one or more imaging devices in embodiments of the present disclosure.

[0037] FIG. 7 is a drawing for illustrating a region of interest in embodiments of the present disclosure.

[0038] FIG. 8 is a drawing for illustrating a monitoring device in embodiments of the present disclosure.

[0039] FIGS. 9a to 9c are drawings illustrating examples of replayed images in embodiments of the present disclosure.

[0040] FIG. 10 is a drawing for explaining that a playback image is played on a plurality of display devices in embodiments of the present disclosure.

[0041] Hereinafter, specific embodiments of the present disclosure will be described in detail with reference to the attached drawings.

[0042] The embodiments of the present disclosure are illustrative for the purpose of explaining the embodiment. Various modifications may be made to the embodiments, and the scope of the present application is not limited by these embodiments. It should be understood that all modifications, equivalents, and substitutions to the embodiments are included within the scope of the rights.

[0043] In the accompanying drawings, identical or similar components are assigned the same reference numbers. Additionally, when describing embodiments of the present disclosure, descriptions of identical or similar components may be omitted to avoid redundant descriptions. However, such omission of description is not intended to imply that the component is not included in a particular embodiment.

[0044] Unless otherwise defined, the terms used in this disclosure may have the meaning generally understood by those skilled in the art.

[0045] In the present disclosure, the expressions “each of a plurality of A” or “each of a plurality of A” may refer to each of all elements included in a plurality of A, or may refer to each of some elements of a plurality of A.

[0046] In the present disclosure, the expression “one or more A” may mean a set of one or more A's unless the context clearly indicates otherwise.

[0047] In this disclosure, expressions such as "first," "second," or "first," "second," etc., do not limit the order, importance, etc., of the components they modify unless the context clearly indicates otherwise. These expressions may be used to distinguish one component from another.

[0048] In the present disclosure, expressions such as “A, B, or C”, “A, B, and / or C”, “at least one of A, B, and C”, “at least one of A, B, or C”, “at least one of A, B, and / or C”, “at least one selected from A, B, and C”, “at least one selected from A, B, or C”, and “at least one selected from A, B, and / or C” may mean each or all possible combinations thereof. For example, “at least one of A or B” may refer to at least one A, at least one B, at least one A, and at least one B.

[0049] In the present disclosure, expressions such as "connected" and "connected" should be understood to mean that while one component may be directly connected to or connected to another component, a new component may exist between them.

[0050] Expressions such as “comprising,” “having,” and “having” as used in this disclosure imply the presence of the relevant features (e.g., functions, operations, or components, etc.) and do not exclude the presence of additional features. That is, these expressions should be understood as open-ended terms that leave open the possibility of including other embodiments.

[0051] In the present disclosure, expressions such as "configured to..." may have meanings such as "set to...", "capable of...", "modified to...", "made to...", or "capable of..." depending on the context. These expressions are not limited to "specifically designed in hardware." For example, a processor configured to perform a specific operation may refer to a general-purpose processor capable of performing that operation through software execution, or a special-purpose computer structured through programming to perform the said specific operation.

[0052] Hereinafter, the present disclosure will be described in more detail with reference to the attached drawings.

[0053] FIG. 1 is a block diagram illustrating an event relay and screening system according to embodiments of the present disclosure. FIG. 2 is a diagram for explaining the operation of each component included in the event relay and screening system according to embodiments of the present disclosure.

[0054] Referring to FIGS. 1 and 2, an event relay and screening system (100) according to embodiments of the present disclosure is a system for relaying and screening events, and may be a system comprising a plurality of devices. The event relay and screening system (100) may be operated by one or more operators. One or more operators may provide event relay and screening services through the event relay and screening system (100).

[0055] In the embodiments of the present disclosure, "event" refers to a specific incident, event, or activity, and may mean a large-scale activity in which a large number of spectators watch or participate in real time, such as a sports match, concert, e-sports competition, or exhibition. An event may be a subject that can be delivered to a remote audience through broadcasting and screening. That is, in the embodiments of the present disclosure, an event may be a subject activity that is filmed and broadcast in real time so that an audience can experience it immersively in a large theater or similar venue. In the present disclosure, embodiments are described using a baseball game as an example of an event.

[0056] In the embodiments of the present disclosure, "broadcasting / relay" may mean capturing an event occurring at a remote location and transmitting it to another location. In the embodiments of the present disclosure, broadcasting may mean a process of encoding and transmitting video captured at the event site so that it can be played back in real time on a display device located far away (e.g., a movie theater). That is, in the embodiments of the present disclosure, broadcasting may mean a series of processes that transmit video regarding a captured event to a transmission device via a network or transmission network and connect it to a playback server and a display device.

[0057] In the embodiments of the present disclosure, "screening" may mean projecting an image onto a screen or display to provide it for viewing by an audience or viewer. In particular, in the embodiments of the present disclosure, screening may mean providing images filmed and broadcast regarding an event through a display device by combining or arranging a main image, an area of ​​interest image, an event information image, etc., in various ways.

[0058] The event broadcasting and screening system (100) may include a shooting device (110), a transmission device (120), a playback server (130), and a display device (140). In addition, the event broadcasting and screening system (100) may further include an electronic device not shown in FIG. 1 (hereinafter referred to as "electronic device not shown").

[0059] The shooting device (110) may be one or more electronic devices. The shooting device (110) may include one or more shooting devices (e.g., cameras). The shooting device (110) may refer to a camera or similar device for acquiring or capturing images. The shooting device (110) may include a main camera, a sub-camera, and a special shooting device (e.g., a drone, a jib camera). The shooting device (110) may capture the event site at various angles and resolutions to generate one or more captured images that can be used for screening. The shooting device (110) may acquire the event as original video data and provide it as input for subsequent encoding, transmission, and screening processes.

[0060] In the example of FIG. 2, the event is a baseball game, and the imaging device (110) may include a plurality of imaging devices. For example, the imaging device (110) may include a first imaging device (111), a second imaging device (112), and a third imaging device (113). The first imaging device (111), the second imaging device (112), and the third imaging device (113) may capture different parts of the event. In the example of FIG. 2, the first imaging device (111) may capture the dugout side of the baseball game. The second imaging device (112) may capture the cheerleader side of the baseball game. The third imaging device (113) may capture the stadium side of the baseball game. For example, the third imaging device (113) may be the main camera, and the first imaging device (111) and the second imaging device (112) may be sub cameras. The main camera and the sub cameras may have different resolution specifications. That is, the resolution of the video captured by the main camera and the resolution of the video captured by the sub-camera may differ from each other. However, this is merely illustrative, and the number and types of imaging devices according to the embodiments of the present disclosure are not limited to the examples described herein.

[0061] The shooting device (110) may be configured to capture an event and generate one or more captured images. The captured images will be described in detail below with reference to FIGS. 4 to 7, etc.

[0062] The transmission device (120) may be one or more electronic devices. The transmission device (120) may be a device that encodes video received from a shooting device (110) or an electronic device not shown, converts it into a transmittable stream, and transmits it through a network or transmission network. The transmission device (120) may include an encoder and a relay device. That is, the transmission device (120) may be a hardware and software configuration that encodes the captured video into a stream, transmits it through a network or transmission network, and sends it to a playback server (130).

[0063] Encoding may refer to the process of converting original video and audio signals generated by a recording device into a compression format suitable for digital transmission. For example, encoding may involve converting an uncompressed original signal into a transmittable stream using a compression codec such as H.264, H.265 / HEVC, or AV1. In this process, the video can have its capacity reduced by removing duplicate pixel data and unnecessary information, and the audio can also be converted into a compression format to increase transmission efficiency. In the embodiments of the present disclosure, encoding may involve converting a large volume of video footage captured at an event site via a recording device (110) into a stream transmittable over a network via a transmission device (120).

[0064] For example, the transmission device (120) may be a broadcast van (OB Van). The broadcast van performs functions similar to a mobile broadcasting station and can be connected to a shooting device (110) or an electronic device not shown at the site to encode, edit, and transmit the captured video in real time. The broadcast van is equipped with an encoder, video switcher, audio mixer, satellite and network transmission device, etc., so that it can transmit directly from the site to a broadcasting station or cloud server. In particular, the broadcast van can be used as a key transmission device in various events such as large-scale sports games, concerts, and national events. In addition, the transmission device (120) may take the form of a studio transmission server that encodes and transmits the captured video from within a studio, or a cloud-based transmission system that uploads the stream encoded at the site to the cloud and distributes it to various theaters or platforms. Furthermore, portable mobile transmission devices such as LiveU and TVU Pack can be directly connected to a camera to transmit the captured video in real time via a 5G or LTE network. The transmission device (120) may have various forms as described above and may be selectively used depending on the event relay environment. The form of the transmission device (120) according to the embodiments of the present disclosure is not limited to the examples described herein.

[0065] The transmission device (120) may be configured to encode one or more captured images into a stream of a single synchronized image and transmit them. The specific operation of the transmission device (120) will be described in detail below with reference to FIGS. 5 and 6, etc.

[0066] The playback server (130) may be one or more electronic devices. The playback server (130) may be a device that receives an encoded stream from a transmission device (120), generates a plurality of playback videos, and distributes and controls the playback videos to a plurality of display devices (140). The playback server (130) may be a device that generates and manages a video for screening based on transmission data and controls the output status of the display devices.

[0067] For example, the playback server (130) may be a local playback server. In this case, the playback server (130) may be installed inside a theater to receive video from a transmission device (120), generate a playback video, and control a display device (140). Alternatively, the playback server (130) may be a cloud-based playback server. In this case, the playback server (130) may operate in a cloud environment such as AWS or Azure, and may convert a stream received from a transmission device (120) into multiple playback videos and then transmit them to each theater. Alternatively, the playback server (130) may be a hybrid playback server. In this case, the playback server (130) may combine a cloud server and a local playback server to generate a playback video in the cloud first, then optimize it locally and control a display device (140). However, this is merely illustrative, and the form of the playback server (130) according to the embodiments of the present disclosure is not limited to the examples described herein.

[0068] The playback server (130) may include a processor and memory. The playback server (130) may further include a communication interface. At least one of the components of the playback server (130) may be omitted, or another component may be added to the playback server (130), or additionally or substantially, some of the components may be implemented as an integrated unit or as a single or multiple entity. At least some of the components inside or outside the playback server (130) may be connected to one another via a bus, GPIO (General Purpose Input / Output), SPI (Serial Peripheral Interface), or MIPI (Mobile Industry Processor Interface), etc., to give or receive data or signals. What is described in this disclosure as being performed by the playback server (130) may be understood as being performed by at least one of the processor, memory, and communication interface of the playback server (130).

[0069] The playback server (130) may be configured to set one or more playback target areas on one or more captured images and to generate a plurality of playback images from the captured images based on a stream and one or more playback target areas. The specific operation of the playback server (130) will be described in detail below with reference to FIGS. 7 to 10, etc.

[0070] The display device (140) may be one or more electronic devices. The display device (140) may include one or more display devices or display units (e.g., a display, a screen, etc.). Specifically, in the display device (140), one or more images may be displayed through one or more display devices or display units. The display device (140) may refer to a device that displays and outputs images. For example, the display device (140) may be a TV, a monitor, a projector, a screen, etc. In particular, in the embodiments of the present disclosure, a large screen installed in a theater or an environment in which multiple screens are arranged in series may correspond to the display device (140). However, this is merely illustrative, and the form of the display device (140) according to the embodiments of the present disclosure is not limited to the examples described herein. The display device (140) may be an output device that actually displays and outputs a playback video transmitted from the playback server (130) so that an audience can view it.

[0071] The electronic device not shown may be a device integrated and configured within the transmission device (120), or it may be a device provided separately from the transmission device (120). The electronic device not shown may include a processor and memory. The electronic device not shown may further include a communication interface. At least one of the components of the electronic device not shown may be omitted, or another component may be added to the electronic device not shown, or additionally or substantially, some components may be implemented by being integrated, or implemented as a single or multiple entities. At least some of the components inside or outside the electronic device not shown may be connected to one another via a bus, GPIO (General Purpose Input / Output), SPI (Serial Peripheral Interface), or MIPI (Mobile Industry Processor Interface), etc., to give or receive data or signals. What is described in this disclosure as being performed by the electronic device not shown may be understood as being performed by at least one of the processor, memory, and communication interface of the electronic device not shown.

[0072] An electronic device not shown may be configured to utilize an artificial intelligence model to detect one or more regions of interest in a captured video and to generate metadata regarding one or more regions of interest. In this case, the electronic device not shown may receive data regarding one or more captured videos from a capturing device (110), perform the above operation, and transmit data or metadata regarding one or more regions of interest to a transmitting device (120) or a playback server (130). In this case, the playback server (130) may be configured to set one or more playback target regions among one or more regions of interest based on the metadata.

[0073] In the embodiments of the present disclosure, there may be one or more screening rooms, each equipped with one or more display devices. In the example of FIG. 2, there may be a first screening room (141), a second screening room (142), a third screening room (143), etc. The first screening room (141), the second screening room (142), the third screening room (143), etc., may each be equipped with one or more display devices. The first screening room (141), the second screening room (142), the third screening room (143), etc., and the one or more display devices equipped in each thereof may be separately controlled by a playback server (130) to display a playback video.

[0074] The display device (140) may be configured to play each of a plurality of playback videos. The form and operation of the display device (140) will be described in detail below with reference to FIGS. 9 and 10, etc.

[0075] Hereinafter, with reference to FIG. 3 and the like, an event broadcasting and screening method performed by the event broadcasting and screening system (100) will be described.

[0076] FIGS. 3a and 3b are flowcharts illustrating examples of event relay and screening methods according to embodiments of the present disclosure.

[0077] Referring to FIGS. 1 to 3a and 3b, the event relay and screening method according to embodiments of the present disclosure may be a method for relaying and screening an event, and may include a plurality of steps. The event relay and screening method may be performed by one or more electronic devices. For example, the event relay and screening method may be performed by an event relay and screening system (100).

[0078] An event relay and screening method according to embodiments of the present disclosure may be performed by one or more operators. One or more operators may be operators of an event relay and screening system (100). One or more operators may provide an event relay and screening service through the event relay and screening method.

[0079] FIG. 3a is a flowchart illustrating an example of an event relay and screening method according to embodiments of the present disclosure. Specifically, the event relay and screening method according to embodiments of the present disclosure can be performed based on the example illustrated in FIG. 3a.

[0080] Referring to FIG. 3a, the event broadcasting and screening method may include a step (S100) of capturing an event using one or more capturing devices to generate one or more captured images. Step S100 may be performed by a capturing device (110) of an event broadcasting and screening system (100). Step S100 will be described in detail below with reference to FIG. 4 to 7, etc.

[0081] The event broadcasting and screening method may include a step (S200) of encoding one or more captured videos into a synchronized single video stream and transmitting it. Step S200 may be performed by a transmission device (120) of the event broadcasting and screening system (100). Step S200 will be described in detail below with reference to FIGS. 5 and 6, etc.

[0082] The event broadcasting and screening method may include the step (S300) of setting one or more playback target areas on one or more captured images and generating a plurality of playback images from the captured images based on a stream and one or more playback target areas. Step S300 may be performed by a playback server (130) of the event broadcasting and screening system (100). Step S300 will be described in detail below with reference to FIG. 9, etc.

[0083] The event broadcasting and screening method may include a step (S400) of playing each of a plurality of playback videos through each of a plurality of display devices. Step S400 may be performed by a display device (140) of the event broadcasting and screening system (100). Step S400 will be described in detail below with reference to FIG. 10, etc.

[0084] FIG. 3b is a flowchart illustrating another embodiment of an event relay and screening method according to embodiments of the present disclosure. Specifically, the event relay and screening method according to embodiments of the present disclosure may be performed by modifying it as shown in FIG. 3b based on the embodiment shown in FIG. 3a. Hereinafter, only the parts of FIG. 3b that differ from the embodiment shown in FIG. 3a will be described.

[0085] Referring to FIG. 3b, the event broadcasting and screening method may further include a step (S150) of detecting one or more regions of interest in a captured video using an artificial intelligence model and generating metadata regarding one or more regions of interest. Step S150 may be performed by an electronic device of the event broadcasting and screening system (100). The electronic device may be an electronic device not shown in FIG. 1. Step S150 will be described in detail below with reference to FIG. 7, etc.

[0086] The event broadcasting and screening method may include the step (S300') of setting one or more playback target areas among one or more regions of interest based on metadata, and generating a plurality of playback videos from a captured video based on a stream and one or more playback target areas. Specifically, step S300 in the embodiment illustrated in FIG. 3a may be performed as step S300' in the embodiment illustrated in FIG. 3b. That is, step S300 may include step S300'. Step S300' may be performed by a playback server (130) of the event broadcasting and screening system (100). Step S300' will be described in detail below with reference to FIG. 9, etc.

[0087] FIG. 4 is a drawing for explaining the resolution of the captured image and the reproduced image in the embodiments of the present disclosure.

[0088] Referring to FIGS. 1 to 4, the event broadcasting and screening method may include the step (S100) of capturing an event using one or more shooting devices to generate one or more captured images.

[0089] The resolution of the captured image (VC) captured by the capturing device (110) in step S100 may be at least four times the resolution of the playback image (VP) generated by the playback server (130) in step S300 or played by the display device (140) in step S400. For example, the resolution of the captured image (VC) may be 16 times the resolution of the playback image (VP). In the example of FIG. 4, the resolution of the captured image (VC) may be 8K (7680X4320) and the resolution of the playback image (VP) may be FHD (1920X1080). Alternatively, although not illustrated, the resolution of the captured image (VC) may be 16K (15360X8640) and the resolution of the playback image (VP) may be UHD (3840X2160). However, this is merely illustrative, and the resolution of the captured image and the reproduced image according to the embodiments of the present disclosure is not limited to the examples described herein.

[0090] According to this, by making the resolution of the captured video sufficiently higher than the resolution of the playback video, multiple playback videos to be played on each of the multiple display devices within the video can be obtained using only a single captured video. This will be explained in detail below with reference to FIG. 7, etc.

[0091] FIG. 5 is a drawing showing an example of a captured image in embodiments of the present disclosure. Specifically, FIG. 5 is a drawing showing an example of a captured image taken by a capturing device in step S100.

[0092] In the example of FIG. 5, the event is a baseball game, and the shooting device (110) may be the third shooting device (113) of FIG. 2. The third shooting device (113) may be configured to shoot towards the stadium during the baseball game. That is, the captured video (VC1) may be a captured video of the stadium during the baseball game. In this case, the third shooting device (113) may have a resolution specification of at least four times (e.g., 16 times) the resolution of the playback video. That is, the captured video (VC1) may have a resolution of at least four times (e.g., 16 times) the resolution of the playback video. For example, the third shooting device (113) may have a resolution specification of 8K or higher as a main camera. That is, the captured video (VC1) may have a resolution of 8K or higher. In this case, the captured video (VC1) may include the entire area of ​​the stadium (an area including the entire diamond area consisting of the first base, second base, third base, and home area, and all players in the game).

[0093] FIGS. 6a and 6b are drawings illustrating other examples of captured images in embodiments of the present disclosure. Specifically, FIGS. 6a and 6b are drawings illustrating examples of captured images taken by the capturing device (110) in step S100.

[0094] In the example of FIG. 6a, the event is a baseball game, and the recording device (110) may be the first recording device (111) of FIG. 2. The first recording device (111) may be configured to record the dugout side of the baseball game. That is, the recorded video may be a recorded video of the dugout side of the baseball game. In this case, the first recording device (111) may have a resolution specification substantially identical to the resolution of the playback video. That is, the recorded video may have a resolution substantially identical to the resolution of the playback video. For example, the first recording device (111) may have a resolution specification of FHD or UHD as a sub-camera. That is, the recorded video may have a resolution of FHD or UHD.

[0095] In the example of FIG. 6b, the event is a baseball game, and the recording device (110) may be the second recording device (112) of FIG. 2. The second recording device (112) may be configured to record the cheerleaders in the baseball game. That is, the recorded video may be a recording of the cheerleaders in the baseball game. In this case, the second recording device (112) may have a resolution specification substantially identical to the resolution of the playback video. That is, the recorded video may have a resolution substantially identical to the resolution of the playback video. For example, the second recording device (112) may have a resolution specification of FHD or UHD as a sub-camera. That is, the recorded video may have a resolution of FHD or UHD.

[0096] The method for broadcasting and screening an event may include the step (S200) of encoding one or more captured videos into a stream of a single synchronized video and transmitting it.

[0097] For example, in step S200, multiple captured images can be encoded into a synchronized single image stream and transmitted. Specifically, in step S200, multiple captured images can be treated as a single image and encoded into a synchronized single image stream for transmission. For example, in step S200, multiple captured images can be encoded into a synchronized single image stream and transmitted through the same transmission path in a synchronized state according to the same reference timecode.

[0098] If video is acquired from multiple recording devices and then encoded into separate streams for transmission, each stream must be individually decoded and synchronized during the playback stage, which may result in latency or synchronization inconsistencies. On the other hand, according to the embodiments of the present disclosure, multiple captured videos are integrated into a single synchronized video stream and encoded for transmission, so that no time difference occurs between videos during transmission and they can be provided in a synchronized state according to the same reference time code. Accordingly, since videos played on multiple display devices maintain an exactly aligned time axis, the audience can enjoy stable viewing without interruption or inconsistency even during screen transitions or multi-screen screenings.

[0099] Furthermore, transmitting as a single synchronized video stream can be advantageous in terms of network bandwidth management and transmission efficiency. While transmitting multiple streams in parallel increases the load on the transmission path and raises the risk of delay or packet loss, encoding and transmitting as a single synchronized video stream allows for stable data delivery over the same transmission path. As a result, the video displayed on multiple screens within a theater provides a more realistic and immersive experience, while ensuring consistent quality during both transmission and playback.

[0100] According to embodiments of the present disclosure, by utilizing multiple captured images taken by multiple shooting devices deployed at an event site, viewers watching the event broadcast can appreciate various aspects of the event. This can be maximized by playback control and screening methods according to embodiments of the present disclosure, which will be explained in detail below with reference to FIGS. 8 to 10, etc.

[0101] Figure 7 is a diagram illustrating an example of a region of interest in the example of the captured image of Figure 5.

[0102] Referring to FIGS. 1 to 5 and 7, the event broadcasting and screening method may include the step (S150) of detecting one or more regions of interest in a captured video using an artificial intelligence model and generating metadata regarding one or more regions of interest.

[0103] In step S150, one or more regions of interest (AI1, AI2, AI3) can be determined in the captured image (VC1).

[0104] In the embodiments of the present disclosure, a "region of interest" may refer to an area within a filmed video of an event that is expected to receive special attention from a viewer or contains meaningful information. That is, the region of interest may refer to a portion of the video that includes a person, object, scene, segment, etc., likely to attract the attention of an audience during the broadcasting and screening of the event.

[0105] In the embodiments of the present disclosure, an artificial intelligence model can automatically detect a region of interest from a captured video, and such a region of interest can be expressed in the form of metadata. The metadata may include the location, size, time information, recommended display location, etc., of the region of interest. This metadata can be utilized to provide the corresponding scene as a separate playback video on multiple display devices. Through this, the audience can enjoy a richer and more realistic viewing experience.

[0106] The region of interest may have a size corresponding to the resolution of the playback video. For example, if the resolution of the playback video is FHD, the region of interest may have a size corresponding to FHD. If the resolution of the playback video is UHD, the region of interest may have a size corresponding to UHD. According to the embodiments of the present disclosure, since the resolution of the captured video may be four times or more the resolution of the playback video, the size of the region of interest, which is a part of the captured video, may correspond to the resolution of the playback video. For example, if the resolution of the captured video is 8K and the resolution of the playback video is FHD, since the resolution of the captured video is 16 times the resolution of the playback video, the size of the region of interest may be 1 / 16 of the size of the captured video.

[0107] In the example of FIG. 7, the resolution of the captured video (VC1) may be 8K or higher, and the resolution of the playback video may be UHD or lower. In step S150, a first region of interest (AI1), a second region of interest (AI2), and a third region of interest (AI3) may be determined in the captured video (VC1). The sizes of the first region of interest (AI1), the second region of interest (AI2), and the third region of interest (AI3) may correspond to the resolution of the playback video. For example, if the resolution of the playback video is FHD, the sizes of the first region of interest (AI1), the second region of interest (AI2), and the third region of interest (AI3) may correspond to FHD. The first region of interest (AI1) may be an area centered on the pitcher in a baseball game. The second region of interest (AI2) may be an area centered on the batter in a baseball game. The third region of interest (AI3) may be a part of the spectator stands in a baseball game.

[0108] In step S150, an artificial intelligence model may be used to determine one or more regions of interest (AI1, AI2, AI3).

[0109] An artificial intelligence model can refer to software or algorithms capable of performing functions such as prediction, classification, recognition, and inference on new inputs by learning from a large amount of data. Artificial intelligence models can be utilized in the processing of image, audio, and text data.

[0110] An "artificial intelligence model" according to embodiments of the present disclosure may be a model trained to detect areas of interest (i.e., areas of interest) that a viewer has in relation to an event in a video of an event. For example, the artificial intelligence model may be trained to automatically analyze, detect, and identify players, specific scenes, objects, actions, etc. The artificial intelligence model may be trained through various machine learning and deep learning-based techniques. Below, training techniques that can be used to train the artificial intelligence model will be described in detail.

[0111] For example, when applying supervised learning techniques, a model can be trained using training data that labels areas such as players, specific scenes, and regions of interest included in event videos. This method enables precise detection of regions of interest within a video in terms of location and size by utilizing object detection models such as Convolutional Neural Networks (CNN), R-CNN, YOLO, and Faster R-CNN.

[0112] Alternatively, semi-supervised learning techniques can be applied. In this case, the entire event video can be efficiently trained by using only a small amount of labeled data and utilizing the model's self-predicted results for additional training on the large volume of unlabeled data. This allows for the reduction of labeling costs while ensuring versatility applicable to various event types.

[0113] Alternatively, unsupervised learning techniques can be applied. For instance, using autoencoders, variational autoencoders (VAE), and generative adversarial networks (GANs), it is possible to automatically extract key areas of interest by learning recurring objects or patterns from unlabeled data. This method can be advantageous for automatically classifying specific individuals or key parts of a stage during games or performances.

[0114] Alternatively, reinforcement learning techniques can be applied. In this case, by utilizing reward signals such as audience reactions, voting results, and interaction inputs, the model can dynamically detect areas of interest aligned with the actual viewers' interests or attention flows. Applying this method enables adaptive detection that responds to real-time changes in audience interest.

[0115] Alternatively, transfer learning techniques can be applied to fine-tune a pre-trained model, originally trained on existing large-scale public datasets, to suit the event video. In this case, high-accuracy detection of regions of interest can be achieved even with limited event data.

[0116] The AI ​​model trained in this manner can detect and identify areas of interest that an audience may focus on within a video of an event. Furthermore, the AI ​​model may generate metadata such as the location, size, and time information of the area. That is, in the embodiments of the present disclosure, the AI ​​model may be an intelligent module for extracting meaningful scenes in real time in an event broadcasting and screening environment and for providing video suitable for a multi-screen environment of a theater.

[0117] In the example of FIG. 7, the AI ​​model can determine one or more regions of interest (AI1, AI2, AI3) by analyzing a captured video (VC1). For example, the AI ​​model can determine the first region of interest (AI1) by determining that the area surrounding the pitcher in the captured video (VC1) regarding a baseball game is a region of interest. The AI ​​model can determine the second region of interest (AI2) by determining that the area surrounding the batter in the captured video (VC1) regarding a baseball game is a region of interest. The AI ​​model can determine the third region of interest (AI3) by determining that a part of the spectator stands in the captured video (VC1) regarding a baseball game is a region of interest. While determining multiple regions of interest, the AI ​​model can determine the ranking and type of each region of interest. The ranking of a region of interest may be the ranking of the level of interest of that region among multiple regions of interest. The type of a region of interest may refer to what type of region of interest it is (for example, in the case of a baseball game, whether it is a region of interest regarding the game, a region of interest regarding the spectators, a region of interest regarding the dugout, etc.).

[0118] In step S150, metadata regarding the determined regions of interest (AI1, AI2, AI3) can be generated.

[0119] Metadata refers to data about data, and may mean data that includes information describing the structure, attributes, location, and usage method of the original data. In the embodiments of the present disclosure, metadata may include information regarding the location of a region of interest on a captured video. In addition, metadata may include information regarding the size, ranking, type, recommended display location, etc. of the region of interest. Alternatively, metadata may include information regarding a team or player reflected in other broadcast videos. Here, the recommended playback location may be information regarding which of the plurality of display devices will play the video of the region of interest. The recommended playback location will be described in detail below with reference to FIG. 10. Metadata may include control information for identifying a region of interest within a captured video and appropriately mapping it to a plurality of display devices. The metadata generated in this way can be used to configure a plurality of playback videos in a playback server (130) and distribute them to display devices.

[0120] According to embodiments of the present disclosure, an artificial intelligence model can be utilized to automatically detect areas in a filmed video that are likely to attract the audience's interest, and metadata regarding these areas can be generated to create a playback video. By doing so, key players, specific scenes, and important parts of a game can be extracted into separate playback videos, allowing those scenes to be provided intensively on multiple display devices. Through this configuration, the audience can enjoy the desired scenes in real time without missing them.

[0121] FIG. 8 is a drawing for illustrating a monitoring device in embodiments of the present disclosure.

[0122] Referring to FIGS. 1 to 8, the event relay and screening method may include the step (S300) of setting one or more playback target areas on one or more captured images and generating a plurality of playback images from the captured images based on a stream and one or more playback target areas.

[0123] Step S300 may include the step of displaying one or more captured images and one or more images of regions of interest to a monitoring device (MN) so as to be distinguishable from one another.

[0124] Although not illustrated in FIG. 1, the event broadcasting and screening system (100) may further include a monitoring device (MN). The monitoring device (MN) may be a component included in the playback server (130) or a component separately provided as a peripheral device of the playback server (130). The monitoring device (MN) may be a device for enabling an operator of the event broadcasting and screening system (100) or a user of the playback server (130) (hereinafter collectively referred to as "operator") to set a playback target area among one or more captured images and one or more images of a region of interest. For example, the monitoring device (MN) may be a display device. In this case, the monitoring device (MN) may be configured to display one or more captured images and one or more images of a region of interest on a large display so as to be distinguishable from one another.

[0125] In the example of FIG. 8, the display of the monitoring device (MN) may display one or more captured images and one or more images of a region of interest (parts indicated by multiple small rectangles in FIG. 8) so as to be distinguishable from one another. In this case, the monitoring device (MN) may display information regarding each image together with the image. For example, information regarding the capturing device that captured the image, the resolution of the image, and the part of the event where the image is captured (e.g., game, dugout, cheerleaders, spectator stands, etc.) may be displayed together. Additionally, the monitoring device (MN) may provide an identification mark for the image of the region of interest. The identification mark may indicate that the image is an image of the region of interest, information included in the metadata of the region of interest, etc.

[0126] In the monitoring device (MN), when the resolution of the captured image is higher than the resolution of the playback image, the captured image can be divided into multiple segmented captured images of a size corresponding to the resolution of the playback image and displayed so as to be distinguishable from each other. In this case, the segmented captured images may include images of the region of interest. For example, when the resolution of the captured image is 8K and the resolution of the playback image is FHD, the monitoring device (MN) can divide the captured image into segments of a size corresponding to FHD and display them so as to be distinguishable from each other.

[0127] Step S300 may include receiving input from an operator selecting two or more of the displayed images.

[0128] Specifically, the operator may select two or more videos among the multiple videos displayed on the monitoring device (MN) to be set as the playback target area. That is, the operator may select two or more videos among the multiple videos displayed on the monitoring device (MN) to be played through the multiple display devices (140). In this case, the operator may refer not only to the multiple videos displayed on the monitoring device (MN) themselves, but also to the information regarding the corresponding videos provided together. The operator may input the above selection through the monitoring device (MN) or its peripheral devices. The playback server (130) may receive the above input.

[0129] Step S300 may include the step of generating a playback video based on each of two or more videos selected based on the operator's input.

[0130] Specifically, the playback server (130) can set each of two or more selected videos as videos to be played based on the operator's input. The playback server (130) can generate a video to be played through a plurality of display devices (140) based on the videos to be played.

[0131] In addition, although not illustrated, the event broadcasting and screening method may further include the step of receiving input from an operator regarding the switching of a playback video and the step of switching the playback video based on the input. For example, in the above steps, if the operator wishes to switch the playback video currently being screened, the operator may select and input the video to be switched from the monitoring device (MN), and the playback server (130) may receive the input and switch the playback video.

[0132] According to embodiments of the present disclosure, an operator can receive input to select or switch a specific video among a plurality of playback videos and control the playback device accordingly. Through this, the operator can directly select a screen they wish to play during a screening, or immediately switch to and watch a player or scene that viewers are likely to be interested in, thereby providing viewers with a more reliable video broadcasting and screening service.

[0133] In the event relay and screening method according to the embodiments of the present disclosure, the embodiment described with reference to FIG. 8 may be omitted. That is, in the embodiments of the present disclosure, the process of an operator directly selecting a video to be played through a monitoring device (MN) may be omitted.

[0134] FIGS. 9a to 9c are drawings illustrating examples of replayed images in embodiments of the present disclosure.

[0135] Referring to FIGS. 1 to 9, the event relay and screening method may include the step (S300) of setting one or more playback target areas on one or more captured images and generating a plurality of playback images from the captured images based on a stream and one or more playback target areas.

[0136] Specifically, in step S300, a plurality of playback images can be generated from a captured image based on a stream transmitted in step S200 and one or more playback target areas set in step S300. The plurality of playback images may be images of the playback target areas. The number of playback target areas may be equal to the number of display devices (140).

[0137] As an example, referring to FIGS. 7 and 9a, each of a plurality of regions of interest (AI1, AI2, AI3 in FIG. 7) among a captured image (VC1 in FIG. 7) can be set as a playback target area based on metadata. In this case, the playback target area may be automatically set based on metadata or may be set by the operator's selection through the method described with reference to FIG. 8.

[0138] In the examples of FIGS. 7 and 9a, the first region of interest (AI1) of FIG. 7 may be set as the first playback target area (AP1). In this case, for example, the first region of interest (AI1) may be the region of interest with the highest ranking among the regions of interest. The image of the first playback target area (AP1) may be an image to be played on a display device positioned in the center among the plurality of display devices (140). The second region of interest (AI2) of FIG. 7 may be set as the second playback target area (AP2). In this case, for example, the second region of interest (AI2) may be the region of interest with the second or third highest ranking among the regions of interest. The image of the second playback target area (AP2) may be an image to be played on a display device positioned on the left or right among the plurality of display devices (140). The third region of interest (AI3) of FIG. 7 may be set as the third playback target area (AP3). In this case, for example, the third region of interest (AI3) may be a region of interest with the third or second highest ranking. The image of the third playback target area (AP3) may be an image to be played on a display device positioned on the right or left among the plurality of display devices (140). However, this is merely illustrative, and the setting of the playback target area according to the embodiments of the present disclosure is not limited to the examples described herein.

[0139] As an example, with reference to FIGS. 2, 5, 6, and 9b, each of a plurality of captured images (or a portion of the captured images) captured using a plurality of capturing devices may be set as a playback target area. In this case, the playback target area may be set automatically or may be set by the operator's selection through the method described with reference to FIG. 8.

[0140] In the examples of FIGS. 2, 5, 6, and 9b, a portion of the captured image (VC1) of FIG. 5, captured by the third capturing device (113) of FIG. 2, may be set as the first playback target area (AP1). In this case, for example, the third capturing device (113) may be the main camera. The portion may be the region of interest of the captured image (VC1). The portion may be the region of interest with the highest ranking among the regions of interest of the captured image (VC1). The image of the first playback target area (AP1) may be the image to be played on the display device positioned in the center among the plurality of display devices (140). The captured image of FIG. 6a, captured by the first capturing device (111) of FIG. 2, may be set as the second playback target area (AP2). In this case, for example, the first capturing device (111) may be the sub-camera. The image of the second playback target area (AP2) may be an image to be played on a display device positioned on the left or right among the plurality of display devices (140). The captured image of FIG. 6b, captured by the second capturing device (112) of FIG. 2, may be set as the third playback target area (AP3). In this case, for example, the second capturing device (112) may be a sub-camera. The image of the third playback target area (AP3) may be an image to be played on a display device positioned on the right or left among the plurality of display devices (140). However, this is merely illustrative, and the setting of the playback target area according to the embodiments of the present disclosure is not limited to the examples described herein.

[0141] As an example, with reference to FIGS. 5 and 9c, the event relay and screening method may include the step of generating one or more event information videos based on data containing information about the event. The step may be performed by a transmission device (120) or a playback server (130), or by other devices.

[0142] In the above step, one or more event information videos capable of conveying information to a viewer can be generated based on data containing information about an event (e.g., information about the game, information about a player, etc. in a baseball game). The information about the event may be included in metadata or may be data generated separately. One or more event information videos may be displayed on the monitoring device (MN) of FIG. 8.

[0143] In the examples of FIGS. 5 and 9c, a portion of the captured image (VC1) of FIG. 5 may be set as a first playback target area (AP1). In this case, for example, the portion may be an area of ​​interest of the captured image (VC1). The portion may be the area of ​​interest with the highest ranking among the areas of interest of the captured image (VC1). The image of the first playback target area (AP1) may be an image to be played on a display device positioned in the center among a plurality of display devices (140). A first event information image may be generated based on data containing information regarding a baseball game (e.g., the score status of the game). In this case, the first event information image may be set as a second playback target area (AP2). A second event information image may be generated based on data containing information regarding a player in a baseball game (e.g., the player's record). In this case, the second event information image may be set as a third playback target area (AP3). Here, the player may be a player displayed in the first playback target area (AP1). However, this is merely illustrative, and the setting of the playback target area according to the embodiments of the present disclosure is not limited to the examples described herein.

[0144] In this case, the event broadcasting and screening method may further include the step of playing the event information video through one or more of a plurality of display devices.

[0145] Step S300 may include the step of generating multiple playback videos that are different for each theater and transmitting them to each theater.

[0146] Referring again to FIG. 2, in the embodiments of the present disclosure, there may be one or more screening rooms each equipped with one or more display devices (e.g., the first screening room (141), the second screening room (142), the third screening room (143), etc. of FIG. 2). In this case, the playback server (130) can control each screening room separately. That is, the playback server (130) can control the video to be played on the multiple display devices of each screening room differently for each screening room. For example, the multiple display devices of the first screening room (141) of FIG. 2 can be controlled to play the videos of FIG. 9a, the multiple display devices of the second screening room (142) of FIG. 2 can be controlled to play the videos of FIG. 9b, and the multiple display devices of the third screening room (143) of FIG. 2 can be controlled to play the videos of FIG. 9c.

[0147] According to embodiments of the present disclosure, by providing not only regions of interest detected using an artificial intelligence model in captured video footage, but also video footage from various viewpoints acquired by multiple capturing devices and video regarding various event information data such as game statistics, player information, and progress status, on multiple display devices, the audience can obtain a rich and multi-layered viewing experience that is difficult to experience with a single screen. That is, by placing the entire flow of the game on the main screen and video of the surrounding areas of the game or additional information on peripheral screens and displaying them simultaneously, the sense of presence can be enhanced while the ability to convey information can be strengthened.

[0148] FIG. 10 is a drawing for explaining that a playback image is played on a plurality of display devices in embodiments of the present disclosure.

[0149] Referring to FIGS. 1 to 10, the event broadcasting and screening method may include the step (S400) of playing each of a plurality of playback videos through each of a plurality of display devices.

[0150] In the example of FIG. 10, the plurality of display devices (140) may include a first display device (DP1), a second display device (DP2), and a third display device (DP3). In this case, each of the plurality of display devices (140) may represent a display unit (display) of a display device. For example, each of the plurality of display devices (140) may be a display unit of a separate display device or a display unit separately provided in a single display device. By arranging the plurality of display devices in this way, a realistic multi-screen viewing environment can be realized.

[0151] In this case, for example, a plurality of display devices (140) may be arranged visually in a continuous manner. In the example of FIG. 10, the first display device (DP1), the second display device (DP2), and the third display device (DP3) may be arranged visually in a continuous manner. For example, the first display device (DP1) may be placed in the center, and the second display device (DP2) and the third display device (DP3) may be placed to the left or right of the first display device (DP1), respectively.

[0152] In this case, for example, the display portion of each of the plurality of display devices (140) may be at least one of the screen of the screening room or the wall surface adjacent to the screen. In the example of FIG. 10, the first display device (DP1) may be the screen of the screening room, and the second display device (DP2) and the third display device (DP3) may be the wall surface adjacent to the screen.

[0153] Specifically, FIG. 10 is a diagram illustrating an example in which a playback image of FIG. 9a is played through a plurality of display devices. The first playback target area (AP1) of FIG. 9a can be played through the first display device (DP1) of FIG. 10. The second playback target area (AP2) of FIG. 9a can be played through the second display device (DP2) of FIG. 10. The third playback target area (AP3) of FIG. 9a can be played through the third display device (DP3) of FIG. 10.

[0154] In step S400, each of the plurality of playback videos may be configured to be played on a display device selected among the plurality of display devices (140) based on information regarding a recommended playback location corresponding to the playback video. The recommended playback location is information regarding which of the plurality of display devices the video of the region of interest will be played on, and may be information included in metadata. That is, each of one or more captured videos and one or more videos of the region of interest may include metadata regarding a recommended playback location, and in this case, each of the plurality of playback videos may be configured to be played on a display device corresponding to a recommended playback location corresponding to the playback video based on the metadata.

[0155] For example, in the examples of FIGS. 9a and 10, for the first playback target area (AP1), information regarding a centrally located display device (e.g., main screen) as a recommended playback location may be included in the metadata, and accordingly, the corresponding video may be played on the centrally located first display device (DP1). For the second playback target area (AP2), information regarding a leftly located display device (e.g., left sub-screen or left wall) as a recommended playback location may be included in the metadata, and accordingly, the corresponding video may be played on the leftly located second display device (DP2). For the third playback target area (AP3), information regarding a rightly located display device (e.g., right sub-screen or right wall) as a recommended playback location may be included in the metadata, and accordingly, the corresponding video may be played on the rightly located third display device (DP3).

[0156] Step S300 may include receiving input from an operator regarding which of the plurality of display devices to play each of the plurality of playback videos through, and controlling the plurality of display devices based on said input.

[0157] For example, if three playback videos to be played on three display devices are determined, the operator may input which of the three display devices each playback video will be played on. The playback server (130) may receive the input and control the three display devices based on it, and the three display devices may display the playback videos based on the control.

[0158] In the examples of FIGS. 9a and 10, the operator may input that the first playback target area (AP1) be played on a display device placed in the center, the second playback target area (AP2) be played on a display device placed on the left, and the third playback target area (AP3) be played on a display device placed on the right. The playback server (130) receives the input and can control the first display device (DP1), the second display device (DP2), and the third display device (DP3) based on the input. Based on the control, the first display device (DP1) placed in the center can play the image of the first playback target area (AP1), the second display device (DP2) placed on the left can play the image of the second playback target area (AP2), and the third display device (DP3) placed on the right can play the image of the third playback target area (AP3).

[0159] Step S400 may include the step of playing a playback video corresponding to a captured image taken by a main camera through a display device located at the center among a plurality of display devices, and the step of playing a playback video corresponding to a captured image taken by a sub camera through a display device located at the periphery among a plurality of display devices.

[0160] Specifically, when the plurality of shooting devices (110) include a main camera and a sub-camera, the playback video corresponding to the footage captured by the main camera can be played through a display device located at the center among the plurality of display devices. On the other hand, the playback video corresponding to the footage captured by the sub-camera can be played through a display device located at the periphery among the plurality of display devices. Since the main camera generally has high resolution, the footage captured by the main camera can be provided through a display device located at the center where the audience is most immersed.

[0161] According to embodiments of the present disclosure, by synchronizing and providing ultra-high resolution and high frame rate video footage to a plurality of display devices, the audience can experience a vivid sense of immersion as if they were at the actual event site. For example, by playing high-resolution video captured by a main camera on a central display device in the theater and synchronizing and playing auxiliary video captured by a sub-camera on peripheral display devices, the entire screen and a specific scene can be displayed simultaneously, thereby maximizing the richness of visual information.

[0162] According to embodiments of the present disclosure, the system provides a structure capable of transmitting video in real time to multiple theaters without delay or degradation of image quality while maintaining the same quality and configuration. Since the same timecode-based synchronization is possible even in multiple theaters with different network environments, stability is ensured even when large-scale events are screened simultaneously on a national or global scale.

[0163] The methods according to the embodiments of the present disclosure may be one or more computer-implemented methods. In the present disclosure, each operation of the methods is illustrated and described in a predetermined order, but each operation may be performed in an order that can be arbitrarily combined according to the present disclosure, in addition to being performed sequentially. In the embodiments, at least some of the operations may be performed in parallel, iteratively, or heuristically. The present disclosure does not exclude variations or modifications to the methods. In the embodiments, at least some of the operations may be omitted, or other operations may be added.

[0164] Various embodiments of the present disclosure may be implemented as software recorded on one or more machine-readable recording media. The software may be software for implementing the various embodiments of the present disclosure described above. The software may be inferred from the various embodiments of the present disclosure by programmers skilled in the art to which the present disclosure pertains. For example, the software may be a machine-readable instruction (e.g., code or code segment) or a program. The machine may be a device capable of operating according to instructions called from the recording medium, for example, a computer. In the embodiments, the machine may be an electronic device according to the embodiments of the present disclosure. In the embodiments, the processor of the machine may execute the called instruction to cause the components of the machine to perform a function corresponding to the instruction. In the embodiments, the processor may be a processor of the electronic device according to the embodiments of the present disclosure. The recording medium may mean any type of recording medium in which data is stored that can be read by the machine. The recording medium may include, for example, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. In the embodiments, the recording medium may be memory. In the embodiments, the recording medium may be implemented in a distributed form in a networked computer system, etc. Software may be stored and executed in a distributed manner in a computer system, etc. The recording medium may be a non-transitory recording medium. A non-transitory recording medium refers to a tangible medium that exists regardless of whether data is stored semi-permanently or temporarily, and does not include a signal that propagates transitorily.

[0165] As an example in which embodiments of the present disclosure are implemented in the form of a recording medium, a non-transient computer-readable recording medium may include at least one instruction that causes one or more processors to perform one or more operations when executed by one or more processors.

[0166] As explained above, those skilled in the art of the present disclosure will recognize that the present disclosure may be implemented in various forms without altering its technical principles or core features. Accordingly, it should be understood that the above embodiments are merely illustrative and do not limit the scope of the present disclosure. The scope of the present disclosure is defined by the claims below rather than the detailed description, and all variations or modifications based on the meaning and scope of the claims and equivalent concepts should be interpreted as being included within the scope of the present disclosure.

[0167] The features and advantages described in this disclosure are only partial, and more additional features and advantages will become apparent to those skilled in the art upon reference to the drawings, specification, and claims. Additionally, it should be noted that the language used in this disclosure has been chosen for readability and illustrative purposes and is not necessarily chosen to limit or describe the subject matter of this disclosure.

[0168] The description of the above embodiments is provided for illustrative purposes only and is not intended to limit the scope of the disclosure in its exact form. Those skilled in the art will understand that various modifications and variations are possible from the content of the disclosure.

[0169] Therefore, the scope of the present disclosure is not limited by the detailed description but is defined by the claims of this specification. Accordingly, the embodiments of the present disclosure are illustrative and do not limit the scope of the present disclosure as set forth in the claims below.

Claims

1. As a method of event relaying and screening performed by one or more electronic devices, A step of capturing an event using one or more capturing devices to generate one or more captured images; A step of encoding and transmitting one or more of the above-mentioned captured images into a synchronized single image stream; A step of setting one or more playback target areas on one or more captured images, and generating a plurality of playback images from the captured images based on the stream and the one or more playback target areas; and An event relay and screening method comprising the step of playing each of the plurality of playback videos through each of the plurality of display devices.

2. In Paragraph 1, The method further includes the step of detecting one or more regions of interest on the captured video using an artificial intelligence model and generating metadata regarding the one or more regions of interest. The step of setting one or more playback target areas above is, An event relay and screening method comprising the step of setting one or more playback target regions among one or more regions of interest based on the above metadata.

3. In Paragraph 2, The above area of ​​interest is the area that the viewer is interested in regarding the event, and The above artificial intelligence model is a model trained to detect the region of interest in a video regarding an event, in an event relay and screening method.

4. In Paragraph 2, The above metadata includes information regarding the location of the region of interest on the captured image and the recommended playback location of the region of interest, and The above recommended playback location is information regarding which of the plurality of display devices the video of the corresponding area of ​​interest will be played on, an event relay and screening method.

5. In Paragraph 4, An event relay and screening method, wherein each of the plurality of playback videos is configured to be played on a display device selected based on information regarding a recommended playback position corresponding to the playback video among the plurality of display devices.

6. In Paragraph 2, At least one of the above-mentioned one or more captured images has a first resolution, and An event relay and screening method in which the resolution of the playback video is a second resolution that is 1 / 4 or less of the first resolution.

7. In Paragraph 6, An event broadcasting and screening method in which the first resolution is 8K or higher and the second resolution is FHD or lower.

8. In Paragraph 6, The above-mentioned region of interest has a size corresponding to the above-mentioned second resolution, an event relay and screening method.

9. In Paragraph 2, The step of generating the above plurality of playback videos is, A step of displaying the above one or more captured images and the above one or more images of regions of interest on a monitoring device so as to be distinguishable from one another; A step of receiving input from an operator selecting two or more images among a plurality of displayed images; and An event relay and screening method comprising the step of generating a playback video based on each of the two or more videos based on the above input.

10. In Paragraph 9, In the step of displaying the above one or more captured images on a monitoring device so as to be distinguishable from one another, An event broadcasting and screening method in which, when the resolution of the above-mentioned captured video is higher than the resolution of the above-mentioned playback video, the above-mentioned captured video is divided into a plurality of divided captured videos of a size corresponding to the resolution of the above-mentioned playback video and displayed so as to be distinguished from each other.

11. In Paragraph 1, An event relay and screening method in which the display portions of the plurality of display devices are visually arranged in a continuous manner.

12. In Paragraph 11, An event broadcasting and screening method in which the display portion of each of the plurality of display devices is at least one of a screen of a screening room or a wall surface adjacent to the screen.

13. In Paragraph 11, The above one or more shooting devices include a main camera and a sub camera, and The step of playing each of the above plurality of playback videos is, A step of playing a playback video corresponding to a captured image taken by the main camera through a display device located at the center among the plurality of display devices; and An event relay and screening method comprising the step of playing a playback video corresponding to a captured video taken by the sub-camera through a display device located in the periphery among the plurality of display devices.

14. In Paragraph 1, A step of generating one or more event information images based on data containing information regarding the above event; and An event relay and screening method further comprising the step of playing the above-mentioned event information video through one or more of the above-mentioned plurality of display devices.

15. In Paragraph 1, The step of generating the above plurality of playback videos is, A step of receiving input from an operator regarding which of the plurality of display devices to play each of the plurality of playback videos through; and An event relay and screening method comprising the step of controlling the plurality of display devices based on the above input.

16. In Paragraph 1, A step of receiving input from an operator regarding the switching of the playback video; and An event relay and screening method further comprising the step of switching the playback video based on the above input.

17. As an event broadcasting and screening system, One or more shooting devices configured to capture an event and generate one or more captured images; A transmission device configured to encode one or more of the above-mentioned captured images into a synchronized single image stream and transmit it; A playback server configured to set one or more playback target areas on one or more captured images and to generate a plurality of playback images from the captured images based on the stream and the one or more playback target areas; and An event relay and screening system comprising a plurality of display devices configured to play each of the plurality of playback videos.

18. In Paragraph 17, The electronic device further includes an artificial intelligence model configured to detect one or more regions of interest on the captured image and to generate metadata regarding the one or more regions of interest. The above playback server is, An event relay and screening system further configured to set one or more playback target regions among one or more regions of interest based on the above metadata.

Images