Method and apparatus for digital conversion of sports competitions

Abstract

The operation method of a server that provides digital conversion of sports competitions is disclosed. The service server receives a service request signal from a user terminal that scans a first identification code, forwards the electronic display control signal received from the user terminal to a first access point corresponding to the first identification code, requests video data captured by a first shooting system corresponding to the first access point from a data center, extracts key sections from the video data based on the electronic display control signal, registers section information for the key sections, and sends section information for at least one key section to the user terminal as a response to the section information request signal.

Description

Technical Field

[0001] The following embodiments relate to a method and apparatus for digital conversion of sports competitions.

Background Art

[0002] Digital conversion of sports competitions means innovating the operation, analysis, and viewing methods of competitions by utilizing the latest technologies. The main background technologies enabling digital conversion include data analysis and machine learning, virtual and augmented reality (VR / AR), Internet of Things (IoT), cloud computing, and the like.

[0003] However, the conventional digital conversion technology for sports competitions has a structure that requires expensive specialized equipment and specialized personnel, resulting in high introduction costs and very low accessibility for use. Detailed Description of the Invention

[0004] <目标语言文本中出现的 标签,由于原始文本中没有对应翻译内容,所以保留原样 [Means for Solving the Problems] A server operating a one-sided digital conversion of a sports competition includes the steps of: providing identification codes to multiple access points; receiving a service request signal from a user terminal that has scanned a first identification code; sending a service approval signal to the first access point and the user terminal corresponding to the first identification code in response to the approval of the service request; transferring an electronic display control signal received from the user terminal to the first access point; sending a service termination signal to the first access point and the user terminal in response to the termination of the service; requesting video data captured by a first shooting system corresponding to the first access point from a data center; extracting a plurality of main sections from the video data based on the electronic display control signal; registering section information for the plurality of main sections; receiving a section information request signal from the user terminal for at least one of the plurality of main sections; and sending section information for the at least one main section to the user terminal in response to the section information request signal.

[0005] The step of extracting the plurality of main sections may include the steps of: estimating at least one segmented section within the sports competition based on the electronic scoreboard control signal; extracting motion information within a predetermined area of ​​the video frame included in the at least one segmented section; and estimating at least one main section included in the at least one segmented section based on the motion information.

[0006] The step of extracting the plurality of major intervals may further include the step of identifying an electronic display control signal received at a time corresponding to the estimated at least one major interval from among the electronic display control signals, and the step of generating analytical information corresponding to the estimated at least one major interval based on the identified electronic display control signals.

[0007] The step of extracting the plurality of main sections may include the steps of: identifying at least one predetermined type of electronic display control signal among the electronic display control signals; identifying the time when the identified electronic display control signal was received; and estimating at least one main section within the sports competition based on the identified time.

[0008] The step of extracting the plurality of main intervals may further include the step of generating analytical information corresponding to the estimated at least one main interval based on the type of the identified electronic display control signal.

[0009] The operation method of the server may further include the steps of receiving audio data from the first access point, synchronizing the video data and the audio data based on the electronic display board control signal, and uploading the synchronized video and audio data to the streaming server.

[0010] The step of transmitting section information relating to at least one main section to the user terminal may include the steps of generating electronic display board information corresponding to the at least one main section based on the electronic display board control signal, and transmitting the electronic display board information to the user terminal.

[0011] The operation method of the server may further include the steps of receiving a sports metric recording request signal from at least one second user terminal, and generating real-time recording information of the sports competition based on the recording request signal.

[0012] The operation method of the server may further include the step of transmitting the real-time recording information to the access point.

[0013] The operation method of the server may further include the steps of receiving a real-time recording information viewing request signal from a third user terminal distinct from the at least one second user terminal, and transmitting the real-time recording information to the third user terminal in response to the viewing request signal.

[0014] A server that provides a digital conversion of a sports competition on one side includes memory and at least one processor connected to the memory and configured to execute a computer-readable program contained in the memory. The program includes instructions to cause at least one processor to perform the following steps: providing identification codes to a plurality of access points; receiving a service request signal from a user terminal that has scanned a first identification code; sending a service approval signal to the first access point and the user terminal corresponding to the first identification code in response to the approval of the service request; transferring an electronic display control signal received from the user terminal to the first access point; sending a service termination signal to the first access point and the user terminal in response to the termination of the service; requesting video data captured by a first shooting system corresponding to the first access point from a data center; extracting a plurality of main sections from the video data based on the electronic display control signal; registering section information for the plurality of main sections; receiving a section information request signal from the user terminal for at least one of the plurality of main sections; and sending section information for the at least one main section to the user terminal in response to the section information request signal.

[0015] The first shooting system includes a plurality of cameras that divide and shoot the stadium where the sports competition is held, and the video data may include a plurality of channels captured by the plurality of cameras.

[0016] Each of the segment information relating to the plurality of main segments may further include a channel indicator that indicates the channel from among the plurality of channels on which the play of the corresponding main segment was filmed.

[0017] The multiple channels included in the video data are simultaneously streamed to the user terminal, the channel selected by the channel indicator is displayed on the user terminal by default, and the multiple channels may be switched and displayed or displayed simultaneously in response to user input through the user terminal. [Brief explanation of the drawing]

[0018] [Figure 1] Figure 1 shows a digital conversion system according to one embodiment. [Figure 2] Figure 2 illustrates the digital conversion operation according to one embodiment. [Figure 3] Figure 3 illustrates a digital conversion operation linked to a real-time recording function according to one embodiment. [Figure 4] Figure 4 illustrates a digital conversion operation linked to a recording function according to one embodiment. [Figure 5] Figure 5 illustrates a digital conversion operation that can be linked with a stadium rental function according to one embodiment. [Figure 6] Figure 6 illustrates a digital conversion operation linked to a video recording function according to one embodiment. [Figure 7] Figure 7 shows a photographic system and access point for a sports stadium according to one embodiment.

[0019] [Best mode for carrying out the invention] The specific structural or functional descriptions disclosed herein are illustrative for the purpose of illustrating embodiments based on the technical idea, and embodiments can be carried out in a variety of other forms and are not limited to those described herein.

[0020] Terms such as first or second may be used to describe various components, but these terms should be understood only for the purpose of distinguishing one component from another. For example, the first component can be named the second component, and similarly, the second component can be named the first component.

[0021] When it is mentioned that a certain component is "connected to" or "attached to" another component, it should be understood that it may be directly connected or attached to the other component, but there may also be other components in between. On the other hand, when it is mentioned that a certain component is "directly connected to" or "directly attached to" another component, it should be understood that there are no other components in between. Expressions describing the relationship between components, such as "between" and "directly between", or "adjacent to" and "directly adjacent to", should be interpreted in the same way.

[0022] Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "including" or "having" are intended to specify the presence of the recited features, numbers, steps, operations, components, parts, or combinations thereof, and should not be construed as precluding the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0023] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the relevant art. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense unless clearly defined herein.

[0024] Embodiments relate to a method and apparatus for generating sports data through digital conversion of sports competitions. Although basketball among sports events is mainly described as an example, embodiments can be substantially identically applied to sports of team or individual events / ball games or non-ball games. Embodiments of the present invention can be implemented in various forms such as mobile applications, web-based applications, SaaS, PC programs, etc. For the sake of convenience of explanation, an example implemented in a mobile application will be described. Hereinafter, the subject providing functions according to embodiments is referred to as "sports data service". The sports data service may instruct software such as an application or a server program, and may also instruct hardware such as a client device, a server device, or an edge device. Of course, the sports data service can also be interpreted in accordance with the literal meaning of the term "service".

[0025] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The same reference numerals presented in each drawing indicate the same members.

[0026] FIG. 1 is a diagram showing a digital conversion system according to an embodiment. Referring to FIG. 1, a digital conversion system according to an embodiment provides a digital conversion function for sports competitions. The sports data provided through digital conversion of sports competitions includes sports video, and may further include sports record information associated with the sports video. The digital conversion system may include a service server (110), a streaming server (120), a data center (130), a user terminal (140), and a sports stadium (150). The service server (110) performs main operations for providing the digital conversion function, and the streaming server (120) performs operations for streaming sports video to the user terminal. In the embodiment of FIG. 1, the service server (110) and the streaming server (120) are shown separately, but depending on the implementation manner of the digital conversion system, the service server (110) may be designed to also perform the functions of the streaming server (120).

[0027] A sports stadium (153) may include a camera system (151) and an access point (152). Sports footage captured by the camera system (151) may be transmitted to and stored in a data center (130). The data stored in the data center (130) may be kept for a predetermined period (e.g., 10 days, 1 month, etc.). In one embodiment, the camera system (151) includes an IP (Internet Protocol) camera, and for example, the camera system (151) may be implemented as an IP-based CCTV system. The IP-based CCTV system is primarily operated for the purpose of facility safety and management and fire prevention, and may be used to provide sports data only for the relevant time period in response to service requests from athletes and teams participating in sports competitions.

[0028] The access point (152) provides a user interface to enhance the accessibility of the digital conversion service. For example, the access point (152) includes a display screen, and a user can request the digital conversion service by scanning the access point (152)'s identification code (e.g., a QR code) with a user terminal (141). In one embodiment, the shooting system (151) may only perform video recording and not audio recording. In this case, audio recording can be performed on the access point (152). The access point (152) can provide an electronic scoreboard function during a sports competition. The electronic scoreboard displayed on the access point (152) can be controlled by the user terminal (141).

[0029] When the use of the digital conversion service ends, the service server (110) requests the sports video from the data center (130). If the shooting system (151) and the data center (130) are operated by different entities than the service server (110), the service server (110) can download the sports video for the relevant section through an API provided by the operators of the shooting system (151) and the data center (130). After extracting the main sections from the sports video, the service server (110) can register section information related to the extracted main sections. The service server (110) can upload the sports video to the streaming server (120). The service server (110) provides the section information corresponding to the main sections to the user terminal (141), and the user terminal (141) can use the section information to request and receive the sports video for the main sections from the streaming server (120). According to one embodiment, since the shooting system (151) captures video data from multiple channels, the section information relating to the main section may further include an indicator that indicates the channel from which the play of the relevant main section was captured among the multiple channels.

[0030] Although not shown in the drawings, the streaming server (120) may include a separate data center distinct from the data center (130). The streaming server (120) can encode sports video in accordance with streaming standards and can also encode sports video at various resolutions for adaptive streaming services. Depending on the embodiment, the shooting system (151) and the streaming server (120) may be operated by the same or interconnected operating entity, in which case the streaming server (120) may also utilize the data center (130) of the shooting system (151).

[0031] The service server (110) can provide digital conversion services in conjunction with applications (APP) and the web (WEB) running on user terminals (141). In addition to providing sports videos as described above, the service server (110) can also provide sports record information linked to the sports videos. For example, the service server (110) can extract key sections from the sports video and provide highlight scenes of the sports competition. The service server (110) can utilize the control information of the electronic scoreboard input during the sports competition to add electronic scoreboard information to the sports video, and can also add analysis information to key sections based on the control information of the electronic scoreboard. The analysis information is the result of analyzing the scenes in the key sections and may include, for example, sports metrics related to the scenes in question.

[0032] The service server (110) can provide user terminals (141) with a function that allows real-time input of sports metrics while the competition is in progress, and can also provide user terminals (141) with a function that allows retrospective input of sports metrics based on already recorded competition footage after the competition has ended. The function for inputting sports metrics is designed to be accessible by multiple user terminals (140) via a cloud system, so that it can be used in a way that allows multiple users to divide the roles among themselves and input sports metrics separately.

[0033] One embodiment of the digital conversion system can function as a platform for disseminating sports data. Compared to existing sports data solutions, the digital conversion system can provide a series of functions, such as service application, sports video recording, key scene extraction and editing, sports record generation linked to key scenes, and sharing of sports video and record, more cheaply and easily.

[0034] Figure 2 illustrates the digital conversion operation according to one embodiment. Referring to Figure 2, in step (201), a filming system (151) installed in the sports stadium films the stadium and stores the footage in a data center (130). The filming system (151) can transmit the video data of the stadium to the data center (130). The filming system (151) includes cameras that film the stadium where the sports competition is taking place. According to one embodiment, the filming system (151) may include multiple cameras that film the stadium in sections. The basic cameras included in the filming system (151) may be positioned to film the sports competition in a quarter-view composition. The filming system (151) may also include additional cameras positioned to film the players' performance in a dynamic composition. The multi-channel video data filmed by the cameras included in the filming system (151) may be transmitted to the data center (130) and stored in a synchronized time.

[0035] According to one embodiment, the shooting system (151) may include a cloud-based CCTV device installed in a sports stadium. In this case, the CCTV device can continuously shoot the stadium and upload the captured video to a data center (130).

[0036] The sports stadium's filming system (151) and the data center (130) are connected via a network, and the competition footage uploaded to the data center (130) can be automatically deleted after being stored for a certain period of time. The filming system (151) may include multiple CCTV devices that constitute multiple channels. For example, the filming system (151) may include a first channel CCTV device that films one side of the stadium and a second channel CCTV device that films the other side of the stadium.

[0037] In other embodiments, the imaging system (151) may include a cloud-based IP camera device installed in a sports stadium. Although not shown in the drawings, the IP camera device can receive imaging requests from a first service server and, in response, image the stadium. The image captured can be uploaded to a network-connected data center (130). The imaging system (151) in the sports stadium and the data center (130) are connected via a network, and the sports footage uploaded to the data center (130) may be automatically deleted after being stored for a certain period of time. Alternatively, it may be deleted in a FIFO manner depending on the remaining storage space allocated to the data center (130). The imaging system (151) may include multiple IP camera devices that constitute multiple channels. For example, the imaging system (151) may include a first channel IP camera device that images one side of the stadium and a second channel IP camera device that images the other side of the stadium.

[0038] In step (202), the access point (152) displays an identification code for applying to use the digital conversion service. For example, the identification code may include, but is not limited to, a QR code. The access point (152) may display a basic screen that includes images and videos for publicity and explanation of the digital conversion service, and may display the identification code in an appropriate area on the basic screen. Depending on the embodiment, the basic screen may also include images and videos for notices and publicity related to the sports stadium where the access point (152) is installed.

[0039] In step (203), the user terminal (141) scans the identification code. For example, the user terminal (141) can use an image sensor to scan the identification code, and the method of scanning the identification code is not limited to this.

[0040] According to one embodiment, in response to scanning an identification code, the user terminal (141) can check whether an application for the digital conversion service is installed. If the application is not installed, the user terminal (141) can display a screen that allows the user to install the application. If the application is installed, the user terminal (141) can run the application. Alternatively, in response to scanning an identification code, the user terminal (141) can display a website for the digital conversion service. The user terminal (141) can display a service application screen through the application or website.

[0041] In step (204), the user terminal (141) sends a service request signal to the service server (110). The user of the user terminal (141) can enter the date and time information for when they wish to use the digital conversion service through the application screen. The sports stadium is automatically identified by the identification code, and after the service server (110) checks whether there is a history of a previous application for the entered date and time information, it can request the user terminal (141) to settle the service usage fee. According to one embodiment, on the application screen, the user can easily proceed with procedures such as consent to the collection and use of personal information, consent to photography related to portrait rights, and consent to audio recording.

[0042] In step (205), the service server (110) approves the service request and sends a service approval signal to the access point (152) and the user terminal (141). In one embodiment, the access point (152) can respond to the service approval signal and display a second identification code that guides users participating in sports competitions to easily access sports data. By scanning the second identification code, users can easily proceed with procedures such as app installation, membership registration, team registration, consent to collection and use of personal information, consent to photography related to portrait rights, and consent to audio recording.

[0043] In step (206), the access point (152) displays an electronic scoreboard screen. The electronic scoreboard screen may include electronic scoreboard information for the progress of the sports competition. For example, the electronic scoreboard screen may include the names of both teams participating in the sports competition, division information (e.g., quarter, first / second half, etc.), time information (e.g., quarter time, first / second half time, shot clock, timeout time, etc.), the scores of both teams, the number of fouls committed by both teams (e.g., team foul count), the number of timeouts for both teams, etc. In step (207), the user terminal (141) is granted access to a controller interface for controlling the electronic scoreboard. For example, the controller interface may include buttons to control the names of both teams, quarter information, time information, the scores of both teams, the number of fouls committed by both teams, and the number of timeouts for both teams.

[0044] According to one embodiment, the shooting system (151) may be designed to record video only. Such a design may be necessary to comply with laws and regulations that prohibit audio recording of CCTV, or because the camera is located far from the court of play and unsuitable for audio recording. In this case, the access point (152) can record the audio of the game. The access point (152) may also continuously record audio during the service hours, or it may detect the start and end of divided sections of the sport (e.g., quarters, first / second halves, etc.) based on the electronic scoreboard control signal in step (207) and perform audio recording only within those divided sections.

[0045] The service server (110) can forward the electronic display control signals received from the user terminal (141) to the access point (152). The access point (152) can update the electronic display screen based on the forwarded electronic display control signals. Depending on the embodiment, the user terminal (141) may be designed to connect directly to the access point (152). For example, the user terminal (141) and the access point (152) may be connected via Bluetooth or through the same Wi-Fi AP. In some cases, the user terminal (141) and the access point (152) may be connected via a wired connection. Even in such cases, the electronic display control signals can be sent to the service server (110) by the user terminal (141) or the access point (152).

[0046] According to one embodiment, the controller interface of the user terminal (141) may include a VAR (Video Assistant Referees) request function. When the user terminal (141) sends a VAR request signal, the service server (110) can request video of a predetermined section (for example, a section within 3 minutes from the current time) from the data center (130). The data center (130) sends a streaming URL that allows streaming reception of the requested section of video, and the service server (120) can send the streaming URL to the user terminal (141). The user terminal (141) can provide the VAR function by using the streaming URL to stream and play the video of the predetermined section from the data center (130). The length of the predetermined section can be appropriately set according to the sport, and depending on the embodiment, the user terminal (141) can also specify the section when making a request.

[0047] In step (208), in response to the termination of the service, the service server (110) sends a service termination signal to the access point (152) and the user terminal (141). The service server (110) may decide to terminate the service when the usage time entered at the time of the service request in step (204) expires, or in response to an explicit request from the user terminal (141). In response to the service termination signal, the access rights to the controller interface granted to the user terminal (141) may also be terminated.

[0048] In step (209), the service server (110) requests the competition video from the data center (130). The service server (110) can request video data for the section including the usage time entered in the service request in step (204). In step (210), the service server (110) receives the competition video from the data center (130). The service server (110) can receive video data for the section including the usage time entered in the service request in step (204).

[0049] Depending on the embodiment, there may be a defined maximum length of video (e.g., 1 hour) that the data center (130) can provide in a single file. In this case, the service server (110) can request and receive video from the data center (130) as multiple files for the requested time interval. The service server (110) can combine the multiple files into a single file prior to or during the operation of step (213).

[0050] If the access point (152) is recording the competition audio in step (206), the access point (152) can transmit the audio data to the service server (110) in step (211). Depending on the embodiment, the access point (152) can transmit the audio data to the service server (110) at predetermined intervals (e.g., every minute, every five minutes) even before the service ends in step (208). Alternatively, the access point (152) can detect the start and end of divisions in the sports competition (e.g., quarter, first / second half, etc.) based on the electronic scoreboard control signal in step (207), and transmit the audio data for the division to the service server (110) at the end of the division.

[0051] In step (212), the access point (152) may, in response to the service termination signal, display the basic screen again instead of the electronic display screen. The basic screen may include an identification code for the next service application. Depending on the embodiment, the basic screen may also include a second identification code that guides users participating in sports competitions to easily access sports data. The identification code and the second identification code may be displayed together on the basic screen, alternately, or, depending on the design, as a single identification code that provides the functions of both the identification code and the second identification code.

[0052] In step (213), the service server (110) extracts key segments from the competition video.

[0053] According to one embodiment, the game footage may be footage of a basketball game. The service server (110) can extract key segments from the game footage where a shot is attempted or a score is scored. The service server (110) can set a region of interest (ROI) in the game footage that includes the backboard and / or rim (goal), and extract key segments by detecting the movement of objects occurring in the region of interest. Depending on the embodiment, regions of interest may be pre-set for each stadium and / or channel, or regions of interest may be detected from the game footage using artificial intelligence technology. The movement of objects in the region of interest may be due to the movement of the ball or players within the region of interest, or it may be due to the movement, vibration, or shaking of the rim, net, or backboard.

[0054] The service server (110) can detect the movement of an object in the region of interest by detecting whether the pixel values ​​in the region of interest have changed compared to the pixel values ​​in adjacent frames (previous or subsequent frames within a predetermined time interval). In one embodiment, the shooting system is equipped to photograph one or both goals at a certain high angle or higher from a fixed viewpoint near the halfway line of the stadium, thereby minimizing interference in the region of interest. In this case, the scenes in which the movement of an object is detected in the region of interest (e.g., when the ball hits the backboard or rim, or when the ball passes through the rim and the net shakes) are more likely to correspond to scenes in which a shot is attempted or a goal is scored. Alternatively, the service server (110) can detect the movement of an object in the region of interest by using an artificial intelligence model to detect the ball in the region of interest (e.g., when the ball is detected in the backboard area) or by tracking the trajectory of the ball.

[0055] In other embodiments, the competition video may be video footage of a futsal match. The service server (110) can extract key segments from the competition video where a shot is attempted or a goal is scored. The service server (110) can set a region of interest (ROI) in the competition video that includes the goal and / or penalty area, and extract key segments by detecting the movement of objects occurring in the region of interest. Depending on the embodiment, regions of interest may be pre-set for each field and / or channel, or regions of interest may be detected from the competition video using artificial intelligence technology. The movement of objects in the region of interest may be due to the movement of a ball or people within the region of interest, or due to the movement, vibration, or shaking of the goal or net.

[0056] The service server (110) can detect the movement of an object in the region of interest by detecting whether the pixel value of the region of interest has changed compared to the pixel value of an adjacent frame (the previous or next frame within a predetermined time interval). In one embodiment, the shooting system is equipped to photograph one of the goals at a certain high angle or higher with a fixed viewpoint near the corner of the field, thereby minimizing interference in the region of interest. In this case, the scenes in which the movement of an object is detected in the region of interest (e.g., when the ball hits the goal or shakes the goal net) are more likely to correspond to scenes in which a shot is attempted or a goal is scored. Alternatively, the service server (110) can detect the movement of an object in the region of interest by using an artificial intelligence model to detect a ball in the region of interest (e.g., when a ball is detected in the penalty area) or by tracking the trajectory of a ball.

[0057] According to one embodiment, the service server (110) can estimate the divisions within the game (e.g., quarters, first / second halves, etc.) based on the electronic scoreboard control signal of step (207). The service server (110) can extract motion information from a predetermined area of ​​the video frame included in the division. The predetermined area can be determined according to the characteristics of the sport, the camera setup, etc., and may include, for example, areas where the backboard and goal, paint area and no-charge semicircle of a basketball, or the goal and penalty area of ​​a soccer / futsal game are filmed in the video.

[0058] The service server (110) can extract motion information by processing the visual data of a predetermined region in consecutive video frames within a divided section. For example, the service server (110) can extract motion information by extracting visual data of a predetermined region from consecutive video frames within a divided section and sensing the amount of change in the visual data extracted from adjacent video frames. Alternatively, the service server (110) can also extract motion information by applying an artificial intelligence model that detects or tracks people or balls to the visual data of a predetermined region in consecutive video frames within a divided section.

[0059] According to one embodiment, the service server (110) can manage parameters for extracting motion information. The parameters for extracting motion information may include region parameters that indicate a predetermined area within a video frame, threshold parameters related to the amount of change in visual data, etc. The region parameters may be set differently depending on the composition of the camera installed in the sports stadium and the position of the goals in the sports stadium. The threshold parameters may be set differently depending on the noise level contained in the video of the sports stadium and the size of the objects (e.g., balls and players) captured in the video.

[0060] The service server (110) can drive a threshold parameter search algorithm to find the optimal threshold parameters for each sports stadium. For example, after securing positive ground truth data from which motion information should be extracted and negative ground truth data from which motion information should not be extracted in the video data captured at the sports stadium, the service server (110) can adjust the threshold parameters for the stadium in a direction that improves FRR and / or FAR.

[0061] The service server (110) can determine region parameters using detection algorithms and segmentation algorithms. Since the imaging system includes a fixed camera, if the region parameters are determined at a predetermined interval (for example, once a day or once per service request), the service server (110) can utilize the previously determined region parameters without having to determine them for each frame when extracting the main interval in step (213).

[0062] The service server (110) can periodically update threshold parameters along with domain parameters, and depending on the embodiment, the update cycle for threshold parameters may be managed to be longer than the update cycle for domain parameters.

[0063] The service server (110) can estimate the main intervals within the divided intervals based on the motion information. For example, the service server (110) can determine the main intervals to include the video frame from which motion information has been extracted. The service server (110) can determine the main intervals to include the n frames before and m frames after the video frame from which motion information has been extracted. If motion information has been extracted in multiple consecutive video frames, the service server (110) can determine the main intervals to include the n frames before the first video frame and the m frames after the last video frame. If the previous main intervals overlap in the n frames before, or if the later main intervals overlap in the m frames after, the service server (110) can combine two or more main intervals into a single main interval.

[0064] The service server (110) can identify the electronic display control signals received at the time corresponding to the main section among the electronic display control signals in step (207). Based on the identified electronic display control signals, the service server (110) can generate analysis information corresponding to the main section. For example, the service server (110) can identify the type of the identified electronic display control signals (e.g., score, assist, etc.) and generate analysis information corresponding to the main section (e.g., score, assist, etc.) according to the identified type.

[0065] According to one embodiment, the service server (110) can identify predetermined types of electronic scoreboard control signals from the electronic scoreboard control signals of step (207) in order to extract key sections within the video footage of the competition. The predetermined types may be types suitable for classification as key scenes according to the characteristics of the sport (e.g., scoring, assists, etc.). After identifying the time when the identified electronic scoreboard control signals were received, the service server (110) can estimate key sections within the sport based on the identified time. For example, the service server (110) can determine key sections to include the video frame at the identified time. The service server (110) can determine key sections to include the n frames before and m frames after the video frame at the identified time.

[0066] In step (214), the service server (110) can upload the competition video to the streaming server. The service server (110) can upload the entire competition video, not just the video of the main sections. When an upload is requested, the streaming server can return a video identifier. Within the streaming server, the competition video may be stored corresponding to the video identifier. After the upload is complete, the service server (110) can receive (by polling or pushing, etc.) a video link corresponding to the video identifier from the streaming server.

[0067] According to one embodiment, a service server (110) can upload sports data, including competition footage, to a streaming server (120). If the shooting system (151) includes multiple cameras, the service server (110) can synchronize video data from multiple channels and upload it to the streaming server (120). For example, the service server (110) can synchronize video data from multiple channels based on the shooting time of the video data from multiple channels.

[0068] If audio data is recorded by the access point (152) in step (211), the service server (110) can synchronize the audio data with (multiple) video data and upload it to the streaming server (120). For example, the service server (110) can synchronize the audio data and video data based on the recording time of the audio data and the shooting time of the video data. According to one embodiment, the service server (110) can synchronize the video data and audio data based on the electronic scoreboard control signal in step (207). For example, if recording proceeds only during the division time of the competition at the access point (152), the service server (110) can determine the start and end times of the division time based on the electronic scoreboard control signal. Based on the start and end times of the division time, the service server (110) can synchronize the audio data recorded during that division time with the corresponding division time in the video data.

[0069] The service server (110) can insert audio data into the audio channel of the video data. Although not shown in the diagram, the service server (110) can generate audio channels distinct from (multiple) video channels in order to provide a synchronization adjustment function between the video data and the audio data. The service server (110) can provide the user terminal (141) with a function to adjust the synchronization between (multiple) video channels and the audio channels. Different synchronization (sync) parameters between video and audio may be set for each individual sports data. The service server (110) can correct the interval information of the video data and audio data according to the synchronization parameters and provide it to the user terminal (141). Alternatively, the user terminal (141) can synchronize and play the video data and audio data based on the synchronization parameters.

[0070] In step (215), the service server (110) registers segment information. The segment information includes information indicating divided segments and main segments extracted from the overall video footage of the sports competition. The segment information may include information indicating the start and end points of the divided segments in time units or in frame units. The segment information may also include information indicating the start, end, or main points of the main segments in time units or in frame units.

[0071] Although not shown in the diagram, the actions of steps (213), (214), and (215) may also be implemented so that they are performed in the data center (130). In this case, the data center can perform the actions of steps (213), (214), and (215) in response to the request signal of step (209), and the action of step (210) may be omitted.

[0072] In step (216), the user terminal (141) can specify a sport and request segment information for that sport. For example, the user terminal (141) can display a list containing multiple sports in which the user has the right to participate or view. When a specific sport is selected from the list, the user terminal (141) can send a segment information request signal to the service server (110) requesting segment information for the selected sport.

[0073] In step (217), the service server (110) transmits the segment information registered for the sport requested by the user terminal (141) as a response to the segment information request signal. For the sake of explanation, the diagram illustrates the transmission of segment information, but it can be substantially applied to embodiments of sports data transmission as well. For example, the service server (110) can generate sports data for the relevant sport based on the service request signal in step (204), the electronic scoreboard control signal in step (207), the video data in step (210), the audio data in step (211), the main segment in step (213), etc., and can register the sports data in step (215). In this case, the user terminal (141) can request sports data for the selected sport from the service server (110) and receive the transmission.

[0074] In step (218), the user terminal (141) can request sports video from the streaming server (120) based on the segment information in step (217). In step (219), the streaming server (120) can respond to the video request and provide the user terminal (141) with streaming video of the requested segment.

[0075] According to one embodiment, multiple channels included in the video data are simultaneously streamed to the user terminal (141), and the user terminal (141) can display the channel selected by the channel indicator included in the interval information as the default. For example, the user terminal (141) can provide multiple players for multiple channels, but the player for the selected channel can be placed on the top layer. The user terminal (141) can provide a button to request switching between multiple channels, and can switch and display multiple channels in response to user input. For example, the user terminal (141) can place the player for the requested channel on the top layer among the multiple players for multiple channels. Alternatively, the user terminal (141) may display multiple players for multiple channels together in response to user input.

[0076] When the service server (110) transmits section information in step (217), it can also provide the user terminal (141) with additional information such as electronic display board information and analysis information corresponding to the section information. The user terminal (141) can display the electronic display board information and analysis information for that scene on its screen along with the competition video.

[0077] According to one embodiment, a user terminal (141) can request the download of video clips corresponding to the main section. The user terminal (141) can receive section information corresponding to the main section from the service server (110), request the section information from the streaming server (120), and receive the video. The user terminal (141) can encode the received streaming video to generate a video clip. The user terminal (141) can store the video clip in local storage or share it with a messaging service, social networking service, internet community service, etc.

[0078] Figure 3 illustrates a digital conversion operation linked to a real-time recording function according to one embodiment. The steps (201) to (215) shown in Figure 3 can be substantially applied to the matters described in Figure 2, and steps (216) to (219) in Figure 2 can also be substantially applied to the embodiment in Figure 3.

[0079] Referring to Figure 3, in step (301), the second user terminal (142) can provide a real-time recording interface. In response to user input through the real-time recording interface, the second user terminal (142) can send a sports metric recording request signal to the service server (110). Recordable sports metrics can be set differently depending on the characteristics of the sport, and multiple metrics may be automatically set from a single input depending on the rules of the sport. For example, in basketball, if a steal by a team (player) is entered, a turnover by the opposing team (player) may be automatically set. Also, if a foul is committed during a shot attempt that could be recognized as an assist, it may be set as a candidate for an assist. The candidate for an assist may be set as an official assist only if at least one of the subsequent free throws is successful. In the case of a personal foul by the defensive side, a team foul is also counted, while in the case of a personal foul by the offensive side, a team foul may not be counted. Also, if substitution information is entered, the playing time for each player may be automatically calculated based on the scoreboard time at the time of substitution. When a team scores or concedes a goal, the goal difference (margin) of the players currently on the field may be automatically counted up or down. While this example uses basketball, it can be applied substantially identically to sports metrics in other team ball sports such as soccer, futsal, handball, and volleyball. It can also be similarly extended to sports metrics in racket sports such as badminton, table tennis, and tennis.

[0080] According to one embodiment, the second user terminal (142) can provide a real-time recording interface only if it has access rights to the competition for which the service request has been made by the first user terminal (141). Access rights can be granted in various ways. For example, access rights may be granted if the account of the second user terminal (142) belongs to a team related to the competition for which the service request has been made by the first user terminal (141), or access rights may be granted directly from the first user terminal (141).

[0081] In the embodiment shown in Figure 3, a user terminal (141) providing the electronic display board controller interface and a second user terminal (142) providing the real-time recording interface are shown separately. However, depending on the embodiment, a single interface combining the real-time recording interface and the electronic display board controller interface may be provided. In this case, the electronic display board control signal in step (207) and the sports indicator recording request signal in step (301) may be transmitted by the same terminal. Furthermore, the electronic display board control signal in step (207) and the sports indicator recording request signal in step (301) may be integrated into the same protocol, in which case the service server (110) can process them appropriately through data header information and the like.

[0082] The service server (110) can generate real-time recording information based on the sports metric recording request signal. The service server (110) can construct sports data based on the real-time recording information, along with the service request signal in step (204), the electronic scoreboard control signal in step (207), the video data in step (210), the audio data in step (211), and the main section in step (213), and can register the sports data in step (215).

[0083] Depending on the embodiment, in step (302), the service server (110) may transfer real-time record information to the access point (152). The access point (152) may display the real-time record information on an electronic scoreboard screen. For example, the electronic scoreboard screen may further include player information, such as player scores, fouls, and playing time. The access point (152) may also display both basic scoreboard information and player information based on real-time record information, or it may display basic scoreboard information but temporarily overlay at least some of the relevant information on top of the scoreboard information when the real-time record information is updated.

[0084] According to one embodiment, a third user terminal (not shown in the drawings) can receive real-time recording information through an application or web interface. To this end, the third user terminal can send a real-time recording information viewing request signal to a service server (110). In response to the viewing request signal, the service server (110) can transfer the real-time recording information to the third user terminal. For example, the third user terminal may also display an interface similar to the real-time recording interface provided to the second user terminal (142), and real-time recording information may be provided through that interface. In this case, the third user terminal may not be granted recording privileges, but only viewing privileges.

[0085] The service server (110) can generate analytical information corresponding to key intervals based on real-time recording information. For example, the real-time recording information may include multiple events. Each event may include relevant sports metrics (e.g., scores, shot attempts, score types, assists, steals, fouls, misses, etc.), player identification information (e.g., jersey number, name, etc.), competition division information (e.g., quarter, first / second half, etc.), time information, etc. The service server (110) can select key intervals that match the competition division information and time information, and generate analytical information corresponding to the selected key intervals (e.g., scores, assists, etc., for player a of team A). Alternatively, the service server (110) can select events that match the key interval for which it wants to generate analytical information, and then generate analytical information for the key interval based on the sports metrics and player identification information of the selected events.

[0086] Figure 4 is a diagram illustrating a digital conversion operation linked to a recording function according to one embodiment. The steps (201) to (219) shown in Figure 4 can be substantially applied to the matters described above.

[0087] Referring to Figure 4, in step (401), the user terminal (141) can request recording for a sports competition. For example, the tournament interface may have multiple competitions pre-registered according to the match schedule. Alternatively, the team interface may have friendly matches, inter-squad matches, pickup games, social matching games, etc., pre-registered. The user terminal (141) can select one of the pre-registered competitions and invoke the recording function.

[0088] In step (402), the service server (110) can approve the request after checking the permissions of the user terminal (141). Figure 4 illustrates that the approval in step (402) is performed in response to the request in step (401), but it is also possible that an permission check is performed before step (401), and only user terminals with the necessary permissions can make the record request in step (401). In this case, the separate approval procedure in step (402) may be omitted.

[0089] In step (403), the user terminal (141) can record the results of a sports competition. For example, the user terminal (141) can provide the real-time recording function of step (301) as described in Figure 3. According to one embodiment, the user terminal (141) can respond to user input and send a signal to the service server (110) to indicate a candidate for the main section. Based on this signal, the service server (110) can extract the main section in step (213).

[0090] In step (404), the user terminal (141) can send a recording completion signal to the service server (110).

[0091] Figure 5 illustrates a digital conversion operation that can be linked with a stadium rental function according to one embodiment. The steps (201) to (219) shown in Figure 5 can be substantially applied as described above.

[0092] Referring to Figure 5, in step (502), the user terminal (141) can send a reservation request signal to request the exclusive use of the stadium. The reservation request signal may include first user information, first stadium information, first date information, and first time information. Depending on the embodiment, there may be multiple courts in the stadium, in which case the stadium information may be understood to also include court information. In step (503), the user terminal (141) sends a photography request signal to request photography of the stadium. The photography request signal may include second user information, second stadium information, second date information, and second time information.

[0093] The actions in steps (502) and (503) may be performed through an app installed on the user terminal (141) or through a web interface accessed from the user terminal (141). The app or web interface for step (502) may be the same as or different from the app or web interface for step (503).

[0094] Although not shown in the diagram, a separate server may be operated to process payments in response to the shooting request in step (503). In this case, the first service server can periodically request the breakdown of shooting requests from this server. Alternatively, the server may send a push notification to the first service server as the breakdown of shooting requests is updated.

[0095] In step (504), upon receiving a photo shoot request, the first service server can request the second service server to provide the venue rental information. In one embodiment, the first service server can request the second service server to provide the venue rental information after confirming whether payment for the photo shoot request has been completed and / or whether the payment has not been canceled by a predetermined time (e.g., the time the photo shoot request was made or the time when payment can be canceled). In one embodiment, the second service server responsible for venue rental management may differ for each stadium. The first service server can identify the second service server corresponding to the second stadium information. The first service server can request the second service server corresponding to the second stadium information to provide the second date information and the second time information. Depending on the embodiment, the first service server may also periodically request the second service server to provide the venue rental information according to a predetermined cycle.

[0096] In step (505), the second service server may respond to the first service server with reservation information. The reservation information may include third user information corresponding to the second stadium information, second date information, and second time information.

[0097] In step (506), the first service server receives the reservation information from the second service server and can compare the third user information contained in the reservation information with the second user information to perform verification regarding the permission to request photography. Although not shown in the diagram, if the sports stadium photography system (151) is a cloud-based IP camera device, after the verification regarding the permission to request photography is complete, the first service server can request the sports stadium photography system (151) corresponding to the second stadium information to photograph the stadium according to the second date information and the second time information.

[0098] Although not shown in the diagram, both the reservation request in step (502) and the photography request in step (503) may be requested to the second service server. In this case, the second service server can forward both the reservation information (reservation request information) and the photography information (photography request information) to the first service server in step (505), and step (504) may be omitted. Also, in this case, a separate verification of photography request authority may not be required, so step (506) may be omitted.

[0099] In step (209), the first service server requests the competition video from the data center (130). The first service server may request the competition video corresponding to the second venue information, the second date information, and the second time information. In step (210), the data center (130) responds with the competition video.

[0100] In step (215), the first service server can register the section information of the main section with the third service server. The section information can be stored by matching it with a shooting identifier corresponding to the second stadium information, second date information, and second time information included in the shooting request, and may include the section identifier, the section start point (time or frame in the video), and the section end point (time or frame in the video).

[0101] For example, each section may be a scene related to a shot, and the start and end points of each section may include section information indicating when the scene begins and ends. In this case, the first service server can either match the video identifier and / or video link received from the streaming server (120) with the shooting identifier along with the section information and store it, or it can request registration from the third service server.

[0102] In step (216), the user terminal (141) can request segment information from the third service server. The third service server is a server that provides competition video for each user and / or team and provides diverse sports data to the user terminal (141) through competition analysis. In step (217), the third service server can respond with segment information.

[0103] In step (218), the user terminal (141) can request video from the streaming server (120) based on the segment information. In step (219), the streaming server (120) can respond (stream transmit) the requested video. The operations in steps (216) and (218) can be performed through an app installed on the user terminal (141) or through a web interface connected from the user terminal (141). The app or web interface for steps (216) and (218) may be the same as or different from the app or web interface for steps (502) and / or step (503).

[0104] According to one embodiment, after the upload in step (214) is completed and the section information registration in step (215) is completed, the first service server can send a notification message to the user account that made the shooting request in step (503). The notification message can be sent in various forms, such as IMS, SMS, email, and / or APP notification. Prior to step (216), the user terminal (141) can request competition registration from the third service server using the shooting identifier. For example, the user terminal (141) can request competition registration from the third service server by entering the shooting identifier through an App or Web interface. The third service server can generate and register competition information for the user account and / or team of the user terminal (141) using the section information, video identifier, and / or video link stored in matching the shooting identifier. Depending on the embodiment, the user terminal (141) that made the shooting request in step (503) and the user terminal (141) that requested competition registration prior to step (216) may be different. In this case, the user terminal (141) requesting competition registration can receive the shooting identifier from the user terminal (141) that made the shooting request.

[0105] The user terminal (141) can request registration of a competition by specifying a portion of the competition video in the video identifier and / or video link, or by specifying multiple portions of the competition. For example, if a request is made to film 3 hours of competition video, multiple (N) competitions may take place within those 3 hours. In this case, the user terminal (141) can request registration of multiple competitions from the third service server by obtaining multiple (N) portions of the competition in which the multiple (N) competitions took place (for example, by receiving input from the user or obtaining them through video processing). Based on the multiple (N) portions of the competition requested for registration, the third service server can divide the portion information relating to the main portion and register each portion in multiple (N) competition information.

[0106] Depending on the embodiment, the third service server may receive registration requests for some of the multiple (N) competitions as the first team of the user account, and for the remaining competitions as the second team of the same user account. Alternatively, the third service server may receive registration requests for some of the multiple (N) competitions from the first user terminal (141), and for the remaining competitions from the second user terminal (141).

[0107] The third service server generates competition information according to the team of the user account that made the registration request, but it can prevent the same time interval in the competition video of the same video identifier and / or video link from being registered for different competitions multiple times. For example, when the third service server receives a registration request from a user terminal (141) that specifies a particular interval in the competition video of the video identifier and / or video link, it can check if there is already competition information registered for the same competition video using the same shooting identifier. If there is already competition information registered using the same shooting identifier, the third service server can check the interval specified in the already registered competition information and check whether it overlaps with the interval received this time by a certain amount or more. The third service server can register the new competition information only if there is no overlap by a certain amount or more.

[0108] Depending on the embodiment, the user terminal (141) may request previously registered competition information from a third service server in accordance with the shooting identifier, and the user may be provided with an interface that prevents competition segments that have been pre-selected in previously registered competition information from being designated as segments for a new competition.

[0109] In another embodiment, in step (215), the third service server first generates competition information corresponding to the second stadium information, second date information, and second time information, and can match the generated competition information to store segment information, video identifiers, and / or video links. After the upload in step (214) is completed and the segment information registration in step (215) is completed, the first service server can send a notification message to the user account that made the shooting request in step (503). The notification message can be sent in various forms, such as IMS, SMS, email, and / or APP notification, and may include a key (or QR code, etc.) that indicates the competition information. Prior to step (216), the user terminal (141) can request competition registration from the third service server using a key that indicates the competition information. The third service server can use the key that indicates the competition information to match the competition information generated in step (214) with the user account and / or team that requested competition registration. Depending on the embodiment, the user terminal (141) that made the photo shoot request in step (503) and the user terminal (141) that made the competition registration request prior to step (216) may be different. In this case, the user terminal (141) that made the photo shoot request can receive a key (or QR code, etc.) indicating the competition information from the user terminal (141) that made the photo shoot request.

[0110] In another embodiment, in step (215), the first service server may forward the user account that made the shooting request in step (503) to the third service server. In this case, the third service server can immediately match the generated competition information corresponding to the second stadium information, second date information, and second time information to the user account. The third service server may also immediately match the competition information to the user account only if the user account has the user privileges to register for competitions (e.g., team manager privileges).

[0111] Depending on the embodiment, at least two of the first, second, and third service servers may be operated in an integrated manner. In this case, the signals transmitted and received between the servers shown in the diagram can be understood as protocol signals exchanged between modules within the integrated server.

[0112] The embodiments described above may provide a platform service that significantly reduces the physical resources required for users to directly film their own competition footage, as well as the time resources required to watch the entire competition footage in order to extract key segments from it.

[0113] In one embodiment, a user terminal (141) can provide the user with video clips of key sections through an app or web interface. The user terminal (141) can either request the video clips from a third service server to download them, or it can directly encode the video clips. The user terminal (141) can also provide a function to post the video clips to social media, etc.

[0114] In one embodiment, the user terminal (141) can work in conjunction with a third service server to provide the user with a function to subdivide the recording of competition video, including key sections (e.g., matching various stats and player information involved in each stat to the video time and recording them). The user terminal (141) can work in conjunction with the third service server to perform statistical processing on the aggregated records and provide the user with the digital conversion results of the sports competition through various visualization techniques. The user terminal (141) can work in conjunction with the third service server to provide a function to share sports data related to video and records with other users.

[0115] Figure 6 illustrates a digital conversion operation linked to a video recording function according to one embodiment. The above-described matters can be applied substantially as is to steps (215) to (219) shown in Figure 6.

[0116] Referring to Figure 6, in step (601), the user terminal (141) can provide a video recording interface based on the competition video provided by the streaming server (120). In response to user input through the video recording interface, the user terminal (141) can send a request signal to the service server (110) to record sports metrics. The video recording interface may include a player for playing the video and may also include an interface for searching for the playback point of the video (e.g., time information or frame information) to modify previously saved sports metrics or add new sports metrics.

[0117] Similar to real-time recording, recordable sports metrics can be set differently depending on the characteristics of the sport, and in some cases, multiple metrics may be automatically set from a single input according to the rules of the sport.

[0118] In step (602), the service server (110) can generate video recording information based on the sports metric recording request signal. The service server (110) can update previously registered sports data (e.g., segment information) based on the video recording information.

[0119] Steps (603) through (606) are operations between the second user terminal (142) and the service server (110), and the matters described above in steps (216) through (219) can be applied substantially as is. Similarly, steps (607) and (608) are operations between the second user terminal (142) and the service server (110), and the matters described above in steps (601) and (602) can be applied substantially as is.

[0120] According to one embodiment, the video recording interface may include a variety of detailed interfaces to enable efficient division and progress of the recording work. For example, the video recording interface may include a segment-specific recording interface so that a user terminal (141) and a second user terminal (142) can proceed with the recording work separately for each segment. Furthermore, the video recording interface may include a main segment-specific recording interface so that the recording work can proceed separately for each main segment within the same segment. The main segment-specific recording interface can provide convenience by including the video clips of the main segments extracted in step (213) in a predetermined format (e.g., card format), so that the recording work can proceed mainly with the main segments without having to play the entire video.

[0121] Furthermore, the video recording interface may include a team recording interface that prioritizes recording team-level sports metrics, and a player recording interface that records player identification information for each sports metric afterward. Through the team recording interface, users can input team-level sports metrics (e.g., Team A's shooting attempts, Team B's rebounds / blocks, etc.) while playing back the game footage. The player recording interface includes team-level sports metrics in a predetermined format (e.g., card format), allowing users to input relevant player identification information while playing back only the video segments corresponding to the team-level sports metrics.

[0122] By differentiating the team record interface from the player record interface, even users who cannot accurately identify individual players can use the team record interface to record team-level sports metrics using only visual information that distinguishes the two teams (e.g., uniform color). In one embodiment, this can be linked to a business model that distributes recording work to an unspecified number of cloud workers through the team record interface.

[0123] According to one embodiment, after recording of major sections is complete, the service server (110) can determine whether or not there is a section with an error between adjacent major sections. For example, in a basketball game, since offense and defense naturally alternate, if two adjacent major sections are recorded as shooting attempts by the same team, it can be estimated that there is an error by the opposing team between them. By providing the estimated section to the user terminal, the service server (110) allows the user to efficiently record the section with the error without having to replay the entire game.

[0124] Although not shown in the diagram, the service server (110) can store sports data by integrating video data, electronic scoreboard data, real-time recording data, and other video data. Based on the stored sports data, the service server (110) can generate highlight videos for specific sports competitions. For example, the service server (110) can predict the characteristics of a particular sports competition based on the previous records of two teams participating in that competition and the records of the participating athletes. The service server (110) can generate comments on key sections and sections with mistakes while comparing the records of the sports competition with the predicted characteristics. The model for generating the comments described above can be realized based on records and broadcast comments from professional leagues, university leagues, etc.

[0125] The service server (110) can select sections to be included in the highlight video by assigning weights to key sections and sections with errors. For example, sections where the score difference between the two teams changes in a way that has a dominant impact on the outcome of the game (e.g., a game-winning goal or buzzer-beater in basketball, or a goal in soccer / futsal) or sections with loud recorded audio (e.g., the sound of cheers) may be given a high weight. If the highlight video to be generated is short content, the service server (110) can select key sections and sections with errors that fit a predetermined video length (e.g., 30 seconds), and then use the comments generated for the selected sections to generate the short content. If the highlight video to be generated is of regular length (e.g., 10 minutes), the service server (110) can select key sections and sections with errors for each segment of the sport and generate a comprehensive comment that tells the story of the sport based on the individual comments for the selected sections. The service server (110) can then combine the video of the selected sections and use the comprehensive comment to generate content of regular length.

[0126] Figure 7 shows a photographic system and access point for a sports stadium according to one embodiment. Referring to Figure 7, a shooting system including multiple cameras (151-1, 151-2) may be installed in the sports stadium (153). The first camera (151-1) may be installed in a first position to photograph the first court of the sports stadium (153) in a quarter-view composition, and the second camera (151-2) may be installed in a second position to photograph the second court of the sports stadium (153) in a quarter-view composition. The first and second courts may correspond to the courts on either side of the half-line of the sports stadium (153). The area covered by the field of view of the first camera (151-1) and the area covered by the field of view of the second camera (151-2) may partially overlap. The multiple cameras (151-1, 151-2) may be connected to the internet, and the captured video may be transmitted to a data center (130) via the network.

[0127] Access points (152) may be further installed in the sports stadium (153). The access points (152) can also be connected to the internet by wire or wireless connection and can communicate with the service server (110) via the network. The access points (152) are assigned an identification code by the service server (110) and can display the identification code through their basic screen. Service usage applications can be submitted through user terminals (141) that scan the identification code from among the user terminals (140). Once service approval is completed after procedures such as confirmation of usage time and payment confirmation, the access points (152) can display an electronic display screen. User terminals (141) can provide a controller interface to control the electronic display screen displayed on the access points (152).

[0128] The user (710) can control the electronic scoreboard screen displayed on the access point (152) through the controller interface of the user terminal (141). Players from both teams (720, 730) can check the progress of the competition and / or real-time record information through the electronic scoreboard screen. In some environments, such as when a sports stadium (153) is outdoors, it may be difficult to permanently install an access point (152). The access point (152) may be designed as a portable device rather than a fixed-installation device. Depending on the embodiment, one of the user terminals (140) may also take on the role of an access point (152).

[0129] The embodiments described above may be embodied as processing units comprising hardware components, software components, and / or combinations of hardware and software components. For example, the devices, methods, and components described in the embodiments may be embodied using one or more general-purpose or special-purpose computers, such as a processor, controller, ALU (arithmetic logic unit), digital signal processor, microcomputer, FPGA (field programmable gate array), PLU (programmable logic unit), microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications running on the OS. The processing unit may also access, store, manipulate, process, and generate data in response to the execution of software. For convenience of understanding, the processing unit may have been described as using only one, but a person with ordinary skill in the art will know that the processing unit may include multiple processing elements and / or multiple types of processing elements.

[0130] Software may include computer programs, code, instructions, or a combination of one or more of these, which can configure a processing unit to operate as desired, or instruct the processing unit independently or collectively. Software and / or data may be permanently or temporarily embodyed in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, for interpretation by a processing unit or for providing instructions or data to a processing unit. Software may also be distributed across a network of computer systems and stored and executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0131] The methods according to the embodiments are embodied in the form of program instructions that can be executed through various computer means and can be recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., individually or in combination. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

[0132] Although embodiments have been described above with limited drawings, a person with ordinary skill in the art can apply a variety of technical modifications and variations based on the above. For example, satisfactory results can be achieved even if the described techniques are performed in a different order than described, and / or if the described systems, structures, devices, circuits, and other components are combined or assembled in a different manner than described, or substituted or replaced by other components or equivalents.

[0133] Therefore, other embodiments, other embodiments, and claims equivalent to those described below also fall within the scope of the claims.

Claims

1. A method for operating a server that provides digital conversion of sports competitions, The steps include providing identification codes to multiple access points, The steps include receiving a service request signal from a user terminal that has scanned a first identification code, In response to the approval of the service request, the steps include: transmitting a service approval signal to the first access point and the user terminal corresponding to the first identification code; The steps include: transferring the electronic display control signal received from the user terminal to the first access point; The steps include sending a service termination signal to the first access point and the user terminal in response to the termination of the service, The steps include requesting video data captured by the first shooting system corresponding to the first access point from the data center, Based on the electronic display board control signal, the steps include extracting multiple main sections from the video data, Steps include registering section information for multiple major sections, The steps include receiving a section information request signal from the user terminal relating to at least one of several main sections, The steps include: transmitting section information relating to at least one main section to the user terminal as a response to the section information request signal; The server's operating method, including its operation.

2. The step of extracting the aforementioned multiple main intervals is: The steps include: estimating at least one segmented section within the sports competition based on the electronic display control signal; The steps include: extracting motion information within a predetermined area of ​​a video frame included in at least one of the division sections; A step of estimating at least one main section included in the at least one divided section based on the motion information, A method of operating the server according to claim 1, including the method described in claim 1.

3. The step of extracting the aforementioned multiple main intervals is: The steps include identifying the electronic display control signals received at the time corresponding to the estimated at least one main interval among the electronic display control signals, The steps include generating analysis information corresponding to the estimated at least one major section based on the identified electronic display control signals, The method of operating the server according to claim 2, further comprising:

4. The step of extracting the aforementioned multiple main intervals is: The steps include identifying at least one predetermined type of electronic display control signal from among the aforementioned electronic display control signals, The steps include identifying the time when the identified electronic display board control signal was received, A step of estimating at least one major interval within the sporting competition based on the identified time, A method of operating the server according to claim 1, including the method described in claim 1.

5. The step of extracting the aforementioned multiple main intervals is: The steps include generating analysis information corresponding to the estimated at least one main section based on the identified type of electronic display board control signal, The server operation method according to claim 4, further comprising:

6. The steps include receiving audio data from the first access point, The steps include synchronizing the video data and the audio data based on the electronic display board control signal, The steps include uploading the synchronized video and audio data to a streaming server, The method of operating the server according to claim 1, further comprising:

7. The step of transmitting section information relating to at least one major section to the user terminal is: The steps include generating electronic display information corresponding to at least one main section based on the electronic display control signal, The steps include transmitting the aforementioned electronic display board information to the user terminal, A method of operating the server according to claim 1, including the method described in claim 1.

8. The steps include receiving a request signal for recording a sports metric from at least one second user terminal, The steps include generating real-time record information of the sports competition based on the record request signal, The method of operating the server according to claim 1, further comprising:

9. The server operation method according to claim 8, further comprising the step of transmitting the real-time recording information to the access point.

10. The steps include receiving a real-time recording information viewing request signal from a third user terminal distinct from the at least one second user terminal, The server operation method according to claim 8, further comprising the step of transmitting the real-time recording information to the third user terminal in response to the viewing request signal.

11. A computer-readable recording medium on which a program for performing the method described in any one of claims 1 to 10 is recorded.

12. A server that provides digital conversion of sports competitions, Memory and At least one processor connected to the memory and configured to execute a computer-readable program contained in the memory, Includes, The program is configured on at least one processor, The steps include providing identification codes to multiple access points, The steps include receiving a service request signal from a user terminal that has scanned a first identification code, In response to the approval of the service request, the steps include: transmitting a service approval signal to the first access point and the user terminal corresponding to the first identification code; The steps include: transferring the electronic display control signal received from the user terminal to the first access point; The steps include sending a service termination signal to the first access point and the user terminal in response to the termination of the service, The steps include requesting video data captured by the first shooting system corresponding to the first access point from the data center, Based on the electronic display board control signal, the steps include extracting multiple main sections from the video data, Steps include registering section information for multiple major sections, The steps include receiving a section information request signal from the user terminal relating to at least one of several main sections, The steps include: transmitting section information relating to at least one main section to the user terminal as a response to the section information request signal; A server containing instructions to execute.

13. The first shooting system includes a plurality of cameras that divide and photograph the stadium where the sports competition was held, The server according to claim 12, wherein the video data includes a plurality of channels captured by the plurality of cameras.

14. Each of the section information relating to the aforementioned multiple main sections is: The server according to claim 13, further comprising a channel indicator that indicates the channel in which the play of the corresponding main section was filmed among the plurality of channels.

15. The multiple channels included in the video data are simultaneously streamed to the user terminal. The channel selected by the channel indicator is displayed on the user terminal by default. The server according to claim 14, wherein multiple channels are switched and displayed in response to user input via the user terminal, or are displayed simultaneously.

Images