Method and device for digital conversion of sports game

Abstract

An operation method of a server for providing digital conversion of a sports game is disclosed. This service server: receives a service request signal from a user terminal which has scanned a first identification code; transmits electronic display board control signals received from the user terminal to a first access point corresponding to the first identification code; requests image data captured by a first photographing system corresponding to the first access point from a data center; extracts major sections from the image data on the basis of the electronic display board control signals; registers section information on the major sections; and transmits section information on at least one major section to the user terminal in response to a section information request signal.

Description

Methods and devices for digital transformation of sports events

[0001] The following examples relate to methods and devices for digital conversion of sports events.

[0002] The digital transformation of sports events refers to leveraging cutting-edge technologies to revolutionize how events are managed, analyzed, and viewed. Key underlying technologies enabling this digital transformation include data analytics and machine learning, virtual and augmented reality (VR / AR), the Internet of Things (IoT), and cloud computing.

[0003] However, the digital transformation technologies of conventional sports games have a structure that requires expensive specialized equipment and specialized personnel, which results in high introduction costs and very low accessibility.

[0004] A method of operating a server providing digital conversion of a sports game according to one side comprises the steps of: providing identification codes to a plurality of access points; receiving a service request signal from a user terminal that scans a first identification code; transmitting a service approval signal to a first access point corresponding to the first identification code and the user terminal upon approval of the service request; transmitting electronic scoreboard control signals received from the user terminal to the first access point; transmitting a service termination signal to the first access point and the user terminal upon termination of the service; requesting image data captured by a first photographing system corresponding to the first access point to a data center; extracting a plurality of key sections from the image data based on the electronic scoreboard control signals; registering section information regarding the plurality of key sections; receiving a section information request signal regarding at least one key section among the plurality of key sections from the user terminal; and transmitting section information regarding the at least one key section to the user terminal in response to the section information request signal.

[0005] The step of extracting the plurality of main sections may include the step of estimating at least one branch section within the sports game based on the scoreboard control signals; the step of extracting motion information within a predetermined area of ​​image frames included in the at least one branch section; and the step of estimating at least one main section included in the at least one branch section based on the motion information.

[0006] The step of extracting the plurality of main sections may further include the step of identifying a board control signal received at a time corresponding to the estimated at least one main section among the board control signals; and the step of generating analysis information corresponding to the estimated at least one main section based on the identified board control signal.

[0007] The step of extracting the plurality of main sections may include the step of identifying at least one predetermined type of scoreboard control signal among the scoreboard control signals; the step of identifying a time at which the identified scoreboard control signal was received; and the step of estimating at least one main section within the sports game based on the identified time.

[0008] The step of extracting the plurality of main sections may further include a step of generating analysis information corresponding to the estimated at least one main section based on the type of the identified electronic board control signal.

[0009] The operating method of the server may further include the steps of: receiving audio data from the first access point; synchronizing the video data and the audio data based on the electronic display control signals; and uploading the synchronized video and audio data to a streaming server.

[0010] The step of transmitting section information regarding at least one major section to the user terminal may include the step of generating electronic board information corresponding to the at least one major section based on the electronic board control signals; and the step of transmitting the electronic board information to the user terminal.

[0011] The method of operating the server may further include the step of receiving recording request signals of sports indicators from at least one second user terminal; and the step of generating real-time recording information of the sports game based on the recording request signals.

[0012] The operating method of the above server may further include a step of transmitting the real-time record information to the access point.

[0013] The operating method of the server may further include the step of receiving a request signal for viewing real-time record information from a third user terminal that is distinct from the at least one second user terminal; and the step of transmitting the real-time record information to the third user terminal in response to the request signal for viewing.

[0014] A server providing digital conversion of a sports event according to one aspect includes a memory; and at least one processor connected to the memory and configured to execute a computer-readable program included in the memory. The program comprises the steps of: causing the at least one processor to provide identification codes to a plurality of access points; receiving a service request signal from a user terminal that scans a first identification code; transmitting a service approval signal to a first access point corresponding to the first identification code and the user terminal upon approval of the service request; transmitting electronic scoreboard control signals received from the user terminal to the first access point; transmitting a service termination signal to the first access point and the user terminal upon termination of the service; requesting image data captured by a first photographing system corresponding to the first access point to a data center; extracting a plurality of key sections from the image data based on the electronic scoreboard control signals; registering section information regarding the plurality of key sections; receiving a section information request signal regarding at least one key section among the plurality of key sections from the user terminal; And, in response to the section information request signal, includes commands for performing a step of transmitting section information regarding at least one major section to the user terminal.

[0015] The first filming system may include a plurality of cameras that divide and film the stadium where the sports event is held, and the image data may include a plurality of channels filmed by the plurality of cameras.

[0016] Each section information regarding the plurality of main sections may further include a channel indicator indicating a channel on which the play of the corresponding main section was filmed among the plurality of channels.

[0017] The plurality of channels included in the video data are simultaneously streamed to the user terminal, a channel selected by the channel indicator is displayed as a default on the user terminal, and the plurality of channels can be switched and displayed or displayed simultaneously according to a user input through the user terminal.

[0018] FIG. 1 is a diagram illustrating a digital conversion system according to one embodiment.

[0019] FIG. 2 is a diagram illustrating a digital conversion operation according to one embodiment.

[0020] FIG. 3 is a diagram illustrating a digital conversion operation linked to a real-time recording function according to one embodiment.

[0021] FIG. 4 is a diagram illustrating a digital conversion operation associated with a recording function according to one embodiment.

[0022] FIG. 5 is a diagram illustrating a digital conversion operation that can be linked to a stadium rental function according to one embodiment.

[0023] FIG. 6 is a diagram illustrating a digital conversion operation linked to an image recording function according to one embodiment.

[0024] FIG. 7 is a diagram illustrating a shooting system and access point of a sports stadium according to one embodiment.

[0025] Any specific structural or functional descriptions disclosed in this specification are merely illustrative for the purpose of describing embodiments according to technical concepts, and the embodiments may be implemented in various other forms and are not limited to the embodiments described in this specification.

[0026] While terms like "first" and "second" may be used to describe various components, these terms should be understood solely to distinguish one component from another. For example, a "first" component may be referred to as a "second" component, and similarly, a "second" component may also be referred to as a "first" component.

[0027] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. Conversely, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. Expressions that describe relationships between components, such as "between" and "immediately between," or "adjacent to" and "directly adjacent to," should be interpreted similarly.

[0028] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "has" should be understood to indicate the presence of a stated feature, number, step, operation, component, part, or combination thereof, but not to exclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0029] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art. Terms defined in commonly used dictionaries should be interpreted to have a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0030] The embodiments relate to a method and apparatus for generating sports data through the digital transformation of sports events. While basketball has been primarily used as an example, the embodiments can be substantially equally applied to team or individual sports, ball games, or non-ball games. The embodiments of the present invention can be implemented in various forms, such as mobile applications, web-based applications, SaaS, and PC programs. For convenience of explanation, an example implemented as a mobile application is described. Hereinafter, the entity providing functions according to the embodiments is referred to as a "sports data service." The sports data service may refer to software, such as an application or server program, or hardware, such as a client device, a server device, or an edge device. Of course, the sports data service may also be interpreted in accordance with the literal meaning of the term "service."

[0031] Hereinafter, embodiments are described in detail with reference to the attached drawings. The same reference numerals in each drawing represent the same components.

[0032]

[0033] FIG. 1 is a diagram illustrating a digital conversion system according to one embodiment.

[0034] Referring to FIG. 1, a digital conversion system according to one embodiment provides a digital conversion function for a sports event. Sports data provided through digital conversion of a sports event may include sports videos and further include sports record information linked to the sports videos. The digital conversion system may include a service server (110), a streaming server (120), a data center (130), user terminal(s) (140), and sports stadium(s) (150). The service server (110) performs major operations for providing the digital conversion function, and the streaming server (120) performs operations for streaming sports videos to user terminals. In the embodiment of FIG. 1, the service server (110) and the streaming server (120) are illustrated separately, but depending on the implementation method of the digital conversion system, the service server (110) may also be designed to perform the functions of the streaming server (120).

[0035] A sports stadium (153) may include a filming system (151) and an access point (152). Sports images captured by the filming system (151) may be transmitted to and stored in a data center (130). The data stored in the data center (130) may be stored for a predetermined period of time (e.g., 10 days, 1 month, etc.). According to one embodiment, the filming system (151) includes an IP (Internet Protocol) camera, and for example, the filming system (151) may be implemented as an IP-based CCTV system. The IP-based CCTV system is basically operated for the purpose of facility safety and management, and fire prevention, and may be utilized to provide sports data limited to images of a corresponding time zone upon service use requests from player(s) or team(s) participating in a sports game.

[0036] The access point (152) provides a user interface to enhance accessibility of the digital conversion service. For example, the access point (152) includes a display screen, and a user can request the digital conversion service by scanning an identification code (e.g., a QR code) of the access point (152) with a user terminal (141). In one embodiment, the recording system (151) may only perform video recording and not audio recording. In this case, the access point (152) may perform audio recording. The access point (152) may provide an electronic scoreboard function during a sports game. The electronic scoreboard displayed on the access point (152) may be controlled by the user terminal (141).

[0037] When the use of the digital conversion service is terminated, the service server (110) requests a sports video from the data center (130). If the shooting system (151) and the data center (130) are operated by an operating entity different from the service server (110), the service server (110) can download the sports video of the corresponding section through an API provided by the operating entity of the shooting system (151) and the data center (130). The service server (110) can extract key sections from the sports video and then register section information related to the extracted key sections. The service server (110) can upload the sports video to the streaming server (120). The service server (110) provides section information corresponding to the key sections to the user terminal (141), and the user terminal (141) can utilize the section information to request and receive the sports video of the key sections from the streaming server (120). According to one embodiment, since image data of multiple channels are captured by the shooting system (151), the section information regarding the main section may further include an indicator indicating the channel in which the play of the corresponding main section was captured among the multiple channels.

[0038] Although not shown in the drawing, the streaming server (120) may include a separate data center distinct from the data center (130). The streaming server (120) may encode sports videos according to streaming standards, and may also encode sports videos in various resolutions for adaptive streaming services. Depending on the embodiment, the shooting system (151) and the streaming server (120) may be operated by the same or linked operating entity(ies), in which case the data center (130) of the shooting system (151) may be utilized together with the streaming server (120).

[0039] The service server (110) can provide a digital conversion service in conjunction with an app or web running on a user terminal (141). In addition to providing the aforementioned sports video, the service server (110) can provide sports record information linked to the sports video. For example, the service server (110) can extract key sections from a sports video and provide highlight scenes of a sports game. The service server (110) can add scoreboard information to the sports video by utilizing the control information of the scoreboard input during the sports game, and further, can add analysis information to the key sections based on the control information of the scoreboard. The analysis information is the result of analyzing the scene of the key section, and can include, for example, sports indicators related to the scene.

[0040] The service server (110) can provide a user terminal (141) with a function that allows for inputting sports indicators in real time while the game is in progress, and can also provide a user terminal (141) with a function that allows for inputting sports indicators after the game has ended based on previously recorded game footage. The function for inputting sports indicators is designed to be accessible to multiple user terminals (140) in a crowd-based manner, so that multiple users can divide up roles and input sports indicators.

[0041] A digital conversion system according to one embodiment can function as a platform for popularizing sports data. Compared to existing sports data solutions, the digital conversion system can provide a range of functions, including service subscription, sports video recording, key scene extraction and editing, sports record creation linked to key scenes, and sports video and record sharing, at a lower cost and with greater ease.

[0042]

[0043] FIG. 2 is a diagram illustrating a digital conversion operation according to one embodiment.

[0044] Referring to FIG. 2, in step (201), a shooting system (151) installed in a sports stadium takes pictures of the stadium and stores the pictures in a data center (130). The shooting system (151) can transmit image data taken of the stadium to the data center (130). The shooting system (151) includes a camera that takes pictures of the stadium where a sports game is taking place. According to one embodiment, the shooting system (151) may include multiple cameras that divide the stadium and take pictures. The primary camera(s) included in the shooting system (151) may be installed at a location suitable for taking pictures of a sports game in a quarter-view format. In addition, the shooting system (151) may include additional cameras that are installed at a location suitable for taking pictures of players' plays in a dynamic format. The image data of multiple channels taken by the cameras included in the shooting system (151) may be transmitted to the data center (130) and stored with a time synchronized with each other.

[0045] In one embodiment, the recording system (151) may include a cloud-based CCTV device installed in a sports stadium. In this case, the CCTV device may continuously record the stadium and upload the recorded video to a data center (130). The recording system (151) of the sports stadium and the data center (130) are connected via a network, and the game video uploaded to the data center (130) may be stored for a certain period of time and then automatically deleted. The recording system (151) may include a plurality of CCTV devices configured to form a plurality of channels. For example, the recording system (151) may include a CCTV device of a first channel that records one side of the stadium and a CCTV device of a second channel that records the other side of the stadium.

[0046] In another embodiment, the recording system (151) may include a cloud-based IP camera device installed in a sports stadium. Although not illustrated in the drawing, the IP camera device may receive a recording request from the first service server and, in response, record the stadium. The recorded video may be uploaded to a data center (130) connected via a network. The recording system (151) of the sports stadium and the data center (130) are connected via a network, and the game video uploaded to the data center (130) may be stored for a certain period of time and then automatically deleted. Alternatively, the video may be deleted in a FIFO manner depending on the remaining storage space allocated to the data center (130). The recording system (151) may include a plurality of IP camera devices configured as multiple channels. For example, the recording system (151) may include a first channel IP camera device that records one side of the stadium and a second channel IP camera device that records the other side of the stadium.

[0047] In step (202), the access point (152) displays an identification code for applying for use of the digital conversion service. For example, the identification code may include, but is not limited to, a QR code. The access point (152) may display a basic screen containing images or videos for promoting and explaining the digital conversion service, and may display the identification code in an appropriate area within the basic screen. Depending on the embodiment, the basic screen may include images or videos for announcements or promotions related to the sports stadium where the access point (152) is installed.

[0048] In step (203), the user terminal (141) scans an identification code. For example, the user terminal (141) may scan the identification code using an image sensor, and the method of scanning the identification code is not limited thereto.

[0049] In one embodiment, in response to a scan of an identification code, the user terminal (141) can check whether an application for a digital conversion service is installed. If the application is not installed, the user terminal (141) can display a screen for installing the application. If the application is installed, the user terminal (141) can execute the application. Alternatively, in response to a scan of the identification code, the user terminal (141) can display a website for the digital conversion service. The user terminal (141) can display a service use application screen through the application or website.

[0050] In step (204), the user terminal (141) transmits a service request signal to the service server (110). The user of the user terminal (141) can input the date and time information for using the digital conversion service through the service application screen. The sports stadium is automatically specified by the identification code, and the service server (110) can check whether the entered date and time information contains previously applied information and then request payment of the service usage fee from the user terminal (141). According to one embodiment, the user can easily proceed with procedures such as consent to the collection and use of personal information, consent to filming related to portrait rights, and consent to audio recording through the service application screen.

[0051] In step (205), the service server (110) approves the service request and transmits a service approval signal to the access point (152) and the user terminal (141). According to one embodiment, the access point (152) may display a second identification code in response to the service approval signal to guide users participating in a sports event to easily access sports data. By scanning the second identification code, users can easily proceed with procedures such as app installation, membership registration, team registration, consent to the collection and use of personal information, consent to filming related to portrait rights, and consent to audio recording.

[0052] In step (206), the access point (152) displays an electronic scoreboard screen. The electronic scoreboard screen may include electronic scoreboard information for the progress of a sports game. For example, the electronic scoreboard screen may include the names of both teams participating in the sports game, information on the time interval (e.g., quarter, first / second half, etc.), time information (e.g., quarter time, first / second half time, shot clock, timeout time, etc.), scores of both teams, number of fouls of both teams (e.g., number of team fouls), number of timeouts of both teams, etc. In step (207), the user terminal (141) is granted access to a controller interface for controlling the electronic scoreboard. For example, the controller interface may include buttons for controlling the names of both teams, quarter information, time information, scores of both teams, number of fouls of both teams, and number of timeouts of both teams.

[0053] In one embodiment, the recording system (151) may be designed to only record video. This may be to comply with any laws or regulations prohibiting audio recording of CCTV, or because the camera is installed far from the playing court, making audio recording unsuitable. In this case, the access point (152) may record the game audio. The access point (152) may continuously record audio during the service usage time, or may detect the start and end of the game's quarters (e.g., quarters, first / second halves, etc.) based on the electronic scoreboard control signals of step (207) and record audio only during the quarters.

[0054] The service server (110) can transmit the electronic display board control signals received from the user terminal (141) to the access point (152). The access point (152) can update the electronic display board screen based on the transmitted electronic display board control signals. Depending on the embodiment, the user terminal (141) may be designed to be directly connected to the access point (152). For example, the user terminal (141) and the access point (152) may be connected via Bluetooth or through the same Wi-Fi AP. In some cases, the user terminal (141) and the access point (152) may be connected via a wire. In these cases as well, the electronic display board control signals may be transmitted to the service server (110) by the user terminal (141) or the access point (152).

[0055] According to one embodiment, the controller interface of the user terminal (141) may include a VAR (Video Assistant Referees) request function. When the user terminal (141) transmits a VAR request signal, the service server (110) may request a video of a predetermined section (e.g., a section within 3 minutes from the current time) from the data center (130). The data center (130) may reply with a streaming URL for streaming the video of the requested section, and the service server (120) may transmit the streaming URL to the user terminal (141). The user terminal (141) may use the streaming URL to stream and play the video of the predetermined section from the data center (130), thereby providing the VAR function. The length of the predetermined section may be appropriately set according to the sports game, and in some embodiments, the user terminal (141) may also request the section by specifying it.

[0056] In step (208), upon termination of the service, the service server (110) transmits a service termination signal to the access point (152) and the user terminal (141). The service server (110) may decide to terminate the service upon expiration of the usage time entered at the time of the service request in step (204), or may decide to terminate the service upon an explicit request from the user terminal (141). In response to the service termination signal, access rights to the controller interface granted to the user terminal (141) may also be suspended.

[0057] In step (209), the service server (110) requests a game video from the data center (130). The service server (110) may request video data of a section including the usage time entered when requesting the service in step (204). In step (210), the service server (110) receives a game video from the data center (130). The service server (110) may receive video data of a section including the usage time entered when requesting the service in step (204).

[0058] Depending on the embodiment, the maximum duration (e.g., 1 hour) of video that the data center (130) can provide as a single file may be determined. In this case, the service server (110) may request and receive video of the requested time period from the data center (130) in multiple files. The service server (110) may combine the multiple files into a single file prior to or during the operation of step (213).

[0059] When recording of game audio is performed by the access point (152) in step (206), the access point (152) may transmit audio data to the service server (110) in step (211). According to an embodiment, the access point (152) may transmit audio data to the service server (110) at predetermined intervals (e.g., 1 minute, 5 minutes, etc.) even before the end of the service in step (208). Alternatively, the access point (152) may detect the start and end of a quarter (e.g., quarter, first / second half, etc.) of a sports game based on the scoreboard control signals in step (207), and transmit audio data of the corresponding quarter to the service server (110) at the end of the quarter.

[0060] In step (212), the access point (152) may, in response to the service termination signal, display the main screen again instead of the electronic scoreboard screen. The main screen may include an identification code for applying for the next service. Depending on the embodiment, the main screen may also include a second identification code to guide users participating in a sports event to easily access sports data. The identification code and the second identification code may be displayed together on the main screen, or alternatively, or, depending on the design, may be displayed as a single identification code that provides the functions of both the identification code and the second identification code.

[0061] In step (213), the service server (110) extracts key sections within the game video.

[0062] In one embodiment, the game video may be a video of a basketball game. The service server (110) may extract scenes in which shots are attempted or scores are scored as key sections in the game video. The service server (110) may set a region of interest (ROI) including a backboard and / or a rim (goal post) in the game video, and extract the key sections by detecting movement of objects occurring in the ROI. Depending on the embodiment, the ROI may be preset for each stadium and / or channel, or the ROI may be detected in the game video using artificial intelligence technology. The movement of objects in the ROI may be due to the movement of a ball or a person within the ROI, or may be due to movement, vibration, or shaking of the rim, net, or backboard.

[0063] The service server (110) can detect the movement of an object within the region of interest by detecting whether the pixel values ​​of the region of interest have changed compared to the pixel values ​​of an adjacent frame (a previous frame or a subsequent frame within a predetermined time interval). According to one embodiment, the shooting system is equipped to capture one or both goal posts at a predetermined or higher high angle from a fixed point of view near the halfway line of the stadium, thereby preventing interference from occurring within the region of interest as much as possible. In this case, there is a high possibility that a scene in which the movement of an object within the region of interest is detected (e.g., a scene in which the ball hits the backboard or rim, or a scene in which the net shakes as the ball passes through the rim, etc.) corresponds to a scene in which a shot is attempted or a goal is scored. Alternatively, the service server (110) can detect the movement of an object within the region of interest by utilizing an artificial intelligence model to detect a ball within the region of interest (e.g., detecting a ball within the backboard area, etc.) or to track the trajectory of the ball.

[0064] In another embodiment, the match video may be a video of a futsal match. The service server (110) may extract scenes in which shots are attempted or goals are scored as key sections from the match video. The service server (110) may set a region of interest (ROI) including a goal and / or penalty area in the match video, and extract the key sections by detecting movement of objects occurring in the ROI. Depending on the embodiment, the ROI may be preset for each stadium and / or channel, or the ROI may be detected from the match video using artificial intelligence technology. The movement of objects in the ROI may be due to the movement of a ball or a person within the ROI, or due to movement, vibration, or shaking of a goal or net.

[0065] The service server (110) can detect the movement of an object within the region of interest by detecting whether the pixel values ​​of the region of interest have changed compared to the pixel values ​​of an adjacent frame (a previous frame or a subsequent frame within a predetermined time interval). According to one embodiment, the shooting system is equipped to photograph one goal post at a high angle above a certain level from a fixed point of view near the corner of the stadium, thereby preventing interference in the region of interest as much as possible. In this case, there is a high possibility that a scene in which the movement of an object within the region of interest is detected (e.g., a scene in which the ball hits the goal post or a scene in which the ball shakes the goal net, etc.) corresponds to a scene in which a shot is attempted or a goal is scored. Alternatively, the service server (110) can detect the movement of an object within the region of interest by utilizing an artificial intelligence model to detect a ball within the region of interest (e.g., detecting a ball within the penalty area, etc.) or to track the trajectory of the ball.

[0066] According to one embodiment, the service server (110) can estimate a game branch section (e.g., quarter, first / second half, etc.) based on the scoreboard control signals of step (207). The service server (110) can extract motion information from a predetermined area of ​​video frames included in the branch section. The predetermined area can be determined according to the characteristics of the sports game, the camera installation composition, etc., and can include, for example, an area where a basketball backboard or goal, a paint zone or no-charge zone, a soccer / futsal goal or penalty area, etc. are filmed in the video.

[0067] The service server (110) can extract motion information by image processing visual data of a predetermined area in consecutive video frames within a branching section. For example, the service server (110) can extract motion information by extracting visual data of a predetermined area in consecutive video frames within a branching section and detecting changes in visual data extracted from adjacent video frames. Alternatively, the service server (110) can extract motion information by applying an artificial intelligence model that detects or tracks a person or a ball to visual data of a predetermined area in consecutive video frames within a branching section.

[0068] According to one embodiment, the service server (110) can manage parameters for extracting motion information. The parameters for extracting motion information may include area parameter(s) indicating a predetermined area within a video frame, threshold parameter(s) related to the amount of change in visual data, etc. The area parameter may be set differently depending on the composition of a camera installed in a sports stadium and the location of the goal posts in the sports stadium. The threshold parameter may be set differently depending on the noise level included in an image capturing the sports stadium or the size of an object (e.g., a ball or a player) captured in the image.

[0069] The service server (110) may run a threshold parameter search algorithm to find the optimal threshold parameters for each sports stadium. For example, the service server (110) may acquire positive correct data from which motion information should be extracted and negative correct data from which motion information should not be extracted from video data captured at the sports stadium, and then adjust the threshold parameters for the stadium in a way that improves FRR and / or FAR.

[0070] The service server (110) can determine region parameters using a detection algorithm or a segmentation algorithm. Since the shooting system includes fixed cameras, if region parameters are determined at a predetermined cycle (e.g., once a day, or once per service request), the service server (110) can utilize the predetermined region parameters without having to determine region parameters for each frame when extracting key sections in step (213).

[0071] The service server (110) can periodically update the critical parameters together with the area parameters, and depending on the embodiment, the update cycle of the critical parameters can be managed to be longer than the update cycle of the area parameters.

[0072] The service server (110) can estimate a key section within a branch section based on motion information. For example, the service server (110) can determine a key section to include a video frame from which motion information is extracted. The service server (110) can determine a key section by including n frames preceding and m frames following the video frame from which motion information is extracted. If motion information is extracted from multiple consecutive video frames, the key section can be determined by including n frames preceding and m frames following the last video frame based on the first video frame. If a previous key section overlaps with n previous frames or a subsequent key section overlaps with m subsequent frames, the service server (110) can combine two or more key sections into a single key section.

[0073] The service server (110) can identify the electronic board control signal received at a time corresponding to a key section among the electronic board control signals of step (207). The service server (110) can generate analysis information corresponding to the key section based on the identified electronic board control signal. For example, the service server (110) can identify the type of the identified electronic board control signal (e.g., score, assist, etc.) and generate analysis information corresponding to the key section (e.g., Team A's score, assist, etc.) based on the identified type.

[0074] According to one embodiment, the service server (110) may identify a predetermined type of scoreboard control signal among the scoreboard control signals of step (207) in order to extract a key section within the game video. The predetermined type may be a type suitable for classification as a key scene according to the characteristics of the sports game (e.g., a score, an assist, etc.). The service server (110) may identify the time at which the identified scoreboard control signal was received and then estimate the key section within the sports game based on the identified time. For example, the service server (110) may determine the key section to include the video frame at the identified time. The service server (110) may determine the key section to include the n preceding frames and the m following frames centered on the video frame at the identified time.

[0075] In step (214), the service server (110) can upload the match video to the streaming server. The service server (110) can upload not only the main section of the match video, but also the entire match video. When an upload request is made, the streaming server can return a video identifier. The match video can be stored in the streaming server corresponding to the video identifier. After the upload is completed, the service server (110) can receive (pull or push, etc.) a video link corresponding to the video identifier from the streaming server.

[0076] According to one embodiment, the service server (110) can upload sports data including game footage to the streaming server (120). If the shooting system (151) includes multiple cameras, the service server (110) can synchronize the video data of multiple channels and upload them to the streaming server (120). For example, the service server (110) can synchronize the video data of multiple channels based on the shooting times of the video data of the multiple channels.

[0077] In step (211), when audio data is recorded by the access point (152), the service server (110) can synchronize the audio data with (multiple) video data and upload the same to the streaming server (120). For example, the service server (110) can synchronize the audio data and the video data based on the recording time of the audio data and the shooting time of the video data. According to one embodiment, the service server (110) can synchronize the video data and the audio data based on the electronic scoreboard control signals of step (207). For example, when recording is performed only during the game quarter time at the access point (152), the service server (110) can determine the start and end times of the quarter time(s) based on the electronic scoreboard control signals. The service server (110) can synchronize the audio data recorded during the quarter time with the quarter time in the video data based on the start and end times of the quarter time.

[0078] The service server (110) can insert audio data into the audio channel of the video data. Although not shown in the drawing, the service server (110) can create an audio channel that is distinct from (a plurality of) video channels in order to provide a synchronization adjustment function between the video data and the audio data. The service server (110) can provide the user terminal (141) with a function for adjusting the synchronization between (a plurality of) video channels and audio channels. The sync parameter between the video and audio can be set differently for each individual sports data. The service server (110) can correct the section information of the video data and the audio data according to the sync parameter and provide it to the user terminal (141). Alternatively, the user terminal (141) can synchronize the video data and the audio data and play them based on the sync parameter.

[0079] In step (215), the service server (110) registers segment information. The segment information includes information indicating branch sections or main sections extracted from the entire video of a sports game. The segment information may include information indicating the start or end point of a branch section in units of time or frames. Furthermore, the segment information may include information indicating the start, end, or main point of a main section in units of time or frames.

[0080] Although not shown in the drawing, the operations of steps (213), (214), and (215) may be implemented to be performed in the data center (130). In this case, the data center may perform the operations of steps (213), (214), and (215) in response to the request signal of step (209), and the operation of step (210) may be omitted.

[0081] In step (216), the user terminal (141) may specify a sports event and request segment information for the event. For example, the user terminal (141) may display a list containing multiple events in which the user has the right to participate or view. When a specific event is selected from the list, the user terminal (141) may transmit a segment information request signal requesting segment information for the selected event to the service server (110).

[0082] In step (217), the service server (110) responds to the section information request signal by replying the section information registered in response to the game requested by the user terminal (141). For the convenience of explanation, the operation of requesting and replying section information is illustrated in the drawing, but it can be substantially applied to an embodiment of requesting and replying sports data. For example, the service server (110) can generate sports data for the corresponding sports game based on the service request signal of step (204), the electronic scoreboard control signals of step (207), the video data of step (210), the audio data of step (211), the main section of step (213), etc., and can register the sports data in step (215). In this case, the user terminal (141) can request the sports data of the selected game from the service server (110) and receive a reply.

[0083] In step (218), the user terminal (141) can request a sports video from the streaming server (120) based on the section information of step (217). In step (219), the streaming server (120) can respond to the video request and provide the streaming video of the requested section to the user terminal (141).

[0084] According to one embodiment, a plurality of channels included in the video data may be simultaneously streamed to the user terminal (141), and the user terminal (141) may display a channel selected by a channel indicator included in the section information as a default. For example, the user terminal (141) may provide a plurality of players for the plurality of channels, and may place the player of the selected channel on the top layer. The user terminal (141) may provide a button for requesting switching between the plurality of channels, and may switch and display the plurality of channels according to a user input. For example, the user terminal (141) may place the player of the channel for which switching is requested among the plurality of players for the plurality of channels on the top layer. Alternatively, the user terminal (141) may display a plurality of players for the plurality of channels together according to a user input.

[0085] When the service server (110) returns section information in step (217), it may provide additional information, such as scoreboard information or analysis information corresponding to the corresponding section information, to the user terminal (141). The user terminal (141) may display the scoreboard information or analysis information of the corresponding scene on the screen together with the game video.

[0086] According to one embodiment, a user terminal (141) may request a download of a video clip corresponding to a key section. The user terminal (141) may receive section information corresponding to the key section from the service server (110) and request the section information from the streaming server (120) to receive the video. The user terminal (141) may encode the received streaming video to create a video clip. The user terminal (141) may store the video clip in a local storage or share it on a messaging service, social network service, Internet community service, etc.

[0087]

[0088] FIG. 3 is a diagram illustrating a digital conversion operation linked to a real-time recording function according to one embodiment. The steps (201) to (215) illustrated in FIG. 3 may substantially be applied to the steps described in FIG. 2, and steps (216) to (219) of FIG. 2 may also substantially be applied to the embodiment of FIG. 3.

[0089] Referring to FIG. 3, in step (301), the second user terminal (142) may provide a real-time recording interface. Based on user input through the real-time recording interface, the second user terminal (142) may transmit recording request signals of sports indicators to the service server (110). Recordable sports indicators may be set differently depending on the characteristics of the sports game, and multiple indicators may be automatically set from a single input according to the rules of the sports game. For example, in a basketball game, if a steal by one team (player) is input, a turnover by the opposing team (player) may be automatically set. Additionally, if a foul is committed during a scoring attempt that can be recognized as an assist, the player may be set as an assist candidate. Only if at least one of the subsequent free throws is successful, the assist candidate may be set as an official assist. In the case of a personal foul on the defensive side, a team foul may be counted together, whereas in the case of a personal foul on the offensive side, a team foul may not be counted. Additionally, when substitution information is entered, the playing time for each player can be automatically calculated based on the scoreboard time at the time of the substitution. When a team scores or concedes a goal, the goal margin for the player in play can be automatically counted up or down. While this example is for a basketball game, the same approach can be applied to sports metrics for team sports such as soccer, futsal, handball, and volleyball. Furthermore, similar extensions can be applied to sports metrics for racket sports such as badminton, table tennis, and tennis.

[0090] In one embodiment, the second user terminal (142) may provide a real-time recording interface only if it has access to the match requested by the first user terminal (141). Access may be granted in various ways. For example, access may be granted if the account of the second user terminal (142) is affiliated with a team related to the match requested by the first user terminal (141), or access may be granted directly from the first user terminal (141).

[0091] In the embodiment of FIG. 3, the user terminal (141) providing the scoreboard controller interface and the second user terminal (142) providing the real-time recording interface are depicted as being distinct from each other. However, depending on the embodiment, a single interface combining the real-time recording interface and the scoreboard controller interface may be provided. In this case, the scoreboard control signals of step (207) and the sports indicator recording request signals of step (301) may be transmitted by the same terminal. Furthermore, the scoreboard control signals of step (207) and the sports indicator recording request signals of step (301) may be integrated into the same protocol, in which case the service server (110) may appropriately process the data through header information, etc.

[0092] The service server (110) can generate real-time record information based on the record request signals of sports indicators. The service server (110) can construct sports data based on the real-time record information together with the service request signal of step (204), the electronic scoreboard control signals of step (207), the video data of step (210), the audio data of step (211), the main sections of step (213), etc., and can register the sports data in step (215).

[0093] In some embodiments, in step (302), the service server (110) may transmit real-time record information to the access point (152). The access point (152) may display the real-time record information on the electronic scoreboard screen. For example, the electronic scoreboard screen may further include player information, such as the player's score, fouls, and playing time. The access point (152) may display both basic electronic scoreboard information and player information based on the real-time record information, or may display the basic electronic scoreboard information, but temporarily overlay at least some of the relevant information on the electronic scoreboard information when the real-time record information is updated.

[0094] According to one embodiment, a third user terminal (not shown in the drawing) can receive real-time record information through an application or web interface. To this end, the third user terminal can transmit a request signal to view the real-time record information to the service server (110). In response to the request signal, the service server (110) can transmit the real-time record information to the third user terminal. For example, the third user terminal can display an interface similar to the real-time record interface provided to the second user terminal (142), and real-time record information can be provided through the interface. In this case, the third user terminal may not be granted record permission, but only view permission or view permission.

[0095] The service server (110) can generate analysis information corresponding to key sections based on real-time record information. For example, the real-time record information can include multiple events. Each event can include related sports indicators (e.g., scores, scoring attempts, score types, assists, steals, fouls, errors, etc.), player identification information (e.g., jersey number, name, etc.), game quarter information (e.g., quarters, first / second halves, etc.), time information, etc. The service server (110) can select key sections matching the game quarter information and time information, and generate analysis information corresponding to the selected key sections (e.g., scores, assists, etc. of Player A of Team A). Alternatively, the service server (110) can select an event matching a key section for which analysis information is to be generated, and then generate analysis information for the key section based on the sports indicators and player identification information of the selected event.

[0096]

[0097] FIG. 4 is a diagram illustrating a digital conversion operation associated with a recording function according to one embodiment. The aforementioned steps (201) to (219) illustrated in FIG. 4 can be substantially applied as is.

[0098] Referring to FIG. 4, at step (401), a user terminal (141) may request a record of a sports match. For example, multiple matches according to the bracket may be pre-registered in the competition interface. Alternatively, friendly matches, internal competitions, pick-up matches, and social matching matches may be pre-registered in the team interface. The user terminal (141) may select one of the pre-registered matches and invoke the record function.

[0099] In step (402), the service server (110) can check the authority of the user terminal (141) and then approve the request. In FIG. 4, the approval in step (402) is exemplified as being performed in response to the request in step (401). However, the authorization check may be performed before step (401) so that only authorized user terminals can make a record request in step (401). In this case, the separate approval procedure in step (402) may be omitted.

[0100] In step (403), the user terminal (141) may record a sports event. For example, the user terminal (141) may provide the real-time recording function of step (301) described in FIG. 3. According to one embodiment, the user terminal (141) may transmit a signal to the service server (110) to indicate a key section candidate in response to a user input. Based on the signal, the service server (110) may extract a key section in step (213).

[0101] In step (404), the user terminal (141) can transmit a recording end signal to the service server (110).

[0102]

[0103] Figure 5 is a diagram illustrating a digital conversion operation that can be linked to a stadium rental function according to one embodiment. The aforementioned steps (201) to (219) illustrated in Figure 5 can be substantially applied as is.

[0104] Referring to FIG. 5, in step (502), a user terminal (141) may transmit a rental request signal requesting rental of a stadium. The rental request signal may include first user information, first stadium information, first date information, and first time information. Depending on the embodiment, a stadium may have multiple courts, in which case the stadium information may be understood to also include court information. In step (503), the user terminal (141) transmits a photography request signal requesting photography of the stadium. The photography request signal may include second user information, second stadium information, second date information, and second time information.

[0105] The operations of steps (502) and (503) may be performed through an App installed on the user terminal (141) or through a Web interface accessed from the user terminal (141). The App or Web interface for step (502) may be the same as or different from the App or Web interface for step (503).

[0106] Although not shown in the drawing, a separate server may be operated to process payments in response to the shooting request in step (503). In this case, the first service server may periodically request shooting request details from the server. Alternatively, the server may push notifications to the first service server as the shooting request details are updated.

[0107] In step (504), upon receiving a filming request, the first service server may request rental information from the second service server. In one embodiment, the first service server may request rental information from the second service server after confirming whether payment for the filming request has been completed and / or whether payment has not been canceled by a predetermined time (e.g., the time of the filming request or the cancellation time of the payment). In one embodiment, the second service server that manages rental may be different for each stadium. The first service server may identify the second service server corresponding to the second stadium information. The first service server may request rental information corresponding to the second date information and the second time information from the second service server corresponding to the second stadium information. In one embodiment, the first service server may also periodically request rental information from the second service server according to a predetermined cycle.

[0108] In step (505), the second service server may respond with rental information to the first service server. The rental information may include third user information corresponding to second stadium information, second date information, and second time information.

[0109] In step (506), the first service server may receive rental information from the second service server and verify the shooting request authority by comparing the third user information included in the rental information with the second user information. Although not illustrated in the drawing, if the shooting system (151) of the sports stadium is a cloud-based IP camera device, the first service server may request the shooting system (151) of the sports stadium corresponding to the second stadium information to shoot the stadium according to the second date information and the second time information after the verification of the shooting request authority is completed.

[0110] Although not illustrated in the drawing, the rental request of step (502) and the shooting request of step (503) may be requested together to the second service server. In this case, the second service server may transmit the rental information (rental request information) and shooting information (shooting request information) together to the first service server in step (505), and step (504) may be omitted. Furthermore, in this case, since separate verification of shooting request authority may not be required, step (506) may be omitted.

[0111] In step (209), the first service server requests match video from the data center (130). The first service server may request match video corresponding to the second stadium information, second date information, and second time information. In step (210), the data center (130) responds with the match video.

[0112] In step (215), the first service server can register section information of a major section with the third service server. The section information can be stored by matching it with a shooting identifier corresponding to the second stadium information, second date information, and second time information included in the shooting request, and can include a section identifier, a section start point (time or frame within the video), and a section end point (time or frame within the video).

[0113] For example, each section may be a scene related to shooting, and the start and end points of each section may include section information where the scene begins and ends. In this case, the first service server may store the video identifier and / or video link received from the streaming server (120) together with the section information and the shooting identifier, or request registration from the third service server.

[0114] In step (216), the user terminal (141) may request segment information from a third-party service server. The third-party service server provides match videos for each user and / or team, and provides various sports data to the user terminal (141) through match analysis. In step (217), the third-party service server may respond with segment information.

[0115] In step (218), the user terminal (141) can request a video from the streaming server (120) based on the section information. In step (219), the streaming server (120) can respond (stream transmission) the requested video. The operations in steps (216) and (218) can be performed through an App installed in the user terminal (141) or through a Web interface accessed from the user terminal (141). The App or Web interface for steps (216) and (218) may be the same as or different from the App or Web interface for steps (502) and / or (503).

[0116] According to one embodiment, after the upload in step (214) is completed and the section information registration in step (215) is completed, the first service server may transmit a notification message to the user account that requested the filming in step (503). The notification message may be transmitted in various forms, such as IMS, SMS, email, and / or APP notification. The user terminal (141) may request match registration to the third service server using the filming identifier prior to step (216). For example, the user terminal (141) may request match registration to the third service server by entering the filming identifier through an App or Web interface. The third service server may create and register the user account and / or team match information of the user terminal (141) using the section information, video identifier, and / or video link that are stored matching the filming identifier. Depending on the embodiment, the user terminal (141) that requested the filming in step (503) and the user terminal (141) that requests match registration prior to step (216) may be different. In this case, the user terminal (141) requesting game registration can receive a shooting identifier from the user terminal (141) that made the shooting request.

[0117] The user terminal (141) may request registration of a match by specifying a section of the match video of the video identifier and / or video link, or may request registration of multiple matches by specifying multiple sections. For example, if a 3-hour match video is requested to be filmed, multiple (N) matches may be played within the 3 hours. In this case, the user terminal (141) may request registration of multiple matches to a third service server by obtaining multiple (N) sections in which the multiple (N) matches were played (e.g., by inputting the information from the user, obtaining the information through image processing, etc.). The third service server may divide section information regarding the main sections based on the multiple (N) sections for which registration has been requested, and register the information in multiple (N) match information, respectively.

[0118] In some embodiments, the third service server may receive registration requests for some matches among multiple (N) matches as the first team of a user account, and for the remaining matches as the second team of the same user account. Alternatively, the third service server may receive registration requests for some matches among multiple (N) matches from the first user terminal (141), and for the remaining matches from the second user terminal (141).

[0119] The third service server may generate match information according to the team of the user account for which registration has been requested, but may prevent the same time section from being registered in different matches in the match video of the same video identifier and / or video link. For example, when the third service server receives a registration request from the user terminal (141) that specifies a specific section in the match video of the video identifier and / or video link, the third service server may check whether match information has already been registered in the same match video using the same filming identifier. If match information has already been registered using the same filming identifier, the third service server may check the specified section in the previously registered match information to determine whether it overlaps with the section received this time by a certain amount or more. The third service server may register new match information only if there is no overlap by a certain amount or more.

[0120] According to an embodiment, the user terminal (141) may request previously registered match information corresponding to a shooting identifier from a third service server, and may provide the user with an interface that prevents a previously registered match section from being designated as a new match section.

[0121] According to another embodiment, in step (215), the third service server may first generate match information corresponding to the second stadium information, the second date information, and the second time information, and store section information, a video identifier, and / or a video link by matching the generated match information. After the upload in step (214) is completed and the section information registration in step (215) is completed, the first service server may send a notification message to the user account that requested the shooting in step (503). The notification message may be sent in various forms, such as IMS, SMS, email, and / or APP notification, and may include a key (or QR code, etc.) indicating the match information. The user terminal (141) may request match registration to the third service server using the key indicating the match information prior to step (216). The third service server may match the match information generated in step (214) to the user account and / or team that requested the match registration using the key indicating the match information. Depending on the embodiment, the user terminal (141) that requested the shooting in step (503) and the user terminal (141) that requested the game registration prior to step (216) may be different. In this case, the user terminal (141) that requested the game registration may receive a key (or QR code, etc.) indicating game information from the user terminal (141) that requested the shooting.

[0122] In another embodiment, in step (215), the first service server may forward the user account requesting the shooting in step (503) to the third service server. In this case, the third service server may directly match the generated match information corresponding to the second stadium information, the second date information, and the second time information to the corresponding user account. The third service server may also directly match the match information to the corresponding user account after verifying whether the corresponding user account has user authority to register the match (e.g., team manager authority). If the user account has such authority, the third service server may directly match the match information to the corresponding user account.

[0123] In some embodiments, at least two of the first service server, the second service server, and the third service server may operate in an integrated manner. In this case, the signals transmitted and received between the servers depicted in the drawing may be understood as protocol signals exchanged between modules within the integrated server.

[0124] By the above-described embodiments, a platform service can be provided that significantly reduces the physical resources required for users to directly film their own match videos and the time resources required to watch the entire match videos to extract key sections from the match videos.

[0125] According to one embodiment, a user terminal (141) can provide video clips of key sections to the user via an app or web interface. The user terminal (141) can request a third-party service server to download the video clips, or can directly encode the video clips. The user terminal (141) can also provide a function for posting the video clips to social networking services (SNS).

[0126] According to one embodiment, a user terminal (141) may provide a user with a function to subdivide the records of a game video including key sections (e.g., record various stats and player information involved in each stat by matching them to the time of the video, etc.) in conjunction with a third-party service server. The user terminal (141) may provide a user with the results of a digital transformation of a sports game through statistical processing of the aggregated records and various visualization techniques in conjunction with a third-party service server. The user terminal (141) may provide a function to share sports data related to videos or records with other users in conjunction with a third-party service server.

[0127]

[0128] FIG. 6 is a diagram illustrating a digital conversion operation associated with a video recording function according to one embodiment. The aforementioned steps (215) to (219) illustrated in FIG. 6 can be substantially applied as is.

[0129] Referring to FIG. 6, in step (601), a user terminal (141) may provide a video recording interface based on a game video provided from a streaming server (120). Based on a user input through the video recording interface, the user terminal (141) may transmit a recording request signal of a sports indicator to the service server (110). The video recording interface may include a player that plays the video, and may include an interface that searches for the playback time of the video (e.g., time information or frame information) and modifies a previously stored sports indicator or adds a new sports indicator. Similar to real-time recording, recordable sports indicators may be set differently depending on the characteristics of the sports game, and multiple indicators may be automatically set from a single input depending on the rules of the sports game.

[0130] In step (602), the service server (110) can generate video recording information based on the recording request signals of sports indicators. The service server (110) can update previously registered sports data (e.g., section information, etc.) based on the video recording information.

[0131] Steps (603) to (606) are operations between the second user terminal (142) and the service server (110), and the aforementioned matters of steps (216) to (219) can be substantially applied as is. In addition, steps (607) and (608) are also operations between the second user terminal (142) and the service server (110), and the aforementioned matters of steps (601) and (602) can be substantially applied as is.

[0132] According to one embodiment, the video recording interface may include various detailed interfaces that enable the recording task to be efficiently divided and performed. For example, the video recording interface may include a branch section-specific recording interface so that the user terminal (141) and the second user terminal (142) can perform the recording task by dividing it by branch section. Furthermore, the video recording interface may include a main section-specific recording interface so that the recording task can be performed by dividing it by main section within the same branch section. The main section-specific recording interface may provide convenience by including video clips of the main sections extracted in step (213) in a predetermined format (e.g., card format, etc.), thereby allowing the recording task to be performed mainly on the main sections without having to play the entire video.

[0133] Additionally, the video recording interface may include a team recording interface that primarily records team-level sports metrics and a player recording interface that later records player identification information for each sports metric. Through the team recording interface, users can input team-level sports metrics (e.g., shooting attempts by Team A, rebounds / blocks by Team B, etc.) while playing a game video. The player recording interface includes team-level sports metrics in a predefined format (e.g., card format), allowing users to input associated player identification information while playing only the video segment of the team-level sports metric.

[0134] By separating the team record interface from the player record interface, even users who cannot accurately identify individual players can utilize the team record interface to record team-level sports metrics using only visual information (e.g., uniform color) that distinguishes the two teams. In one embodiment, the team record interface can be linked to a business model that distributes record-keeping tasks to an unspecified number of crowd workers.

[0135] In one embodiment, after recording a key segment, the service server (110) can determine whether an error segment exists between adjacent key segments. For example, in a basketball game, since it's natural for offense and defense to alternate, if two adjacent key segments are recorded as scoring attempts by the same team, it can be assumed that an error segment by the opposing team exists between them. By providing the estimated segments to user terminals, the service server (110) can efficiently record error segments without having to replay the entire game.

[0136] Although not shown in the drawing, the service server (110) can accumulate sports data by synthesizing video data, scoreboard data, real-time record data, video data, etc. The service server (110) can generate a highlight video for a specific sports game based on the accumulated sports data. For example, the service server (110) can predict the aspect of a specific sports game based on the previous records of two teams participating in the specific sports game and the records of the participating players. The service server (110) can generate comments on key sections or error sections by comparing the records of the corresponding sports game with the predicted aspect. The model for generating the aforementioned comments can be implemented based on records and broadcast comments from professional leagues or college leagues.

[0137] The service server (110) can select sections to be included in the highlight video by assigning weights to key sections or error sections. For example, high weights can be assigned to sections where the score difference between the two teams changes in a direction that has a dominant influence on the outcome of the game (e.g., a go-ahead goal in basketball, a buzzer-beater, a goal in soccer / futsal, etc.), or sections with a large volume of recorded audio (e.g., cheering, etc.). If the highlight video to be created is a short content, the service server (110) can select key sections or error sections that fit a predetermined video length (e.g., 30 seconds, etc.) and then use comments generated in response to the selected sections to create the short content. If the highlight video to be created is a content of regular length (e.g., 10 minutes, etc.), the service server (110) can select key sections or error sections by branch sections of the sports game and create comprehensive comments that tell the story of the sports game based on the individual comments of the selected sections. The service server (110) can create regular-length content by connecting selected sections of video and utilizing comprehensive comments.

[0138]

[0139] FIG. 7 is a diagram illustrating a shooting system and access point of a sports stadium according to one embodiment.

[0140] Referring to FIG. 7, a shooting system including a plurality of cameras (151-1, 151-2) may be installed in a sports stadium (153). A first camera (151-1) may be installed in a first position to capture a first court of the sports stadium (153) in a quarter-view configuration, and a second camera (151-2) may be installed in a second position to capture a second court of the sports stadium (153) in a quarter-view configuration. The first court and the second court may correspond to courts on either side of the half-line of the sports stadium (153). The area covered by the angle of view of the first camera (151-1) and the area covered by the angle of view of the second camera (151-2) may partially overlap. The plurality of cameras (151-1, 151-2) may be connected to the Internet, so that captured images may be transmitted to a data center (130) via a network.

[0141] An access point (152) may be additionally installed in the sports stadium (153). The access point (152) may also be connected to the Internet via a wired or wireless connection and communicate with the service server (110) via a network. The access point (152) may be assigned an identification code by the service server (110) and may display the identification code on the main screen. Service usage applications may be processed through a user terminal (141) that scans the identification code among the user terminals (140). Once service approval is completed through procedures such as confirmation of usage time and payment, the access point (152) may display an electronic scoreboard screen. The user terminal (141) may provide a controller interface that controls the electronic scoreboard screen displayed on the access point (152).

[0142] A user (710) can control the electronic scoreboard screen displayed on the access point (152) through the controller interface of the user terminal (141). Players of both teams (720, 730) can check the game progress and / or real-time record information through the electronic scoreboard screen.

[0143] In some cases, such as when a sports stadium (153) is outdoors, it may be difficult to permanently install an access point (152). The access point (152) may be designed as a portable device rather than a fixed installation device. In some embodiments, one of the user terminals (140) may also serve as the access point (152).

[0144]

[0145] The embodiments described above may be implemented as processing devices using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements.

[0146] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may, independently or collectively, command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0147] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0148] Although the embodiments described above have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the above. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0149] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In the operating method of a server that provides digital conversion of a sports game, A step of providing identification codes to multiple access points; A step of receiving a service request signal from a user terminal that scanned the first identification code; Upon approval of the service request, a step of transmitting a service approval signal to the first access point corresponding to the first identification code and the user terminal; A step of transmitting the electronic display board control signals received from the user terminal to the first access point; Upon termination of the service, a step of transmitting a service termination signal to the first access point and the user terminal; A step of requesting image data captured by a first shooting system corresponding to the first access point to a data center; A step of extracting a plurality of major sections from the image data based on the above electronic board control signals; A step of registering section information regarding multiple major sections; A step of receiving a section information request signal regarding at least one of a plurality of major sections from the user terminal; and In response to the above section information request signal, a step of transmitting section information regarding at least one major section to the user terminal. A method of operating a server, including:

2. In paragraph 1, The step of extracting the above multiple major sections is A step of estimating at least one branch section within the sports game based on the above scoreboard control signals; A step of extracting motion information within a predetermined area of ​​video frames included in at least one branch section; and A step of estimating at least one main section included in at least one branch section based on the above motion information. A method of operating a server, including:

3. In paragraph 2, The step of extracting the above multiple major sections is A step of identifying an electronic board control signal received at a time corresponding to at least one estimated major section among the electronic board control signals; and A step of generating analysis information corresponding to at least one estimated major section based on the identified electronic board control signal. A method of operating a server, including further comprising:

4. In paragraph 1, The step of extracting the above multiple major sections is A step of identifying at least one predetermined type of electronic board control signal among the above electronic board control signals; A step of identifying the time at which the identified electronic board control signal is received; and A step of estimating at least one major section within the sports game based on the identified time. A method of operating a server, including:

5. In paragraph 4, The step of extracting the above multiple major sections is A step of generating analysis information corresponding to at least one estimated major section based on the type of the identified electronic board control signal. A method of operating a server, including further comprising:

6. In paragraph 1, A step of receiving audio data from the first access point; A step of synchronizing the image data and the audio data based on the above electronic board control signals; and Step of uploading the synchronized video and audio data to the streaming server A method of operating a server, including further comprising:

7. In paragraph 1, The step of transmitting section information regarding at least one major section to the user terminal A step of generating electronic board information corresponding to at least one main section based on the electronic board control signals; and A step of transmitting the above electronic board information to the user terminal A method of operating a server, including:

8. In paragraph 1, A step of receiving a request signal for recording a sports indicator from at least one second user terminal; and A step of generating real-time record information of the sports game based on the above record request signals. A method of operating a server, including further comprising:

9. In paragraph 8, A step of transmitting the above real-time record information to the above access point A method of operating a server, including further comprising:

10. In paragraph 8, A step of receiving a request signal for viewing real-time record information from a third user terminal that is distinct from at least one second user terminal; and A step of transmitting the real-time record information to the third user terminal in response to the above-mentioned viewing request signal. A method of operating a server, including further comprising:

11. A computer-readable recording medium having recorded thereon a program for executing any one of the methods of clauses 1 to 10.

12. In a server that provides digital transformation of sports events, memory; and At least one processor connected to said memory and configured to execute a computer-readable program contained in said memory Including, The above program causes at least one processor to A step of providing identification codes to multiple access points; A step of receiving a service request signal from a user terminal that scanned the first identification code; Upon approval of the service request, a step of transmitting a service approval signal to the first access point corresponding to the first identification code and the user terminal; A step of transmitting the electronic display board control signals received from the user terminal to the first access point; Upon termination of the service, a step of transmitting a service termination signal to the first access point and the user terminal; A step of requesting image data captured by a first shooting system corresponding to the first access point to a data center; A step of extracting a plurality of major sections from the image data based on the above electronic board control signals; A step of registering section information regarding multiple major sections; A step of receiving a section information request signal regarding at least one of a plurality of major sections from the user terminal; and In response to the above section information request signal, a step of transmitting section information regarding at least one major section to the user terminal. A server containing commands to perform operations.

13. In paragraph 12, The above first filming system includes a plurality of cameras that divide and film the stadium where the sports event is held, A server, wherein the above image data includes a plurality of channels captured by the plurality of cameras.

14. In paragraph 13, Each section information for the above multiple major sections is A server further comprising a channel indicator indicating a channel on which a play of a corresponding main section among the above multiple channels was filmed.

15. In paragraph 14, The plurality of channels included in the above video data are simultaneously streamed to the user terminal, The channel selected by the above channel indicator is displayed as default on the user terminal, A server in which multiple channels are switched and displayed or displayed simultaneously according to user input through the user terminal.

Images