Information processing device, information processing method, and information processing system.
The information processing system addresses the burden of manually managing playback locations in sports recordings by generating relational data to automatically identify playback start times, improving usability for both recorders and viewers.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-06-09
- Publication Date
- 2026-04-07
AI Technical Summary
The burden on individuals responsible for recording sports competitions is increased due to the separate recording of play progress and moving images, as they need to manually manage playback locations corresponding to specific plays, which is difficult for amateur organizations with limited resources.
An information processing system that generates relational data linking event times with video playback times, allowing automatic identification of playback start times for events in sports matches, reducing the need for manual management and simplifying the recording process.
The system reduces the burden on recorders by enabling easy identification of playback locations for recorded events, enhancing usability for both recorders and viewers, particularly in amateur sports organizations with limited resources.
Smart Images

Figure 0007841207000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing system.
Background Art
[0002] A method for recording play information in sports competitions is known (see, for example, Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] The progress of various plays and the like in sports competitions is distributed via a network, and a moving image of the sports competition is live-distributed. Viewers may search for a playback location in the moving image corresponding to a specific play during or after the competition and view the video of the play. Therefore, it is desirable that viewers can easily identify the playback location of the moving image corresponding to the play. However, since the progress of the sports competition and the moving image are recorded separately, the distributor who distributes the information of the sports competition has to record the playback location of the moving image corresponding to the play during the competition separately from the progress of the competition. Therefore, there has been a problem that the burden on the person in charge of recording is increased.
[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to reduce the burden for recording the progress of sports competitions.
Means for Solving the Problems
[0006] An information processing apparatus in a first aspect of the present invention includes: an event acquisition unit that acquires event information associated with event content indicating the content of a predetermined event that occurred in a predetermined sports match and an event time indicating the time when the event occurred; a relationship data generation unit that generates relationship data indicating the relationship between the playback time in video data created by filming the match and the event time; a specification unit that, based on the event time associated with the event information and the relationship data, specifies the playback time corresponding to the event time in the video data as the playback start time for starting playback of the video corresponding to the event; and an output unit that outputs video playback information associated with the content of the event indicated by the event information and link information for playing the video from the playback start time.
[0007] The system further includes a reception unit that receives an operation to start recording an event in the match, the relational data generation unit generates relational data indicating the playback time of the video data being live-streamed at the time the start operation is received, the event time indicates the time when the event indicated by the event information occurred with the recording start time, which is the time the reception unit receives the start operation, as the reference time, and the identification unit may identify the playback start time by adding the elapsed time from the recording start time indicated by the event time to the recording start time.
[0008] The relational data generation unit generates relational data showing the relationship between the playback time of each of the multiple video data images created by filming the match, which are distributed on each of the multiple different video distribution servers, and the event time. The identification unit may then identify the playback start time corresponding to the event for each of the multiple video data images based on the event time associated with the event information and the relational data.
[0009] The system further includes a storage unit that stores adjustment time information associated with an event type indicating the type of event and an adjustment time indicating the time to adjust the playback start time of the video using the event time included in the event information as a reference time, wherein the event content includes the event type, and the identification unit may identify the playback start time as the time obtained by adding the elapsed time from the recording start time indicated by the event time and the adjustment time to the recording start time.
[0010] The event acquisition unit acquires event information that further includes a target flag indicating whether or not it is an event that is the target of specifying the playback start time, and the output unit may output the video playback information if the target flag included in the event information indicates that it is an event for which video playback information is to be output.
[0011] The system further includes a storage unit that stores type information, which associates an event type indicating the type of event with a target flag indicating whether or not the event is one for which video playback information is to be output. The system further includes a determination unit that refers to the type information and determines whether or not the event type associated with the event information is one for which video playback information is to be output. If the determination unit determines that the event is one for which the playback start time is to be specified, the output unit may output the video playback information.
[0012] The device further includes a user information storage unit that stores user information associating a user who uses an information terminal that displays the video playback information with a cheering team that the user supports, the event content further includes event team information that indicates a team related to the event, and the device further includes a determination unit that determines whether the event team information associated with the event information indicates the user's cheering team, and if the determination unit determines that the event team information included in the event information indicates the user's cheering team, the output unit may output the video playback information.
[0013] The event acquisition unit acquires a plurality of event pieces of information, the output unit displays the plurality of event pieces of information indicated by the plurality of event pieces on each of the plurality of information terminals, the information processing device further includes a receiving unit that receives evaluations of the plurality of event pieces of information from the plurality of information terminals, and the output unit may output video playback information corresponding to the event pieces of information whose evaluation is above a predetermined level.
[0014] The system further includes a highlight generation unit that generates a highlight video by extracting scenes from the video data that correspond to multiple events that meet predetermined conditions from among the multiple event information obtained for the aforementioned match, and when the highlight video is generated, the output unit may output highlight video playback information including link information for playing the highlight video.
[0015] In a second aspect of the present invention, the information processing method includes: an event acquisition step in which a computer performs an event acquisition step in which an event information is obtained in which an event content indicating the content of a predetermined event that occurred in a predetermined sports match is associated with an event time indicating the time when the event occurred; a relationship data generation step in which relationship data indicating the relationship between the playback time in video data created by filming the match and the event time is generated; a identification step in which, based on the event time associated with the event information and the relationship data, the playback time corresponding to the event time in the video data is identified as the playback start time for starting playback of the video corresponding to the event; and an output step in which video playback information is output in which an event information indicating the content of the event is associated with a link information for playing the video from the playback start time.
[0016] In a third aspect of the present invention, the information processing system includes an information processing device for managing events that occur in a predetermined sports match, and a recording terminal for recording the events, wherein the recording terminal includes a receiving unit for receiving input operations for predetermined events that occur in the match, a generation unit for generating event information that associates event content indicating the content of the event and event time indicating the time when the event occurred, based on the input operations received by the receiving unit, and a transmission unit for transmitting the event information to the information processing device, wherein the information processing device includes an event acquisition unit for acquiring the event information, a relationship data generation unit for generating relationship data showing the relationship between the playback time in video data created by filming the match and the event time, a specification unit for specifying the playback time corresponding to the event time in the video data as the playback start time for starting playback of the video corresponding to the event, based on the event time associated with the event information and the relationship data, and an output unit for outputting video playback information that associates the event content indicated by the event information and link information for playing the video from the playback start time. [Effects of the Invention]
[0017] According to the present invention, the burden of recording the progress of sports competitions is reduced. [Brief explanation of the drawing]
[0018] [Figure 1] This is a diagram illustrating the overview of the information processing system S according to the embodiment. [Figure 2] This diagram illustrates the process for determining the playback start time. [Figure 3] This is a block diagram showing the configuration of the information processing device 1. [Figure 4] This figure shows an example of a progress viewing screen displayed by the output unit 135. [Figure 5] This figure shows an example of the data structure of event information stored in the memory unit 12. [Figure 6] It is a diagram showing an example of the data structure of the adjustment time information stored in the storage unit 12. [Figure 7] It is a diagram showing an example of the data structure of the type information stored in the storage unit 12. [Figure 8] It is a diagram showing an example of the user information stored in the storage unit 12. [Figure 9] It is a diagram showing an example of the elapsed viewing screen to be displayed by the output unit 135. [Figure 10] It is a flowchart showing the processing flow in the information processing apparatus 1. [Figure 11] It is a block diagram showing other configurations of the information processing apparatus 1. [Figure 12] It is a block diagram showing the configuration of the recorder terminal 2.
Mode for Carrying Out the Invention
[0019] [Overview of Information Processing System S] FIG. 1 is a diagram for explaining the overview of the information processing system S according to the embodiment. The information processing system S is a system for recording various events such as plays that occur in a game of a predetermined sport and for distributing information regarding the recorded events. The information processing system S includes an information processing apparatus 1, a recorder terminal 2, a video distribution server 3, and a user terminal 4.
[0020] The information processing apparatus 1 is an apparatus for recording information regarding a game of a predetermined sport and for distributing the recorded information regarding the game. The information processing apparatus 1 records the overview information of the game (the date and time of the game, the venue, the sport, the name of the tournament or league, etc., the teams participating in the game, the players participating in the game, etc.) and the predetermined events that occurred in the game.
[0021] The designated sport may be a team sport such as baseball, soccer, or basketball; an individual sport such as tennis or table tennis; or an athletics sport or motorsport. The designated event will vary depending on the sport. For example, if the sport is basketball, the designated event may be the result of a play related to scoring or winning conditions such as a shot or goal; the result of a play recorded as a stat such as a rebound; a foul or other violation; or information such as player substitutions or timeouts. The designated event may also be comments entered by commentators or analysts.
[0022] Recorder terminal 2 is a terminal used by recorder U1. Recorder U1 watches the match at the venue where the match is being held or remotely and records events that occur during the match. Recorder U1 may also be a commentator or analyst. Recorder terminal 2 displays a recording screen for receiving input on the match content from recorder U1 and transmits summary information and event information of the match to information processing device 1 based on the input.
[0023] The video distribution server 3 is a device for distributing video data (hereinafter simply referred to as "video data") generated by camera C capturing the target match. The video distribution server 3 accepts uploads of video data from camera C that generated the video data or from a terminal (not shown) that has captured the video data, and distributes video data in response to requests from user terminals 4.
[0024] User terminal 4 is an information terminal used by user U2 to view match information distributed by information processing device 1. User terminal 4 displays a screen showing match information based on the information distributed from information processing device 1. In addition, user terminal 4 acquires video data from video distribution server 3 and displays match video based on operations from user U2.
[0025] Incidentally, in sports competitions, hundreds of plays can occur during a single match, and it is difficult to manually manage playback points corresponding to such a large number of plays in video footage of sports. While analysis tools for sports plays are provided for professionals such as professional sports organizations and broadcasters, it is difficult for amateur sports organizations and small groups with limited personnel and budgets to utilize them. Therefore, there is a need for a means for viewers to easily access playback points corresponding to their desired play without using specialized tools. The processing of the information processing system S will be explained below.
[0026] The processing in the information processing system S will be explained with reference to Figures 1 and 2. Figure 2 is a diagram illustrating the process for identifying the playback start time corresponding to an event in the video data. The video distribution server 3 acquires the video data ((1) in Figure 1).
[0027] Recorder U1 operates the recorder terminal 2 and initiates the recording start operation. The recording start operation is an operation to start recording events in the information processing device 1. The recording start operation may be performed when the match starts or prior to the match starts.
[0028] The information processing device 1 receives information indicating that a recording start operation has been performed (Figure 1, (2)). The information indicating that a recording start operation has been performed may include a URL for viewing the video data of the match distributed by the video distribution server 3. The information indicating that a recording start operation has been performed may also include information for identifying the match to be recorded. Hereafter, the time at which the recording start operation is performed will be referred to as the "reference time". Although not shown in the figures, summary information of the match is registered in the information processing device 1 before the recorder terminal 2 receives the recording start operation. The information processing system S may be configured to use a predetermined time (for example, the scheduled start time of the match) as the reference time without receiving the recording start operation.
[0029] When the match start operation is performed, the information processing device 1 obtains the reference playback time (3 in Figure 1). The reference playback time indicates the playback time corresponding to the reference time in the video data. The reference playback time may also be the recording time at the reference time of the video data being live-streamed by the video distribution server 3.
[0030] The information processing device 1 generates relational data based on the acquired reference playback time (Figure 1, (4)). The relational data shows the relationship between the playback time in the video image data and the time when the event occurred. In the example shown in Figure 2, the information processing device 1 generates relational data by associating the reference time T(0) with the reference playback time T'(0) acquired from the video distribution server 3.
[0031] The recording terminal 2 transmits event information to the information processing device 1 ((5) in Figure 1). The event information indicates a play that occurred in the match or the progress or situation of the match. The event information associates an event content that indicates the content of the event that occurred with an event time that indicates the time when the event occurred. The event content includes, for example, the type of event, the teams involved in the event, the players involved in the event, etc. In the example in Figure 2, the event information corresponding to event A includes the content of event A and an event time that indicates the time T(A). Note that the event time may indicate the time when the recording terminal 2 recorded the event, or it may indicate the elapsed time from the reference time to the time when the event occurred.
[0032] The information processing device 1 identifies the playback start time corresponding to the event information ((6) in Figure 1). In the example shown in Figure 2, the information processing device 1 identifies the playback start time T'(A) in the video data corresponding to event A based on the relationship between the event time T(A) indicated by the event information and the reference time T(0) and reference playback time T'(0) indicated by the related data. Specifically, the information processing device 1 identifies the playback start time T'(A) by adding the difference between time T(0) and time T(A) to time T'(0).
[0033] The information processing device 1 transmits video playback information to the user terminal 4 (Figure 1, (7)). The video playback information includes the content of the event indicated by the event information and a link to play the scene corresponding to that event in the video data. The link is information that combines a URL for viewing the video data and parameters for playing the video data from the playback start time specified for the event. The user terminal 4 displays the links included in the video playback information so that they can be selected. User U2 operates the user terminal 4 and taps the link they want to view. The user terminal 4 retrieves the video data indicated by the selected link from the video distribution server 3 and plays the video data from the playback start time included in the link.
[0034] As described above, the information processing system S generates relational data showing the relationship between the time an event occurred and the playback time of that event in the video data. Then, based on the generated relational data, the information processing system S identifies the playback start time of the video corresponding to the event and outputs video playback information for playing the video data from the identified playback start time. With the information processing system S configured in this way, the recorder U1 can record the events to be recorded with simple operations, and user U2 can easily identify the playback point of the video corresponding to the recorded event. Therefore, it is possible to reduce the burden on the recorder U1 who is recording the progress of a sports competition.
[0035] [Configuration of Information Processing Device 1] Figure 3 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 includes a communication unit 11, a storage unit 12, and a control unit 13. The control unit 13 includes a reception unit 131, a relational data generation unit 132, an event acquisition unit 133, a specification unit 134, an output unit 135, a determination unit 136, and an evaluation reception unit 137.
[0036] The communication unit 11 is a communication interface for sending and receiving data with other devices via a network. The storage unit 12 is a storage medium including ROM (Read Only Memory), RAM (Random Access Memory), SSD (Solid State Drive), hard disk drive, etc. The storage unit 12 pre-stores programs to be executed by the control unit 13.
[0037] The control unit 13 is a processor, such as a CPU (Central Processing Unit). By executing a program stored in the memory unit 12, the control unit 13 functions as a reception unit 131, a related data generation unit 132, an event acquisition unit 133, a specification unit 134, an output unit 135, a determination unit 136, and an evaluation reception unit 137.
[0038] The reception unit 131 receives the recording start operation. Specifically, the recorder terminal 2 transmits information to the information processing device 1 indicating that the recording start operation has been performed. The reception unit 131 receives the information indicating that the recording start operation has been performed. The reception unit 131 may also accept registration of summary information prior to the recording start operation.
[0039] The relational data generation unit 132 generates relational data. Specifically, as an example, the relational data generation unit 132 generates relational data indicating the playback time of the live-streamed video data at the time the recording start operation is received. First, the relational data generation unit 132 accesses the video streaming server 3 and obtains a reference playback time. Specifically, when the reception unit 131 receives a recording start operation, the relational data generation unit 132 accesses the video streaming server 3 and obtains the latest playback time (recording time of the video data) of the live-streamed video data at the time the recording start operation was received as the reference playback time. Then, the relational data generation unit 132 generates relational data by associating the reference time with the obtained reference playback time.
[0040] The event acquisition unit 133 acquires event information. The event acquisition unit 133 acquires event information from the recorder terminal 2. The event acquisition unit 133 may store the acquired event information in the storage unit 12.
[0041] The identification unit 134 identifies the playback time corresponding to the event time in the video data, based on the event time associated with the event information and the related data, as the playback start time for starting playback of the video corresponding to the event. For example, the identification unit 134 identifies the playback start time by adding the difference between the reference time indicated by the related data and the event time associated with the event information to the reference playback time. If the event time indicates the elapsed time from the reference time, the identification unit 134 identifies the playback start time by adding the elapsed time from the recording start time indicated by the event time to the recording start time.
[0042] The output unit 135 outputs video playback information that associates the content of the event indicated by the event information with link information for playing the video from the playback start time. Specifically, the output unit 135 displays the progress viewing screen SC1, which includes the video playback information, on the user terminal 4.
[0043] Figure 4 shows an example of a progress viewing screen displayed by the output unit 135. In the progress viewing screen, a video panel SC11 is arranged, along with multiple event display panels SC12 arranged in a timeline format. The video panel SC11 is an area for displaying video data. The video panel SC11 may display video based on video data being live-streamed, or, as will be described later, video data may be played back from the playback start time corresponding to the selected event. The event display panel SC12 displays video playback information or event information. When video playback information is displayed on the event display panel SC12, the event display panel SC12 includes the event time indicated by the event information, the event content, and a video playback button SC121.
[0044] The video playback button SC121 is associated with a link included in the video playback information. When user U2 presses the video playback button SC121, user terminal 4 plays the video image data on the video panel SC11 starting from the playback start time indicated by the link included in the video playback information.
[0045] If the event displayed on the event display panel SC12 is not an event for which video playback information is to be displayed, the event display panel SC12 may still display event information. In this case, the information that the output unit 135 distributes to the user terminal 4 does not include a link that specifies the playback start time. Therefore, in this case, the video playback button SC121 is not displayed on the event display panel SC12.
[0046] For example, the output unit 135 displays the progress viewing screen when it receives a request from the user terminal 4 to display the progress viewing screen. The user terminal 4 may periodically request the information processing device 1 to update the information displayed on the timeline of the progress viewing screen SC1. When the information processing device 1 receives an update request, the output unit 135 determines whether the event acquisition unit 133 has acquired a new event after the progress viewing screen has been displayed. If a new event has been acquired, the output unit 135 displays video playback information or event information for that event.
[0047] In this way, the information processing device 1 generates relational data, identifies the playback start time based on the relational data, and outputs video playback information for playing the video data from the playback start time. As a result, by recording events in a sports match, the information processing device 1 can generate information that makes it easy to identify scenes corresponding to events in the video. As a result, the burden on the recorder U1 can be reduced.
[0048] Furthermore, if the information processing device 1 stores the playback start time associated with the event information, the processing required for archive distribution can be reduced. Specifically, the output unit 135 stores the playback start time associated with the event information in the storage unit 12. Figure 5 shows an example of the data structure of event information stored in the storage unit 12. In the event information shown in Figure 5, "event time," "event type," "team," "player," and "playback start time" are associated. "Event type," "team," and "player" indicate the type of recorded event, the team associated with the event, and the player associated with the event.
[0049] The output unit 135 is configured to store event information associated with the playback start time in the storage unit 12. This allows the recorder U1 to record the video playback start time along with the event. By having the information processing device 1 store event information in this way, the load on the information processing device 1 required for identifying the playback location when distributing video display information after the end of a match, etc., can be reduced.
[0050] When multiple video distribution servers 3, each corresponding to a different video distribution platform, distribute video of the same match, the method of specifying the playback start time in the link and the playback time corresponding to the event may differ for each video distribution server 3. In this case, the relational data generation unit 132 generates relational data showing the relationship between the playback time and the event time for each of the multiple video image data created by filming the match, which are distributed by each of the multiple different video distribution servers 3. Specifically, the relational data generation unit 132 obtains the reference playback time at the reference time for each of the multiple video image data distributed by each of the multiple different video distribution servers 3, and generates relational data associating the obtained reference playback times for each video distribution server 3. The identification unit 134 identifies the playback start time corresponding to the event for each of the video image data distributed by each of the multiple video distribution servers 3.
[0051] The output unit 135 may output multiple link pieces of information that can be accessed by each of the multiple video distribution servers 3. In addition, if the video distribution platform to be used by each user is predetermined, the output unit 135 outputs video playback information that associates link information for playing the video data corresponding to the event in the video data corresponding to
[0052] Furthermore, if the time specification format differs for each video distribution platform, for example, the related data generation unit 132 may further associate the time specification format defined for each video platform. The output unit 135 outputs video playback information that includes link information specifying the playback time in the time specification format for each of the multiple video platforms.
[0053] The information processing device 1 is configured to generate relational data for identifying playback times for each video distribution platform, thereby absorbing differences in time parameters and time specification formats, and allowing the system to be easily expanded.
[0054] For example, when distributing video footage shot from multiple viewpoints, or when distributing video data divided into time segments for longer matches, it is conceivable to broadcast a single match using multiple video data files. In such cases, relationship data is generated for each of the multiple video data files. The relationship data generation unit 132 accesses the video distribution server 3 and obtains a reference playback time for each video data file. Specifically, when the reception unit 131 receives a recording start operation, the relationship data generation unit 132 accesses the video distribution server 3 and obtains the latest playback time (recording time of the video data file) of the multiple video data files being live-streamed at the time the recording start operation was received as the reference playback time.
[0055] The identification unit 134 identifies the playback time corresponding to the event time in each of the multiple video data images as the playback start time to start playback of the video corresponding to the event, based on the event time associated with the event information and related data. The output unit 135 may output video playback information that associates the content of the event indicated by the event information with multiple link information for playing the video from the playback start time corresponding to each of the multiple video data images. As an example, the output unit 135 may output video playback information configured so that each of the multiple link information can be selected.
[0056] For example, a video distribution server 3 that a user terminal 4 accesses to view video data may be predetermined, and the identification unit 134 may determine the playback start time corresponding to an event based on a predetermined reference playback time corresponding to the video distribution server 3 for the user terminal 4.
[0057] By the way, depending on the type of event, such as a scoring scene, the user U2 may want to watch the video including the events leading up to the event. Also, in cases such as when halftime is recorded, the user may want to watch the video from a time before the event occurred. Therefore, it is desirable to be able to adjust the playback start time corresponding to the event based on the type of event. The configuration in this case is described below.
[0058] The memory unit 12 stores adjustment time information, which is associated with an event type indicating the type of event and an adjustment time indicating the time to adjust the playback start time of the video using the event time included in the event information as the reference time. Figure 6 is a diagram showing an example of the data structure of the adjustment time information stored by the memory unit 12. In the adjustment time information, the "event type" and the "adjustment time" are associated. The "adjustment time" indicates the time to advance or rewind from the playback time corresponding to the event time in order to identify a suitable playback start time.
[0059] The identification unit 134 identifies the playback start time as the time obtained by adding the elapsed time from the recording start time indicated by the event time and the adjustment time to the recording start time. When the event acquisition unit 133 acquires event information, the identification unit 134 refers to the adjustment time information stored in the storage unit 12 and identifies the adjustment time corresponding to the event type indicated by the event information. The identification unit 134 identifies the playback start time by adding the identified adjustment time to the time in the video image data identified based on the event time and related data.
[0060] By configuring the information processing device 1 to adjust the playback start time according to the type of event, user U2 can view the video from a point appropriate to the type of event, thus reducing the burden on user U2 in identifying the part they want to watch. For example, in the case of exciting plays, such as scoring scenes, it becomes possible to play the video from before the start of the play, improving user U2's viewing experience. Furthermore, even in events that require time adjustments, such as timeouts or the end of a period, playback can start from the appropriate time, saving user U2 the trouble of skipping unnecessary parts.
[0061] Incidentally, depending on the sport, the events that occur during a match can be diverse and numerous. Therefore, if video playback information is output for all events that occur, the burden on user U2 to check the displayed information will increase, leading to a decrease in usability. To address this, the information processing device 1 may be configured so that recorder U1, who visually observes and records the events, decides whether or not to output video playback information, and the video playback information is output based on the recorder U1's decision. This configuration is described below.
[0062] The event acquisition unit 133 acquires event information that further includes a target flag. The target flag indicates whether or not the event is one for which video playback information will be output. When the recorder U1 registers event information on the recording screen displayed on the recorder terminal 2, he selects the content of the event and also selects whether or not to output video playback information. Based on the operation of recorder U1, the recorder terminal 2 transmits the event information including the target flag to the information processing device 1.
[0063] The output unit 135 outputs video playback information when the target flag included in the event information indicates that the event is one for which video playback information should be output. For example, if the output unit 135 indicates that the target flag included in the event information indicates that the event is one for which video playback information should be output, it displays the video playback information for that event on the user terminal 4. If the output unit 135 indicates that the target flag included in the event information is not one for which video playback information should be output, it displays the event content included in the event information on the user terminal 4. However, if the target flag included in the event information indicates that the event is not one for which video playback information should be output, the output unit 135 may be configured not to display information about that event on the user terminal 4.
[0064] Furthermore, if the identification unit 134 indicates that the target flag included in the event information is an event for which video playback information is to be output, it may also identify the playback start time for that event. In this case, the identification unit 134 does not identify the playback start time for events that are not for which video playback information is to be output.
[0065] By configuring the information processing device 1 to output video playback information for the event selected by recorder U1, the number of events displayed on the user terminal 4's progress viewing screen will not become too large, thus reducing the burden on user U2 in finding the event to watch.
[0066] In the above embodiment, an example was described in which the recorder U1 decides whether or not to output video playback information. However, if it is known in advance that user U2 wants to view a scene related to a specific type of event, the information processing device 1 may be configured to determine whether or not to output video playback information depending on the type of event being recorded. The configuration in this case is described below.
[0067] The memory unit 12 stores type information that associates an event type, which indicates the type of event, with a target flag, which indicates whether or not the event is the target event for which the playback start time is specified. Figure 7 shows an example of the data structure of the type information. In the type information shown in Figure 7, the "event type" and the "target flag" are associated.
[0068] The determination unit 136 refers to the type information and determines whether the event type associated with the event information is an event for which video playback information is to be output. When the event acquisition unit 133 acquires event information, the determination unit 136 refers to the type information stored in the storage unit 12. If the target flag associated in the type information with the event type indicated by the event information acquired by the event acquisition unit 133 indicates that it is an event for which video playback information is to be output, the determination unit 136 determines that the event is an event for which video playback information is to be output.
[0069] If the determination unit 136 determines that an event is eligible for outputting video playback information, the output unit 135 outputs the video playback information. As already mentioned, if the output unit 135 determines that the event indicated by the event information acquired by the event acquisition unit 133 is eligible for outputting video playback information, it displays the video playback information on the user terminal 4. If the output unit 135 determines that the event indicated by the event information is not eligible for outputting video playback information, it displays, for example, the event content included in the event information on the user terminal 4.
[0070] By configuring the information processing device 1 to output video playback information for only specific events in this way, the load on the information processing device 1 is reduced, and the burden on the user to check the information is also reduced. Specifically, user U2 can check the video focusing on specific types of events that interest them (for example, scoring scenes, fine plays, warnings / red cards, etc.), thus preventing a decrease in visibility of the progress viewing screen due to information overload even in matches with many events, and enabling efficient viewing and analysis.
[0071] Incidentally, there is a need for user U2 to watch videos related to events concerning the team or player that user U2 supports. Therefore, the information processing device 1 may be configured to output video playback information about the team or player that user U2 supports, based on information about the team or player that user U2 supports. The configuration in this case will be described below.
[0072] The storage unit 12 stores user information that associates user U2, who uses the user terminal 4 that displays video playback information, with the team that user U2 supports. Figure 8 shows an example of the data structure of user information stored in the storage unit 12. In the user information, "User ID" and "Supported Team" are associated. "Supported Team" indicates the team that user U2 supports.
[0073] In this case, the event details in the event information further include event team information. The event team information indicates the team associated with the event. The determination unit 136 determines whether the event team information associated with the event information indicates the team supported by user U2. The determination unit 136 refers to the user information and identifies the team supported by user U2, who is the target of the distribution. The determination unit 136 determines whether the event team information associated with the event information matches the identified team supported by user U2.
[0074] If the determination unit 136 determines that the event team information included in the event information indicates the team supported by user U2, the output unit 135 outputs video playback information. In other words, if the event team information associated with the event information matches the team supported by the identified user U2, the output unit 135 displays the video playback information for that event information on user U2's user terminal 4.
[0075] In addition, the user information may include a player that user U2 supports. In this case, the determination unit 136 determines whether the player information associated with the event information acquired by the event acquisition unit 133 indicates a player that user U2 supports in the user information. If the player associated in the event information matches a player that user U2 supports in the user information, the output unit 135 outputs video playback information for the event indicated by the event information.
[0076] By configuring the information processing device 1 to output video playback information about events related to the team or player being supported, it becomes possible to output video playback information about events viewed by user U2, thereby improving usability. In particular, since user U2 can easily extract and view only events related to the team or player they support, user U2 can quickly review scenes in which their supported team or player performed well (e.g., goals, assists, fine saves, etc.), which is expected to enrich user U2's support experience and improve user U2's satisfaction.
[0077] However, if video playback information is output for all events registered in the information processing device 1, a problem arises where the operation for user U2 to find the scene they want to watch becomes complicated. Therefore, the information processing device 1 may be configured to output video playback information only for events that have received high ratings from user U2.
[0078] In this case, the output unit 135 displays the multiple event contents indicated by the multiple event information on each of the multiple user terminals 4. Specifically, the output unit 135 displays the progress viewing screen SC1A shown in Figure 9 on the user terminal 4. In this case, the event display panel SC12 of the progress viewing screen SC1A contains event information and an evaluation button SC122. The evaluation button SC122 is a button for evaluating the content of an event and sending the evaluated content to the information processing device 1. In the progress viewing screen shown in Figure 9, an evaluation button is provided to indicate a high evaluation, but there may also be a button to indicate a low evaluation, or other evaluation buttons (for example, a button to request an explanation of the play content).
[0079] The evaluation reception unit 137 receives evaluations of multiple event information from multiple user terminals 4. In the example shown in Figure 9, when user U2 operates user terminal 4 and presses the evaluation button on the progress viewing screen SC1B, user terminal 4 transmits information indicating the event information to be evaluated and information indicating the evaluation content corresponding to the pressed evaluation button to the information processing device 1. The evaluation reception unit 137 acquires the information indicating the event information to be evaluated and the information indicating the evaluation content corresponding to the pressed evaluation button.
[0080] The output unit 135 outputs video playback information corresponding to event information that has been evaluated above a predetermined level from among multiple event information. In the example shown in Figure 9, if the button indicating a high evaluation is pressed a predetermined number of times or more, the output unit 135 displays information on the user terminal 4 that includes a link to play video data from the playback start time corresponding to the event that was evaluated above the predetermined level. The predetermined number of presses may be set in advance, or it may be determined based on the number of users U2 to whom the event information is distributed (for example, the number of simultaneous connections).
[0081] By configuring the information processing device 1 to output video playback information based on the evaluation of user U2's events, it is possible to display information for playing videos that are likely to be of high interest to user U2, thereby improving the usability of the progress viewing screen SC1B.
[0082] [Processing flow in information processing device 1] Figure 10 is a flowchart showing the processing flow in the information processing device 1. The flowchart shown in Figure 10 starts from the point when the device is ready to receive information about the match from the recorder terminal 2.
[0083] The reception unit 131 receives the recording start operation (S01). The relationship data generation unit 132 obtains the reference playback time from the video distribution server 3 (S02). The relationship data generation unit 132 generates relationship data based on the reference playback time (S03). As an example, the relationship data generation unit 132 generates relationship data by associating the reference time, which indicates the time the recording start operation was received, with the obtained reference playback time.
[0084] The event acquisition unit 133 acquires event information from the recorder terminal 2 (S04). The identification unit 134 identifies the playback start time to start playback of the video corresponding to the event indicated by the event information (S05). As an example, the identification unit 134 identifies the playback start time by adding the elapsed time from the reference time indicated by the event information to the reference playback time indicated by the related data. The output unit 135 delivers video playback information, including a link for playing the video data from the identified playback start time, to the user terminal 4 (S06).
[0085] The event acquisition unit 133 determines whether the processing termination conditions are met (S07). For example, the event acquisition unit 133 determines that processing should be terminated when the reception unit 131 receives an operation to terminate the recording of events. If the termination conditions are not met (NO in S07), the event acquisition unit 133 proceeds to S04. If the termination conditions are met (YES in S07), the information processing device 1 terminates processing.
[0086] [Generating highlight videos] The information processing device 1 may be configured to generate highlight videos of important events among multiple events recorded at predetermined points in time, such as when the match ends or during halftime. The configuration of the information processing device 1 in this case is shown in Figure 11. In this case, the information processing device 1 further includes a highlight generation unit 138.
[0087] The highlight generation unit 138 generates a highlight video by extracting scenes from video data that correspond to multiple events that meet predetermined conditions from among the multiple event information obtained about the match. The predetermined conditions include being an event of a predetermined type (e.g., a score) or being an event recorded in association with a predetermined player.
[0088] The highlight generation unit 138 identifies the playback end time for each of the multiple events that meet predetermined conditions. For example, the highlight generation unit 138 may identify the playback end time by adding a predetermined time (e.g., 5 seconds, 10 seconds, 20 seconds, etc.) to the playback start time associated with each event. Alternatively, the playback time of the video data may be predetermined for each type of event. In this case, the highlight generation unit 138 identifies the playback end time by adding the playback time corresponding to the type of event associated with each event to the playback start time associated with that event.
[0089] The highlight generation unit 138 acquires video data from the video distribution server 3. The highlight generation unit 138 then extracts playback scenes from the video data for each of the multiple events that meet predetermined conditions, based on the playback start time and playback end time for each of the multiple events that meet predetermined conditions. The highlight generation unit 138 then combines the playback scenes for each of the multiple events that meet the predetermined conditions to generate a highlight video.
[0090] The highlight generation unit 138 uploads the generated highlight video to the video distribution server 3. The highlight generation unit 138 obtains link information from the video distribution server 3 for playing the uploaded highlight video. The output unit 135 outputs highlight video playback information, which includes the link information for playing the uploaded highlight video. The highlight video playback information may also include a message indicating that a highlight video of the match has been generated. As an example, the output unit 135 displays the highlight video playback information on the user terminal 4.
[0091] The highlight generation unit 138 may generate highlight videos based on the importance of each event indicated by the event information. In this case, the memory unit 12 stores an importance determination model, which is a trained model for outputting the importance of each event, when event information is input. The importance determination model is trained using multiple training event information that occurred in the match and the importance of each event indicated by the multiple training event information as training data. The highlight generation unit 138 inputs each of the multiple event information recorded in the match into the importance determination model and determines the importance of each of the multiple events.
[0092] For example, the highlight generation unit 138 may select a predetermined number of event information in descending order of importance as events that satisfy predetermined conditions, and identify a playback scene corresponding to each of the selected event information. Alternatively, if there is a predetermined upper limit on the playback time of the highlight video, the highlight generation unit 138 may select events that satisfy predetermined conditions from the predetermined number of events selected in descending order of importance, such that the sum of the playback times of the playback scenes does not exceed the upper limit on the playback time of the highlight video. The highlight generation unit 138 then generates a highlight video for the events selected as events that satisfy predetermined conditions.
[0093] [Recorder terminal 2 configuration] Figure 12 is a block diagram showing the configuration of the recording terminal 2. The recording terminal 2 has a display unit 21, an input unit 22, a communication unit 23, a storage unit 24, and a control unit 25. The control unit 25 has a display control unit 251, a receiving unit 252, a generation unit 253, and a transmission unit 254.
[0094] The display unit 21 is a display. The display unit 21 displays an image based on a signal generated by the display control unit 251. The input unit 22 is a user interface for receiving operations from the recorder U1. The input unit 22 is, for example, a keyboard, mouse, or touch panel display.
[0095] The communication unit 23 is a communication interface for sending and receiving data with other devices via a network. The storage unit 24 is a storage medium including ROM, RAM, SSD, hard disk drive, etc. The storage unit 24 pre-stores programs to be executed by the control unit 25.
[0096] The control unit 25 is, for example, a processor such as a CPU. The control unit 25 functions as a display control unit 251, a reception unit 252, a generation unit 253, and a transmission unit 254 by executing a program stored in the storage unit 24.
[0097] The display control unit 251 displays a recording screen for inputting event and match summary information for a given match. The recording screen is configured to allow input of event details, players involved in the event, and teams involved in the event. The reception unit 252 receives signals from the input unit 22 corresponding to the operations of recorder U1. Specifically, the reception unit 252 receives operations to record events that occurred in a given match.
[0098] The generation unit 253 generates event information based on the operation received by the reception unit 252. For example, the generation unit 253 associates the time the operation was received with the information received by the reception unit 252 as the event time, and generates event information. The transmission unit 254 transmits the event information generated by the generation unit 253 to the information processing device 1.
[0099] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments. [Explanation of Symbols]
[0100] 1. Information Processing Device 2. Recorder terminal 3. Video streaming server 4. User terminals 11 Communications Department 12 Storage section 13 Control Unit 21 Display section 22 Input section 23 Communications Department 24 Memory section 25 Control Unit 131 Reception Department 132 Related Data Generation Unit 133 Event Acquisition Section 134 Specific part 135 Output section 136 Judgment section 137 Evaluation Reception Department 138 Highlight Generation Unit 251 Display Control Unit 252 Reception Department 253 Generation part 254 Transmitter
Claims
1. An event acquisition unit acquires event information that associates event content, which indicates the content of a predetermined event that occurred in a predetermined sporting match, with event time, which indicates the time when the event occurred. A relational data generation unit generates relational data showing the relationship between the playback time and the event time in the video data created by the filming of the aforementioned match, A specification unit identifies the playback time corresponding to the event time in the video data, based on the event time associated with the event information and the related data, as the playback start time for starting playback of the video corresponding to the event. An output unit outputs video playback information associated with the content of the event indicated by the event information and link information for playing the video from the playback start time, An information processing device having
2. The system further includes a reception unit that accepts the operation to start recording events in the aforementioned match, The relational data generation unit generates relational data indicating the playback time of the video data being live-streamed at the time the start operation is received, The event time indicates the time when the event indicated by the event information occurred, with the recording start time being the time when the reception unit received the start operation as the reference time. The identification unit determines the playback start time by adding the elapsed time from the recording start time indicated by the event time to the recording start time. The information processing apparatus according to claim 1.
3. The relational data generation unit generates relational data showing the relationship between the playback time of each of the multiple video data images created by filming the match, which are distributed on each of the multiple different video distribution servers, and the event time. The identifying unit identifies the playback start time corresponding to the event for each of the plurality of video data based on the event time associated with the event information and the relational data. The information processing apparatus according to claim 1.
4. The system further includes a storage unit that stores adjustment time information associated with an event type indicating the type of event, and an adjustment time indicating the time to adjust the playback start time of the video using the event time included in the event information as a reference time. The aforementioned event details include the aforementioned event type, The identification unit identifies the playback start time as the time obtained by adding the elapsed time from the recording start time indicated by the event time and the adjustment time to the recording start time. The information processing apparatus according to claim 2.
5. The event acquisition unit acquires the event information, which further includes a target flag indicating whether or not it is the event that is the target of specifying the playback start time. The output unit outputs the video playback information when the target flag included in the event information indicates that the event is one for which video playback information is to be output. The information processing apparatus according to claim 1.
6. The system further includes a storage unit that stores type information, which associates an event type indicating the type of event with a target flag indicating whether or not the event is the target event for which the video playback information is to be output. The system further includes a determination unit that refers to the type information and determines whether the event type associated with the event information is an event for which the video playback information is to be output, If the determination unit determines that the event is one that will determine the playback start time, the output unit outputs the video playback information. The information processing apparatus according to claim 1.
7. The system further includes a user information storage unit that stores user information associating a user who uses the information terminal that displays the video playback information with a team that the user supports. The aforementioned event details further include event team information indicating the teams involved in the aforementioned event, The system further includes a determination unit that determines whether the event team information associated with the event information indicates the user's supported team. If the determination unit determines that the event team information included in the event information indicates the user's supported team, the output unit outputs the video playback information. The information processing apparatus according to claim 1.
8. The event acquisition unit acquires multiple pieces of event information, The output unit displays the multiple event contents indicated by the multiple event information on each of the multiple information terminals. The information processing device further includes a receiving unit that receives evaluations of the multiple event information from the multiple information terminals, The output unit outputs the video playback information corresponding to the event information among the plurality of event information for which the evaluation is above a predetermined level. The information processing apparatus according to claim 1.
9. The system further includes a highlight generation unit that generates a highlight video by extracting scenes from the video data that correspond to multiple events that meet predetermined conditions from among the multiple event information obtained for the aforementioned match. When the aforementioned highlight video is generated, the output unit outputs information for playing the highlight video, including link information for playing the highlight video. The information processing apparatus according to claim 1.
10. A computer executes An event acquisition step involves acquiring event information that associates event content, which indicates the content of a predetermined event that occurred in a predetermined sporting match, with event time, which indicates the time when the event occurred. A relationship data generation step that generates relationship data showing the relationship between the playback time and the event time in the video data created by the filming of the aforementioned match, A selection step in which, based on the event time associated with the event information and the relational data, the playback time corresponding to the event time in the video data is identified as the playback start time for starting playback of the video corresponding to the event; An output step that outputs video playback information associated with the content of the event indicated by the event information and link information for playing the video from the playback start time, An information processing method having
11. It comprises an information processing device for managing events that occur in a designated sports match, and a recording terminal for recording the said events. The aforementioned recording terminal is A reception unit that accepts input operations regarding predetermined events that occurred in the aforementioned match, Based on the input operation received by the reception unit, a generation unit generates event information that associates event content indicating the content of the event and event time indicating the time when the event occurred. A transmission unit that transmits the event information to the information processing device, It has, The aforementioned information processing device is An event acquisition unit that acquires the aforementioned event information, A relational data generation unit generates relational data showing the relationship between the playback time and the event time in the video data created by the filming of the aforementioned match, A specification unit identifies the playback time corresponding to the event time in the video data, based on the event time associated with the event information and the related data, as the playback start time for starting playback of the video corresponding to the event. An output unit outputs video playback information associated with the content of the event indicated by the event information and link information for playing the video from the playback start time, Having, Information processing system.
Citation Information
Patent Citations
Video editing program, video editing device, and video editing method
JP2019208196A
Information Processing Terminal and Information Processing Method
JP6256331B2
Production of image guide
JP1987056331A
Method of providing sports game record service and server performing the same
JP2017134811A