Information processing device, information processing method, and program

Abstract

This information processing device is provided with a calculation unit that performs: a determination process for determining whether or not a target play for which content is to be generated has occurred on the basis of game information, which is information relating to a game, during a competition game; a generation process for generating content relating to the target play in accordance with the determination of occurrence of the target play; and an editing process for generating edited content that is obtained by editing the generated content on the basis of user information pertaining to a user to whom a service is to be provided.

Description

Information processing device, information processing method, and program

[0001] The present technology relates to an information processing device, an information processing method, and a program, and in particular to a service that provides content related to an actual game.

[0002] In recent years, there have been services that provide various information during sports matches such as baseball, soccer, and basketball. For example, Patent Document 1 describes a system that acquires information on the progress of a match and the details of plays at the match venue in real time, centrally manages it at a center, and provides it to third parties. Also, Patent Document 2 describes a communication processing system that can report match information for multiple matches held at multiple stadiums in real time.

[0003] JP 2002-268806 JP 8-299525

[0004] Many fans visit stadiums to watch baseball, soccer, basketball, and other sports. Many also watch live broadcasts on television. In order to develop sports culture, it is desirable to increase spectator satisfaction and broaden the enjoyment of these games.

[0005] Therefore, the present disclosure proposes a technology for providing services that can enhance the enjoyment of users who are spectators while watching a game.

[0006] The information processing device according to the present technology includes a calculation unit that performs a determination process for determining whether a target play for content generation has occurred during a sports game based on game information, which is information related to the game, a generation process for generating content related to the target play in response to the determination of the occurrence of the target play, and an editing process for generating edited content by editing the content based on user information related to a service recipient. For example, during a sports game such as baseball or soccer, an impressive play, a memorable play, etc., is determined as a target play for content generation. Content is generated in response to the occurrence of such a target play. Furthermore, edited content is generated with content additions or changes made to the content based on the user information of the service recipient.

[0007] 1 is an explanatory diagram of an information providing system according to an embodiment of the present technology. FIG. 1 is a block diagram of an information providing system according to an embodiment. FIG. 2 is an explanatory diagram of a functional configuration of the information providing system according to an embodiment. FIG. 3 is a block diagram of an information processing device according to an embodiment. FIG. 4 is an explanatory diagram of an example screen by a match linkage service according to an embodiment. FIG. 5 is an explanatory diagram of a locker room screen according to an embodiment. FIG. 6 is an explanatory diagram of a key moment notification screen according to an embodiment. FIG. 7 is an explanatory diagram of key moment content according to an embodiment. FIG. 8 is an explanatory diagram of key moment content according to an embodiment. FIG. 9 is an explanatory diagram of post-edited key moment content according to an embodiment. FIG. 10 is an explanatory diagram of an item corresponding to content according to an embodiment. FIG. 11 is an explanatory diagram of post-edited key moment content according to an embodiment. FIG. 12 is an explanatory diagram of post-edited key moment content according to an embodiment. FIG. 13 is an explanatory diagram of post-edited key moment content according to an embodiment. 10 is a flowchart of an example of content playback processing according to an embodiment.

[0008] The following describes the embodiment in the following order: <1. System configuration> <2. Screen and content example of match-linked service> <3. Processing example> <4. Summary and modified examples>

[0009] In this disclosure, "image" refers to both video and still images. For example, the imaging device 10 shown in FIG. 1 is expected to primarily capture video, but the images displayed on the terminal device 5 may be video or still images. Furthermore, "image" refers to the image actually displayed on the screen, but "image" in the signal processing process and transmission path leading up to display on the screen refers to image data. In the services of the embodiments, content and digital items are primarily provided as images, but may also include still images, video, and pseudo-videos made up of a small number of still images. These images may or may not include audio.

[0010] 1 shows an overview of an information provision system 1 according to an embodiment. The information provision system 1 in Fig. 1 includes an imaging device 10, a main server 2, a score data server 3, a sensor 4, and a terminal device 5. These are connected to each other via wired or wireless communication, network communication, or the like.

[0011] This information provision system 1 is a system that realizes a service (hereinafter referred to as a "match-linked service") that provides virtual spaces, digital items, and various content linked to a match to users with terminal devices 5. In this match-linked service, users are assumed to be fans of teams or players, and, for example, when these users watch a match, virtual spaces, image content, game content, digital items, etc. that are generated or updated according to the match, or according to the match or user are provided to the terminal devices 5. This allows users to enjoy the fun provided by the match-linked service in addition to the enjoyment of watching the match itself.

[0012] The multiple imaging devices 10 in the information provision system 1 capture images of a subject area of ​​a playing field, such as a baseball stadium, e.g., the state of a game, from various positions. Although multiple imaging devices 10 are shown, it is sufficient to provide at least one imaging device 10. In the case of baseball, for example, the imaging device 10 is used to capture images for analyzing the movements of the pitcher, fielders, batters, and runners, and for determining the trajectory, type of pitch, speed, spin, etc. of the ball.

[0013] The information provision system 1 extracts skeletal capture data of the subject player from the image captured by the imaging device 10, and determines the player's movements, such as pitching, batting, and base running, based on the skeletal capture data. In addition to players, the movements of other playing objects such as a ball or bat may also be determined.

[0014] In recent years, a technology known as EPTS (Electronic Performance and Tracking Systems) has become known for use in sports such as soccer and basketball. This technology estimates the posture and position of players and referees, as well as the position and rotation of the ball, from a specified field based on images taken by specially installed cameras and information from sensors (acceleration sensors and GPS sensors) attached to people (players) and objects (balls) involved in the sport.

[0015] Specifically, the imaging device 10 captures images for obtaining such EPTS data as skeletal capture data. The images captured by the imaging device 10 can also be used as live images of a game or the like.

[0016] The EPTS data generated based on images captured by the imaging device 10 is transmitted to the main server 2. For example, if an information processing device (not shown) that records images captured by multiple imaging devices 10 and generates EPTS data is installed at a sports stadium such as a baseball stadium, the EPTS data generated by the information processing device is transmitted to the main server 2. Alternatively, the images captured by the imaging device 10 may be transmitted to the main server 2, and the EPTS data may be generated on the main server 2 side.

[0017] Sensor 4 is a sensor that detects the movements of players, the ball, etc. Specifically, sensors attached to the players or the ball, such as an acceleration sensor, gyro sensor, GPS (Global Positioning System) sensor, altitude sensor, or impact sensor, are envisioned. For example, the sensor may be a wearable sensor attached to the player's uniform or body, or a sensor built into the ball. Radar, etc. may also be used.

[0018] Information on player movements can also be obtained from the sensing data SS obtained by these sensors 4. Alternatively, the sensing data SS can be used as an auxiliary data when obtaining skeletal capture data from images or when estimating posture, etc. The sensing data SS obtained by the sensors 4 can also be used to determine the speed, number of rotations, and trajectory of the ball, as well as the swing speed and trajectory of the bat. The sensing data SS may be transmitted to the main server 2, or may be input to an information processing device (not shown) that generates EPTS data at a sports venue such as a baseball stadium.

[0019] The score data server 3 is an information processing device of an organization that generates and distributes, for example, baseball score data SD. Here, the score data server 3 is a server device that can transmit the score data SD of a game to the main server 2. The score data server 3 may transmit the score data SD to the main server 2 sequentially during a game, or may transmit all of the score data SD of the game all at once after the game, for example.

[0020] In the case of baseball, score data SD includes various types of game information, such as the score for each inning of the game and information about the players participating, as well as information about each pitch thrown by the pitcher. For example, for each pitch, information may include the time of the pitch, the pitcher's name, the batter's name, whether the batter is left-handed or right-handed, whether there are runners on first, second, or third base, the runners' names, the strike / ball count, whether the ball is a ball or a strike, the out count, the batting result (hit, strikeout, missed, foul, grounder out, flyout, foul fly, etc.), the ball's speed, the type of ball, the number of spins, the axis of spin, the course of the ball, and other information.

[0021] The terminal device 5 is an information processing device such as a smartphone, tablet device, or personal computer, but as described above, it is assumed that this terminal device 5 is a device owned by a general user. The display unit 5a of the terminal device 5 displays key moment content (described later), a virtual space such as the locker room screen 140, and images including digital items through the match linkage service.

[0022] The main server 2 performs various processes as a match-linked service for presenting information on the terminal device 5. For example, the main server 2 determines the status of the match and players based on skeletal capture data of the subject generated from images captured by the imaging device 10, and performs processes such as providing the terminal device 5 with corresponding key moment content, digital items, and images of the virtual space.

[0023] The main server 2 can be assumed to be an information processing device that performs cloud computing, that is, a cloud server.

[0024] However, the processing for displaying images of the match linkage service on the terminal device 5 may be performed by an information processing device other than the cloud server. For example, it is conceivable that an information processing device such as a personal computer installed at the match venue has the function of the main server 2 and performs processing such as acquiring skeletal capture data and generating images to be provided. Furthermore, it is also conceivable that the terminal device 5 also has the function of the main server 2 and performs processing such as acquiring skeletal capture data and generating images.

[0025] 2 shows the configuration of the main server 2 and an example of input and output related to the main server 2 in the information providing system 1 shown in FIG. 1. A part that supplies data to the main server 2 is shown as a data server 30.

[0026] 2 is shown as a conceptual configuration, and collectively represents the configuration that the main server 2 uses as an information source for executing the match linkage service. For example, the data server 30 collectively refers to the imaging device 10, score data server 3, sensor 4, recording unit 11, and EPTS data generation unit 12.

[0027] The imaging device 10 and the sensor 4 are placed on the stadium, athletes, and sports objects as shown in Fig. 1. There are no restrictions on the installation location of the score data server 3. Either or both of the recording unit 11 and the EPTS data generation unit 12 may be realized by an information processing device placed on the stadium, or either or both may be provided on the main server 2 side.

[0028] The imaging devices 10 are configured as digital cameras having imaging elements such as charge-coupled devices (CCD) sensors or complementary metal-oxide-semiconductor (CMOS) sensors, and capture images as digital data. In this example, each imaging device 10 captures a moving image.

[0029] For example, at a baseball stadium, each imaging device 10 is placed at a predetermined position to capture images of the pitcher, fielders, batters, runners, etc. The number of imaging devices 10 is not particularly specified and is one or more, but in order to generate highly accurate EPTS data, it is advantageous to have as many as possible. Each imaging device 10 captures video in a synchronized state and outputs the captured images.

[0030] The recording unit 11 records the images (image data VD) captured by the multiple imaging devices 10 , and supplies each captured image to the EPTS data generation unit 12 .

[0031] The EPTS data generator 12 analyzes one or more captured images, generates EPTS data individually, and then integrates all of the individual EPTS data to generate overall EPTS data. The EPTS data includes, for example, the positions of players (pitcher, fielder, batter, and runner) and the ball at each frame timing, player skeletal capture data and the resulting player posture, and information on the ball's rotation speed and rotation direction (rotation axis). The EPTS data generator 12 may generate EPTS data not only from the captured images but also from sensing data SS obtained by the sensor 4, such as information from an acceleration sensor embedded in the ball or a GPS sensor attached to the player's uniform.

[0032] The EPTS data generator 12 can generate, as EPTS data for the entire game, information that can be used to determine, for example, the pitching motion, ball speed, trajectory, batter's behavior in response to the pitch, batting results, base running results, batter's speed, trajectory, etc. for each of the pitchers' pitches during the game. Therefore, the EPTS data is an example of behavior information about either people (pitcher, batter, runner, etc.) or playing objects (ball, bat, etc.) related to the game.

[0033] The EPTS data generation unit 12 can generate EPTS data from a plurality of captured images obtained by a plurality of imaging devices 10, and can also generate EPTS data from a plurality of captured images obtained by a single imaging device 10. Furthermore, the EPTS data generation unit 12 can generate EPTS data from a plurality of images and sensing data SS from one or a plurality of sensors, and can also generate EPTS data from a single captured image and sensing data SS from a single sensor.

[0034] The EPTS data (skeleton capture data) generated by the EPTS data generator 12 is transmitted to the main server 2. Image data VD captured by the imaging device 10 is also transmitted to the main server 2, for example, via the EPTS data generator 12. In addition, the sensing data SS may be transmitted to the main server 2 and used directly for processing by the main server 2.

[0035] In addition, the EPTS data generation unit 12 may be provided in the main server 2, in which case, for example, the image captured by the imaging device 10 (image data VD) and the sensing data SS of the sensor 4 may be transmitted to the EPTS data generation unit 12 in the main server 2 via network communication, etc.

[0036] As explained in FIG. 1, the score data server 3 successively transmits the score data SD to the main server 2 .

[0037] The main server 2 is configured by an information processing device such as a computer device, and is provided with a calculation unit 21 using a microprocessor or the like, a function as a presentation control unit 22, and a storage 23 using a storage medium accessible by the microprocessor or the like.

[0038] The calculation unit 21 acquires information from the data server 30 and performs various processes for executing the match-linked service using the acquired information, such as data acquisition, match analysis, and generation of virtual space images, digital items, and content. The processing functions of the calculation unit 21 will be described later with reference to FIG. 3.

[0039] The storage 23 represents a storage medium in the main server 2 that stores information such as received image data VD, skeletal capture data BD, score data SD, and the like, and that stores various data generated by the calculation unit 21. The storage 23 may be an internal storage medium of the main server 2, or may be a storage medium separate from the information processing device that constitutes the main server 2.

[0040] The presentation control unit 22 controls the display of various images generated by the processing of the calculation unit 21 in a predetermined manner on the terminal device 5. Specifically, the presentation control unit 22 performs processing to display images of the virtual space, digital items, etc. generated by the calculation unit 21 in the execution of the match linkage service on the display unit 5a of the terminal device 5.

[0041] The calculation unit 21, the presentation control unit 22, and the storage 23 may be provided in one information processing device, or may be provided separately in multiple information processing devices. There are various possible ways to realize the storage 23 as a storage medium.

[0042] The images of the match linkage service or the data for generating the images processed by the main server 2 are transmitted to the terminal device 5 and displayed on the display unit 5a. This allows the user of the terminal device 5 to view the images provided by the match linkage service. Information on user interaction during the provision of the match linkage service may also be input from the terminal device 5 to the calculation unit 21.

[0043] 3 illustrates information transmitted from the data server 30 to the calculation unit 21 and the processing functions of the calculation unit 21. In particular, this figure illustrates the processing functions for a game linked service function 40 and the processing functions as a sharing service that allows results of the game linked service to be exhibited.

[0044] The calculation unit 21 in this embodiment has the processing function of the match linkage service function 40. As shown in the figure, the calculation unit 21 may have the processing function of the shared service function 50, but the shared service function 50 may also be provided in another server device.

[0045] The information provided to the calculation unit 21 by the data server 30 described above can be summarized as follows, as shown in the figure: EPTS data, sensing data SS, image data VD, stats data, historical data, analysis data, and the like.

[0046] The stats data and historical data are score data SD generated by the score data server 3. For example, stats data is performance information about a player or team. For example, examples of stats data for a baseball pitcher include the team name, league, number of wins, number of losses, earned run average, number of games pitched, number of complete games, number of shutouts, number of saves, number of save opportunities, number of innings pitched, number of runs allowed, number of home runs allowed, number of hit by pitch, number of walks allowed, number of intentional walks, number of strikeouts, hit percentage, number of runners allowed per inning pitched (WHIP: Walks plus Hits per Inning Pitched), and ground ball / flyout ratio. In addition to the past performance of teams and players, stats data also includes information about the performance of teams and players in ongoing games up to the present time, i.e., detailed information about the game progress, information about registered players, information about starting lineups, information about substitute players, etc. The information on the progress of the game includes information on each play, such as pitching details, batting results, fielding, and base running.

[0047] Historical data is also information about the performance of teams and players, and is included in the broad definition of stats data. However, for the purposes of explanation, it is shown here as information such as past best records, team records, and individual records. It also includes information about records that may be achieved in the current game. Examples include the number of strikeouts in a single game, consecutive hits in at-bats, consecutive games played, and the number of team hits in a single game. This type of historical data can be referenced for editing special digital items in the game-linked service.

[0048] The analysis data indicates data determined for the EPTS data, the sensing data SS, and the image data VD by the function of the data analysis unit 32. The function of this data analysis unit 32 may be provided in the main server 2, or may be realized by another information processing device.

[0049] Specific examples of analysis data include specific player movements determined from EPTS data, sensing data SS, etc., and the trajectory of the ball. For example, this is tracking data of the movements of players and playing objects in a game. In the case of baseball, player movements include the pitcher's pitching movements, the catcher's catching movements, the batter's batting movements, the fielders' defensive movements, and the runners' base running movements. The overall movements of players in various sports can be obtained as tracking data.

[0050] Sporting objects are objects used in a match, such as the ball in a ball game, or objects used to hit the ball, such as bats and rackets. Other sporting objects include the bamboo sword in kendo and the saber in fencing. Furthermore, auxiliary objects used in the game, such as protectors and uniforms, are also included in sporting objects. Tracking data of the movement of these sporting objects can also be obtained as analysis data.

[0051] The EPTS data, sensing data SS, image data VD, stats data, historical data, and analysis data supplied from the data server 30 to the calculation unit 21 are information related to the match, and will be referred to as match information. This match information refers to information related to the match itself and information about the players and teams playing the match, and is distinguished from user information, which will be described later.

[0052] Information about the game itself includes the game date and time, venue, weather, score, and information about the progress of the game (current inning, out count), etc. Player information includes information about each individual player, such as their game performance, past performance, game images, play details, and player movements, etc. Team information includes information about the team as a whole, such as their game performance, past performance, game images, participating players, and reserve players.

[0053] It should be noted that it is not necessary for all of the "match information" including the EPTS data, sensing data SS, image data VD, stats data, historical data, and analysis data to be transmitted to the calculation unit 21. For example, by transmitting at least one of these to the calculation unit 21, the calculation unit 21 can perform processing for the match linkage service function 40. The EPTS data and analysis data may also be generated by the calculation unit 21 based on the image data VD and sensing data SS.

[0054] The information input from the terminal device 5 to the calculation unit 21 includes user information and information regarding purchase / sale / share / exchange.

[0055] Here, we will explain the match information and user information. The "match information" referred to in this disclosure has the following two information sources: Information provided by the score data server 3 Information obtained based on signals from the imaging device 10 and the sensor 4 The content of the information obtained from these two types of information sources may be different or the same.

[0056] When considering the types of content of the game information, in this embodiment, it is classified into "fixed game information" and "game progress information."

[0057] Fixed game information is information that does not change as the game progresses. Examples include the venue, game start date and time, season, teams, starting lineup, weather information such as the weather and temperature at the start of the game, team performance before the game, players on the bench, player and team performance before the game (stats data, historical data), referee, game type (official game, championship game, magic number lighting game, etc.), player condition before the game, player profile (birthday, hometown, etc.), etc.

[0058] Game progress information is information obtained as the game progresses, such as the score of the game (game progress / results), the innings / time / half played, weather changes during the game, player and team performance as the game progresses (stats data, historical data), participating players, information on each play during the game, player behavior during each play (EPTS information / sensing data SS / analysis data), game image data VD, achievement records, etc.

[0059] User information refers to information that the main server 2 can acquire about a target user (a user who is logged in to the match linkage service function 40). Here, user information is classified into "user fixed information" and "user status information" in terms of content type.

[0060] The user fixed information is user information that does not change depending on the current match (the match that the logged-in user is watching). Examples of the user fixed information include the user's account information, address information, attribute information, history information related to the match linkage service, and information about owned items. The attribute information may include basic information such as age, gender, place of residence, and email address, as well as information indicating the team or player the user supports in relation to the match linkage service. Information that is added to the user fixed information over time includes the date and time, stadium name, and seat information for when watching a match at a stadium. Note that some or all of the user fixed information may be entered in advance for a user registered with the match linkage service function 40 and stored in the storage 23, for example.

[0061] User status information is information that indicates the user's status with respect to the current match and the match linkage service. It includes, for example, information about the user's location, information corresponding to the user's actions and interactions, etc. Information about the user's location includes, for example, the user's current location information, information about the facility or store where the user is currently located, etc. It may also include seat information and area information in the stadium. Information corresponding to the user's actions and interactions includes information about the user's movement status, vocalizations, actions, cheers by the user (or the entire audience), answer inputs to quizzes and the like provided by the match linkage service, information input by the user about the current match indicating the team or player the user is supporting, and information input by the user during the match (for example, operation information, participation information, answer information, etc. for quizzes provided by the match linkage service).

[0062] It should be noted that information on the history of user actions and interactions may be added sequentially to the user fixed information as history information.

[0063] The calculation unit 21 receives the above-mentioned game information (fixed game information, game progress information) and user information (fixed user information, user status information) in relation to the processing of the game cooperation service function 40 .

[0064] The processing functions for executing the match linkage service function 40 in the calculation unit 21 include a match information acquisition unit 41, a user information acquisition unit 42, a match analysis unit 43, a quiz generation unit 44, an item / content generation unit 45, a storage control unit 46, a locker processing unit 47, and a game processing unit 48. It is not necessary for the calculation unit 21 to have all of these processing functions.

[0065] The game information acquisition unit 41 has a function of acquiring game information (fixed game information, game progress information), for example, before the start of the game and during the game, and performs processing to successively acquire game information from the data server 30.

[0066] The user information acquisition unit 42 is a function for acquiring user information (user fixed information, user status information). For example, it acquires user information about a logged-in user before the start of a match or sequentially during the match. At the time of login, it also performs processing to read the user fixed information of the user stored in the storage 23.

[0067] The game analysis unit 43 analyzes the game based on the game information and user information, and performs processing to determine the game situation. In addition, the game analysis unit 43 performs processing to determine the timing to request a user's response regarding the service, and the timing to edit digital items and provide content, depending on the determination of the game situation.

[0068] The quiz generation unit 44 generates quizzes and questionnaires to be provided to the user and transmits them to the terminal device 5. The quiz generation unit 44 can also perform processing to request user interaction in addition to quizzes and questionnaires.

[0069] The item / content generation unit 45 generates digital items. The item / content generation unit 45 also generates image content such as digest videos of matches, free viewpoint images, and CG (computer graphics) images. The item / content generation unit 45 also generates information that will ultimately be associated with digital items. The item / content generation unit 45 also generates and awards points, which will be described later.

[0070] In this embodiment, the item / content generating unit 45 particularly has the functions of a determining unit 45a, a generating / editing unit 45b, and a providing processing unit 45c.

[0071] The determination unit 45a performs a determination process based on the match information to determine whether a target play that is a target for generating key moment content has occurred during a competitive match. In this disclosure, a "key moment" refers to a moment during a match when a moving play, an impressive play, an exciting play, a play that gets the crowd excited, or a play that achieves some kind of record occurs. Key moment content is created by converting a key moment play into image content using CG or captured images. The determination unit 45a can also be said to perform a process for determining the occurrence of a key moment. A play determined to be a key moment is referred to as a "target play."

[0072] For example, the determination unit 45a determines a specific type of play determined based on the match information as a target play. The determination unit 45a can also determine the occurrence of a target play based on the match information and user information.

[0073] The generating and editing unit 45b performs a generating process to generate content related to the target play (key moment content) in response to the key moment determination. The generating and editing unit 45b also performs an editing process to generate edited key moment content by adding or changing content to the key moment content based on user information related to the user to whom the service is provided.

[0074] The provision processing unit 45c performs processing related to content provision. For example, when the provision processing unit 45c generates key moment content, it notifies the service destination terminal device 5 that the content is available for viewing. The provision processing unit 45c also generates a digital item corresponding to edited key moment content with added or modified content based on user information about the service destination user, and associates the edited key moment content with the digital item. The provision processing unit 45c also performs processing to play the edited content in response to an operation on the digital item.

[0075] The storage control unit 46 performs processing for storing and reading information in the storage 23 regarding the match linkage service function 40 .

[0076] The locker processing unit 47 is a function that performs processing related to providing the clubhouse as a virtual space including images of virtual lockers for general users and players (locker room screen 140, which will be described later). The locker processing unit 47 performs processing for changing the settings and appearance of the lockers provided to users as the locker room screen 140.

[0077] The game processing unit 48 has a function for processing game content provided on the screen of the terminal device 5. This game content is, for example, a game provided by an application program or a browser screen, and the game content can be of various types. However, this game has a function for causing changes linked to actual match information and user information. For example, in-game parameters and game items may be changed in accordance with match information, user information, or even digital items related to the locker room screen 140.

[0078] The calculation unit 21 of the main server 2 is shown to have a shared service function 50 in addition to the match linkage service function 40 described above. This shared service function 50 may include a function as an NFT (Non-Fungible Token) market. The NFT market function is a service that allows users to list and sell NFT works they have acquired or purchase NFT works that are being listed. For example, in this embodiment, the digital items generated by the match linkage service function 40 are edited based on the progress of the match and user interactions, and ultimately become digital items unique to each user. These can then be listed or purchased as NFT works in the shared service function 50.

[0079] For this reason, the shared service function 50 includes a smart contract function 51 and a settlement function 52. The smart contract function 51 is a function that automatically executes predetermined buying and selling processing in accordance with predetermined conditions for buying and selling transactions. The settlement function 52 is a function that performs settlement processing for buying and selling.

[0080] The shared service function 50 may also include a share service function 53 and an exchange service function 54 .

[0081] The sharing service function 53 is a function that enables a user to share items, content, etc. that the user owns with others free of charge.

[0082] The exchange service function 54 is a function that enables a user to exchange items, content, etc. owned by the user for items, content, etc. owned by other people.

[0083] The match linkage service function 40 can put up some kind of digital item for such a sharing service function 50 and make it available for purchase by users.

[0084] Furthermore, the match linkage service function 40 allows users to sell digital items they have acquired, purchase digital items sold by others, share them with others, and exchange them for other people's digital items.

[0085] Note that the functional configuration in Figure 3 is an example. Some of the functions of the match linkage service function 40 can also be processed on the terminal device 5 side. For example, some or all of the functions of the quiz generation unit 44, the match analysis unit 43, the item / content generation unit 45, and the game processing unit 48 can be executed outside the match linkage service function 40. In other words, some of the functions of the calculation unit 21 may be provided on the terminal device 5 side. For example, a calculation unit including the item / content generation unit 45 may be provided on the terminal device 5.

[0086] It is also possible to eliminate the need for the shared service function 50. For example, the match linkage service function 40 may perform processing such as selling the generated digital items to users.

[0087] The configuration of the information processing device 70 used in the information provision system 1 described above with reference to Figures 1, 2, and 3 will now be described. For example, the main server 2, the terminal device 5, and the EPTS data generation unit 12 in Figure 2 can be realized by the information processing device 70 shown in Figure 4. The information processing device 70 can be configured as, for example, a dedicated workstation, a general-purpose personal computer, a mobile terminal device, or the like.

[0088] 4 executes various processes in accordance with programs stored in a ROM 72 or a nonvolatile memory unit 74 such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), or programs loaded from a storage unit 79 to a RAM 73. The RAM 73 also stores data necessary for the CPU 71 to execute various processes as appropriate.

[0089] The image processing unit 85 is configured as a processor that performs various types of image processing, such as image generation processing for video clips, image analysis processing for captured images, generation processing for animation images and CG images, DB (Data Base) processing, image effect processing, and EPTS data generation processing.

[0090] The image processing unit 85 can be realized by, for example, a CPU separate from the CPU 71, a graphics processing unit (GPU), a general-purpose computing on graphics processing units (GPGPU), an artificial intelligence (AI) processor, etc. The image processing unit 85 may be provided as a function within the CPU 71.

[0091] The CPU 71, ROM 72, RAM 73, nonvolatile memory unit 74, and image processing unit 85 are interconnected via a bus 83. To this bus 83, an input / output interface 75 is also connected.

[0092] An input unit 76 consisting of operators and operation devices is connected to the input / output interface 75. For example, the input unit 76 may be various operators and operation devices such as a keyboard, a mouse, keys, a dial, a touch panel, a touch pad, a remote controller, etc. The input unit 76 detects user operations, and the CPU 71 interprets signals corresponding to the input operations.

[0093] The input / output interface 75 is also connected, either integrally or separately, to a display unit 77 such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) panel, and an audio output unit 78 such as a speaker.

[0094] The display unit 77 displays various types of information as a user interface. The display unit 77 is configured, for example, by a display device provided on the housing of the information processing device 70 or a separate display device connected to the information processing device 70. The display unit 77 displays various images on the display screen based on instructions from the CPU 71. The display unit 77 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the CPU 71.

[0095] For example, if this information processing device 70 is considered as a terminal device 5, the display unit 77 corresponds to the display unit 5a and displays screens using the match linkage service function 40, such as screens including key moment content and digital items, which will be described later.

[0096] A storage unit 79 configured with a solid state drive (SSD) or a hard disk drive (HDD), or a communication unit 80 configured with a modem, may be connected to the input / output interface 75. For example, if the information processing device 70 is considered to be the main server 2, the storage unit 79 can be considered to be an example of the storage 23 in which information is stored by the storage control unit 46. The communication unit 80 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, or the like.

[0097] A drive 82 is also connected to the input / output interface 75 as needed, and a removable recording medium 81 such as a flash memory, a memory card, a magnetic disk, an optical disk, or a magneto-optical disk is appropriately attached. The drive 82 allows data files such as image files and various computer programs to be read from the removable recording medium 81. The read data files are stored in the storage unit 79, and images and sounds contained in the data files are output on the display unit 77 and the audio output unit 78. In addition, the computer programs and the like read from the removable recording medium 81 are installed in the storage unit 79 as needed.

[0098] In this information processing device 70, software can be installed via network communication by the communication unit 80 or via a removable recording medium 81. Alternatively, the software may be stored in advance in the ROM 72, the storage unit 79, or the like.

[0099] For example, when this information processing device 70 is considered as the main server 2, the software provides the functions of the calculation unit 21 and presentation control unit 22 described above, and the CPU 71 and image processing unit 85 execute the processing of these functions.

[0100] The sensor unit 84 is shown as a component that outputs some kind of sensing data SS, such as an image sensor (camera), a gyro sensor, an acceleration sensor, a position sensor, etc. For example, when the information processing device 70 is realized as a terminal device 5, the sensor unit 84 is provided so as to be able to detect the actions, behavior, position, etc. of the user.

[0101] 2. Screen and Content Examples of the Game Linkage Service> A description will be given of screen examples on the terminal device 5 implemented in the game linkage service. The game linkage service is a service that provides digital items, image content, game content, virtual space, and the like related to a sport, in accordance with game information related to a game of a sport such as baseball.

[0102] 5 shows some examples of screens provided by the match-linked service function 40. For example, there is a top screen 100, a match screen 110, a cheering screen 120, a mini-game screen 130, and a locker room screen 140. The user can view these screens by transitioning between them as desired.

[0103] The top screen 100 displays information about the match currently being played, images for screen transitions, images related to the logged-in user, and the like.

[0104] On the top screen 100 and other screens described later, icons 101, 102, 103, 104, and 105 are displayed as selectable items.

[0105] Icon 101 is an icon for an operation to transition to a locker room screen 140 as a personal page. Icon 102 is an icon for an operation to transition to a cheering screen 120. Icon 103 is an icon for an operation to transition to a match screen 110. Icon 104 is an icon for an operation to transition to a mini-game screen 130. Icon 105 is an icon for an operation to transition to a setting screen (not shown).

[0106] These icons also represent the current screen. For example, Fig. 6 shows an example of a locker room screen 140. In this case, the icon 101 representing the locker room screen 140 is displayed in a different manner from the other icons. For example, in Fig. 6, the frame of the icon 101 is displayed with a thicker frame than the frames of the other icons.

[0107] 5 is a screen that provides the user with digital items that change depending on the progress of the game being watched, quizzes about game predictions, and the like. Examples of digital items include items related to the sport, such as designs of a baseball, bat, glove, etc. For example, an item may have a design in which a team logo or the like is added to a ball.

[0108] The match screen 110 also displays information about digital items, the match, and the user. For example, team / score information, point information, etc. are displayed. The point information refers to points for the user, that is, the user who has logged in to the match linkage service and is viewing the provided screen on the terminal device 5. The match linkage service awards points to the user according to the match situation and the user situation. For example, points are awarded according to the user's input or actions, the results of the user's answers to quizzes, or the performance of a player selected by the user.

[0109] The cheering screen 120 is a screen where fans can get excited by cheering for each other, and it allows fans to communicate with each other and share exciting moments. It is also possible that the playback of key moment content, which will be described later, can be performed on the cheering screen 120.

[0110] The mini-game screen 130 is a screen that provides game content to the user. For example, game content such as a batting game and a pitching game is available, and the user can enjoy these games. In particular, in this case, the pitching and batting in the game are set based on tracking data from an actual game, so that the user can experience pitching and the like of an actual player on the game screen.

[0111] The locker room screen 140 is a page that virtually displays a locker room as a user's homepage. The locker room screen 140 is shown in FIG. 6 . The locker room screen 140 is prepared, for example, for each user who subscribes to the match linkage service as the user's homepage. For example, the locker room screen 140 in FIG. 6 is a screen provided for a user displayed as the username 202, and serves as the homepage when the user logs in to the match linkage service.

[0112] This locker room screen 140 displays a virtual locker 201. This locker 201 is set to, for example, a basic shape, but is displayed in various states for each user. For example, various items 203 can be placed on the shelves or floor inside the locker 201. The user can select an item 203 from among the items 203 they own and place it in any location.

[0113] Examples of the items 203 include items used in baseball, such as bats, helmets, hats, cleats, and uniforms. Items 203 also include items unrelated to baseball, such as casual clothing, plants, accessories, and food. Furthermore, items prepared for fans of teams and players, such as player figures, team character logo goods, team mascot dolls, and medals, may also be included. The match linkage service provides these various virtual items 203 to users, either for a fee or free of charge, so that each user can obtain them.

[0114] The user can purchase the item 203 in a virtual shop, obtain the item 203 as a prize for answering a quiz correctly, or exchange the item 203 with another person. The user can place the item 203 thus obtained in his / her own locker 201.

[0115] Here, item 203A is an item that indicates key moment content, which will be described later. When a key moment content is acquired, item 203A corresponding to that key moment content is also given to the user, and can be placed in locker 201.

[0116] Furthermore, the color of the locker 201 itself and the arrangement of the shelves may be customizable by the user.

[0117] A poster 204 is attached to the locker 201. The poster 204 functions as a display unit for various images. For example, still images and videos of a player that the user likes, and still images and videos posted by the user are displayed on the poster 204.

[0118] A virtual speaker 206 can also be placed inside the locker 201. For example, the user can obtain the speaker 206, which is available as one of the items 203, by purchasing it from the item screen 250 or by receiving it as a gift based on quiz results, point rankings, match results, etc. When the user places the obtained speaker 206 in the locker 201, audio is output when the locker room screen 140 is viewed.

[0119] For example, if a user places a speaker 206 in a locker 201, when the user is viewing the locker room screen 140 on the terminal device 5, the user can play and output audio or music. For example, a player's theme song can be played. Also, when other users are reporting on a game, the user can listen to the commentary and commentary.

[0120] The locker room screen 140 also displays user information 205. For example, the like icon, the number of likes, the comment icon, the number of comments, and an introduction about the user are displayed.

[0121] In this way, a unique locker room screen 140 is created for each user and placed in the virtual clubhouse. Therefore, a large number of virtual locker room screens 140 are created for a large number of users.

[0122] Each logged-in user can transition from the locker room screen 140, which is the user's own homepage, to another user's locker room screen 140 or a player's locker room screen 140 and view it.

[0123] Some of the items 203 arranged on the locker room screen 140 can also be used in game content. For example, if a player owns a special bat as the item 203, using the item 203 in a batting game can increase a batting ability parameter in the game content.

[0124] Key moment content will now be described. Fig. 7 shows an example of a key moment notification screen 121. This screen is displayed when, for example, a key moment occurs while a user is viewing the cheering screen 120 on the terminal device 5 while watching a game, and key moment content 300 (hereinafter abbreviated as "KM content 300") shown in Fig. 8 and other figures is generated.

[0125] It should be noted that key moment notification screen 121 may be displayed even if the current screen is a screen other than cheering screen 120. Alternatively, instead of displaying the entire screen, a notification may be given in a pop-up window or the like when a key moment occurs, and when the user transitions to cheering screen 120, key moment notification screen 121 as shown in Fig. 7 may be displayed. These notification modes are merely examples.

[0126] The key moment notification screen 121 displays a notification message 122, a close button 123, a view button 124, and the like. The notification message 122 informs the user that a key moment has been added, that is, that KM content 300 representing the key moment has been generated and is available for viewing. The user can choose whether or not to view the content. If the user does not want to view the content, the user can simply close the key moment notification screen 121 using the close button 123. If the user wants to view the content, the user operates the view button 124. This starts playback of the KM content 300 on the terminal device 5.

[0127] 8 and 9 show examples of KM content 300. These are examples in which the KM content 300 is image content that represents a target play of a key moment.

[0128] 8 shows KM content 300 generated with a home run as the target play when a certain player hits a home run and the home run is determined to be a key moment. This is CG content that displays, for example, the trajectory of the home run ball in the stadium, the ball's speed, the distance traveled, the date and time of the play, the inning, the name of the batter, etc. For example, a CG video of the ball tracing a trajectory and hitting the ball into the stands is conceivable.

[0129] 9 shows KM content 300 generated when a pitcher's strikeout scene is determined to be a key moment, with the strikeout pitch being used as the target play. The ball's trajectory, the batter's swing, and other elements are expressed as CG animation. In this example, a watch button 310 is also displayed. The watch button 310 is an operator that allows the user to indicate that they are watching the target play in this KM content 300.

[0130] The KM content representing such a target play as a key moment is generated, for example, by the calculation unit 21 of the main server 2 using the function of the item / content generation unit 45 based on data related to the target play in the match information. Furthermore, the calculation unit 21 can edit this KM content 300 by adding or changing the content using user information. For the sake of explanation, the KM content 300 that has been edited in this way will be referred to as the "edited KM content 300S."

[0131] For example, Fig. 10 shows an example of edited KM content 300S. This is an example of editing in which a spectator icon 301 is added to KM content 300 such as that shown in Fig. 8. For example, this is editing corresponding to a user situation in which the user is watching a game at a stadium, and is an example of an icon with the words "watched this" placed on a design resembling a fan-shaped baseball field. For example, the edited KM content 300S is provided to a user who is presumed to be at the stadium based on the location information in the user situation information, and is given a spectator icon 301 indicating that the user is actually watching the game at the stadium.

[0132] For example, such edited KM content 300S can be acquired by the user. For example, the user can collect it as electronic property on the game linkage service. In this case, a digital item is associated with the edited KM content 300S. For example, the calculation unit 21 generates an item 203A corresponding to the edited KM content 300S as shown in FIG. 11 . For example, the item 203A clearly indicates which edited KM content 300S it corresponds to for a target play, such as "X player's 12th home run." For example, the item 203A can be a moment ball, which indicates the details of the key moment along with the design of the ball, so that the user can understand what key moment it represents.

[0133] The calculation unit 21 associates the item 203A and the edited KM content 300S with the user, and makes them acquired by the user. The calculation unit 21 then enables the user to post the item 203A on the locker room screen 140, which is the home page, or on an item collection screen (not shown). The locker room screen 140 in Figure 6 shows an example in which the item 203A is placed in a locker 201.

[0134] The user can arbitrarily play back the edited KM content 300S acquired as the item 203A. For example, the user can view the edited KM content 300S as shown in Fig. 10 by operating the item 203A. This allows the user to recall the target play, and the spectator icon 301 allows the user to recall that he or she was at the venue watching the target play.

[0135] The edited KM content 300S may be edited in the same way for all users to whom the content is provided, or may be edited in common for users with a certain attribute.Furthermore, the edited KM content 300S may be edited uniquely for each individual user.

[0136] Alternatively, the edited KM content 300S may be viewed from the first viewing stage when the view button 124 in FIG. 7 is pressed, or the KM content 300 may be viewed first, and then the edited KM content 300S may be generated based on the user's reaction and situation, and the user may then be able to view the edited KM content 300S. After the KM content 300 is first viewed, conditions for providing the edited KM content 300S to the user may be set. For example, the edited KM content 300S may be provided to the user based on a predetermined operation performed by the user or the user's situation. Alternatively, the user may be able to obtain both the KM content 300 and the edited KM content 300S. Various procedures for providing the KM content 300 and the edited KM content 300S to the user are conceivable.

[0137] Further examples of edited KM content 300S are shown below. FIG. 12 shows an example in which a spectator icon 301 has been added, which is an example of a case in which a user is indirectly watching a game through a broadcast or distribution. For example, an example of an icon is a monitor screen design with the words "I watched this." For example, the spectator icon 301 indicating indirect spectatorship is added to edited KM content 300S provided to a user who is presumed to be outside the stadium based on location information in the user situation information.

[0138] The spectator icon 301 in Fig. 10 or 12 may be assigned to a user who has expressed their intention by operating, for example, the spectator button 310 as shown in Fig. 9. Furthermore, if a user who is watching the game directly at the stadium can be determined from GPS (Global Positioning System) information, beacon information, ticket information, or the like, the spectator icon 301 as shown in Fig. 10 may be added without any operation by the user, and for other users, the spectator icon 301 in Fig. 12 may be added by operating the spectator button 310.

[0139] 13 shows the edited KM content 300S to which a commemorative icon 302 based on user information has been added. For example, if the day of a game is the user's birthday, the commemorative icon 302 indicating the birthday is added. This allows the user to recall that the target play shown in the edited KM content 300S was a play on their birthday.

[0140] The commemorative icon 302 may be any icon that can be determined from user information and may correspond to information input by the user to the match linkage service. For example, if the user provides birthday information to the match linkage service, the commemorative icon 302 indicating the birthday can be added by referencing that information. In that sense, if the user information includes information about anniversaries for the user, such as a wedding anniversary or a child's birthday, a commemorative icon 302 corresponding to that information can be added.

[0141] 14 shows an example in which information about the user's location when watching a game is used as the commemorative icon 302. For example, if the viewing location is not a stadium, a commemorative icon 302 indicating viewing at home, viewing at a store such as a sports bar, viewing at a public viewing, etc. can be added. This allows the user to recall the location where the target play was viewed. Furthermore, when watching a game at a stadium, the viewing icon 301 may be an icon of the actual location, and the commemorative icon 302 may be added to indicate the seat location or seating area (e.g., behind the backstop, infield seats on the first base side, outfield seats on the left field side, etc.).

[0142] Up to this point, we have shown the edited KM content 300S to which the spectator icon 301 and the commemorative icon 302 have been added. However, the content of the KM content 300 itself may be edited to change it. For example, the KM content 300 shown in FIG. 8 is initially viewed, but when it is given to a user, it is edited to change the viewpoint. For example, the KM content 300 in FIG. 8 is a CG image taken from the viewpoint of the infield seats on the first base side. However, if the user is watching the game from the infield seats on the third base side, the edited KM content 300S may be a CG image with the viewpoint changed to the infield seats on the third base side, as shown in FIG. 15. Furthermore, if the player in the target play is a player the user is supporting, the edited KM content 300S may be a CG image taken from the viewpoint of that player.

[0143] 16 and 17 show examples of editing using user-specific information. For example, the user's avatar is used. FIG. 16 shows an example of edited KM content 300S in which a spectator icon 301 and an avatar 303 are added to KM content 300. FIG. 17 shows an example of editing the content of KM content 300, in which a CG image of a player is replaced with the user's avatar 303. In this way, it is possible to add user-specific information or change the image content using user-specific information. Such edited KM content 300S can be made user-specific.

[0144] 18 to 23 will be used to explain processing examples of the main server 2 for realizing processing related to the KM content 300 in the match linkage service. These processing examples are processing examples executed by the match linkage service function 40 in the calculation unit 21 of the main server 2 (FIG. 3), and in particular show processing related to the provision of content by the item / content generation unit 45.

[0145] The processing of this calculation unit 21 is processing executed by the CPU 71 when the information processing device 70 in Fig. 4 is configured as the main server 2. However, part of the processing may be executed on the terminal device 5 side. When the information processing device 70 in Fig. 4 is configured as the terminal device 5, the processing is executed by the CPU 71. Furthermore, the processing in Fig. 18 is executed for each terminal device 5 of a user logged in to the match linkage service.

[0146] In processing the KM content 300, the calculation unit 21 monitors the start of the match in step S101 of Fig. 18. Since the KM content 300 is generated in response to key moments in the match, the calculation unit 21 starts processing from step S102 onwards in response to the start of the match.

[0147] In step S102, the calculation unit 21 monitors the end of the match. If the match is still in progress, the process proceeds to step S103. In step S103, the calculation unit 21 performs a key moment determination. An example of the key moment determination process is shown in FIG. 19.

[0148] In the key moment determination, the calculation unit 21 acquires game progress information in step S150 and performs a play determination. That is, it determines what kind of play has occurred at the moment. For example, it recognizes the type of individual play, such as a strikeout, walk, hit, double, triple, home run, error, or stolen base, as well as the players involved in that play, in terms of pitching results and batting results.

[0149] In step S151, the calculation unit 21 determines whether the recognized play can be evaluated as a common key moment. A common key moment is a moment when a play occurs that can be generally evaluated as a moving or exciting moment, not limited to an individual user. On the other hand, individual key moments, which will be described later, are key moments determined for each individual user according to the user's attributes.

[0150] Common key moments may be set, for example, as scoring plays, home runs, strikeouts, memorable plays such as achieving 2,000 hits, fine plays, triple plays, etc. Alternatively, in step S150, not only game progress information but also information regarding the cheers of the spectators in the stadium (volume of cheers, sound of applause, etc.) may be input, and the calculation unit 21 may use the sounds of plays to determine common key moments.

[0151] If it is determined that a common key moment has occurred, the calculation unit 21 proceeds to step S154 and determines that a key moment has occurred that targets all users logged in to the match linkage service.

[0152] If it is not determined to be a common key moment, the calculation unit 21 proceeds to step S152 to check the user information of the user being processed. For example, the calculation unit 21 determines the user's favorite team and favorite player. Then, in step S153, the calculation unit 21 determines whether an individual key moment has occurred for the user being processed.

[0153] For example, if there is user information indicating that a user is rooting for player A, then all of player A's at-bats may be considered individual key moments for that user. Similarly, if a user is a fan of baseball team X, a scoring play or a winning play for baseball team X may be considered an individual key moment for that user. If such an individual key moment can be determined, calculation unit 21 proceeds to step S155 and determines that a key moment has occurred for the user being processed.

[0154] If it is determined that the immediately preceding play is neither a common key moment nor an individual key moment, the calculation unit 21 ends the process from step S153 to FIG. 19, that is, the process of step S103 in FIG.

[0155] If it is determined through the above key moment determination that a key moment has not occurred, the calculation unit 21 returns from step S104 to step S102 in Fig. 18. If it is determined through the key moment determination that a key moment has occurred, the calculation unit 21 proceeds from step S104 to step S105, and performs processing to generate KM content 300. For example, the calculation unit 21 creates a CG image according to the content of the target play determined to be a key moment. Note that at this time, the calculation unit 21 may generate one type of KM content 300 common to all users for the target play, or may generate multiple types of KM content 300 for the target play for each user or user group.

[0156] In step S106, the calculation unit 21 notifies the terminal device 5 of the user to be processed that the KM content 300 is available for viewing. For example, the calculation unit 21 controls the terminal device 5 to display the key moment notification screen 121 shown in Fig. 7. In the case of a common key moment, all logged-in users are notified, and in the case of an individual key moment, the relevant logged-in users are notified.

[0157] A user viewing the key moment notification screen 121 can select whether or not to view the KM content 300 by pressing the view button 124. If the user does not operate the view button 124, for example, if the user operates the close button 123, the calculation unit 21 returns from step S107 to step S102.

[0158] If the user operates the watch button 124, the calculation unit 21 proceeds to step S108 and determines whether the user to be processed is a local user. If the user is a local user, i.e., a user watching the game at the stadium, the calculation unit 21 proceeds to step S109 and causes the terminal device 5 to play back the KM content 300 as shown in Figure 8. In this case, it can be assumed that the user is watching the game in person, so the watch button 310 as shown in Figure 9 is not displayed.

[0159] If it is determined from the user's location information that the user is not a local user, the calculation unit 21 proceeds to step S110 and executes playback of the KM content 300. In this case, since it is unclear whether the user is watching the game or not, a watch button 310 as shown in FIG.

[0160] If the user operates the watch button 310 within a predetermined time after the KM content 300 is played in step S109 or after the KM content 300 is played in step S110, the calculation unit 21 proceeds to step S120. This is the case where it can be assumed that the user was watching a key moment. In this case, the KM content 300 is presented to the user as a memento of the fact that the user was present at the target play (witnessed it directly or indirectly) and watched the KM content 300. Specifically, the calculation unit 21 generates edited KM content 300S to be presented to the user depending on the user's situation.

[0161] An example of the process for generating edited KM content 300S will be described with reference to Figures 20 to 23. Figure 20 shows an example of adding a spectator icon 301 as in Figure 10. In step S201, the calculation unit 21 sets the spectator icon 301 according to the user's spectator behavior. That is, it determines whether the user is watching the game in person at the stadium or indirectly by watching a broadcast or the like. Depending on the determination, the spectator icon 301 as in Figure 10 or the spectator icon 301 as in Figure 12 is set.

[0162] In step S202, the calculation unit 21 performs processing to add the spectator icon 301 to the KM content 300, and creates the edited KM content 300S.

[0163] FIG. 21 shows an example in which the content details are also changed, as in FIG. 15. In step S201, the calculation unit 21 sets a spectator icon 301 according to the user's spectator behavior. In step S210, the calculation unit 21 changes the content details according to user information. For example, information on the user's seat position and seat area is acquired, and the user's viewpoint position is determined accordingly. The image content of the KM content 300 is then changed to an image from the user's viewpoint position. Alternatively, if the user is a fan of a player involved in the play, it is possible to change the image to one featuring that player, or to one that shows the play as seen from that player's viewpoint.

[0164] In step S202, the calculation unit 21 performs processing to add a spectator icon 301 to the KM content 300 whose contents have been changed, and creates the edited KM content 300S.

[0165] Figure 22 shows an example of adding a commemorative icon 302 like those in Figures 13 and 14. In step S201, the calculation unit 21 sets a spectator icon 301 according to the user's viewing style. In step S220, the calculation unit 21 checks the user information and sets a commemorative icon 302. For example, a commemorative icon 302 based on a date and time such as a birthday, or a commemorative icon 302 based on a location such as a viewing location, may be set. Depending on the user information, no particular commemorative icon 302 may be set. In step S202, the calculation unit 21 performs a process of adding the spectator icon 301 and the commemorative icon 302 to the KM content 300, and this becomes the edited KM content 300S.

[0166] Figure 23 is an example in which an avatar is used, as in Figures 16 and 17. In step S201, the calculation unit 21 sets a spectator icon 301 according to the user's spectator style. In step S230, the calculation unit 21 modifies the KM content 300 using the user's avatar. For example, editing is performed by adding an avatar 303 or using the avatar 303 as the image content of the KM content 300. In step S202, the calculation unit 21 performs processing to add a spectator icon 301 to the KM content 300 modified using the avatar, and this is set as edited KM content 300S.

[0167] The calculation unit 21 performs the processes shown in Figures 20 to 23 in step S120 of Figure 18. In step S121, the calculation unit 21 sets the item 203A corresponding to the edited KM content 300S.

[0168] The calculation unit 21 performs the above-described processes from step S103 to step S121 for each user during the match. Therefore, every time a key moment occurs during the match, the KM content 300 is provided, and edited KM content 300S to be presented to the user is generated in response to the user's viewing, etc.

[0169] When the end of the match is detected, the calculation unit 21 proceeds from step S102 to step S125, and performs a process of granting the edited KM content 300S and the item 203A to the user. This allows the user to obtain the item 203A and the edited KM content 300S related to the play of the key moment that the user witnessed as a spectator. The user can place the obtained item 203A on the locker room screen 140 or check it on a collection screen (not shown) or the like.

[0170] 24 shows an example of processing in response to an operation on item 203A. When an operation on item 203A is detected, the calculation unit 21 proceeds from step S301 to step S302, where it identifies the edited KM content 300S corresponding to the user's operation. Then, in step S303, the calculation unit 21 performs playback processing to play the edited KM content 300S on the terminal device 5 of the user who performed the operation. This allows the user to view the acquired edited KM content 300S at their discretion.

[0171] 4. Summary and Modifications The above embodiment provides the following effects.

[0172] The information processing device 70 serving as the main server 2 of the embodiment includes a calculation unit 21 that performs the following operations: a determination process for determining whether a target play for which KM content is to be generated has occurred during a competitive match based on match information, which is information about the match; a generation process for generating KM content 300 related to the target play in response to the determination of the occurrence of the target play; and an editing process for generating edited KM content 300S by editing the KM content 300 based on user information related to the user to whom the service is provided. This allows users to view the KM content 300 related to a play determined to be a key moment. Furthermore, users can obtain edited KM content 300S to which additional content has been added or modified, such as the addition of a spectator icon 301. In other words, users can obtain edited KM content 300S that shows the key moment and the user's situation at the time. This allows users to obtain memorable edited KM content 300S that reflects their own situation as well as the details of the play that moved or excited them during the match, providing users with a new way to enjoy watching a match. The determination process, generation process, and editing process may be shared and performed by a plurality of information processing devices.

[0173] In the embodiment, an example has been described in which, upon determining that a target play has occurred, the calculation unit 21 generates KM content 300 related to the target play based on game information and notifies the service-provided terminal device 5 that the content is available for viewing (see step S106 in FIGS. 7 and 18 ). This allows the user to learn of the existence of KM content 300 during or after the game when KM content 300 related to a play determined to be a key moment is generated and view the KM content 300. For example, the user receives a notification immediately after a key moment, learns of the existence of KM content 300 for that play, and can enjoy the content about the special moment they were watching just before.

[0174] In the embodiment, an example has been given in which the calculation unit 21 generates an item 203A corresponding to edited KM content 300S to which content has been added or changed based on user information about the user to whom the service is provided, and then associates the edited KM content 300S and the item 203A with the user (see step S125 in FIG. 18 ). This allows the user to acquire the edited KM content 300S and the item 203A. For example, the user can acquire a one-of-a-kind edited KM content 300S and item 203A that expresses the user's situation and key moments, and use them as mementos of a game they watched.

[0175] In the embodiment, an example has been given in which the calculation unit 21 performs processing to play back the edited KM content 300S in response to an operation on the item 203A (see FIG. 24). For example, by performing an operation to designate the item 203A, the edited KM content 300S corresponding to that item 203A is played back on the terminal device 5. This allows a user who has acquired the edited KM content 300S and the item 203A to view the edited KM content 300S at any time and recall key moments from a match or their own situation.

[0176] In the embodiment, the calculation unit 21 generates KM content 300 representing the movement of a person (player or umpire) or a playing object related to the target play in the KM content 300 generation process. For example, human movement related to the target play can be a player's pitching form, batting form, base running, or an umpire's gestures. A possible example of the movement of a playing object is the trajectory of a ball or other object. The calculation unit 21 generates KM content 300 as CG animation representing the movement of the player, ball, or other object based on tracking data. Alternatively, the calculation unit 21 can generate KM content 300 as a video, still image, slideshow, or the like using captured images of the movement. Furthermore, KM content 300 can be generated by combining captured images and CG. This allows the user to be provided with KM content 300 that dynamically represents the target play. If an animal participates in a game, such as a horse in a horse race, content representing the animal's movement can be generated.

[0177] In the embodiment, an example was given in which the calculation unit 21 performs editing processing on the KM content 300 to add an image to the content that indicates that the user was watching the target play. For example, for a user watching a game at a stadium or via television broadcast or network streaming, a spectator icon 301 indicating that the user was watching the play is added to the KM content 300. This allows the user to recognize that the play was one that they watched in real time when viewing the edited KM content 300S later. Furthermore, owning the edited KM content 300S serves as a memento and proof of the fact that the user witnessed a memorable play, making it valuable digital content for the user.

[0178] In the embodiment, an example has been given in which the calculation unit 21 performs editing processing on the KM content 300 to add an image indicating whether the user is watching the game directly or indirectly, as an image representing that the user is watching the target play (see FIGS. 10 and 12 ). For example, a spectator icon 301 with a different design is added to the KM content 300 for a user who is watching the game directly at the stadium and a user who is watching the game indirectly via television broadcasting, network streaming, or the like. In this way, the edited KM content 300S can be a record of the spectator style in which the user watched the game.

[0179] In the embodiment, an example has been given in which the calculation unit 21 performs editing on the KM content 300, adding an image to the content to indicate that the user was watching a target play based on the user's location information or in response to the user performing a predetermined operation related to the content (see FIG. 9 ). For example, if it is possible to estimate from the user's location information that the user was in the stadium when the target play occurred, or if the user indicates their intention to watch the game by pressing the watch button 310 on the content, the spectator icon 301 is added to the KM content 300. This makes it possible to generate edited KM content 300S that indicates that the user was watching the game.

[0180] In the embodiment, an example was given in which the calculation unit 21 performs editing processing on the KM content 300, adding to the content an image representing user information related to the date and time of occurrence of the target play based on user information (see FIG. 13 ). For example, if the day the target play occurred was the user's birthday, a commemorative icon 302 indicating that it was the birthday is added to the KM content 300. This allows the edited KM content 300S to record the date and time the user witnessed the target play. For example, it can also evoke memories of watching a game for the user. If various anniversaries, such as a wedding anniversary or a child's birthday, can be determined as user information related to the date and time of occurrence of the target play, it is also possible to add commemorative icons 302 corresponding to those anniversaries or the time of the commemoration.

[0181] In the embodiment, an example was given in which the calculation unit 21 performs editing processing on the KM content 300, adding an image representing the viewing location of the target play to the content based on user information (see FIG. 14 ). A spectator icon 301 indicating where the user was watching the game when the target play occurred is added to the KM content 300. For example, if the game was being watched at a stadium, an image indicating the seat position, seating area, etc. is added. Even in the case of watching a game via broadcast or streaming, an image representing, for example, watching the game at home, watching the game at a public viewing, or watching the game at a specific establishment such as a sports bar is added. In this way, the edited KM content 300S can record where the user was watching the game. For example, it can also evoke memories of watching the game for the user.

[0182] In the embodiment, an example has been given in which the calculation unit 21 performs editing processing on the KM content 300 to add an image representing the user to the content (see FIG. 16 ). For example, the user's avatar 303, a photographic image, or the like is added to the KM content 300. This makes the edited KM content 300S unique, including the user's own image, thereby increasing its value to the user.

[0183] In the embodiment, an example has been given in which the calculation unit 21 performs editing processing on the KM content 300 to change the content based on information about the user's viewing location (see FIG. 15 ). For example, edited KM content 300S is generated by changing an image of a play in the KM content 300 so that the viewpoint is set according to the user's seat position. This allows the user to save a play that they actually witnessed as edited KM content 300S with an image from the same viewpoint.

[0184] In the embodiment, an example has been given in which the calculation unit 21 performs editing processing on the KM content 300 to change the content so as to replace images of players in an image representing a target play with images representing the user himself / herself (see FIG. 17 ). For example, an image of a player in a play in the KM content 300 is replaced with the user's avatar 303. This allows the user to obtain edited KM content 300S that makes it appear as if the user is participating in the play.

[0185] It should be noted that the various editing processes described in the embodiments can be combined. For example, content changes based on the viewpoint position of the KM content 300, addition of the spectator icon 301, addition of the commemorative icon 302, addition of the avatar 303, and content changes based on the avatar may all be performed, or some of these may be combined. It is also conceivable to add multiple types of commemorative icons 302, or to add a user-specific icon. Content changes are not limited to viewpoint changes and avatar changes, and the representation of the play itself may also be changed to a different one.

[0186] In the embodiment, an example was given in which the calculation unit 21 determines a specific type of play, determined based on game information, as a target play in the key moment determination process (see step S103 in FIG. 18 and FIG. 19). For example, the type of target play that triggers the generation of KM content 300 is set in advance depending on the sport. In baseball, for example, specific types of plays include home runs, RBI hits, stolen bases, other scoring plays, strikeouts, double plays, triple plays, and fine plays. The calculation unit 21 then generates KM content 300 by detecting these plays from game progress information. This makes it possible to appropriately detect key moments and generate KM content 300.

[0187] In the embodiment, the calculation unit 21 determines the occurrence of a target play based on game information and user information in the key moment determination process (see FIG. 19 ). For example, the user information may include a specific player or team that the user supports. Then, when a play by that player is detected from the game progress information, it is determined to be the target play, or when a specific type of play by the user's supported team is detected, it is determined to be the target play. This allows the user to identify personal key moments and generate KM content 300 (300S) accordingly. The edited KM content 300S will be filled with even more memories of the user's game experience.

[0188] In the embodiment, an example was given in which the game content sets the movement of a ball in a game space based on tracking data of the ball in a baseball or softball game. The movement of the ball in the game content is expressed based on tracking data of the ball as pitched by the pitcher, tracking data of a batted ball, etc. This makes it possible to provide game content that allows the user to experience the ball in baseball or softball.

[0189] Although the game coordination service has been explained using the example of linking with a baseball game, the game coordination service can be applied to a variety of sports. Examples include soccer, American football, rugby, basketball, volleyball, tennis, and golf. Ball games are particularly suitable for sports that use the EPTS system. Of course, the service can also be used for sports other than ball games. For example, it can be used for gymnastics, skating, track and field, swimming, judo, kendo, boxing, fencing, and so on.

[0190] The judgment of a play as a key moment, the content of the KM content 300, the edited KM content 300S, and the content of the item 203A are considered depending on the sport. In soccer, it is expected that a goal scene or a free kick scene will be considered as a key moment. Possible items 203A include a soccer ball for soccer, boxing gloves for boxing, and a racket for tennis. Match information is also considered for each sport.

[0191] As for match information, an example of baseball stats data was given, but of course it differs depending on the sport. For soccer, stats data includes the following: - Number of goals: Number of goals scored during the season - Number of shots: Number of shots taken - Number of shots on target: Number of shots taken inside the goal - Number of final passes: Number of passes that resulted in goal chances - Number of one-touch passes: Number of passes made with one touch - Number of aerial duels: Number of contests for the ball in the air - Number of tackles: Number of attempts to retrieve the ball from the ball holder - Distance traveled: Distance traveled during the match for each player

[0192] In the case of soccer, examples of key moments include goals, corner kicks, free kicks, penalty kicks, and saves by the goalkeeper, as well as contact plays.

[0193] Although the embodiment has been described mainly as processing by the calculation unit 21 of the main server 2, all or part of the processing by the calculation unit 21 may be executed by the CPU of the terminal device 5. For example, the match linkage service function 40 of the calculation unit 21 may be installed as an application program on the terminal device 5, and processing by the item / content generation unit 45, locker processing unit 47, game processing unit 48, etc. shown in FIG. 3 may be performed on the terminal device 5. The terminal device 5 may also be equipped with other functions, such as the match information acquisition unit 41, user information acquisition unit 42, match analysis unit 43, quiz generation unit 44, and memory control unit 46, and processing by these functions may be performed on the terminal device 5.

[0194] 18 to 24 is executed by, for example, a CPU, a DSP (digital signal processor), an AI processor, or an information processing device 70 including any of these. That is, the program of the embodiment is a program that causes an information processing device to execute a determination process of determining whether a target play for which KM content 300 is to be generated has occurred during a competitive match, based on match information, which is information about the match; a generation process of generating KM content 300 related to the target play in accordance with the determination of the occurrence of the target play; and an editing process of generating edited KM content 300S by adding or changing content to the KM content based on user information about the user to whom the service is provided.

[0195] By using such a program, the information processing device 70 constituting the information providing system 1 of the embodiment can be realized in, for example, a computer device, a mobile terminal device, or other device capable of executing information processing.

[0196] Such a program can be pre-recorded on a hard disk drive (HDD) as a recording medium built into a computer or other device, or on a ROM within a microcomputer having a CPU. Alternatively, the program can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disc, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. Such removable recording media can be provided as so-called packaged software. Furthermore, such a program can be installed on a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0197] Furthermore, such a program is suitable for a wide range of use as the information processing device 70 constituting the information provision system 1 of the embodiment. For example, by downloading the program to a mobile terminal device such as a smartphone or tablet, an imaging device, a mobile phone, a personal computer, a game device, a video device, a PDA (Personal Digital Assistant), or the like, these devices can function as the information processing device 70 constituting the information provision system 1 of the present disclosure.

[0198] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0199] The present technology may also be configured as follows. (1) An information processing device including a calculation unit that performs the following: a determination process for determining whether a target play for which content is to be generated has occurred during a competitive match, based on match information that is information related to the match; a generation process for generating content related to the target play in response to the determination of the occurrence of the target play; and an editing process for generating edited content by editing the content based on user information related to a user at a service destination. (2) The information processing device described in (1) above, wherein the calculation unit generates content related to the target play based on match information in response to determining that the target play has occurred, and notifies a service destination device that the content is available for viewing. (3) The information processing device described in (1) or (2) above, wherein the calculation unit generates a digital item corresponding to edited content with added or changed content based on user information related to the user at a service destination, and associates the edited content and the digital item with the user. (4) The information processing device described in (3) above, wherein the calculation unit performs a process for playing the edited content in response to an operation of the digital item. (5) The information processing device according to any one of (1) to (4) above, wherein the calculation unit, in the generation process, generates content that represents the movement of a person, animal, or playing object related to the target play. (6) The information processing device according to any one of (1) to (5) above, wherein the calculation unit, in the editing process, performs editing to add to the content an image that represents that the user was watching the target play. (7) The information processing device according to any one of (1) to (6) above, wherein the calculation unit, in the editing process, performs editing to add to the content an image that represents that the user was watching the target play, an image that represents that the user was watching the target play, the image indicating whether the user was watching directly or indirectly.(8) The information processing device according to any one of (1) to (7) above, wherein the calculation unit performs editing in the editing process to add to the content an image representing that the user was watching the target play, based on location information of the user or in response to the user performing a predetermined operation related to the content. (9) The information processing device according to any one of (1) to (8) above, wherein the calculation unit performs editing in the editing process to add to the content an image representing user information related to a date and time when the target play occurred, based on user information. (10) The information processing device according to any one of (1) to (9) above, wherein the calculation unit performs editing in the editing process to add to the content an image representing a location where the target play was watched, based on user information. (11) The information processing device according to any one of (1) to (10) above, wherein the calculation unit performs editing in the editing process to add to the content an image representing the user themselves. (12) The information processing device according to any one of (1) to (11) above, wherein the calculation unit performs editing in the editing process to change content details, based on information about the user's viewing location. (13) The information processing device according to any of (1) to (12), wherein the calculation unit, in the editing process, edits content to change the content so as to replace an image of a player in an image representing a target play with an image representing the user himself / herself. (14) The information processing device according to any of (1) to (13), wherein the calculation unit, in the determination process, determines a specific type of play determined based on match information to be the target play. (15) The information processing device according to any of (1) to (14), wherein the calculation unit, in the determination process, determines the occurrence of the target play based on match information and user information.(16) An information processing method in which an information processing device performs the following processes: a determination process for determining whether a target play for which content is to be generated has occurred during a competitive match, based on match information that is information about the match, a generation process for generating content related to the target play in response to the determination of the occurrence of the target play, and an editing process for generating edited content by editing the content based on user information related to a user to whom the service is to be provided. (17) A program that causes an information processing device to perform the following processes: a determination process for determining whether a target play for which content is to be generated has occurred during a competitive match, based on match information that is information about the match, a generation process for generating content related to the target play in response to the determination of the occurrence of the target play, and an editing process for generating edited content by editing the content based on user information related to a user to whom the service is to be provided.

[0200] REFERENCE SIGNS LIST 1 Information provision system 2 Main server 3 Score data server 5 Terminal device 10 Imaging device 21 Calculation unit 22 Presentation control unit 45 Item / content generation unit 45a Determination unit 45b Generation / editing unit 45c Provision processing unit 70 Information processing device 71 CPU 203, 203A Item 300 Key moment content (KM content) 300S Edited key moment content (edited KM content) 301 Watching icon 302 Commemorative icon 303 Avatar 310 Watching button

Claims

1. An information processing device having a calculation unit that performs the following steps: a determination process for determining whether or not a target play for which content is to be generated has occurred during a competitive match, based on match information, which is information related to the match; a generation process for generating content related to the target play in accordance with the determination that the target play has occurred; and an editing process for generating edited content by editing the content, based on user information related to a user to whom the service is provided.

2. The information processing device according to claim 1, wherein the calculation unit, in response to determining that the target play has occurred, generates content relating to the target play based on match information and notifies the service destination device that the content can be viewed.

3. The information processing device according to claim 1, wherein the calculation unit generates a digital item corresponding to edited content to which content has been added or changed based on user information relating to the user to whom the service is provided, and performs processing to associate the edited content and the digital item with the user.

4. The information processing device according to claim 3, wherein the calculation unit performs processing for playing the edited content in response to an operation on the digital item.

5. The information processing device according to claim 1, wherein the calculation unit generates content expressing the movement of a person, animal, or playing object related to the target play in the generation process.

6. The information processing device according to claim 1, wherein the calculation unit performs editing in the editing process to add an image to the content that represents that the user was watching the target play.

7. The information processing device according to claim 1, wherein the calculation unit performs editing in the editing process to add an image to the content indicating whether the user was watching the target play directly or indirectly, as an image representing that the user was watching the target play.

8. The information processing device of claim 1, wherein the calculation unit, in the editing process, performs editing to add an image to the content representing that the user was watching a target play based on the user's location information or in response to the user performing a specified operation related to the content.

9. The information processing device according to claim 1, wherein the calculation unit performs editing in the editing process to add an image expressing user information related to the date and time of occurrence of a target play to the content based on user information.

10. The information processing device according to claim 1, wherein the calculation unit performs editing in the editing process to add an image representing a viewing location of a target play to the content based on user information.

11. The information processing device according to claim 1, wherein the calculation unit performs editing in the editing process to add an image representing the user to the content.

12. The information processing device according to claim 1, wherein the calculation unit performs editing to change the content based on information about the user's viewing location in the editing process.

13. The information processing device according to claim 1, wherein the calculation unit, in the editing process, performs editing to change the content so as to replace an image of a player in an image representing a target play with an image representing the user himself / herself.

14. The information processing device according to claim 1, wherein the calculation unit, in the determination process, determines a specific type of play determined based on match information as the target play.

15. The information processing device according to claim 1, wherein the calculation unit, in the determination process, determines the occurrence of the target play based on match information and user information.

16. An information processing method in which an information processing device performs a determination process to determine whether a target play for which content is to be generated has occurred during a competitive match based on match information, which is information related to the match; a generation process to generate content related to the target play in accordance with the determination that the target play has occurred; and an editing process to generate edited content by editing the content based on user information related to the user to whom the service is provided.

17. A program that causes an information processing device to execute the following steps: a determination process that determines whether a target play for which content is to be generated has occurred during a competitive match, based on match information, which is information related to the match; a generation process that generates content related to the target play in accordance with the determination that the target play has occurred; and an editing process that generates edited content by editing the content based on user information related to the user to whom the service is provided.

Images