Information processing system, program, and information processing method
By controlling the player's avatar and scene playback in the virtual space, combined with the interactive quiz function, the problem of difficulty in improving the user experience of multi-player events in the existing technology is solved, and a more dynamic and interactive user experience is achieved.
Patent Information
- Application Number
- JP2024134916
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-20
- Filing Date
- 2024-08-13
- Publication Date
- 2025-05-02
AI Technical Summary
The prior art is difficult to improve the user experience of multi-player participation events through sports data.
An information processing system is designed to provide an interactive quiz experience by controlling units to display the player avatar in the virtual space and control scene playback, option presentation and answer evaluation.
Through dynamic virtual space experience and interactive quiz functions, the user experience is enhanced and the utilization value of sports data is enhanced.
Smart Images

Figure 2025070965000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information processing system, a program, and an information processing method. [Background technology]
[0002] In recent years, a technology for displaying content generated based on motion data such as skeletal information has become known. For example, Patent Document 1 discloses a technology for generating a bone model of a character based on information obtained by tracking the user's body, and displaying an image of the character based on the bone model. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2020 / 174586 Summary of the Invention [Problem to be solved by the invention]
[0004] Here, in an event held by multiple players, motion data of each player is acquired, and the motion data is used to move the player's character made of 3DCG (3-Dimensional Computer Graphics), and an image that can be viewed from any viewpoint is generated. It is desirable to further improve the user experience by utilizing such motion data.
[0005] Therefore, the present disclosure proposes a new and improved technology that can provide a new user experience using the motion data of each player. [Means for solving the problem]
[0006] According to the present disclosure, an information processing system is provided that includes a control unit that controls the display of a player avatar in a virtual space corresponding to a player participating in an event, the player avatar being generated based on motion data of the player, and the control unit performs the following processes: controlling the playback of a scene of a specific situation of the event in the virtual space; presenting a plurality of options related to the specific situation; and presenting the correctness or incorrectness of an answer selected from the plurality of options.
[0007] Furthermore, according to the present disclosure, there is provided an information processing system including a control unit that performs the following processes: displaying a screen for generating a quiz using player avatars corresponding to one or more players in a virtual space, the quiz being generated based on motion data of the one or more players obtained from event information; and setting, on the screen, a scene of a specific situation in the event and a plurality of options including correct and incorrect options relating to the specific situation.
[0008] Furthermore, according to the present disclosure, a program is provided that causes a computer to function as a control unit that controls the display of a player avatar in a virtual space that corresponds to a player participating in an event, the player avatar being generated based on motion data of the player, and the control unit performs the following processes: controlling the playback of a scene of a specific situation of the event in the virtual space; presenting a plurality of options related to the specific situation; and presenting the correctness or incorrectness of an answer selected from the plurality of options.
[0009] Furthermore, according to the present disclosure, an information processing method is provided, including: a processor controlling display of a player avatar in a virtual space corresponding to a player participating in an event, the player avatar being generated based on motion data of the player; controlling playback of a scene of a specific situation of the event in the virtual space; presenting a plurality of options relating to the specific situation; and presenting correct or incorrect an answer selected from the plurality of options. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram for explaining the overall configuration of a quiz question setting system 1 according to an embodiment of the present disclosure. [Diagram 2] 2 is a diagram for explaining information managed by the server 10. FIG. [Diagram 3] 1 is a block diagram showing an example of a configuration of a server 10 according to the present embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of a configuration of an operator terminal 20 according to the present embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of a display screen for editing a quiz scene, which is displayed on the operation display unit 220. [Figure 6] FIG. 13 is a diagram showing an example of a selection screen for selecting a correct answer option displayed on the operation display unit 220. [Figure 7] 13 is a diagram showing an example of a display screen of a quiz question scene drawn in accordance with quiz metadata 133. FIG. [Figure 8] 3 is a sequence diagram showing an example of the flow of operational processing of the quiz question setting system 1 according to the present embodiment. FIG. [Figure 9] FIG. 11 is a flow diagram showing an example of the flow of a process for generating quiz metadata 133 by the operator terminal 20 according to this embodiment. [Figure 10] 10 is a flow diagram showing an example of the flow of a quiz video playback process by the user terminal 30 according to this embodiment. FIG. [Figure 11] FIG. 13 is a diagram showing an example of a display screen of a quiz video. [Figure 12] 1 is a block diagram showing an example of a hardware configuration of an information processing device 900 that realizes a server 10, an operator terminal 20, and a user terminal 30 according to an embodiment of the present disclosure. [Figure 13] FIG. 2 is a block diagram showing an example of the configuration of a user terminal 30 according to the present embodiment. [Figure 14] 1A to 1C are diagrams showing an example of a quiz object placed in a virtual space according to the present embodiment. [Figure 15]13 is a diagram showing an example of a display screen when a quiz for answering a shooting course is given according to the present embodiment. FIG. [Figure 16] 13A to 13C are diagrams showing an example of a correct / incorrect display of a quiz for answering a shooting course according to the present embodiment. [Figure 17] 13 is a diagram showing an example of a display screen when a quiz for answering the next action is given according to the present embodiment. FIG. [Figure 18] FIG. 11 is a diagram showing an example of a quiz creation screen according to the present embodiment. [Figure 19] 10 is a flowchart showing an example of the flow of an operational process of quiz question setting control according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.
[0012] <1. Overview> An embodiment of the present disclosure relates to a quiz system that asks a quiz about a player participating in an event as a new user experience utilizing the motion data of the player. The event is not particularly limited as long as it is an event performed by one or more players. A player is a person who participates in the event. For example, the event may be a sports match. The type of sport is not particularly limited, and may be, for example, a sport performed using a spherical object such as a ball, such as soccer, baseball, badminton, or curling. In addition, the type of sport may be sprinting, long-distance running, swimming, speed skating, judo, artistic swimming, or the like. When the event is a sport, the player may be an athlete who performs the sport, or a spectator who comes to watch the event.
[0013] Furthermore, the event may be a music, dance, or drama competition. In this case, the player is a person who participates in the competition, such as a person who sings, a person who plays an instrument, a person who dances, or a person who performs. In addition, the "player who participates in the event" broadly includes people involved in the event. For example, a referee who judges a sports match, an assistant, a judge of the competition, an accompanist, an audience, etc. may be assumed. Note that the event does not have to be performed by a person, and may be, for example, a show in which animals such as dogs or robots participate as players. In addition, the number of players who participate is not particularly limited, and may be one or more. In this embodiment, an example in which the event is a soccer match performed by multiple players will be mainly described.
[0014] First, the overall configuration of a quiz question setting system 1 according to an embodiment of the present disclosure will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining the overall configuration of a quiz question setting system 1 according to an embodiment of the present disclosure.
[0015] As shown in Fig. 1, a quiz question setting system 1 according to an embodiment of the present disclosure includes a server 10, an operator terminal 20, a user terminal 30, and a network 40. As shown in Fig. 1, the server 10, the operator terminal 20, and the user terminal 30 are configured to be able to communicate with each other via the network 40.
[0016] (Server 10) The server 10 has a function of managing information related to quiz questions. The information managed by the server 10 will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining the information managed by the server 10.
[0017] 2, the server 10 manages event information 131, highlight scene metadata 132, and quiz metadata 133. The information managed by the server 10 is exchanged with the operator terminal 20 and the user terminal 30 via the network 40.
[0018] The event information 131 includes skeleton information of each of the multiple players participating in the event. In this embodiment, the event information 131 includes motion data of each player participating in the match that changes over time. The event information 131 also includes position information of each player participating in the match that changes over time.
[0019] The motion data of each player is information that represents the time series changes in the movement of each player. The motion data of each player may be, for example, skeletal information of each player. The skeletal information of each player is, for example, three-dimensional position information of each joint position of each player (athlete) obtained by analyzing captured images obtained from a large number of cameras installed at a match venue in real space. In this embodiment, an example in which the motion data is skeletal information will be mainly described, but the motion data is not particularly limited as long as it represents the time series changes in the movement of each player, and may be, for example, data obtained by detecting the acceleration of each part of the player's hands, feet, etc.
[0020] The event information 131 includes three-dimensional position information of each joint position of each player that changes over time, obtained by tracking the movement of each player during the game. The event information 131 may also include profile information of multiple players participating in the game. The profile information may be, for example, the name and uniform number of each player.
[0021] Furthermore, the event information 131 according to the present embodiment includes ball information including position information of a ball used in a match that changes over time during the match. The ball position information is also obtained, for example, by analyzing captured images obtained from a number of cameras installed at the match venue. The ball position information may also be obtained based on the analysis results of the captured images and sensing data from an IMU (Inertial Measurement Unit) sensor mounted on the ball. The server 10 may generate the event information 131 of each match held in real space by analyzing video of the actual match obtained from outside, or may obtain the information from outside.
[0022] Such event information 131 is output from the server 10 to the operator terminal 20 and the user terminal 30, respectively. The event information 131 may be output in streaming format to the operator terminal 20 and the user terminal 30, respectively. The operator terminal 20 and the user terminal 30 render and display a replay video replaying the state of the match based on the received event information 131. Note that the operator terminal 20 and the user terminal 30 may receive the replay video generated by the server 10 from the server 10 and display it.
[0023] In the re-enacted video, each player (athlete) may be re-enacted as a character. In this case, each player may be drawn so that the face, hairstyle, physique, skin color, etc. of the player resembles the actual player. Furthermore, the clothing worn by the player during the game may be re-enacted as the clothing worn by the character re-enacted for each player. For example, the uniform with the number printed on it worn by each player during the game may be re-enacted as the clothing worn by the character re-enacted for each player.
[0024] The reproduced image may be an image of a virtual space. For example, a virtual space that reproduces a game venue may be constructed in the server 10, and a character (3D model) resembling each player may be moved based on the skeletal information of each player included in the event information 131, and an image of a virtual camera may be acquired as the reproduced image. The user terminal 30 may acquire information for reproducing the virtual space from the server 10 and generate a similar virtual space. In the generated virtual space (game venue), the user terminal 30 may move the character of each player at any time based on the event information 131 streamed from the server 10, and draw and display the reproduced image. The virtual space may also be a metaverse in which many users can participate.
[0025] The server 10 extracts highlight scene metadata 132 indicating highlight scenes in a match from the event information 131. A highlight scene is a scene that is worth watching in a match, in other words, a scene that attracts the user's attention. For example, highlight scenes may include goal scenes, counterattack scenes, save scenes, pass interception scenes, and warning scenes. Highlight scenes may be automatically determined or may be arbitrarily set manually. In this embodiment, highlight scenes are candidates for quiz question scenes.
[0026] The highlight scene metadata 132 includes time information indicating the highlight scene. The time information indicating the highlight scene may include, for example, the start time and duration of the highlight scene in the match. In addition to these, or instead of the duration of the highlight scene, the end time of the highlight scene may also be included.
[0027] The quiz metadata 133 is metadata related to the quiz question, which is created on the operator terminal 20 based on the operation by the operator O. The quiz metadata 133 is output from the operator terminal 20 to the server 10. In this embodiment, the quiz may be a multiple-choice quiz in which one player participating in the game is the correct answer. For example, the user of the user terminal 30 answers by watching a reproduced video of a question scene based on one scene of the game, and selecting which option a specific character (a character displayed in a display mode with reduced distinctiveness corresponding to the player of the correct answer option) appears in the question scene. The user may select an answer by using the movement of the character reproduced based on the skeletal information of each player in the question scene as a clue.
[0028] The correct answer option may be, for example, an option that includes at least the name or uniform number of a player. Also, the incorrect answer option may be an option that includes at least the name or uniform number of a player participating in the match other than the player of the correct answer option. However, the quiz option may include information other than the player's name or uniform number, and may include the movement performed by the player (such as the name of a technique). In this case, a quiz asking about the movement performed by the player may be given to the user of the user terminal 30. The quiz asking about the movement performed by the player may be given to the user in addition to the quiz asking about the player's name or uniform number. The quiz metadata 133 includes option information indicating the correct answer option and the incorrect answer option.
[0029] The quiz metadata 133 includes time information indicating a scene of a specific situation in a match. The time information indicating a scene of a specific situation may include a start time and a duration. In addition to these, or instead of the duration of the scene of the specific situation, an end time of the scene of the specific situation may be included. The scene of the specific situation is, for example, a scene including a specific situation in a match. The specific situation may be a situation that is predefined, or may be a situation included in a scene arbitrarily designated by an operator or the like. The scene of the specific situation may be, for example, a highlight scene in a match. The scene of the specific situation may be a scene designated by the operator O from within the match by manually operating the operator terminal 20. The scene of the specific situation may be a scene extracted by the server 10 at a predetermined time interval from the start of the match. However, the scene of the specific situation is not limited to these, and may be set appropriately. In this embodiment, an example in which a scene of a specific situation is set as a scene for asking a quiz will be mainly described. However, the scene of the specific situation is not limited to a scene for asking a quiz, and may be a scene that is a candidate for a scene for asking a quiz. In addition, there may be a plurality of scenes of the specific situation.
[0030] (Operator terminal 20) The operator terminal 20 is a terminal device operated by the operator O to support the operator O in creating a quiz. For example, the operator terminal 20 may be a PC (personal computer), a smartphone, a tablet terminal, or the like.
[0031] The operator terminal 20 acquires the event information 131 and the highlight scene metadata 132 from the server 10. The operator O determines a scene to be asked in the quiz by operating the operator terminal 20. The scene to be asked may be, for example, a highlight scene represented by the highlight scene metadata 132.
[0032] Also, the operator O may conceivably create correct answer options and incorrect answer options as part of the quiz creation task by operating the operator terminal 20. However, it takes time to decide which players to select as correct answer options and which players to select as incorrect answer options among the many players who appear in a match scene used in the quiz question scene, and this places a burden on the operator O who creates the quiz.
[0033] Therefore, the operator terminal 20 according to this embodiment partially automates the quiz creation work, thereby making it possible to reduce the effort of the operator O in creating a quiz. Specifically, the operator terminal 20 first calculates the participation rate of each player in the question-asking scene of the quiz based on the skeleton information of the multiple players acquired from the event information 131. The participation rate in the question-asking scene is an index indicating how much each player participated in the question-asking scene. For example, the participation rate in the question-asking scene may be expressed as a value with an upper limit of 100. For example, the participation rate in the question-asking scene may be set higher for a player who spends more time in the question-asking scene.
[0034] Furthermore, the involvement rate in the question scene may be an index representing the degree of contribution to a specific action. The specific action may be, for example, the action of touching the ball. More specifically, the involvement rate in the question scene may be, for example, an involvement rate indicating the degree of involvement with the ball used in the match (hereinafter, also simply referred to as the "involvement rate with the ball"). The involvement rate with the ball may be calculated based on the amount of involvement with the ball over time, or may be calculated based on the number of times the ball was contacted.
[0035] The calculated participation rate is not limited to the participation rate in the scene where the question is asked. The participation rate may be calculated for each of a plurality of scenes of specific situations that are candidates for the scene where the question is asked in the quiz. For example, the participation rate may be an index representing the degree of contribution of one or a plurality of players to each of a plurality of scenes of specific situations. More specifically, the participation rate may be calculated based on the action of the player in the scene of the specific situation. More specifically, the participation rate may be calculated according to the technique performed by the player in the scene of the specific situation, and the participation rate in the scene of the specific situation may be calculated according to the score given to each technique according to the performance of the technique. In addition, the participation rate may be appropriately set according to the event and the content of the quiz question, etc.
[0036] Then, the operator terminal 20 outputs selection candidate information based on the calculated participation rate. For example, the operator terminal 20 displays the selection candidate information, which is information indicating the selection candidates, to the operator O who creates the quiz in order of the highest participation rate. The selection candidates may be, for example, players or scenes of specific situations. To give a more specific example, the operator terminal 20 may display the player candidates to the operator O in order of the highest participation rate as candidates for the correct answer option (an example of the selection candidate information). In addition, the operator terminal 20 may display the player candidates further selected from the candidates for the correct answer option to the operator O as candidates for the incorrect answer option.
[0037] The operator O selects a correct answer option and an incorrect answer option from the displayed correct answer option candidates and incorrect answer option candidates. In this way, the operator terminal 20 displays the correct answer option candidates and the incorrect answer option candidates to the operator O, which makes it possible to easily create a quiz about a player who is involved in the scene where the question is asked, i.e., who is thought to have played an active role in the scene where the question is asked, thereby reducing the effort of the operator O in creating a quiz.
[0038] The operator terminal 20 generates quiz metadata 133 based on the selection of each option by the operator O. The quiz metadata 133 includes time information of the determined scene in which the question is presented, and identification information representing the correct and incorrect options selected by the operator O. Furthermore, the quiz metadata 133 includes (metadata) the target player selected as the correct option.
[0039] The operator terminal 20 outputs, to the server 10, quiz metadata 133 including time information of the determined question scene and option information indicating the correct options and the incorrect options selected by the operator O.
[0040] Although an example in which a player is displayed as the selection candidate information has been described so far, as another example, the selection candidate information may be information indicating candidates for a quiz question scene. The operator terminal 20 may display a plurality of specific situation scenes to the operator O as candidates for a quiz question scene in descending order of the involvement rate calculated for each of the plurality of specific situation scenes of one player. In this case, the operator O may select a question scene from the plurality of specific situation scenes. Then, the operator terminal 20 generates quiz metadata 133 including instruction information for instructing to display the one target player in a display mode with reduced distinctiveness.
[0041] (User terminal 30) The user terminal 30 is a terminal used by a user. For example, the user terminal 30 is realized by a smartphone, a tablet terminal, a PC (personal computer), an HMD (Head Mounted Display) that covers the entire field of view, a glasses-type device, a projector, a console game machine, or the like.
[0042] The user terminal 30 downloads the quiz metadata 133 from the server 10, and renders a display screen including a reproduced image of the question scene and quiz options based on the quiz metadata 133, and displays it to the user. The user terminal 30 also accepts answers to the quiz by the user.
[0043] <2. Example of Server 10 Configuration> Next, an example of the configuration of the server 10 according to the present embodiment will be described. Fig. 3 is a block diagram showing an example of the configuration of the server 10 according to the present embodiment. As shown in Fig. 3, the server 10 has a communication unit 110, a control unit 120, and a storage unit 130.
[0044] (Communication unit 110) The communication unit 110 transmits and receives data to and from an external device via a wired or wireless connection. The communication unit 110 communicates with the operator terminal 20 and the user terminal 30 using, for example, a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 4G (fourth generation mobile communication method), or 5G (fifth generation mobile communication method)), etc.
[0045] (Control unit 120) The control unit 120 functions as an arithmetic processing device and a control device, and controls the overall operation of the server 10 in accordance with various programs. The control unit 120 is realized by electronic circuits such as a CPU (Central Processing Unit) and a microprocessor. The control unit 120 may also include a ROM (Read Only Memory) that stores the programs to be used and arithmetic parameters, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
[0046] The control unit 120 performs appropriate processing based on the data received from the external device, controls storage in the storage unit 130, and controls transmission of data to the external device.
[0047] (Highlight scene extraction unit 121) The control unit 120 also functions as a highlight scene extraction unit 121. The highlight scene extraction unit 121 extracts highlight scene metadata 132 based on information about the match. The highlight scene metadata 132 includes time information indicating the highlight scene.
[0048] A highlight scene may be, for example, a scoring scene in which a player scores a goal in a match. In this case, the highlight scene extraction unit 121 may extract metadata 132 of the highlight scene based on information about the time when a goal was scored in the match.
[0049] The highlight scene extraction unit 121 may extract metadata 132 for a highlight scene, for example, from a predetermined time before (e.g., 10 seconds before) when a score is scored to a predetermined time after (e.g., 5 seconds after) when the score is scored.
[0050] Further, the highlight scene extraction unit 121 may determine a highlight scene based on the volume of cheers from the spectators in the game video, using the time when a goal was scored as a reference, and extract the metadata 132 of the highlight scene.
[0051] Note that the highlight scene is not limited to a scoring scene, but may be a shooting scene in which a player shoots, or a dribbling scene in which one player dribbles for a long time. Note that the metadata 132 of the highlight scene may include information indicating the type of the highlight scene, such as a scoring scene, a shooting scene, or a dribbling scene.
[0052] The highlight scene extraction unit 121 may extract metadata 132 of one highlight scene from one match, or may extract metadata 132 of multiple highlight scenes from one match.
[0053] The metadata 132 of the highlight scenes extracted by the highlight scene extraction unit 121 is stored in the storage unit 130 and is output from the communication unit 110 to the operator terminal 20 as appropriate.
[0054] (Storage unit 130) The storage unit 130 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 120, and a RAM that temporarily stores parameters that change appropriately. The storage unit 130 also stores event information 131, highlight scene metadata 132, and quiz metadata 133.
[0055] (Event Information 131) The event information 131 includes information related to the event. In this embodiment, the event information 131 includes skeleton information of each of the multiple players participating in the match, position information of the multiple players participating in the match, and ball information of the ball used in the match.
[0056] (Highlight Scene Metadata 132) The highlight scene metadata 132 is metadata about the highlight scene extracted by the highlight scene extraction unit 121. The highlight scene metadata 132 includes, for example, time information indicating the highlight scene in the match.
[0057] (Quiz Metadata 133) The quiz metadata 133 is metadata about the quiz questions that is output from the operator terminal 20 and received by the communication unit 110. The quiz metadata 133 includes, for example, choice information indicating correct answer choices and incorrect answer choices for the quiz, and time information indicating the scene in the game where the quiz question is asked.
[0058] <3. Configuration Example of Operator Terminal 20> Next, an example of the configuration of the operator terminal 20 according to this embodiment will be described. Fig. 4 is a block diagram showing an example of the configuration of the operator terminal 20 according to this embodiment. As shown in Fig. 4, the operator terminal 20 has a communication unit 210, an operation display unit 220, a control unit 230, and a storage unit 240.
[0059] (Communication unit 210) The communication unit 210 transmits and receives data to and from an external device via a wired or wireless connection. The communication unit 210 connects and communicates with the server 10 using, for example, a wired / wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 4G (fourth generation mobile communication method), or 5G (fifth generation mobile communication method)), etc. For example, the communication unit 210 may receive metadata 132 of a highlight scene from the server 10. In addition, the communication unit 210 transmits quiz metadata 133 generated by a quiz metadata generation unit 233 described later to the server 10.
[0060] (Operation display section 220) The operation display unit 220 functions as a display unit that displays a display screen drawn based on the event information 131 streamed from the server 10. The operation display unit 220 also functions as an operation unit through which the operator O performs operation input.
[0061] The function of the display unit may be realized by, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, or an OLED (Organic Light Emitting Diode) device. The function of the operation unit may be realized by, for example, a touch panel, a keyboard, or a mouse.
[0062] For example, the operation display unit 220 may display a list of multiple highlight scenes represented by the metadata 132 of multiple highlight scenes received from the server 10 as candidates for a question scene. The operation display unit 220 may then accept an instruction to specify a question scene from among the multiple highlight scenes displayed as a list of candidates. The operation display unit 220 may also preview a re-enacted video in which a player and a ball included in a highlight scene are reproduced based on skeletal information and ball information.
[0063] Furthermore, the operation display unit 220 may accept adjustment of the start time, end time, or duration of a highlight scene displayed as a candidate, and set the adjusted highlight scene as the question scene.
[0064] The operation display unit 220 may accept an instruction to set a scene other than the highlight scene as a question scene received from the server 10. For example, the operation display unit 220 may display scenes from the start time specified by the operator O until a predetermined time (e.g., 10 seconds) has elapsed as candidates for the question scene.
[0065] The operator O may adjust the time information of the question scene displayed as a candidate while previewing the reproduced video of the question scene candidate. This allows the operator O to specify a highlight scene that was not extracted by the server 10 as the question scene. However, the operator O may specify a scene other than the highlight scene as the question scene.
[0066] Here, a display screen for specifying a quiz question scene displayed on the operation display unit 220 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of a display screen for editing a quiz question scene displayed on the operation display unit 220.
[0067] As shown in FIG. 5, a display screen 500 includes a reproduced image 501 , quiz candidate information 502 , a first set button 503 , a time input field 504 , a play button 505 , a seek bar 506 , and a second set button 507 .
[0068] The reproduced video 501 is a video including a character P (e.g., characters P1 and P2) that reproduces a player in a match and an object B that reproduces the ball in a match. The reproduced video 501 may be generated based on, for example, pressing the first set button 503, the play button 505, or the second set button 507, or operating the seek bar 506.
[0069] The quiz candidate information 502 is information representing a highlight scene represented by the highlight scene metadata 132 received from the server 10. Fig. 5 shows an example in which the quiz candidate information 502 includes the start time and duration of the highlight scene, and the type of the highlight scene ("GOAL" indicating that it is a scoring scene).
[0070] The set button 503 is a button for designating a highlight scene corresponding to the quiz candidate information 502 as a quiz question scene. When the set button 503 is pressed, a reproduced video 501 in which the highlight scene corresponding to the quiz candidate information 502 is reproduced may be displayed on the display screen 500.
[0071] The time input field 504 is an input field for inputting time information of a quiz question scene. When the set button 503 is pressed by the operator O, the time information corresponding to the quiz candidate information 502 is automatically input into the time input field 504. The operator O may also adjust the time of the highlight scene by editing the time information automatically input into the time input field 504 in response to pressing of the set button 503.
[0072] The play button 505 is a button for playing back the reproduced video 501 according to the time input in the time input field 504. For example, the operator O can press the play button 505 to check the reproduced video 501 that reproduces the highlight scene after the time adjustment.
[0073] The seek bar 506 is an operation unit that allows the operator O to specify the time of the game to be reproduced in the reproduced video 501. By operating the seek bar 506, the operator O can specify which video of the entire game is to be reproduced in the reproduced video 501.
[0074] The operator O may arbitrarily specify a scene for the quiz based on inputting a start time in the time input field 504 or operating the seek bar 506. The operator O may specify a scene from the start time until a predetermined time (e.g., 10 seconds) has elapsed as the scene for the quiz by pressing the second set button 507 after inputting a start time in the time input field 504 or operating the seek bar 506. The operator O may further adjust the time by editing the time information automatically input in the time input field 504 after pressing the second set button 507.
[0075] The above describes the designation of the quiz scene accepted by the operation display unit 220. By partially automating the selection of the scene to be questioned, such as presenting one or more highlight scenes as candidates for the quiz scene to be questioned, or automatically inputting the designation of the scene to be questioned (setting of start time, end time, and duration), the work can be further reduced. Furthermore, the display screen 500 may further display a first correct answer option candidate 508 and an incorrect answer option candidate 509 determined by the candidate determination unit 232 described later. The operation display unit 220 may then accept the selection of each option. The display of the candidates for each option and the acceptance of the selection by the operation display unit 220 will be described in detail later.
[0076] (Control unit 230) The control unit 230 functions as an arithmetic processing device and a control device, and controls the overall operation of the operator terminal 20 in accordance with various programs. The control unit 230 is realized by electronic circuits such as a CPU (Central Processing Unit) and a microprocessor. The control unit 230 may also include a ROM (Read Only Memory) that stores the programs to be used and arithmetic parameters, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
[0077] The control unit 230 performs appropriate processing based on the data received from the external device, controls storage in the storage unit 240, and controls transmission of data to the external device.
[0078] The control unit 230 also functions as a participation rate calculation unit 231, a candidate determination unit 232, and a quiz metadata generation unit 233, as shown in FIG.
[0079] (Participation rate calculation unit 231) The participation rate calculation unit 231 calculates the participation rate of each player in a quiz question scene (e.g., a highlight scene) specified by the operator O by operating the operation display unit 220, based on the skeleton information of the multiple players acquired from the event information 131. More specifically, the participation rate calculation unit 231 according to this embodiment calculates the participation rate of each player in the ball as the participation rate in the question scene, based on the skeleton information and ball information.
[0080] The involvement rate calculation unit 231 may, for example, calculate the number of times a player contacts the ball in a quiz scene, and calculate the involvement rate such that the more times a player contacts the ball, the higher the involvement rate of the player. Also, the involvement rate calculation unit 231 may calculate the time that a player was near the ball, and calculate the involvement rate such that the longer a player was near the ball, the higher the involvement rate of the player.
[0081] The contribution rate calculation unit 231 may calculate the contribution rates only for players who belong to a specific team among the players who participate in the match. The specific team may be, for example, a team managed by a club to which an administrator who manages the setting of quizzes belongs. In this embodiment, an example will be described in which the contribution rate calculation unit 231 calculates the contribution rates only for players who belong to a specific team. However, the contribution rate calculation unit 231 may calculate the contribution rates for all players who participate in the match, or may only target players selected by the operator O for the contribution rate calculation.
[0082] (Candidate determination unit 232) The candidate designator 232 determines candidates for the correct answer option and candidates for the incorrect answer option according to the contribution rate calculated by the contribution rate calculation unit 231. For example, the candidate designator 232 selects players as candidates for the correct answer option in descending order of contribution rate. The candidate designator 232 may select a predetermined number of players as candidates for the correct answer option. The predetermined number may match, for example, the number of options in the quiz. Furthermore, the candidate designator 232 may select a player with the highest contribution rate from among the candidates for the correct answer option as the first candidate for the correct answer option.
[0083] Furthermore, the candidate designator 232 may further select candidates for the incorrect answer options from the candidates for the correct answer options. For example, the candidate designator 232 may select, from among the candidates for the correct answer options, a candidate for the incorrect answer option other than the first candidate for the correct answer option. Hereinafter, when there is no distinction between the correct answer options and the incorrect answer options, they are also simply referred to as "options".
[0084] The candidate designator 232 executes control to display the selected correct option candidates on the operation display unit 220 in descending order of involvement rate. For example, the operation display unit 220 may display a first correct option candidate 508 and an incorrect option candidate 509 as correct option candidates, as shown in Fig. 5. Fig. 5 shows an example in which the uniform numbers of the players of the candidates for each option are displayed as the first correct option candidate 508 and the incorrect option candidate 509.
[0085] The operator O can select the first correct answer candidate 508 as the correct answer candidate and the incorrect answer candidate 509 as the incorrect answer candidate by performing a save operation for the quiz while the first correct answer candidate 508 and the incorrect answer candidate 509 are displayed. In this way, the first correct answer candidate 508 and the incorrect answer candidate 509 are automatically selected and displayed, so that the operator O can easily select a quiz option suitable for the quiz question scene.
[0086] Furthermore, the operator O may select a correct answer option from among the candidates for the correct answer option other than the first correct answer option candidate 508. For example, when the first correct answer option candidate 508 is pressed by the operator O, the operation display unit 220 may transition the display screen 500 to a selection screen for the correct answer option.
[0087] FIG. 6 is a diagram showing an example of a selection screen for a correct answer option displayed on the operation display unit 220. As shown in FIG. 6, the selection screen 510 includes candidates 511 for the correct answer option. The candidates 511 for the correct answer option are selected by the candidate designation unit 232 and displayed on the selection screen 510 in descending order of the contribution rate. FIG. 6 shows an example in which the name, uniform number, and contribution rate of the player of each candidate for the correct answer option are displayed as the candidates 511 for the correct answer option. In this way, the players are displayed in descending order of the contribution rate together with the contribution rate of each player, so that the operator O can select the correct answer option while referring to the contribution rate, which makes it easier to select the correct answer option.
[0088] After selecting a correct answer option from the correct answer option candidates 511, the operator O can confirm the selection of the correct answer option by performing a save operation of the quiz.
[0089] The number of correct answer candidate 511 may be the same as the number of correct answer candidates on display screen 500 in FIG. 5 (i.e., 4, which is the sum of the first correct answer candidate 508 and the incorrect answer candidate 509), or may be different from the above number.
[0090] The selection screen 510 for selecting the correct answer option has been described above. Here, when the operator O presses the incorrect answer option candidate 509 included in the display screen 500 shown in FIG. 5, the display screen 500 may transition to an incorrect answer option selection screen. The display content of the incorrect answer option selection screen may be the same as the selection screen 510 shown in FIG.
[0091] Furthermore, the method of displaying the correct answer options is not limited to the method described with reference to Fig. 5 and Fig. 6. For example, the correct answer options candidates may be displayed on the operation display unit 220 in order of participation rate so that the correct answer options or the incorrect answer options can be selected from the correct answer option candidates in a pull-down format. In this case, the operator O can assign (select) the correct answer options and the incorrect answer options from the correct answer option candidates.
[0092] As described above, the candidates for the correct answer option are displayed in the order of the contribution rate. However, exceptions may be provided to the display order of the candidates for the correct answer option. For example, the candidate designator 232 may select a player who scored a point in the question scene as a candidate for the correct answer option with the highest priority, regardless of the contribution rate. Also, the candidate designator 232 may select a player who took a shot in the question scene as a candidate for the correct answer option with the highest priority, regardless of the contribution rate. Then, the operation display unit 220 may display the candidate for the correct answer option selected with the highest priority at the top of the display order. Also, the candidate designator 232 may select the candidate for the correct answer option selected with the highest priority as the first candidate for the correct answer option.
[0093] In addition, the candidate determination unit 232 may set the contribution rate of the player who scored the goal or took the shot to the upper limit of the contribution rate regardless of the contribution rate calculated by the contribution rate calculation unit 231, thereby selecting the player as a candidate for the correct answer option with the highest priority.
[0094] (Quiz metadata generation unit 233) The quiz metadata generating section 233 generates the quiz metadata 133 to be transmitted to the server 10. The quiz metadata generating section 233 may generate the quiz metadata 133 in response to a quiz save operation received by the operation display section 220.
[0095] The quiz metadata generating unit 233 generates quiz metadata 133 including time information of a quiz question scene specified by the operator O operating the operation display unit 220. The quiz metadata generating unit 233 also generates quiz metadata 133 including option information indicating correct answer options and incorrect answer options determined by the quiz metadata generating unit 233.
[0096] Further, the quiz metadata generating unit 233 generates the quiz metadata 133 including instruction information for instructing to display the player selected as the correct answer option included in the question scene in a display mode with reduced distinctiveness. Note that, here, a case has been described in which the quiz metadata generating unit 233 generates the quiz metadata 133 including instruction information for instructing to display in a display mode with reduced distinctiveness, but the present embodiment is not limited to this. For example, the operator terminal 20 or the server 10 may set a flag for the player to be displayed in a display mode with reduced distinctiveness in the data used when asking a quiz, or may update the motion data of the player used when asking a quiz to set it to be displayed in a display mode with reduced distinctiveness.
[0097] The display mode with reduced distinctiveness may be a display mode that does not reproduce at least one of the player's hairstyle, face, and skin color. A character displayed in a display mode with reduced distinctiveness may be, for example, a character whose hair and facial features are not drawn. Furthermore, a character displayed in a display mode with reduced distinctiveness may be a character whose skin color is a predetermined color (for example, gray).
[0098] The display mode with reduced distinctiveness may be a display mode that does not reproduce characters such as a player's number written on the player's clothing such as a uniform. In addition, when each player wears different clothing such as shoes, the display mode with reduced distinctiveness may be realized by replacing the player's clothing with a predetermined clothing.
[0099] The display mode with reduced distinctiveness may be a display mode in which the player's name is not displayed in the reproduced image. For example, in a normal display mode, if the player's name is displayed around the character so that the user can recognize who the player reproduced by the character is, in a display mode with reduced distinctiveness, the player's name may not be displayed. In such a case, in a display mode with reduced distinctiveness, the player's name may be replaced with characters such as "Who?" or "?" that allow the user to recognize that the character is the subject of a quiz.
[0100] As described above, in a display mode with reduced distinctiveness, it is desirable to eliminate the player's characteristics as much as possible. Here, in a display mode with reduced distinctiveness, it is also conceivable that the player's height is not reproduced. For example, it is conceivable that a character displayed in a display mode with reduced distinctiveness is displayed so as to correspond to a predetermined height.
[0101] However, for example, when a character is drawn from the center of the player's body, it is preferable that the character be drawn so as to correspond to the actual height. If the character is drawn so as to correspond to a height different from the actual height, the character may be drawn as if it is not in contact with the ground or the ball, even though it is actually in contact with the ground or the ball. Also, the character may be drawn as if it is sinking into the ground or the ball, even though it is actually in contact with the ground or the ball.
[0102] The quiz metadata generation unit 233 controls the communication unit 210 to transmit the generated quiz metadata 133 to the server 10. The transmitted quiz metadata 133 is transmitted from the server 10 to the user terminal 30. The user terminal 30 then renders and displays a video of the question scene in accordance with the quiz metadata 133. Note that the user terminal 30 renders players other than the player who selected the correct answer option, including the player who selected the incorrect answer option, in a display manner that enables them to be distinguished from other players.
[0103] Fig. 7 is a diagram showing an example of a display screen showing a quiz question scene drawn in accordance with the quiz metadata 133. As shown in Fig. 7, a display screen 600 includes a character Q corresponding to a player of a correct answer option and a character NQ corresponding to a player of an incorrect answer option.
[0104] 7, character Q corresponding to the player of the correct answer option (i.e., a character with reduced distinctiveness displayed based on the skeletal information of the player who is the subject of the quiz) does not reproduce the player's hairstyle, face, and skin color, and is less distinctive than other players. Also, a "?" is displayed above character Q so that the user can recognize that character Q is the subject of the quiz.
[0105] On the other hand, the character NQ corresponding to the player with the incorrect answer option is displayed with the player's hairstyle, face, skin color, and uniform number, making it easy to distinguish from other players. Also, the name of the player, "△△△", is displayed above the character NQ, making it easier to understand who the player is.
[0106] In this way, by displaying the character Q corresponding to the player of the correct answer option in a display mode that reduces distinctiveness, it is possible to prevent the correct answer from being identified by the player's hairstyle, face, skin color, uniform number, etc. This allows the user to select an answer based on the movement of the character Q and the user's own memory of the scene in which the question was asked, making the quiz more enjoyable.
[0107] However, the degree to which the distinctiveness is reduced may be set according to the difficulty of the quiz. For example, when the difficulty of the quiz is lowered, a character may be generated by reproducing parts other than the face of the player. In addition, in order to further increase the difficulty of the quiz, the distinctiveness of characters other than character Q corresponding to the player of the correct answer option may also be reduced.
[0108] (Storage unit 240) The storage unit 240 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 230, and a RAM that temporarily stores parameters that change as appropriate.
[0109] <4. Operation processing example> Next, an example of the flow of operation processing of the quiz question setting system 1 according to this embodiment will be described with reference to FIGS.
[0110] (Operation processing of quiz question system 1) 8 is a sequence diagram showing an example of the flow of the operation process of the quiz question setting system 1 according to this embodiment. First, the highlight scene extraction unit 121 of the server 10 extracts the highlight scene metadata 132 based on the information about the match (S101). The communication unit 110 outputs the highlight scene metadata 132 to the operator terminal 20 (S102).
[0111] Next, the control unit 230 of the operator terminal 20 generates quiz metadata 133 (S103). The communication unit 210 outputs the quiz metadata 133 to the server 10 (S104). Then, the communication unit 110 of the server 10 outputs the quiz metadata 133 to the user terminal 30 (S105).
[0112] The user terminal 30 renders and plays back a quiz video including a replay of the scene in question based on the quiz metadata 133 (S106).
[0113] (Quiz metadata generation process) Next, the process of generating the quiz metadata 133 in S103 in Fig. 8 will be described with reference to Fig. 9. Fig. 9 is a flow diagram showing an example of the flow of the process of generating the quiz metadata 133 by the operator terminal 20 according to this embodiment.
[0114] When S103 in FIG. 8 starts, first, the operation display unit 220 displays a list of a plurality of highlight scenes based on the metadata 132 of the plurality of highlight scenes received by the communication unit 210 from the server 10 (S201).
[0115] The control unit 230 judges whether or not a quiz question scene has been selected from the list of highlight scenes (S202). If a quiz question scene has been selected from the list of highlight scenes (S202 / YES), the control unit 230 determines the selected highlight scene as the question scene (S203). If a quiz question scene has not been selected from the list of highlight scenes (S202 / NO), the control unit 230 determines the question scene according to a manual operation (i.e., an arbitrary manual operation) by the operator O received by the operation display unit 220 (S204).
[0116] Next, the participation rate calculation section 231 calculates the participation rate of the player included in the determined question scene to the ball as the participation rate to the question scene (S205).
[0117] The candidate designator 232 selects players who will be candidates for the correct answer option of the quiz in descending order of participation rate. The operation display unit 220 displays the players who will be candidates for the correct answer option of the quiz selected by the candidate designator 232 in descending order of participation rate (S206). Here, the player with the highest participation rate may be displayed as the first candidate for the correct answer option of the quiz, and the other players may be displayed as candidates for the incorrect answer option of the quiz.
[0118] The operation display unit 220 accepts the selection of a correct answer option and an incorrect answer option from the candidates of the correct answer option by the operator O (S207). Then, the quiz metadata generation unit 233 generates quiz metadata according to the selection by the operator O (S208), and the process proceeds to S104 in the sequence of FIG.
[0119] (Quiz video playback process) Next, the quiz video playback process in S106 in Fig. 8 will be described with reference to Fig. 10. Fig. 10 is a flow diagram showing an example of the flow of the quiz video playback process by the user terminal 30 according to this embodiment.
[0120] The user terminal 30 generates a character of the player who is the subject of the quiz (that is, the player who has chosen the correct answer) in a display mode that reduces distinctiveness in accordance with the instruction information included in the quiz metadata 133 (S301).
[0121] Meanwhile, the user terminal 30 generates characters of players who are not the target of the quiz (i.e., players other than the players who chose the correct answer option, including the players who chose the incorrect answer option) in a display manner that enables them to be distinguished from other players (S302).
[0122] Then, the user terminal 30 plays back a quiz video including a replay video of the scene in which a question is asked, including the characters generated in S301 and S302 (S303). The quiz video includes a display of options.
[0123] Here, an example of a display screen of a quiz video will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of a display screen of a quiz video. As shown in Fig. 11, a display screen 610 displays an image of a virtual space including a reproduced image 611, options 612, and an answer area 613 as the quiz video. The display screen 610 includes an avatar U operated by the user of the user terminal 30.
[0124] The reproduced image 611 is a reproduced image of a quiz question scene, including the characters generated in S301 and S302.
[0125] Choices 612 represent a list of correct answers and distractors generated based on quiz metadata 133 .
[0126] The answer area 613 is an area used for the user to select an answer to the quiz. More specifically, the user can answer the quiz by moving the avatar U into the answer area 613 within the answer time. For example, the user can select "A" as the answer to the quiz by moving the avatar U to the answer area 613 where "A" is displayed. Note that voice input may be used for the user to select the answer to the quiz. For example, when the user utters "A", the user terminal 30 may determine that the user selected the option "A" based on the voice. The method of answering the quiz is not particularly limited. For example, when the user terminal 30 is an HMD or when the user wears an HMD connected to the user terminal 30, an option may be selected based on the user's line of sight detected by a sensor or the like built into the HMD. In addition, the avatar may be operated or an option may be selected by a predetermined gesture such as a hand gesture of the user detected by a sensor or the like built into the HMD.
[0127] 11 shows an example in which only avatar U appears in the reproduced image, avatars operated by other users may be placed on display screen 610 and answer the quiz at the same time. This allows multiple users to enjoy the quiz at the same time.
[0128] Returning to the flow of Fig. 10, the explanation will be continued. Next, the user terminal 30 judges whether the question time has ended (S304). The question time may continue until the playback of the reproduced video of the question scene ends, or may end when a predetermined time has elapsed since the playback of the reproduced video ends.
[0129] If the time for presenting the question has not yet elapsed (S304 / NO), the process returns to S301, and the processes of S301 to S303 are repeated until the time for presenting the question has elapsed.
[0130] When the time for asking the question has elapsed (S304 / YES), the user terminal 30 notifies the user whether the user's answer is correct or incorrect (S305), and the process ends. The notification may be performed, for example, by display.
[0131] Note that multiple quizzes may be given in succession, in which case the processes of S301 to S305 are repeated. When multiple quizzes are given in succession, the number of correct answers given by the user may be displayed.
[0132] <5. Hardware configuration> The embodiment and the modified examples according to the present disclosure have been described above. Next, an example of the hardware configuration of the server 10, the operator terminal 20, and the user terminal 30 according to the embodiment of the present disclosure will be described with reference to FIG.
[0133] The above-described processes by the server 10, the operator terminal 20, and the user terminal 30 can be realized by one or more information processing devices. FIG. 12 is a block diagram showing an example of a hardware configuration of an information processing device 900 that realizes the server 10, the operator terminal 20, and the user terminal 30 according to the embodiment of the present disclosure. Note that the information processing device 900 does not necessarily have to have all of the hardware configuration shown in FIG. 12. In addition, part of the hardware configuration shown in FIG. 12 may not be present in the server 10, the operator terminal 20, or the user terminal 30.
[0134] 12, the information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. Instead of or in addition to the CPU 901, the information processing device 900 may have a processing circuit such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an ASIC (Application Specific Integrated Circuit).
[0135] The CPU 901 functions as an arithmetic processing device and a control device, and controls all or part of the operations in the information processing device 900 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927. The ROM 903 stores programs and arithmetic parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901 and parameters that change appropriately during the execution. The CPU 901, the ROM 903, and the RAM 905 are connected to each other by a host bus 907 that is constituted by an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.
[0136] The input device 915 is a device operated by a user, such as a button. The input device 915 may include a mouse, a keyboard, a touch panel, a switch, a lever, and the like. The input device 915 may also include a microphone that detects the user's voice. The input device 915 may be, for example, a remote control device that uses infrared rays or other radio waves, or an external connection device 929 such as a mobile phone that supports the operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs it to the CPU 901. The user operates the input device 915 to input various data to the information processing device 900 and instruct the information processing device 900 to perform processing operations.
[0137] The input device 915 may also include an imaging device and a sensor. The imaging device is a device that captures real space using an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and various members such as a lens for controlling the formation of a subject image on the imaging element, to generate a captured image. The imaging device may capture a still image or a moving image.
[0138] The sensor is, for example, various sensors such as a distance measurement sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a vibration sensor, a light sensor, a sound sensor, etc. The sensor acquires information on the state of the information processing device 900 itself, such as the attitude of the housing of the information processing device 900, and information on the surrounding environment of the information processing device 900, such as the brightness and noise around the information processing device 900. The sensor may also include a Global Positioning System (GPS) sensor that receives a GPS signal and measures the latitude, longitude, and altitude of the device.
[0139] The output device 917 is configured with a device capable of visually or audibly notifying the user of acquired information. The output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, or a sound output device such as a speaker or a headphone. The output device 917 may also include a PDP (Plasma Display Panel), a projector, a hologram, a printer device, or the like. The output device 917 outputs the results obtained by the processing of the information processing device 900 as a video such as text or an image, or as a sound such as voice or audio. The output device 917 may also include a lighting device that brightens the surroundings.
[0140] The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900. The storage device 919 is configured, for example, with a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs and various data executed by the CPU 901, and various data acquired from the outside.
[0141] The drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads out information recorded on the attached removable recording medium 927 and outputs the information to the RAM 905. The drive 921 also writes information onto the attached removable recording medium 927.
[0142] The connection port 923 is a port for directly connecting a device to the information processing device 900. The connection port 923 may be, for example, a Universal Serial Bus (USB) port, an Institute of Electrical and Electronics Engineers (IEEE) 1394 port, a Small Computer System Interface (SCSI) port, or the like. The connection port 923 may also be a Recommended Standard (RS)-232C port, an optical audio terminal, a High-Definition Multimedia Interface (HDMI) (registered trademark) port, or the like. By connecting an external connection device 929 to the connection port 923, various types of data may be exchanged between the information processing device 900 and the external connection device 929.
[0143] The communication device 925 is, for example, a communication interface configured with a communication device for connecting to the network 40. The communication device 925 may be, for example, a wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), Wi-Fi (registered trademark), or a communication card for WUSB (Wireless USB). The communication device 925 may also be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communications. The communication device 925 transmits and receives signals, for example, between the Internet and other communication devices using a predetermined protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol). The network 40 connected to the communication device 925 is a network connected by wire or wirelessly, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.
[0144] <6. Additional information about the quiz> In the above embodiment, the quiz given to the user is a multiple-choice quiz in which one player has the correct answer, but the present technology is not limited to such an example. For example, the quiz may be a one-question-one-answer format in which one player has the correct answer. In addition, the quiz may be given to multiple players, in which case multiple correct answers are set by the operator O.
[0145] In the above embodiment, an example has been described in which the operator terminal 20 executes the calculation process of the involvement rate in a specific situation, the selection candidate determination process, and the generation process of quiz metadata. However, the present disclosure is not limited to this, and at least a part of each process may be performed by the server 10. In this case, the server 10 may transmit selection candidate information indicating the selection candidates to the operator terminal 20 based on the calculated involvement rate in a specific situation. More specifically, the server 10 may transmit selection candidate information indicating the selection candidates to the operator terminal 20 in descending order of the calculated involvement rate in a specific situation. The operator terminal 20 may transmit information to the server 10 on whether or not to select the selection candidates transmitted in sequence from the server 10 as quiz options based on the operation of the operator O. Then, when information indicating that the selection candidate is not selected as a quiz option is transmitted from the operator terminal 20, the server 10 may transmit selection candidate information indicating the next selection candidate.
[0146] In addition, the server 10 may transmit data to the operator terminal 20 for determining which player to display in a display manner with reduced distinctiveness, and instruction information instructing the player to be displayed in a display manner with reduced distinctiveness may be generated by the operator terminal 20.
[0147] <7.Quiz Variations> In the above embodiment, a "multiple choice quiz in which one player participating in a match is the correct answer" is given as an example of a quiz given by a quiz setting system that asks a quiz about a player participating in an event as a new user experience utilizing the player's motion data, but the present disclosure is not limited to this. Other examples of quizzes given by the quiz setting system according to this embodiment will be described below.
[0148] (7-1. Example of the configuration of the user terminal 30) The control of the quiz questions may be performed in the user terminal 30 by receiving quiz metadata from the server 10. As described above, the user terminal 30 performs control to construct a virtual space based on, for example, information for reproducing the virtual space received from the server 10, and display an image of the virtual space on the display unit of the user terminal 30. The virtual space is, for example, a reproduction of a match venue in a real space (for example, a soccer stadium). The user terminal 30 may move player avatars corresponding to each player placed in the match venue in the virtual space based on the motion data (for example, skeletal information) of each player included in the event information received from the server 10, and draw a reproduced image of the match. The player avatars are an example of characters resembling each player, and may be generated by a 3D model.
[0149] 13 is a block diagram showing an example of the configuration of a user terminal 30 according to this embodiment. As shown in FIG. 13, the user terminal 30 has a communication unit 310, a control unit 320, an operation unit 330, a display unit 340, an audio output unit 350, and a storage unit 360.
[0150] (Communication unit 310) The communication unit 310 transmits and receives data to and from an external device via a wired or wireless connection. The communication unit 310 is connected to the server 10 for communication using, for example, a wired / wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (for example, LTE, 4G, or 5G), or the like.
[0151] (Control unit 320) The control unit 320 functions as a calculation processing device and a control device, and controls the overall operation of the user terminal 30 in accordance with various programs. The control unit 320 is realized by electronic circuits such as a CPU and a microprocessor. The control unit 320 may also include a ROM for storing the programs to be used and calculation parameters, and a RAM for temporarily storing parameters that change as appropriate.
[0152] The control unit 320 performs appropriate processing based on data received from an external device or user operations input from the operation unit 330, and performs display control on the display unit 340, audio output control for the audio output unit 350, storage control for the storage unit 360, and control of data transmission from the communication unit 310 to the external device.
[0153] Specifically, the control unit 320 performs control to display an image of the virtual space on the display unit 340 based on the information received from the server 10. The control unit 320 also receives audio information of the virtual space from the server 10 and performs control to output the audio information from the audio output unit 350.
[0154] The display of the image of the virtual space may be performed in a streaming format by receiving the image of the virtual space generated by the server 10 from the server 10. The user terminal 30 may also construct the virtual space based on the information for reproducing the virtual space received from the server 10, and render and display an image of the virtual space. In the present embodiment, as an example, the user terminal 30 may construct a virtual match venue, move player avatars corresponding to each player placed in the match venue based on the motion data (e.g., skeletal information) of each player included in the event information received from the server 10, and render a reproduced image of the match.
[0155] The user terminal 30 may also receive quiz metadata including data related to the setting of a quiz from the server 10 and control the setting of the quiz. The quiz may be a multiple-choice quiz. The quiz metadata includes, for example, information on a scene based on a scene of a match, information on a plurality of options, and information on target points shown in a virtual space corresponding to the plurality of options. The information on the scene may be, for example, identification information of a match to be a target of a quiz and information on the start time and end time of a scene used in the scene to be a quiz. The start time and end time of a scene may be indicated by the elapsed time from the start of the match. The user terminal 30 may acquire motion data of each player in the match to be a target of a quiz (time-series motion data of each player in one match) as event information from the server 10 and play the scene to be a quiz. The user terminal 30 may also receive time-series motion data of each player in the scene to be a quiz (an example of event information) from the server 10 and play the same on the display unit 340 in a streaming format. The information on the plurality of options includes information on correct options and information on incorrect options. The quiz metadata may include various information depending on the type of quiz.
[0156] The control unit 320 controls the playback of a scene of a specific situation of an event in a virtual space as a quiz question control, for example. The scene of the specific situation of an event corresponds to a quiz question scene, and is also referred to as a quiz video in this specification. In this embodiment, a soccer game is given as an example of an event. The scene of the specific situation of an event is, for example, a goal (shoot) scene, a save scene, a pass scene, a dribble scene, etc. in a soccer game. As described above, the scene of the specific situation may be a scene extracted (listed) as a highlight scene that is a scene of interest in a game. Depending on the method of setting a quiz, the control unit 320 may play and pause a scene before the specific situation, present multiple options described below, and when an answer is selected from the multiple options, present the answer as correct or incorrect, and release the pause to resume the playback of the scene. Note that information (time information) of the position at which the scene playback is paused when a question is set may also be included in the quiz metadata as information on the scene to be set.
[0157] The control unit 320 performs a process of presenting multiple options regarding a specific situation as a quiz question control. In this embodiment, an example of a quiz is one in which a player is asked to answer what action a specific player took in a specific situation. Therefore, the multiple options include options regarding the action of a specific player in a specific situation.
[0158] More specifically, when the specific situation is a shot by a specific player, the multiple options include the shot trajectory (upper right, lower right, upper left, lower left, upper center, lower center, center, etc.). When the specific situation is the next action of a specific player, the multiple options include the type of action (e.g., dribble, pass, cross, or shoot, etc.). For example, a quiz may be given to answer questions such as in which direction the specific player will dribble, to whom he will pass, and where he will cross, as the next action of the specific player.
[0159] In such a case where the multiple options are presented regarding the actions of a specific player in a specific situation, the control unit 320 further performs control to display target points of the actions corresponding to the multiple options on the image (question scene) in the virtual space as a question control for the quiz. For example, when the multiple options are "shooting paths", the control unit 320 displays the shooting positions corresponding to each option in the goal area as target points in the playback of the question scene. Details will be described later with reference to FIG. 15. In addition, when the multiple options are "next actions of a specific player", the control unit 320 may display the moving positions of the ball corresponding to each option on the field (soccer court) (the position of the ball to be moved by the "next action". The moving trajectory and moving direction of the ball may be included.) as target points in the playback of the question scene. The control unit 320 may display the target points when the scene before the specific situation is played and paused in the playback of the question scene.
[0160] 11 prompts the viewer to answer who the specific player involved in a specific situation (e.g., a goal, a pass, etc.) is, and the names of the players are presented as multiple options. Therefore, in the quiz described with reference to Fig. 11, when playing back a scene (quiz video) of a specific situation as a question scene, the control unit 320 plays back the scene after drawing the target (specific) player in a display mode with reduced identifiability.
[0161] The control of setting questions for the various quizzes described above may be performed based on quiz metadata received from the server 10. As described above, the quiz metadata is generated by an operator at the operator terminal 20. In addition to the generation of a quiz that prompts a player to answer who a specific player is involved in a specific situation, as described with reference to FIG. 5, a quiz that prompts a player to answer a shooting course and a quiz that prompts a player to answer the next action of a specific player may also be generated by the operator at the operator terminal 20. In addition, the quiz metadata may be automatically generated at the server 10.
[0162] Here, the generation of the quiz metadata is not limited to the generation by the operator terminal 20 or the server 10, but may be enabled so that the user can also create it at the user terminal 30. The quiz metadata created by the user may be shared with other users via the server 10. This allows users participating in the virtual space to enjoy quizzes that each user has arbitrarily created.
[0163] The control unit 320 controls the display unit 340 to display a screen for generating a quiz using an image of a player avatar corresponding to a player in a virtual space, which is generated based on the motion data of each player. The control unit 320 sets a scene of a specific situation in an event to be used as a question scene, based on a user operation on a quiz creation screen. Specifically, the control unit 320 accepts a user input of a start time and an end time of a scene of a specific situation in a match selected by the user. The control unit 320 also sets a plurality of options including a correct answer option and an incorrect answer option regarding the specific situation. Specifically, the control unit 320 accepts a setting of a selection of a plurality of options and a correct answer option, based on a user operation on a quiz creation screen. The control unit 320 sets the options other than the correct answer option selected by the user as an incorrect answer option among the plurality of options.
[0164] In addition, the control unit 320 can set target points of actions corresponding to multiple options on the image of the virtual space (quiz video) displayed on the quiz creation screen based on a user operation on the quiz creation screen. For example, when multiple options are each shooting course, the control unit 320 displays the position of the shooting course corresponding to each option as a target point in a goal area included in the image of the virtual space. The user can move each target point (for example, a point image of the number or color of the option) displayed in the goal area and set each target point to an arbitrary position. The positions of the shooting courses indicated by the multiple options can be indicated not only by words such as "upper right" and "lower left" but also by using a point image on the image of the virtual space displayed as the quiz video, making it easier for the quiz answerer to intuitively understand.
[0165] The details of the quiz creation described above will be described later with reference to Fig. 18. Note that the quiz creation screen (display screen 500) described with reference to Fig. 5 may be displayed on the user terminal 30, and the quiz metadata described with reference to Fig. 5 may be generated in the user terminal 30.
[0166] (Operation unit 330 and display unit 340) The operation unit 330 accepts an operation input by the user and outputs the input information (user operation) to the control unit 320. The operation unit 330 may be realized by, for example, a touch panel, a keyboard, or a mouse. The display unit 340 displays various display screens according to the control of the control unit 320. The display unit 340 may be realized by, for example, a CRT display device, a liquid crystal display (LCD) device, or an OLED device. In addition, when the user terminal 30 is realized by an HMD worn on the user's head, the display unit 340 may be a transmissive or non-transmissive display located in front of the user's eyes when worn. Here, the HMD worn on the user's head may be any of an optical see-through type, a video see-through type, and other types. The operation unit 330 and the display unit 340 may be realized by an integrated configuration such as a touch panel display.
[0167] (Audio output unit 350) The audio output unit 350 has a function of outputting audio according to the control of the control unit 320. For example, the audio output unit 350 outputs audio in a virtual space (cheering during a match, the voices of the players, various sound effects, etc.). The various sound effects may be, for example, a countdown to an answer time when a quiz question is asked, or sound effects when the correct or incorrect answer is presented. The audio output unit 350 may be realized by a speaker, earphones, or the like.
[0168] (Storage unit 360) The storage unit 360 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 320, and a RAM that temporarily stores parameters that change as appropriate. The storage unit 360 may also store event information and quiz metadata received from the server 10, or quiz metadata generated by a user.
[0169] (7-2. Quiz Questions) Next, the control of quiz setting performed in the user terminal 30 according to this embodiment will be described.
[0170] FIG. 14 is a diagram showing an example of a quiz object arranged in a virtual space according to this embodiment. The display screen 700 of FIG. 14 is an example of a display screen displayed on the display unit 340 of the user terminal 30. A quiz object 702 for starting a quiz is arranged in the virtual space. The shape of the quiz object 702 is not particularly limited. The user terminal 30 draws the quiz object 702 based on a 3D model of the quiz object 702 included in the information for reproducing the virtual space received from the server 10. In addition, the arrangement position of the quiz object 702 may be, for example, beside a soccer court, and is not particularly limited. The user terminal 30 arranges the quiz object 702 in the virtual space based on the arrangement information of the quiz object 702 included in the information for reproducing the virtual space received from the server 10.
[0171] The user may operate the user avatar U1 to approach the quiz object 702 and perform a quiz start operation on the quiz object 702. The user terminal 30 starts asking a quiz in response to the user's start operation on the quiz object 702. A ranking table 704 of the scores of each user who has taken a quiz may be displayed near the quiz object 702. The user terminal 30 may also allow the user to select the type of quiz to answer in the quiz start operation. For example, the user terminal 30 may display a screen for selecting the type of quiz in response to the user's start operation. The types of quiz include, for example, a quiz that asks the user to answer who a specific player involved in a specific situation is, a quiz that asks the user to answer a shooting course, and a quiz that asks the user to answer the next action of a specific player. The type of quiz to be asked may be random. The quiz to be asked may be one question or multiple questions.
[0172] FIG. 15 is a diagram showing an example of a display screen when a quiz for answering a shooting course is asked according to this embodiment. The user terminal 30 controls to play a scene of a specific situation (for example, a shooting scene) as a quiz video in response to a user's operation to start the quiz, and to present multiple options as a multiple-choice quiz. More specifically, the user terminal 30 plays and pauses a scene up to the specific situation (pause position), and presents multiple options. The camera work is not particularly limited, and may be, for example, a camera work that follows a player (specific player) who is the subject of the quiz from behind. Note that such camera work is the standard, and the user may be able to select any viewpoint (camera work) such as a bird's-eye view, a goalkeeper (GK) view, a player view which is the view of the target player, and a user's avatar view.
[0173] 15, the scene playback is paused before a specific situation occurs, here just before the player avatar P10 takes a shot, and an option panel image 712 showing a number of options is displayed. For example, four options, A, B, C, and D, are displayed on the option panel image 712.
[0174] A target point 714 corresponding to each option is displayed in the quiz video (image in virtual space) on the display screen 710. This allows the user to intuitively understand the shooting course indicated by each option. Furthermore, the user terminal 30 may be configured to display the paused scene from any angle of 360 degrees with the ball at the center in response to a swipe operation on the screen by the user even in a paused state.
[0175] Furthermore, the user terminal 30 may start and display a countdown of the answer time (quiz time limit) at the timing of displaying the option panel image 712. In the example shown in FIG. 15, the countdown is displayed on the right edge of the option panel image 712.
[0176] When the user selects an answer from the multiple options, the user terminal 30 displays whether the answer is correct or not, and controls the playback of the scene to be resumed by canceling the pause. Even if no answer is selected, if the answer time has elapsed (if the count reaches 0), the user terminal 30 displays whether the answer is correct or not, and controls the playback of the scene to be resumed by canceling the pause.
[0177] Fig. 16 is a diagram showing an example of a correct / incorrect display of a quiz for answering a shooting course according to this embodiment. On a display screen 720 in Fig. 16, the pause of the scene playback is released and playback is resumed, and a correct / incorrect panel image 722 showing whether the answer is correct or incorrect is displayed. The correct / incorrect panel image 722 shows whether the user's answer is correct or incorrect, and the correct answer option.
[0178] After the scene playback ends, the user terminal 30 may play back the same scene again in a loop. If there is a next quiz, a button for starting the next quiz is displayed on the pass / fail panel image 722. When the user taps the button, the user terminal 30 asks the next quiz.
[0179] Fig. 17 is a diagram showing an example of a display screen when a quiz for answering the next action is asked according to this embodiment. When playing back a scene of the quiz for answering the next action, for example, camerawork (bird's eye) is used that captures the target player (a specific player. In the example shown in Fig. 17, player avatar P12) in the field of view while looking down from a slightly upward angle. The user terminal 30 plays back the video before a specific situation is reached, specifically, until just before the specific player (player avatar P12) takes the next action, and then pauses the playback.
[0180] Furthermore, the user terminal 30 pauses the scene playback and displays an option panel image 732 showing multiple options. The multiple options presented relate to the following actions. For example, the multiple options include dribbling, passing to □□□ (player's name), passing to ○○○ (player's name), and crossing. Furthermore, as shown on the display screen 730 of FIG. 17, target points 734 corresponding to each option are displayed in the quiz video (image of the virtual space). The target points 734 are indicated by arrows showing the movement trajectory of the ball corresponding to each option. This allows the user to intuitively grasp the actions indicated by each option.
[0181] Also in the display screen 730 shown in FIG. 17, the user terminal 30 may be configured to display the paused scene from any angle of 360 degrees with the ball at the center in response to a swipe operation on the screen by the user.
[0182] After presenting the multiple options, the user terminal 30 starts a countdown of the answer time in the same manner as the quiz question control described with reference to FIG. 15. When the user selects an answer from the multiple options or when the count reaches 0, the user terminal 30 displays the result of the quiz and performs control to release the pause and resume the playback of the scene.
[0183] After the scene playback ends, the user terminal 30 may play back the same scene again in a loop. If there is a next quiz, the user terminal 30 displays a button for starting the next quiz on the display screen. When the user taps the button, the user terminal 30 asks the next quiz.
[0184] (7-3. Quiz Creation) 18 is a diagram showing an example of a quiz creation screen according to this embodiment. A quiz creation screen 740 shown in FIG.
[0185] The user creates quiz metadata by inputting appropriate data into the quiz creation screen 740. In response to a user operation on the quiz creation screen 740, the user terminal 30 sets a quiz video (a scene of a specific situation in an event) and multiple options including correct and incorrect options regarding the specific situation.
[0186] 18 is an example of a creation screen for a quiz for answering a shooting course. The user may select the type of quiz he or she wants to create from, for example, a pull-down list, and a creation screen corresponding to the selected type of quiz may be displayed.
[0187] The upper left corner of the quiz creation screen 740 displays a Save button for saving the created quiz, a Load button for loading a file (quiz metadata) of a previously created quiz, and an Upload button for uploading the created quiz to the server 10. The user can tap the Load button to load quiz metadata created previously and modify the quiz on the quiz creation screen 740. In addition, when the user taps the Upload button to send the quiz metadata created by the user to the server 10, the quiz metadata is shared with other users from the server 10, and the other users can also enjoy the quiz created by the user.
[0188] When creating a new quiz, the user taps the Select Match button displayed on the quiz creation screen 740 to select a match to be used in the quiz. When the Select Match button is tapped, a list of selectable matches is displayed. When a match is selected, the date and time of the selected match, opponent information, etc. are displayed in text on the quiz creation screen 740.
[0189] On the quiz creation screen 740, a replay video (image of the virtual space) 741 using a player avatar in the virtual space of the selected match is displayed. In addition, below the replay video 741, there is a seek bar, and the playback position is displayed by an icon. The user can change the playback position by tapping the icon. The playback time (time information of the playback position) is displayed in the lower right of the seek bar. In addition, below the icon, a toggle that allows playback and pausing of the replay video is displayed.
[0190] The user decides on a scene to be used as a quiz video (a scene of a specific situation, also called a question scene) while checking the contents of the scene in the reproduced video 741. Specifically, the user inputs the start time and end time of the scene to be used as the quiz video in a time input field 743 displayed on the right side of the quiz creation screen 740. Icons for the start and end positions may be displayed on the seek bar, and each icon may be linked to the input of the start time and end time in the time input field 743. Furthermore, the user terminal 30 may be able to select the scene to be used as the quiz video from highlight scenes previously extracted by the server 10.
[0191] Also, the user may be allowed to arbitrarily input a position before a specific situation occurs in a scene used as a quiz video, i.e., a position at which playback of the scene when a quiz is asked is paused, in the time input field 743. Also, an icon of the pause position may be displayed on the seek bar, and the icon may be linked to the input of the pause time in the time input field 743. Also, the pause position may be automatically determined by the user terminal 30 or the server 10.
[0192] The end time set here may be treated as the pause time. That is, the user sets a scene before a specific situation is reached as the quiz video. In this case, in replaying scenes when a quiz is asked, the user terminal 30 may play back up to the set end time and then pause, and after the user's answer, play back the scenes from the set end time onwards for a certain period of time. Then, when looping the scenes after the user's answer, the user terminal 30 may target the scenes from the set start time to a certain period of time after the end time for loop playback.
[0193] In the Selections field 744, a plurality of options are set. In the example shown in FIG. 18, for example, four options can be set. Each option corresponds to a point image 746 of a target point displayed in the reproduced image 741. The user can move the position of the point image 746a by, for example, tapping the point image 746a corresponding to option A and moving the finger. In this way, the target point corresponding to each option can be arbitrarily selected in the reproduced image 741. For each option displayed in the Selections field 744, text such as "bottom right", "top right", "top left", and "bottom left" may be automatically input according to the position of the point image 746.
[0194] In the Answer column 745, the correct answer option is set.
[0195] A title button for inputting a title of the quiz is displayed in the upper right corner of the quiz creation screen 740. When the title button is tapped, a software keyboard is displayed, and the user can input a title. The title of the quiz may be input by receiving voice input from the user.
[0196] Although the quiz creation screen according to this embodiment has been described above, the quiz creation screen shown in FIG. 18 is only an example, and this embodiment is not limited to this.
[0197] (7-4. Operation Processing) FIG. 19 is a flowchart showing an example of the flow of operation processing of quiz question setting control according to this embodiment.
[0198] 19, first, the user terminal 30 judges whether or not a start operation is performed by the user on the quiz object 702 (see FIG. 14) arranged in the virtual space (S403). The user terminal 30 waits until the start operation is performed (S403 / No).
[0199] When a start operation is performed (S403 / Yes), the user terminal 30 displays a quiz screen (S406). The quiz screen is a screen that displays a quiz video.
[0200] Next, the user terminal 30 plays the quiz video displayed on the quiz screen (S409). Specifically, the user terminal 30 plays the video up to the scene leading to the specific situation, and then pauses the video. In addition, the user terminal 30 pauses the video and presents multiple options on the quiz screen.
[0201] Next, when the user answers (selects an option) (S412 / Yes), the user terminal 30 displays whether the answer is correct or not (S418).
[0202] If the user does not answer (S412 / No), the user terminal 30 returns to S412 and waits for an answer to be input until a certain time has passed (S415 / No). If the certain time has passed without an answer being input (S415 / Yes), the user terminal 30 displays whether the answer was correct or not (S418).
[0203] Then, in the case where the user terminal 30 proceeds to the next quiz (S421 / Yes), the process returns to S406 and the next quiz is set in the same manner.
[0204] On the other hand, if the user does not proceed to the next quiz (S421 / No), the quiz question setting control process ends. "If the user does not proceed to the next quiz" refers to a case where a certain number of quizzes (e.g., five questions) have all been completed. It is also possible that the user may terminate the quiz at their own discretion even if there is a next quiz. The user terminal 30 may display the user's score and ranking for the quiz experience, and then return to the virtual space screen as shown in FIG. 3.
[0205] An example of the operation process for setting a quiz according to this embodiment has been described above. Note that the operation process shown in Fig. 19 is just an example, and this embodiment is not limited to this.
[0206] (7-5. Supplementary Information) The creation of the quiz is not limited to being performed by operations using the operation unit 330, but may be performed by voice input by the user.
[0207] The quizzes to be asked are assumed to be a fixed number automatically determined by the server 10, but are not limited to this. At the start of the quiz, a list of quizzes may be displayed so that the user can select the quiz they wish to answer.
[0208] If there are multiple quiz types, the user may filter the type of quiz they wish to answer.
[0209] The quizzes to be presented may be filtered by the user according to the user's preferences. For example, when the user has answered various quizzes in the past, the server 10 may learn the types of quizzes that the user likes and recommend quizzes that match the user's preferences.
[0210] The server 10 may give a reward to the user when the quiz is answered correctly. The server 10 may give the user a reward according to the score (number of correct answers). The reward may be, for example, points (points that can be used to purchase items, etc.) or items that can be used in the virtual space. The server 10 may give a larger reward the more seconds there are remaining in the answering time when the user answers the quiz correctly (the faster the user answers correctly).
[0211] The appearance of the quiz object is not limited to the example shown in Fig. 14, and various variations are assumed. For example, the appearance of the quiz object may be changed according to the type of quiz to be given, or the shape, appearance, type, etc. of the quiz object may be changed arbitrarily by the user. Also, a quiz object may be provided for each type of quiz.
[0212] The display of the quiz question screen and the quiz creation screen on the user terminal 30 may be controlled by a control unit of the user terminal 30 based on quiz metadata, or display information for the quiz question screen and the quiz creation screen may be received from the server 10 and displayed on the display unit 340 of the user terminal 30.
[0213] In the quiz video displayed on the quiz screen, characters (player avatars) of teams without authorization may all be drawn as generic characters without faces.
[0214] <8. Supplementary Information> Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.
[0215] The scope of the system in this specification may be the entire information processing system (quiz question setting system 1) shown in Fig. 1, or may include the information processing system, a server, or another information processing system. The system may also include a processor, which is a processing circuit.
[0216] The configuration of the quiz setting system 1 is not limited to the example shown in Fig. 1, and may include at least one of the server 10, the operator terminal 20, and the user terminal 30. The quiz setting system 1 may be realized by the server 10, the operator terminal 20, or the user terminal 30. Each function of the control unit 230 of the operator terminal 20 described with reference to Fig. 4 may be realized by the server 10. Each function of the control unit 320 of the user terminal 30 described with reference to Fig. 13 may be realized by the server 10.
[0217] An example of the correspondence between each unit of the hardware configuration described with reference to FIG. 12 and each unit of the server 10, the operator terminal 20, and the user terminal 30 will be described.
[0218] The CPU (an example of a processing circuit) corresponds to, for example, the control unit 120 of the server 10, the control unit 230 of the operator terminal 20, or the control unit 320 of the user terminal 30. The input device 915 and the output device 917 correspond to, for example, the operation display unit 220 of the operator terminal 20. The input device 915 may also correspond to the operation unit 330 of the user terminal 30. The output device 917 may also correspond to the display unit 340 and the audio output unit 350.
[0219] The storage device 919 corresponds to, for example, the memory unit 130 of the server 10, the memory unit 240 of the operator terminal 20, or the memory unit 360 of the user terminal 30. The communication device 925 corresponds to, for example, the communication unit 110 of the server 10, the communication unit 210 of the operator terminal 20, or the communication unit 310 of the user terminal 30.
[0220] It is also possible to create a computer program for causing hardware such as a CPU (an example of a processing circuit), ROM, and RAM built into the above-mentioned server 10, operator terminal 20, or user terminal 30 to perform the functions of the server 10, operator terminal 20, or user terminal 30. Also provided is a computer-readable storage medium that stores the computer program.
[0221] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.
[0222] Note that the following configurations also fall within the technical scope of the present disclosure. (1) a control unit that controls display of a player avatar in a virtual space that corresponds to a player participating in an event, the player avatar being generated based on motion data of the player; The control unit is A process of controlling playback of a scene of a specific situation of the event in the virtual space; A process of presenting a plurality of options regarding the particular situation; A process of presenting whether an answer selected from the plurality of options is correct or not; To carry out Information processing system. (2) The information processing system described in (1), wherein the multiple options relate to a specific player's behavior in the specific situation. (3) The information processing system according to (2), wherein the control unit performs control to display target points of actions corresponding to the multiple options. (4) the specific situation being a shot by the specific player; the plurality of options are shooting trajectories; The target point is a shooting position in the goal area. The information processing system according to (3) above. (5) the particular situation being the particular player's next action; the plurality of options are types of actions; The target point is a position on the field where the ball will move. The information processing system according to (3) above. (6) The information processing system according to (5), wherein the types of actions include at least one of dribbling, passing, crossing, and shooting. (7) The control unit is reproducing and pausing a scene leading up to the specific situation, and displaying the plurality of options and the target point; The information processing system according to any one of (3) to (6), wherein when an answer is selected from the plurality of options, the system presents whether the answer is correct or incorrect, and performs control to release the pause and resume playback of the scene. (8) The information processing system described in (1), wherein the multiple options relate to who the specific players were involved in the specific situation. (9) The information processing system according to (8), wherein the control unit displays the specific player in a display manner that reduces distinctiveness when playing back a scene of the specific situation. (10) The control unit is reproducing a scene including the specific situation and displaying the plurality of options; The information processing system according to (8) or (9), wherein after playback of the scene has ended, the correctness or incorrectness of the answer is presented. (11) a quiz object for starting a quiz is placed in the virtual space; The control unit of the information processing system described in any one of (1) to (10) controls the playback of a scene of the specific situation as a quiz video in response to a user's start operation on the quiz object, and the presentation of the multiple options as a multiple-choice quiz. (12) displaying a screen for generating a quiz using a player avatar corresponding to one or more players in a virtual space, the player avatar being generated based on motion data of the one or more players acquired from event information; A process of setting, on the screen, a scene of a specific situation in the event and a plurality of options including a correct answer option and an incorrect answer option regarding the specific situation; A control unit that performs Information processing system. (13) The information processing system described in (12), wherein the multiple options relate to a specific player's behavior in the specific situation. (14) The information processing system according to (13), wherein the control unit performs processing for setting target points of actions corresponding to the plurality of options in the virtual space displayed on the screen. (15) The information processing system according to (13) or (14), wherein the plurality of options are a shooting course by the specific player or a next action by the specific player. (16) The control unit is calculating an involvement rate of the player in a specific situation in an event based on the motion data; A process of outputting selection candidate information that is a candidate for the plurality of options based on the participation rate; a process of setting data for displaying a target player in a display mode with reduced distinctiveness based on the selected selection candidate information; The information processing system according to (12) above, (17) The information processing system according to (16), wherein the control unit outputs the selection candidate information in descending order of the participation rate. (18) The information processing system according to (16) or (17), wherein the selection candidate information is information indicating one or more player candidates determined from among the multiple players based on the participation rate. (19) The information processing system according to any one of (16) to (18), wherein the selection candidate information is information indicating one or more specific situation candidates determined based on the participation rate. (20) The information processing system according to any one of (16) to (19), wherein the control unit performs a process of calculating each player's involvement rate with the ball in the specific situation as an involvement rate with the specific situation based on ball information obtained from the event information and including at least position information of a ball used in the event. (twenty one) The control unit performs processing to calculate each player's involvement rate with the ball in the specific situation based on calculating the number of times the player contacted the ball or the time the player was in the vicinity of the ball in the specific situation. (twenty two) The information processing system according to (18), wherein the specific situation is a scene determined according to time information indicating a highlight scene in the event. (twenty three) the event is a match, The highlight scene is a scene in which a player scores a goal in the game. The information processing system according to (22). (twenty four) The information processing system according to (23), wherein the control unit performs processing for outputting the player who scored the point as the selection candidate information with the highest priority regardless of the participation rate. (twenty five) The control unit performs processing to output information for rendering an image of a virtual space including an image of a virtual space representing the specific situation based on the event information. (26) The information processing system according to (18), wherein the control unit outputs the selection candidate information as a candidate for a correct answer option selected by an operator creating the quiz for a quiz about the player. (27) the quiz is a multiple choice quiz, the control unit performs a process of setting data indicating a player that is further selected from the selection candidate information as a candidate for an incorrect answer to the quiz and is displayed in a display manner that allows the player to be distinguished from other players. The information processing system according to (26) above. (28) The information processing system described in (27), wherein the control unit performs processing to output the player with the highest participation rate as a candidate for the correct answer option, and output the players with the next highest participation rate as candidates for the incorrect answer option. (29) The information processing system described in (28), wherein the control unit outputs information for drawing an image of a virtual space including a display of a list of the correct answer options and the incorrect answer options selected from the selection candidate information. (30) The information processing system according to any one of (16) to (29), wherein the display mode with reduced distinctiveness is a display mode that does not reproduce the face or skin color of the player, or a display mode that does not reproduce text written on an item worn by the player. (31) The information processing system according to any one of (16) to (30), wherein the control unit performs a process of displaying the selection candidate information based on the contribution rate as the output of the selection candidate information based on the contribution rate. (32) The information processing system according to any one of (16) to (30), wherein the control unit performs a process of transmitting the selection candidate information to a terminal device operated by an operator as an output of the selection candidate information based on the contribution rate. (33) The information processing system according to (32), wherein the control unit further performs processing to transmit time information indicating a scene of a specific situation in the event. (34) Computer, a control unit that controls the display of a player avatar in a virtual space that corresponds to a player participating in an event and is generated based on the motion data of the player; The control unit is A process of controlling playback of a scene of a specific situation of the event in the virtual space; A process of presenting a plurality of options regarding the particular situation; A process of presenting whether an answer selected from the plurality of options is correct or not; A program to carry out the above. (35) The processor: Controlling display of a player avatar in a virtual space, the player avatar being generated based on motion data of the player participating in the event; and Controlling playback of a scene of a particular situation of the event in the virtual space; presenting a plurality of options relating to said particular situation; and presenting a correct or incorrect answer to a selected answer from the plurality of options; An information processing method comprising: [Explanation of symbols]
[0223] 1. Quiz system 10 Server 110 Communications Department 120 Control section 121 Highlight Scene Extraction Unit 130 Storage section 131 Event Information 132 Highlight Scene Metadata 133 Quiz Metadata 20 Operator terminal 210 Communications Department 220 Operation display section 230 Control Unit 231 Participation Rate Calculation Unit 232 Candidate Decision Department 233 Quiz Metadata Generation Unit 240 Storage section 30 User terminals 310 Communications Department 320 Control Unit 330 Operation section 340 Display section 350 Audio output section 360 storage section 702 Quiz Object 40 Network
Claims
1. a control unit that controls display of a player avatar in a virtual space that corresponds to a player participating in an event, the player avatar being generated based on motion data of the player; The control unit is A process of controlling playback of a scene of a specific situation of the event in the virtual space; A process of presenting a plurality of options regarding the particular situation; A process of presenting whether an answer selected from the plurality of options is correct or not; To carry out Information processing system.
2. The information processing system according to claim 1 , wherein the plurality of options relate to a specific player's action in the specific situation.
3. The information processing system according to claim 2 , wherein the control unit performs control to display target points of actions corresponding to the plurality of options.
4. the specific situation being a shot by the specific player; the plurality of options are shooting trajectories; The target point is a shooting position in the goal area. The information processing system according to claim 3 .
5. the particular situation being the particular player's next action; the plurality of options are types of actions; The target point is a position on the field where the ball will move. The information processing system according to claim 3 .
6. The information processing system according to claim 5 , wherein the types of actions include at least one of a dribble, a pass, a cross, and a shot.
7. The control unit is reproducing and pausing a scene leading up to the specific situation, and displaying the plurality of options and the target point; 4. The information processing system according to claim 3, wherein when an answer is selected from the plurality of options, the system displays whether the answer is correct or not, and controls to release the pause and resume playback of the scene.
8. The information processing system according to claim 1 , wherein the plurality of options relate to who the particular players involved in the particular situation are.
9. The information processing system according to claim 8 , wherein the control unit displays the specific player in a display mode that reduces distinctiveness in playing back the scene of the specific situation.
10. The control unit is reproducing a scene including the specific situation and displaying the plurality of options; 9. The information processing system according to claim 8, wherein after playback of the scene has ended, the answer to the question is displayed as correct or incorrect.
11. a quiz object for starting a quiz is placed in the virtual space; The information processing system according to claim 1 , wherein the control unit controls the playback of a scene of the specific situation as a quiz video in response to a user's start operation on the quiz object, and the presentation of the multiple options as a multiple-choice quiz.
12. displaying a screen for generating a quiz using a player avatar corresponding to one or more players in a virtual space, the player avatar being generated based on motion data of the one or more players acquired from event information; A process of setting, on the screen, a scene of a specific situation in the event and a plurality of options including a correct answer option and an incorrect answer option regarding the specific situation; A control unit that performs Information processing system.
13. The information processing system according to claim 12 , wherein the plurality of options relate to a specific player's action in the specific situation.
14. The information processing system according to claim 13 , wherein the control unit performs processing for setting target points of actions corresponding to the plurality of options in the virtual space displayed on the screen.
15. The information processing system according to claim 13 , wherein the plurality of options are a shooting course for the specific player or a next action for the specific player.
16. The control unit is calculating a participation rate of the player in a specific situation in an event based on the motion data; A process of outputting selection candidate information that is a candidate for the plurality of options based on the participation rate; a process of setting data for displaying a target player in a display mode with reduced distinctiveness based on the selected selection candidate information; The information processing system according to claim 12 , further comprising:
17. The information processing system according to claim 16 , wherein the control unit outputs the selection candidate information in descending order of the participation rate.
18. The information processing system according to claim 16 , wherein the selection candidate information is information indicating one or more player candidates determined from among a plurality of the players based on the participation rate.
19. The information processing system according to claim 16 , wherein the selection candidate information is information indicating one or more candidates for a specific situation determined based on the participation rate.
20. the control unit performs a process of calculating an involvement rate of each player with respect to the ball in the specific situation as an involvement rate with the specific situation, based on ball information including at least position information of a ball used in the event, which is acquired from the event information; 17. The information processing system according to claim 16.
21. the control unit performs a process of calculating an involvement rate of each player with respect to the ball in the specific situation based on calculating the number of times the player contacted the ball or the time the player was in the vicinity of the ball in the specific situation.
21. The information processing system according to claim 20.
22. The information processing system according to claim 18 , wherein the specific situation is a scene determined according to time information indicating a highlight scene in the event.
23. the event is a match, The highlight scene is a scene in which a player scores a goal in the game.
23. The information processing system according to claim 22.
24. The information processing system according to claim 23 , wherein the control unit performs processing for outputting the player who scored the point as the selection candidate information with the highest priority regardless of the participation rate.
25. The information processing system according to claim 16 , wherein the control unit performs a process of outputting information for rendering an image of a virtual space including an image of the virtual space representing the specific situation, based on the event information.
26. The information processing system according to claim 18 , wherein the control unit outputs the selection candidate information as a candidate for a correct answer to a quiz about the player, the correct answer being selected by an operator who creates the quiz.
27. the quiz is a multiple choice quiz, the control unit performs a process of setting data indicating a player that is further selected from the selection candidate information as a candidate for an incorrect answer to the quiz and is displayed in a display manner that allows the player to be distinguished from other players.
27. The information processing system according to claim 26.
28. 28. The information processing system according to claim 27, wherein the control unit performs processing to output the player with the highest participation rate as a candidate for the correct answer option, and to output the players with the next highest participation rates as candidates for the incorrect answer option.
29. The information processing system according to claim 28 , wherein the control unit outputs information for rendering an image of a virtual space including a display of a list of the correct answer options and the incorrect answer options selected from the selection candidate information.
30. The information processing system according to claim 16, wherein the display manner with reduced distinctiveness is a display manner that does not reproduce the face or skin color of the player, or a display manner that does not reproduce text written on an item worn by the player.
31. The information processing system according to claim 16 , wherein the control unit performs a process of displaying the selection candidate information based on the contribution rate as the output of the selection candidate information based on the contribution rate.
32. The information processing system according to claim 16 , wherein the control unit performs a process of transmitting the selection candidate information to a terminal device operated by an operator as an output of the selection candidate information based on the participation rate.
33. The information processing system according to claim 32 , wherein the control unit further performs processing for transmitting time information indicating a scene of a specific situation in the event.
34. Computer, a control unit that controls the display of a player avatar in a virtual space that corresponds to a player participating in an event and is generated based on the motion data of the player; The control unit is A process of controlling playback of a scene of a specific situation of the event in the virtual space; A process of presenting a plurality of options regarding the particular situation; A process of presenting whether an answer selected from the plurality of options is correct or not; A program to carry out the above.
35. The processor: Controlling display of a player avatar in a virtual space, the player avatar being generated based on motion data of the player participating in the event; and Controlling playback of a scene of a particular situation of the event in the virtual space; presenting a plurality of options relating to said particular situation; and presenting a correct or incorrect answer to a selected answer from the plurality of options; An information processing method comprising:
Citation Information
Patent Citations
Information processing device, information processing method, and program
WO2020174586A1