PROGRAM, INFORMATION PROCESSING APPARATUS, AND INFORMATION PROCESSING METHOD

Abstract

To convey contents of play clearly.SOLUTION: A program runs processing of generating visual information that intermittently indicates a plurality of ball positions in a trajectory of a ball in a play video on a computer. The technology can be applied to software for editing a video of table tennis play.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present technology relates to a program, an information processing device, and an information processing method, and more particularly to a program, an information processing device, and an information processing method that allow the content of a play to be communicated in an easily understandable manner. [Background technology]

[0002] 2. Description of the Related Art Conventionally, techniques have been proposed for reducing the difference in appearance between images of players playing a variety of sports, making it easier to compare the images (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-92006 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present technology has been developed in light of these circumstances, and is intended to make it possible to communicate the content of a play in an easily understandable manner. [Means for solving the problem]

[0005] A program according to one aspect of the present technology causes a computer to intermittently display a plurality of positions of the ball on a ball trajectory in a play video, and display a position on or around the ball at least in some of the positions of the ball. , including at least one of the number of rotations and the direction of rotation of the ball. The characteristics of the ball Includes visual effects based on movement A process for generating visual information is executed.

[0006] According to one aspect of the present technology, an information processing device intermittently displays a plurality of positions of the ball on a ball trajectory in a play video, and displays a ball on or around the ball at least in some of the positions of the ball. , including at least one of the number of rotations and the direction of rotation of the ball. The characteristics of the ball Includes visual effects based on movementAn image processing unit is provided that generates visual information.

[0007] In one aspect of the present technology, an information processing method includes: an information processing device intermittently displays a plurality of positions of the ball on a ball trajectory in a play video; and displays a plurality of positions of the ball on or around the ball at least in some of the positions of the ball. , including at least one of the number of rotations and the direction of rotation of the ball. The characteristics of the ball Includes visual effects based on movement Generate visual information.

[0008] In one aspect of the present technology, a plurality of positions of the ball on the trajectory of the ball are intermittently shown in a play video, and a ball is displayed on or around the ball at least in some of the positions of the ball. , including at least one of the number of rotations and the direction of rotation of the ball. The characteristics of the ball Includes visual effects based on movement Visual information is generated. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration example of an information processing system to which the present technology is applied. [Diagram 2] FIG. 2 is a diagram showing an example of the installation positions of a camera and an image sensor. [Diagram 3] 1 is a block diagram showing an example of the configuration of an information processing device; [Figure 4] 4 is a block diagram showing a configuration example of an information processing unit. FIG. [Diagram 5] 13 is a flowchart illustrating an analysis and editing process. [Figure 6] FIG. 2 is a diagram showing a first example of a visual information-added image. [Figure 7] FIG. 11 is a diagram showing a second example of a visual information-added image. [Figure 8] FIG. 13 is a diagram showing a third example of a visual information-added image. [Figure 9] FIG. 13 is a diagram showing a fourth example of a visual information-added image. [Figure 10] FIG. 13 is a diagram showing a fifth example of a visual information-added image. [Figure 11] FIG. 13 is a diagram showing a sixth example of a visual information-added image. [Figure 12] FIG. 13 is a diagram showing a seventh example of a visual information-added image. [Figure 13] FIG. 13 is a diagram showing an eighth example of a visual information-added image. [Figure 14] FIG. 13 is a diagram showing a ninth example of a visual information-added image. [Figure 15] FIG. 17 is a diagram showing a tenth example of a visual information-added image. [Figure 16] FIG. 13 is a diagram showing an example of a display position of ball information. [Figure 17] A figure showing an 11th example of a visual information-added image. [Figure 18] FIG. 13 is a diagram showing a modified example of visual information. [Figure 19] FIG. 13 is a diagram showing a modified example of visual information. [Figure 20] FIG. 13 is a diagram showing a modified example of visual information. [Figure 21] FIG. 13 is a diagram showing a modified example of visual information. [Figure 22] FIG. 13 is a diagram showing a modified example of visual information. [Diagram 23] FIG. 13 is a diagram showing a modified example of visual information. [Figure 24] FIG. 13 is a diagram showing a modified example of visual information. [Diagram 25] FIG. 13 is a diagram showing a modified example of visual information. [Figure 26] FIG. 13 is a diagram showing a modified example of visual information. [Figure 27] FIG. 13 is a diagram showing a modified example of visual information. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present technology will be described in the following order. 1. Embodiment 2. Variations 3.Other

[0011] <<1. Preferred embodiment>> An embodiment of the present technology will be described with reference to FIGS.

[0012] <Example of information processing system configuration> FIG. 1 is a block diagram showing an embodiment of an information processing system 101 to which the present technology is applied.

[0013] The information processing system 101, for example, photographs and analyzes plays in table tennis matches or practice, and edits and distributes footage of table tennis plays (hereinafter referred to as play footage).

[0014] The information processing system 101 includes cameras 111-1 to 111-m, image sensors 112-1 to 112-n, an information processing device 113, a server 114, and a network 121. The information processing device 113 and the server 114 are connected to each other via the network 121 such as the Internet, and are capable of communicating with each other.

[0015] The cameras 111-1 to 111-m are, for example, cameras for broadcasting. At least some of the cameras 111-1 to 111-m are high-speed cameras capable of high-speed shooting (for example, 960 fps).

[0016] For example, the cameras 111-1 to 111-m capture the table tennis play and supply the obtained play footage to the information processing device 113 or other broadcasting equipment (not shown). The play footage is used, for example, for broadcasting the table tennis match, analyzing the play, and the like.

[0017] The image sensors 112-1 to 112-n are each configured by, for example, a CMOS (Complementary MOS) image sensor capable of high-speed shooting (for example, 1000 fps) and high-speed sensing (for example, detection and tracking of an object).

[0018] For example, the image sensors 112-1 to 112-n capture images of a table tennis play and detect and track a table tennis ball, which is an object. The image sensors 112-1 to 112-n also supply the obtained images (hereinafter referred to as sensing images) and information including the detection and tracking results of the ball (hereinafter referred to as sensing information) to the information processing device 113.

[0019] The information processing device 113 is, for example, a device having a video editing function, such as a computer, a video editing device, a broadcasting device, etc. The information processing device 113 analyzes the table tennis play based on the play video, the sensing image, and the sensing information.

[0020] Furthermore, the information processing device 113 edits the play video based on the user's instructions, the analysis results of the play, etc. The information processing device 113 stores, outputs, and transmits the edited play video (hereinafter referred to as edited play video) to the server 114 via the network 121.

[0021] The server 114, for example, stores edited play footage and distributes the edited play footage.

[0022] In the following, when it is not necessary to distinguish between the cameras 111-1 to 111-m, they will simply be referred to as the cameras 111. In the following, when it is not necessary to distinguish between the image sensors 112-1 to 112-n, they will simply be referred to as the image sensors 112.

[0023] <Examples of installation positions of camera 111 and image sensor 112> FIG. 2 shows an example of the installation positions of the camera 111 and the image sensor 112.

[0024] The cameras 111 are installed at positions necessary for broadcasting a table tennis match or analyzing plays, for example. In this example, the cameras 111-1 to 111-8 are installed so as to surround the periphery of the table tennis table 151 and each can capture an image in the direction of the table tennis table 151.

[0025] Image sensor 112 is installed, for example, at a position where it can constantly track the table tennis ball being played. In this example, image sensor 112-1 and image sensor 112-2 are installed near the base or top of a support (not shown) for mounting net 152 on table tennis table 151 so as to be able to capture images of the inside of the court and players on table tennis table 151.

[0026] 2 are merely an example and may be changed as desired. For example, the cameras 111 and image sensors 112 may be installed above the table 151 to capture images of the table 151 from above. However, the cameras 111 and image sensors 112 must be installed in positions that do not interfere with the players' play.

[0027] <Example of configuration of information processing device 113> FIG. 3 is a block diagram showing an example of the configuration of the information processing device 113.

[0028] The information processing device 113 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a bus 204, an input / output interface 205, an input unit 206, an output unit 207, a storage unit 208, a communication unit 209, a drive 210, and a removable media 211.

[0029] The CPU 201 , the ROM 202 , and the RAM 203 are connected to each other via a bus 204 .

[0030] An input / output interface 205 is further connected to the bus 204. An input unit 206, an output unit 207, a storage unit 208, a communication unit 209, and a drive 210 are connected to the input / output interface 205.

[0031] The input unit 206 includes a keyboard, a mouse, a microphone, and the like.

[0032] The output unit 207 includes a display, a speaker, and the like.

[0033] The storage unit 208 includes a hard disk, a non-volatile memory, and the like.

[0034] The communication unit 209 includes a network interface and the like.

[0035] The drive 210 drives a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0036] In the information processing device 113, the CPU 201 loads, for example, a program stored in the storage unit 208 into the RAM 203 via the input / output interface 205 and the bus 204, and executes the program, thereby performing a series of processes.

[0037] Furthermore, the programs executed by the CPU 201 can be provided by being recorded on a removable medium 211 such as a package medium, for example. Furthermore, the programs can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0038] In the information processing device 113, the program can be installed in the storage unit 208 via the input / output interface 205 by mounting the removable medium 211 in the drive 210. The program can also be received by the communication unit 209 via a wired or wireless transmission medium and installed in the storage unit 208. Alternatively, the program can be installed in the ROM 202 or the storage unit 208 in advance.

[0039] <Configuration example of the information processing unit 251> FIG. 4 shows an example of the configuration of an information processing unit 251 that is realized by, for example, the CPU 201 of the information processing device 113 executing a program.

[0040] The information processing unit 251 includes an analysis unit 261 , an image processing unit 262 , a display control unit 263 , and a communication control unit 264 .

[0041] The analysis unit 261 analyzes the table tennis play based on the play video supplied from the camera 111 and the sensing image and sensing information supplied from the image sensor 112. For example, the analysis unit 261 analyzes the ball characteristics (e.g., speed, rotation direction, number of rotations (rotation speed), etc.), the ball trajectory, the swing trajectory, the position where the ball hit the racket (hereinafter referred to as the hit point), the hitting style, and the position where the ball bounced on the court.

[0042] The image processing unit 262 performs various types of image processing. For example, the image processing unit 262 performs image processing related to editing of play footage. Specifically, for example, the image processing unit 262 extracts and synthesizes necessary scenes from play footage captured by each camera 111, generates visual information showing the content of the play, and synthesizes it into the play footage, based on the results of play analysis by the analysis unit 261 or instructions from an editor, etc. Furthermore, the image processing unit 262 outputs the edited play footage after editing.

[0043] The display control unit 263 controls the display and the like provided in the output unit 207, and controls the display of the unedited play video, the edited play video, the sensing image, and the like.

[0044] The communication control unit 264 controls the communication by the communication unit 209 .

[0045] <Analysis and editing process> Next, the analysis and editing process executed by the information processing system 101 will be described with reference to the flowchart of FIG.

[0046] In step S1, each camera 111 and each image sensor 112 captures an image of a table tennis game.

[0047] Specifically, each camera 111 captures the table tennis play and supplies the obtained play video to the information processing device 113.

[0048] Each image sensor 112 captures images of the table tennis game and detects and tracks the ball in parallel with the images captured by each camera 111. Each image sensor 112 supplies the obtained sensing images and sensing information to an information processing device 113.

[0049] The information processing device 113 stores the acquired play footage, sensing images, and sensing information in the storage unit 208, for example.

[0050] In step S2, the image processing unit 262 extracts scenes. For example, the image processing unit 262 extracts scenes to be analyzed and edited from the play footage captured by each camera 111 based on instructions from an editor or the like input via the input unit 206. For example, important scenes during a match and scenes that the manager, coach, player, or the like wants to analyze are extracted.

[0051] It should be noted that the process of step S2 may be omitted, and after all play footage is analyzed in step S3, scenes may be extracted in step S4.

[0052] In step S3, the analysis unit 261 analyzes the play.

[0053] For example, the analysis unit 261 analyzes the rotation direction and rotation number (rotation speed) of the ball based on the play video.

[0054] Here, an example of a method for analyzing the ball's spin direction and spin rate will be described.

[0055] For example, the analysis unit 261 estimates the rotation direction and rotation rate of the ball based on the texture of the ball image in each frame, more specifically, the movement of the logo of the ball image.

[0056] Specifically, the analysis unit 261 detects the area in which the ball appears and the center point of the ball from each frame of the play video using a background subtraction method or the like. The analysis unit 261 extracts an image of the area in which the ball appears (hereinafter referred to as a ball image) from each frame of the play video, with the detected center point of the ball as the center. If necessary, the analysis unit 261 adjusts the size of the ball image so that the size of the ball matches between each of the extracted ball images.

[0057] Next, the analysis unit 261 binarizes each ball image, and detects the center point of the ball logo based on the binarized ball image.

[0058] Next, the analysis unit 261 detects the rotation axis of the ball by connecting the average value of the coordinates of the center point of the ball logo in each ball image with the center point of the ball.

[0059] Then, the analysis unit 261 calculates the inclination of the ball's axis of rotation in the world coordinate system based on the ball's axis of rotation detected based on play footage captured from two or more different directions, for example.

[0060] Furthermore, the analysis unit 261 detects the rotation direction of the ball relative to its rotation axis based on the movement direction of the center point of the ball logo in the ball image.

[0061] Furthermore, the analysis unit 261 detects the frame interval until the center point of the ball logo appears at approximately the same position in the ball image. The analysis unit 261 estimates the time corresponding to the detected frame interval as the time required for the ball to rotate once. Then, the analysis unit 261 calculates the number of rotations of the ball (unit: rpm (rotations per minute)) based on the time required for the ball to rotate once.

[0062] The above-mentioned method for analyzing the ball's spin direction and spin rate is just one example, and other methods may also be used.

[0063] Also, for example, the analysis unit 261 detects the trajectory of the swing (racket) and the position (hit point) where the ball hits the racket by tracking the ball and racket in the play video.

[0064] Furthermore, the analysis unit 261 detects the trajectory (course, ball trajectory) of the ball during play based on the sensing image and sensing information.

[0065] It is also possible to detect the trajectory of the ball by tracing the position of the ball in each frame of the play video captured by the camera 111, for example.

[0066] However, the image sensor 112 has a higher frame rate than the camera 111. Also, since each camera 111 works in conjunction with the other cameras 111 to shoot play footage for broadcast, there are cases where the ball becomes invisible and the ball's trajectory is lost depending on the positions of the players and the ball. On the other hand, as described above, the image sensor 112 is installed in a position where it can constantly track the ball during play, so it will not lose track of the ball's trajectory unless an unexpected play occurs.

[0067] Therefore, it is possible to detect the ball trajectory in more detail and accurately by using the sensing image and sensing information.

[0068] Furthermore, the analysis unit 261 detects the position where the ball bounces on the court based on the detected trajectory of the ball.

[0069] Furthermore, the analysis unit 261 detects the speed of the ball during play (ball speed) based on the sensing image and the sensing information. For example, the analysis unit 261 calculates the ball speed based on the moving distance of the ball between sensing images of different frames and the time between the frames.

[0070] Furthermore, the analysis unit 261 detects the hitting style of each play of the player based on the detected swing trajectory, hit point, and the ball's rotation direction, rotation speed, speed, trajectory, etc. Here, the types of hitting styles are classified into, for example, serve, drive, cut, push, smash, lob, etc. Furthermore, each hitting style may be further classified (for example, by classifying the type of serve) and detected.

[0071] In step S4, the image processor 262 edits the play video.

[0072] For example, the image processor 262 generates visual information that visually indicates the content of a play. The content of a play includes, for example, analysis results of the play, the progress of the score, information about the players, and the like.

[0073] Note that the image processing unit 262 may generate the visual information automatically, or may generate the visual information based on instructions from an editor or the like input via the input unit 206.

[0074] The image processor 262 then superimposes visual information on each frame of the play video as necessary. Examples of the visual information will be described later.

[0075] Furthermore, for example, the image processor 262 extracts and joins together key scenes from gameplay footage as necessary. This task may be performed automatically by the image processor 262 without instructions from an editor or the like, or may be performed based on instructions from an editor or the like input via the input unit 206.

[0076] In the former case, for example, the image processor 262 extracts important or necessary scenes based on the analysis results of the play, etc. For example, scenes that will determine the outcome of the match, scenes where the highest ball speed or spin rate is detected, scenes where the rally lasted the longest, scenes where the crowd cheers the loudest, etc. are extracted.

[0077] In step S5, the information processing device 113 outputs or stores the edited play video.

[0078] For example, the edited play video is stored in the storage unit 208.

[0079] For example, under the control of the communication control unit 264, the communication unit 209 transmits the edited play video to the server 141 via the network.

[0080] In response to this, the server 141, for example, stores edited play footage and distributes it using a video distribution service or the like.

[0081] For example, the information processing device 113 outputs the edited play footage to downstream broadcasting equipment (not shown). Then, for example, in a live broadcast of a table tennis match, the edited play footage is broadcast between games during the match, between matches, after the match ends, etc. Also, for example, the edited play footage is broadcast in a program other than the live broadcast of the table tennis match (for example, sports news).

[0082] <Examples of visual information> Next, examples of visual information superimposed on play images will be described with reference to FIGS.

[0083] First, examples of play images on which visual information is superimposed will be described with reference to FIGS.

[0084] 6 to 15, 17, and 18, the play image before the visual information is superimposed is indicated by dotted lines, and the visual information is indicated by solid lines. The play image before the visual information is superimposed shows a table tennis table 151, a net 152, a player 301, a racket 302, and a ball 303.

[0085] In addition, hereinafter, users who watch the play video are referred to as viewers.

[0086] <First example of video with added visual information> FIG. 6 shows a first example of a visual information-added image.

[0087] In this example, ball information 321 and player information 322 are superimposed on the play video.

[0088] Ball information 321 is superimposed on the bottom left of the play video. The ball information 321 includes information related to the characteristics of the ball 303 (movement of the ball 303). Specifically, the ball information 321 displays an image showing the rotation direction of the ball 303 (hereinafter referred to as a ball rotation image), the number of rotations, and the rotation direction side by side.

[0089] In the ball rotation image, arrows indicating the rotation direction are drawn around the ball image, allowing the viewer to intuitively recognize the rotation direction of the ball 303.

[0090] For example, in the ball rotation image, an animation display may be provided in which the ball or an arrow rotates in the rotation direction.

[0091] The player information 322 is superimposed on the bottom right of the play video. The player information 322 includes information about the player 301. Specifically, the player information 322 displays an image of the upper body of the player 301 and the profile of the player 301 (the team he belongs to and his name) side by side.

[0092] <Second example of video with added visual information> Fig. 7 shows a second example of visual information added image. In the figure, the same reference numerals are used to designate parts corresponding to those in Fig. 6, and the description thereof will be omitted as appropriate.

[0093] The visual-information-added image in FIG. 7 differs from the visual-information-added image in FIG. 6 in that ball information 341 is superimposed on the play image instead of ball information 321, and balls 342-1 to 342-12 are superimposed on the play image.

[0094] In order to make the drawing easier to understand, the reference numerals of the balls 342-1 to 342-12 are partially omitted. In reality, the balls 342-1 to 342-9 are lined up in order from right to left in the drawing, and the balls 342-9 to 342-12 are lined up in order from left to right in the drawing. This is also the case in Figures 8 to 10 shown later.

[0095] Ball information 341 is superimposed on the bottom left of the play video. Ball information 341 differs from ball information 321 in Fig. 6 in that the speed of ball 303 is added. It also shows that the number of rotations of ball 303 is the highest ever recorded in the tournament.

[0096] The balls 342-1 to 342-12 are visual information indicating the trajectory of the ball 303. For example, the balls 342-1 to 342-12 intermittently indicate the position of the ball 303 in a frame prior to the play video of Fig. 7, that is, the position of the ball 303 on the trajectory of the ball 303 in the past.

[0097] For example, an image of the actual ball 303 may be used as the balls 342-1 to 342-12, or an image generated by CG (Computer Graphics) may be used. When an image of the actual ball 303 is used as the balls 342-1 to 342-12, it is desirable to perform image processing such as making it semi-transparent so that it can be distinguished from the ball 303 in the play video.

[0098] The viewer can easily recognize the trajectory of the ball 303 until it reaches the current position by using the balls 342-1 to 342-12.

[0099] <Third example of video with added visual information> Fig. 8 shows a third example of visual information added image. In the figure, the same reference numerals are used to designate parts corresponding to those in Fig. 7, and the description thereof will be omitted as appropriate.

[0100] The visual-information-added image in FIG. 8 differs from the visual-information-added image in FIG. 7 in that arrows 361-1 to 361-13 and ball information 362-1 to 362-4 are superimposed on the play image.

[0101] In order to make the drawing easier to understand, the reference numerals of the arrows 361-1 to 361-13 are partially omitted. In reality, the arrows 361-1 to 361-12 are superimposed on the balls 342-1 to 342-12, and the arrow 361-13 is superimposed on the ball 303. This is also the case in FIG. 9, which will be shown later.

[0102] Arrows 361-1 to 361-13 are visual effects that indicate the rotation direction of ball 303 at the displayed position. That is, arrows 361-1 to 361-13 are drawn so as to surround balls 342-1 to 342-12 and ball 303, respectively, in the rotation direction. This allows the viewer to intuitively recognize the change in the rotation direction of ball 303 over time.

[0103] For example, an animation may be displayed in which the arrows 361-1 to 361-13 rotate in the rotation direction.

[0104] Also, for example, the display mode (for example, the color and thickness of the line) of the arrows 361-1 to 361-13 may be changed depending on the number of rotations of the ball 303.

[0105] The ball information 362-1 to 362-4 are superimposed above the ball 342-2, ball 342-4, ball 342-6, and ball 342-8. The ball information 362-1 to 362-4 each include information on the characteristics of the ball 303 at the positions indicated by the ball 342-2, ball 342-4, ball 342-6, and ball 342-8. Specifically, the ball information 362-1 to 362-4 each display the number of rotations and speed of the ball 303 at each position aligned vertically.

[0106] This allows the viewer to specifically know the time-series changes in the number of rotations and speed of the ball 303.

[0107] <Fourth example of video with added visual information> Fig. 9 shows a fourth example of visual information added image. In the figure, the same reference numerals are used to designate parts corresponding to those in Fig. 8, and the description thereof will be omitted as appropriate.

[0108] The visual-information-added image in FIG. 9 differs from the visual-information-added image in FIG. 8 in that rally information 381 has been added.

[0109] The rally information 381 is superimposed on the right edge of the play image, above the player information 322. In addition, by superimposing the rally information 381, the ball 342-1 and arrow 361-1, the ball 342-2 and arrow 361-2, and the ball information 362-1 displayed in the visual-information-added image in FIG.

[0110] The rally information 381 includes information about each stroke in a rally. Specifically, in this example, information about the first to third strokes in a rally is arranged in order from top to bottom. The information about each stroke also includes the stroke style, number of spins, speed, and a ball rotation image. The ball rotation image is an image that indicates the rotation direction of the ball 303, similar to the ball rotation image of the ball information 321 in FIG. 6 described above.

[0111] When a rally continues for four or more strokes, for example, information on the most recent three strokes is displayed in the rally information 381.

[0112] This allows the viewer to easily and specifically know the chronological progression of the rally.

[0113] <Fifth example of video with added visual information> Fig. 10 shows a fifth example of visual information added image. In the figure, the same reference numerals are used to designate parts corresponding to those in Fig. 7, and the description thereof will be omitted as appropriate.

[0114] The visual-information-added image in FIG. 10 differs from the visual-information-added image in FIG. 7 in that the player information 322 and ball information 341 are deleted and hit point information 401 and play information 402 are added.

[0115] The hit point information 401 is superimposed on the surface of the racket 302 that hit the ball 303 in the play video (hereinafter referred to as the hit surface). Specifically, in the hit point information 401, the hitting surface of the racket 302 is divided into 16 regions by three vertical and three horizontal auxiliary lines. Here, the vertical direction of the hitting surface of the racket 302 is the direction in which the grip of the racket 302 extends, and the horizontal direction is the direction perpendicular to the direction in which the grip extends. Also, the position on the hitting surface of the racket 302 where the ball 303 was hit (i.e., the hit point) is indicated by a black circle and a circle surrounding the black circle.

[0116] The play information 402 is superimposed on the bottom edge of the play image. The play information 402 includes information on how to hit the ball 303 and the characteristics of the ball 303.

[0117] Specifically, in play information 402, the hit point and swing speed are displayed side by side as information related to how to hit ball 303. The hit point is displayed on an image that resembles racket 302 in the same manner as hit point information 401. However, the image that resembles racket 302 is displayed with the hitting surface facing forward, making it easier for the viewer to recognize the hit point.

[0118] In addition, in the play information 402, ball speed, number of spins, and spin direction are displayed side by side as information related to the characteristics of the ball 303.

[0119] This allows the viewer to know how the player 301 hit the ball 303 with the current characteristics.

[0120] <Sixth example of video with added visual information> FIG. 11 shows a sixth example of the visual information-added image.

[0121] In this example, ball information 421 and commentary information 422 are superimposed on the play video.

[0122] Ball information 421 is superimposed on the bottom left of the play video. Ball information 421 includes information about the characteristics of ball 303. Specifically, ball information 421 differs from ball information 321 in Fig. 6 in that the spin direction of ball 303 is indicated by the stroke style, and that information indicating that the number of spins of ball 303 is the highest record in the tournament has been added.

[0123] The commentary information 422 is superimposed on the right side of the ball information 421 in the play video. The commentary information 422 includes a commentary on the play of the player 301 in the play video. For example, the commentary information 422 indicates the strategy of the player 301, his intentions for playing, etc.

[0124] The commentary shown in commentary information 422 may be input by an editor or the like, or may be information obtained by performing voice recognition on the commentary content of a commentator broadcast along with the play footage.

[0125] This allows the viewer to understand the strategy and intentions of the player 301, and adds to the enjoyment of watching table tennis.

[0126] <Seventh example of video with added visual information> FIG. 12 shows a seventh example of a visual information-added image.

[0127] In this example, a visual effect 441, a visual effect 442, and play information 443 are superimposed on the play video.

[0128] Visual effect 441 is visual information showing the trajectory and rotation speed of ball 303. For example, visual effect 441 includes a plurality of wavy lines drawn by connecting characteristic points of ball 303 from the frame in which ball 303 reaches its highest point to the frame shown in Fig. 12 when player 301 throws ball 303 up to serve. Also, the wavelength of the wavy lines of visual effect 441 becomes shorter as the rotation speed (number of rotations) relative to the speed of ball 303 becomes faster.

[0129] Visual effect 442 is visual information that indicates the position of ball 303 at the moment when ball 303 hits racket 302, that is, the moment of impact.

[0130] The play information 443 is superimposed on the right edge of the play video. The play information 443 includes information on the characteristics of the ball 303 before and after impact and on the swing speed. Specifically, the play information 443 vertically displays the speed, number of rotations, and direction of rotation of the ball 303 before impact, as well as the swing speed, number of rotations, and direction of rotation of the ball 303 after impact.

[0131] This allows the viewer to easily recognize the position of impact and the change in the movement of ball 303 before and after impact.

[0132] <8th example of video with added visual information> Fig. 13 shows an eighth example of visual information added image. In the figure, the same reference numerals are used for the parts corresponding to those in Fig. 12, and the description thereof will be omitted as appropriate.

[0133] The eighth visual information-added image differs from the visual information-added image of FIG. 12 in that visual effect 441 and visual effect 442 are deleted and visual effect 461 is added.

[0134] Visual effect 461 is visual information that indicates the trajectory and rotation direction of ball 303. For example, visual effect 461 includes lines that indicate the trajectory and rotation direction of ball 303 from the frame in which player 301 throws ball 303 up to serve and ball 303 reaches its highest point to the frame shown in Fig. 13. Visual effect 461 basically indicates the trajectory of ball 303, but also indicates the rotation direction of ball 303 as appropriate along the trajectory.

[0135] This allows the viewer to easily recognize the trajectory and rotation direction of ball 303.

[0136] <Ninth example of video with added visual information> FIG. 14 shows a ninth example of the visual information added image.

[0137] In this example, balls 481-1 to 481-7, trajectories 482, visual effects 483, visual effects 484, and play information 485 are superimposed on the play video.

[0138] In order to make the drawing easier to understand, the reference numerals of the balls 481-1 to 481-7 are partially omitted. In reality, the balls 481-1 to 481-4 are lined up in order from top to bottom in the drawing, and the balls 481-4 to 481-7 are lined up in order from left to right in the drawing. This is also the case in Figures 15 and 17 shown later.

[0139] Balls 481 - 1 to 481 - 7 and a trajectory 482 are visual information representing the trajectory of the ball 303 .

[0140] Balls 481-1 to 481-7 are visual information representing the trajectory of the ball 303. For example, balls 481-1 to 481-7 intermittently show the position of the ball 303 in a frame prior to the play video of Fig. 14, that is, the position of the ball 303 on the trajectory of the ball 303 in the past.

[0141] For example, an image of the actual ball 303 may be used as the balls 481-1 to 481-7, or an image generated by CG may be used. When an image of the actual ball 303 is used as the balls 481-1 to 481-7, it is desirable to perform image processing such as making it semi-transparent so that it can be distinguished from the ball 303 in the play video.

[0142] Trajectory 482 is drawn, for example, by connecting characteristic points of ball 303 in frames from the past to the present, and shows the trajectory of ball 303 with a line.

[0143] Visual effect 483 is visual information indicating the rotation direction of ball 303. Visual effect 483 indicates the rotation direction of ball 303 with a plurality of lines.

[0144] Visual effect 484 is visual information showing the trajectory of the swing. Visual effect 484 includes visual effect 484A to visual effect 484C.

[0145] Visual effect 484A indicates, for example, the position of the hitting surface of racket 302 in a frame of play video when player 301 raises racket 302 to serve. Specifically, visual effect 484A includes a line indicating the perimeter of the hitting surface of racket 302, a line connecting the vertical vertices of the hitting surface, and a line connecting the horizontal vertices of the hitting surface.

[0146] Visual effect 484B, for example, indicates the position of the hitting surface of racket 302 in the play video of Fig. 14. Specifically, like visual effect 484A, visual effect 484B includes a line indicating the perimeter of the hitting surface of racket 302, a line connecting the vertical vertices of the hitting surface, and a line connecting the horizontal vertices of the hitting surface.

[0147] Visual effect 484C shows the trajectory of racket 302 (swing) from the frame of the play video when racket 302 is swung up to the frame of the play video of Fig. 14. Specifically, visual effect 484C includes lines showing the trajectory of four points, the vertical vertices and horizontal vertices of racket 302 from visual effect 484A to visual effect 484B.

[0148] This allows the viewer to clearly recognize the swing movement of the player 301.

[0149] The play information 485 is superimposed on the play image at a position slightly toward the center from the right edge. The play information 485 includes information related to the characteristics and swing speed of the ball 303. Specifically, the play information 485 displays the ball speed, the number of spins, and the swing speed aligned vertically.

[0150] <10th example of video with added visual information> Fig. 15 shows a tenth example of visual information added image. In the figure, the same reference numerals are used to designate parts corresponding to those in Fig. 14, and the description thereof will be omitted as appropriate.

[0151] The visual information-added image of FIG. 15 differs from the visual information-added image of FIG. 14 in that visual effects 484 and play information 485 have been removed, and ball information 501, leader lines 502, and game information 503 have been added.

[0152] Ball information 501 is superimposed near the center of the play video. The ball information 501 includes information about the characteristics of the ball 303. Specifically, the ball information 501 displays the speed and number of rotations of the ball 303 aligned vertically.

[0153] A lead line 502 connects the ball 303 and the ball information 501, thereby associating the two.

[0154] The game information 503 includes information about the game (set) in which the play shown in the play video took place. In the game information 503, player information 511 and score information 512 are displayed vertically.

[0155] The player information 511 includes information about the players in the match. Specifically, the information about each player is displayed horizontally in the player information 511. In addition, the information about each player includes the team to which the player belongs, an image of the upper body, and the player's name, which are displayed vertically.

[0156] The score information 512 includes information regarding the progress of the points scored in the game (set) in which the play shown in the play image on the left was played, and the final score.

[0157] The scoring progress is shown by arranging rectangular boxes containing numbers indicating the scores vertically in the order in which each player scored. In this example, the progress is shown as follows: first, player 1 scores the first to third points, then player 2 scores the first and second points, then player 1 scores the fourth and fifth points, then player 2 scores the third point, then player 2 scores the sixth point, then player 2 scores the fourth point, then player 1 scores the seventh to eleventh points. The final score of the game is then displayed at the bottom of the score information 512.

[0158] The color of the squares showing the score progress and the circles next to the squares indicate which scene the play image on the left is from. In this example, the play image on the left is a scene from the game where Player 1 scored the fourth point in the first game (first set).

[0159] This allows the viewer to easily follow the progress of the scores and easily recognize which scene in the game the play image is showing.

[0160] FIG. 16 shows an example of the position (display position) at which the ball information 501 in FIG. 15 is superimposed in the play video.

[0161] The display position of the ball information 501 changes depending on the position of the ball 303. For example, except when the ball 303 is displayed near the center of the play image, the ball information 501 is basically displayed at a position closer to the center of the play image than the ball 303.

[0162] For example, in the example of A in FIG. 16, the ball 303 is located near the bottom left corner of the play footage. In the example of B in FIG. 16, the ball 303 is located at the right edge of the play footage and near the center in the vertical direction. In the example of C in FIG. 16, the ball 303 is located near the top right corner of the play footage. In the example of D in FIG. 16, the ball 303 is located near the bottom right corner of the play footage. In these examples, the ball information 501 is displayed closer to the center of the play footage than the ball 303. Furthermore, the ball information 501 is associated with the ball 303 by a leader line 502.

[0163] <11th example of video with added visual information> Fig. 17 shows an eleventh example of visual information added image. In the figure, the same reference numerals are used for the parts corresponding to those in Fig. 15, and the description thereof will be omitted as appropriate.

[0164] The visual-information-added image in FIG. 17 differs from the visual-information-added image in FIG.

[0165] Game information 531 includes score information 541, player information 542, player information 543, serve information 544, and serve information 545. In game information 531, score information 541, player information 542, serve information 544, serve information 545, and player information 543 are displayed side by side. Also, player information 542, serve information 544, serve information 545, and player information 543 are displayed side by side.

[0166] The score information 541 includes information related to the progress of the points scored in the game (set) in which the play shown in the play video on the left took place. Specifically, the score information 541 shows the progress of the points scored by both players in a graph.

[0167] The player information 542 includes information about one player, and the player information 543 includes information about the other player. The player information 542 and the player information 543 each display a face photograph, the team, and the player name of each player.

[0168] Also, the scene of the serve during the game of the play video on the left is indicated in one of player information 542 and player information 543. In this example, player information 542 indicates that it is a scene of player 1's fourth serve during the game.

[0169] If the play video on the left is a scene during a game of serve by player 2, player information 543 indicates which serve number of player 2 this scene is during the game.

[0170] In the serve information 544, the positions where the serve bounced in the opponent's court are indicated by black circles. Also shown is the distribution of the positions where each serve bounced in the opponent's court during the match. Specifically, the opponent's court is divided into areas of four columns and three rows, and the distribution of the positions where the serve bounced is shown for each area. Note that the difference in the display mode of each area (e.g., color, pattern, etc.) indicates the difference in the frequency with which the serve bounced in each area.

[0171] In the serve information 545, the positions where the serve bounced in the player's court are indicated by black circles. Also shown is the distribution of the positions where each serve bounced in the opponent's court during the match. Specifically, the opponent's court is divided into areas of four columns and two rows, and the distribution of the positions where the serve bounced is shown for each area. Note that the difference in the display mode of each area (e.g., color, pattern, etc.) indicates the difference in the frequency with which the serve bounced in each area.

[0172] This allows the viewer to easily follow the progress of the points scored and to recognize which scene in the match the play image is showing. Also, the viewer can easily learn the serving tendencies of each player.

[0173] For example, the distribution of the positions where the ball 303 bounces within the court in plays other than the serve may be displayed.

[0174] <12th example of video with added visual information> FIG. 18 shows a twelfth example of a visual information-added image.

[0175] In this example, visual effects 561, ball information 562, goal score and loss information 563, and player information 564 are superimposed on the play video.

[0176] Visual effect 561 is visual information that indicates the position of ball 303. Specifically, visual effect 561 surrounds ball 303, and this visual effect 561 enables the viewer to easily recognize the position of ball 303.

[0177] The ball information 562 includes information about the characteristics of the ball 303. Specifically, the ball information 562 displays horizontally the speed, number of rotations, and rotation direction of the ball 303. The ball information 562 also includes information indicating which game (set) and which serve in the game the play video is about.

[0178] The points scored and lost information 563 includes information on the tendency of points scored and lost by the player 301. Specifically, the points scored and lost information 563 indicates the number of points scored and lost by the player 301 on serves, the number of points scored and lost in the second and third balls of a rally, the number of points scored and lost in the fourth and fifth balls of a rally, and the number of points scored and lost in the sixth and seventh balls of a rally. This allows the viewer to know the tendency of points scored and lost by the player 301.

[0179] The player information 564 includes information about the player 301. Specifically, the player information 564 displays an image of the upper body of the player 301 and the profile of the player 301 (the team he belongs to and his name) side by side.

[0180] <Modification of visual information> Next, modified examples of visual information will be described with reference to FIGS.

[0181] 19 shows an example of visual effect 601, which is visual information showing the number of rotations of ball 303. Visual effect 601 is superimposed on the right side of ball 303, and displays the number of rotations of ball 303 in large 3D characters. In this way, by displaying the number of rotations of ball 303 using a special design, it is possible to draw the viewer's attention to the number of rotations of ball 303.

[0182] 20 shows an example of visual effect 621, which is visual information indicating the number of rotations of ball 303. Visual effect 621 is superimposed below ball 303, and displays the number of rotations and CG representing the shadow of ball 303 within a rectangular frame. In this way, by displaying the number of rotations of ball 303 through a special design, it is possible to draw the viewer's attention to the number of rotations of ball 303.

[0183] Fig. 21 shows an example of visual effect 641, which is visual information showing the rotation of ball 303. Fig. 21A shows an example when the rotation speed of ball 303 is 100 rpm, and Fig. 21B shows an example when the rotation speed of ball 303 is 200 rpm. Note that the dotted arrows in Fig. 21 indicate the movement of visual effect 641 and are not actually displayed.

[0184] The visual effect 641 includes four bars 641a to 641d arranged at 90 degree intervals around the ball 303. The bars 641a to 641d are oriented in a direction perpendicular to the outer circumference of the ball 303, and their length changes according to the number of rotations of the ball 303. That is, the bars 641a to 641d become longer as the number of rotations of the ball 303 increases, and become shorter as the number of rotations of the ball 303 decreases. The bars 641a to 641d also rotate around the ball 303 in accordance with the rotation direction of the ball 303. The rotation speed of the bars 641a to 641d becomes faster as the number of rotations of the ball 303 increases (the faster the rotation speed), and becomes slower as the number of rotations of the ball 303 decreases (the slower the rotation speed). The number of rotations is also displayed below the ball 303.

[0185] In this way, by expressing the rotation speed of ball 303 through visual movement, the rotation speed of ball 303 can be effectively conveyed to the viewer, and the viewer can also feel the difference in the rotation speed of ball 303.

[0186] FIG. 22 shows an example of a visual effect 661 that is visual information indicating the number of rotations of the ball 303.

[0187] 22A to 22C, visual effect 661 is superimposed on the right side of ball 303, and rotates at a speed according to the number of rotations. Specifically, visual effect 661 rotates around an axis extending in the horizontal direction of the play video. Furthermore, the rotation speed of visual effect 661 becomes faster as the number of rotations of ball 303 increases (the rotation speed becomes faster), and becomes slower as the number of rotations of ball 303 decreases (the rotation speed becomes slower).

[0188] Furthermore, for example, if the number of rotations of ball 303 is equal to or greater than a predetermined threshold, as shown in FIG. 22C, when visual effect 661 faces forward, visual effect 662 representing an exclamation mark is displayed.

[0189] In this way, by expressing the rotation speed of ball 303 through visual movement, the rotation speed of ball 303 can be effectively conveyed to the viewer, and the viewer can also feel the difference in the rotation speed of ball 303.

[0190] 23 shows an example of a visual effect 681 that is visual information indicating the position of the ball 303. Note that the dotted arrows in the figure represent the movement of the visual effect 681, and are not actually displayed.

[0191] For example, from a state in which only the ball 303 is displayed as shown in A of Fig. 23, arcs 681a to 681d constituting a visual effect 681 appear around the ball 303 as shown in B of Fig. 23. The arcs 681a to 681d have a central angle of slightly less than 90 degrees, and appear simultaneously at positions slightly away from the ball 303 at the diagonally upper left, diagonally lower left, diagonally upper right, and diagonally lower right of the ball 303. After that, the arcs 681a to 681d gradually approach the ball 303, and finally, as shown in C of Fig. 23, stop near the ball 303 and surround the ball 303. Furthermore, visual information 682 indicating the number of rotations of the ball 303 is displayed to the right of the ball 303 at approximately the same time that the arcs 681a to 681d stop.

[0192] This allows the viewer to focus on ball 303 and ensures that the number of rotations of ball 303 is conveyed to the viewer.

[0193] FIG. 24 shows an example of a visual effect 701 that is visual information indicating the position of the ball 303 .

[0194] First, as shown in A of Fig. 24, visual effect 701 representing an exclamation mark is displayed to the right of ball 303. Then, as shown in B of Fig. 24, the stem of the exclamation mark of visual effect 701 extends to surround ball 303, and finally, as shown in C of Fig. 24, visual effect 701 becomes a ring shape surrounding ball 303. Furthermore, at approximately the same time that visual effect 701 becomes a ring shape, visual information 702 indicating the number of rotations of ball 303 is displayed to the left of ball 303.

[0195] This allows the viewer to focus on ball 303 and ensures that the number of rotations of ball 303 is conveyed to the viewer.

[0196] Fig. 25 shows examples of visual information 711 and visual effects 712 indicating the rotation speed of ball 303. Fig. 25A shows an example when the rotation speed of ball 303 is 100 rpm, and Fig. 25B shows an example when the rotation speed of ball 303 is 300 rpm.

[0197] Visual information 711 is displayed above ball 303, and the display mode changes according to the number of rotations of ball 303. Specifically, the size of the characters in visual information 711 becomes larger as the number of rotations of ball 303 increases, and becomes smaller as the number of rotations of ball 303 decreases.

[0198] Visual effect 712 is displayed around ball 303, and the display mode changes according to the number of rotations of ball 303. Specifically, the size of visual effect 713 becomes larger as the number of rotations of ball 303 increases, and becomes smaller as the number of rotations of ball 303 decreases.

[0199] This allows the viewer to focus on ball 303 and ensures that the number of rotations of ball 303 is conveyed to the viewer.

[0200] FIG. 26 shows an example of a visual effect 721 that indicates the number of rotations of the ball 303.

[0201] Visual effect 721 includes a circular meter surrounding ball 303 and information indicating the number of rotations of ball 303. The meter value increases as the number of rotations of ball 303 increases, and decreases as the number of rotations of ball 303 decreases. The number of rotations of ball 303 is displayed overlapping the lower right of the meter.

[0202] This allows the viewer to focus on ball 303 and ensures that the number of rotations of ball 303 is conveyed to the viewer.

[0203] Furthermore, entertainment value is improved by displaying the number of rotations of the ball 303 on a meter. For example, after the gameplay video stops and the ball 303 comes to a halt, a meter is displayed around the ball 303. The value on the meter gradually increases according to the number of rotations of the ball 303. This can increase the viewer's attention to the number of rotations.

[0204] 27 shows an example of visual information related to the rotation and trajectory of ball 303. In this example, visual effect 741, visual effect 741, advertisement display 743, and visual effects 744 to 746 are superimposed around ball 303.

[0205] Visual effect 741 is displayed so as to surround ball 303, and rotates in the direction of rotation of ball 303. Furthermore, the display mode of visual effect 741 changes depending on the number of rotations of ball 303. For example, visual effect 741 changes color and rotation speed depending on the number of rotations of the ball.

[0206] Visual effect 742 includes a circular meter similar to visual effect 721 of FIG. 26, and information indicating the number of rotations of ball 303.

[0207] The advertisement display 743 displays, for example, the name of a sponsor of a table tennis tournament or a program that broadcasts edited video.

[0208] Visual effect 744 represents, by vectors, the direction and magnitude of the force applied to ball 303 due to the rotation of ball 303.

[0209] Visual effect 745 shows the actual trajectory of ball 303 with an arrow.

[0210] Visual effect 746 uses an arrow to show the expected trajectory of ball 303 if ball 303 does not spin well (if the number of rotations is small).

[0211] Visual effects 741 and 742 increase the viewer's attention to the direction and number of rotations of ball 303, and can easily convey the direction and number of rotations to the viewer. In addition, the viewer's attention to visual effects 741 and 742 increases the advertising effect of advertisement display 743.

[0212] Furthermore, the visual effects 744 to 746 can convey the effect of the rotation of the ball 303 to the viewer in an easily understandable manner.

[0213] In this manner, the content of the table tennis play can be conveyed to the viewer in an easy-to-understand manner.

[0214] <<2. Modifications>> Below, a modification of the above-described embodiment of the present technology will be described.

[0215] For example, the combination of visual information described above is one example, and can be changed arbitrarily.

[0216] Furthermore, for example, the display position and display mode (for example, color, pattern, etc.) of the visual information can be changed arbitrarily as necessary.

[0217] Furthermore, for example, the visual information may be supplied to the server 114 or a downstream device without being superimposed on the play video, and the visual information may be superimposed on the play video by the server 114 or the downstream device.

[0218] Also, for example, the display control unit 263 may control the display of edited play footage on an external device.

[0219] Furthermore, for example, the present technology can be applied to AR (Augmented Reality). For example, a part or the whole of the information processing device 113 is configured with an eyewear-type wearable device. Then, the display control unit 263 controls a display device included in the output unit 207 so as to display visual information superimposed on the play video within the field of view of the viewer watching the play video. As a result, the visual information is superimposed on the play video within the field of view of the viewer.

[0220] Furthermore, the play footage on which the visual information is superimposed does not necessarily have to be actual table tennis play footage, but may be, for example, play footage from a game or play footage generated by computer graphics.

[0221] <<3.Other>> The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs constituting the software are installed in a computer. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, capable of executing various functions by installing various programs.

[0222] The program executed by the computer can be provided by being recorded on a removable medium such as a package medium (for example, the removable medium 211 in FIG. 3). The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0223] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0224] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same case. Therefore, multiple devices housed in separate cases and connected via a network, and a single device in which multiple modules are housed in a single case, are both systems.

[0225] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0226] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

[0227] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.

[0228] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices.

[0229] <Examples of configuration combinations> The present technology can also be configured as follows.

[0230] (1) an image processing unit that generates visual information that is superimposed on or around a ball in a play image that is an image of a table tennis play, and indicates characteristics of the ball, including at least one of a number of rotations and a direction of rotation of the ball; An information processing device equipped with the device. (2) The visual information is on or around the ball indicative of a characteristic of the ball. Includes visual effects The information processing device according to (1). (3) The visual effects are displayed in different ways depending on the characteristics of the ball. The information processing device according to (2). (4) The visual effects indicate the characteristics of the ball through movement. The information processing device according to (2) or (3). (5) an analysis unit that estimates at least one of the number of rotations and the direction of rotation of the ball based on the logo of the ball in the play video; The information processing device according to any one of (1) to (4) further comprises: (6) The analysis unit estimates at least one of a rotation speed and a rotation direction of the ball based on a movement of the logo of the ball between frames of the play video. The information processing device according to (5). (7) An analysis unit that analyzes a play based on the play video. In addition, The image processing unit extracts a scene for editing the play video based on the analysis result of the play. The information processing device according to any one of (1) to (4). (8) The image processing unit superimposes the visual information on the play image. 8. The information processing device according to any one of (1) to (7). (9) After stopping the play video, the image processing unit superimposes the visual information on the play video so that the characteristics of the ball are displayed on or around the ball stopped in the play video. The information processing device according to (8). (10) a display control unit that controls display of the play video on which the visual information is superimposed; The information processing device according to (8) or (9) further comprises: (11) a display control unit that controls the display of the visual information superimposed on the play image within the user's field of vision; The information processing device according to any one of (1) to (7) further comprises: (12) The visual information further indicates the trajectory of the ball. The information processing device according to any one of (1) to (11). (13) The visual information intermittently indicates the position of the ball in the ball's trajectory. The information processing device according to (12). (14) The visual information further indicates a characteristic of the ball at at least some of the ball locations. The information processing device according to (13). (15) The visual information indicates the trajectory of the ball by a line. 15. The information processing device according to any one of (12) to (14). (16) The visual information further indicates a location where the ball struck the racket. The information processing device according to any one of (1) to (15). (17) The visual information further indicates the trajectory of the swing. The information processing device according to any one of (1) to (16). (18) The visual information further indicates a distribution of locations where the ball bounced within a court. 18. The information processing device according to any one of (1) to (17). (19) An information processing device, The present invention generates visual information that is superimposed on or around a ball in a play image that is an image of a table tennis play, and indicates characteristics of the ball, including at least one of a number of rotations and a direction of rotation of the ball. Information processing methods. (20) The present invention generates visual information that is superimposed on or around a ball in a play image that is an image of a table tennis play, and indicates characteristics of the ball, including at least one of a number of rotations and a direction of rotation of the ball. A program that causes a computer to execute a process.

[0231] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained. [Explanation of symbols]

[0232] 101 information processing system, 111-1 to 111-m cameras, 112-1 to 112-n image sensors, 113 information processing device, 114 server, 201 CPU, 251 information processing unit, 261 analysis unit, 262 image processing unit, 263 display control unit, 264 communication control unit

Claims

1. On the computer, In a play video, a plurality of positions of the ball on a ball trajectory are intermittently displayed, and visual information including a visual effect indicating a characteristic of the ball, including at least one of a number of rotations and a direction of rotation of the ball, through a movement on or around the ball at least in some of the positions of the ball is generated. A program for executing a process.

2. The visual effects are displayed in different ways depending on the characteristics of the ball. The program according to claim 1.

3. The visual information indicates the trajectory of the ball by a line. The program according to claim 1.

4. The visual information further indicates a location where the ball struck the racket. The program according to claim 1.

5. The visual information further indicates the trajectory of the swing. The program according to claim 1.

6. The visual information further indicates a distribution of locations where the ball bounced within a court. The program according to claim 1.

7. The visual information further indicates a hitting style. The program according to claim 1.

8. The visual information further includes rally information including characteristics of the ball in each stroke of a rally. The program according to claim 1.

9. On the computer, Based on the video of the play, an analysis of the play is performed; Extracting scenes to be edited from the video of the play based on the analysis result of the play. The program according to claim 1 , further comprising:

10. On the computer, The visual information is superimposed on the play image. The program according to claim 1 , further comprising:

11. On the computer, After the play image is stopped, the visual information is superimposed on the play image such that characteristics of the ball are displayed on or around the ball stopped in the play image. The program according to claim 10, further comprising:

12. On the computer, Controlling the display of the play video on which the visual information is superimposed The program according to claim 10, further comprising:

13. On the computer, Control is performed to display the visual information superimposed on the play image within the user's field of vision. The program according to claim 1 , further comprising:

14. In the visual information, the position of the ball in the current frame is displayed in a different manner from the position of the ball in the past frame. The program according to claim 1.

15. an image processing unit that intermittently displays a plurality of positions of the ball on a ball trajectory within a play video, and generates visual information including visual effects that show, through movement, characteristics of the ball, including at least one of the number of rotations and the direction of rotation of the ball, on or around the ball at least in some of the positions of the ball; An information processing device equipped with the device.

16. An information processing device, In a play video, a plurality of positions of the ball on a ball trajectory are intermittently displayed, and visual information including a visual effect indicating a characteristic of the ball, including at least one of a number of rotations and a direction of rotation of the ball, through a movement on or around the ball at least in some of the positions of the ball is generated. Information processing methods.

Images