Video output method, video output device and video output system

Abstract

To provide a video output method which enables a user to feel the sense of unity with an event, a video output device and a video output system.SOLUTION: A video output method includes: receiving an operation of each of a plurality of users; producing a performance image and a performance sound based on the received operation; receiving first video data, second video data including a video of a first performer and third video data including a video of a second performer; producing output video data by combining the first video data, the second video data and the third video data; further combining the output video data and the performance image; and outputting the output video data with which the performance image is combined and the performance sound. In the video output method, the performance image and the performance sound are constituted as performance information corresponding to the operation of each of the plurality of users, and the performance information is associated with the first performer or the second performer based on an operation position on a display of each of the plurality of users.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a video output method, a video output device, and a video output system. [Background technology]

[0002] Patent Document 1 discloses a system that displays video that reflects the movements of viewers outside the venue on a display installed in a venue where a live performance is being held, etc. The system in Patent Document 1 transmits video of the live performance or the like from the venue to the viewing terminals of viewers outside the venue, and displays video on the display that corresponds to the movements of the viewers outside the venue.

[0003] The distribution server of Patent Document 2 includes a receiving unit, a determining unit, a combining unit, and a distribution unit. The receiving unit receives video data for live distribution from a distributor terminal. The determining unit determines whether or not the production conditions are satisfied. When the production conditions are satisfied, the combining unit combines the production data with the video data to generate composite video data. The distribution unit distributes the composite video data to the distributor terminal and audience terminals.

[0004] Patent Document 3 discloses an information processing device that acquires the degree of excitement of viewers and extracts highlights of program content based on the degree of excitement. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-21466 [Patent Document 2] Japanese Patent Application Publication No. 2019-92146 [Patent Document 3] Japanese Patent Application Laid-Open No. 2010-16482 Summary of the Invention [Problem to be solved by the invention]

[0006] An object of one embodiment of the present invention is to provide a video output method, a video output device, and a video output system that allow a user to perceive a sense of unity with an event. [Means for solving the problem]

[0007] A video output method according to one embodiment of the present invention accepts operations from multiple users, generates a visual effect and a sound effect based on the accepted operations, accepts first video data, synthesizes the first video data and the visual effect to generate output video data, and outputs the output video data and the sound effect.

[0008] Furthermore, a video output method according to another embodiment of the present invention includes accepting operations from multiple users, accepting first video data captured on a device that performs a performance based on the accepted operations, and outputting output video data based on the first video data. [Effects of the Invention]

[0009] According to one embodiment of the present invention, a user can feel a sense of belonging to an event. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing the configuration of a video output system 1. FIG. [Figure 2] FIG. 1 is a schematic plan view of the venue 10. [Figure 3] FIG. 10 is a schematic diagram showing the event. [Figure 4] FIG. 2 is a block diagram showing the configuration of a video output device 11. [Figure 5] FIG. 2 is a block diagram showing the configuration of a user terminal 51A. [Figure 6] 4 is a flowchart showing the operation of the video output device 11. [Figure 7] FIG. 10 is a schematic diagram showing the event. [Figure 8] FIG. 10 is a block diagram showing the configuration of a video output system 1A according to a second embodiment. [Figure 9] FIG. 1 is a schematic plan view of the venue 10. [Figure 10] FIG. 10 is a schematic diagram showing the event. [Figure 11] FIG. 10 is a block diagram showing the configuration of a video output system 1B according to a third embodiment. [Figure 12] FIG. 10 is a schematic diagram showing the event. [Figure 13] FIG. 10 is a block diagram showing the configuration of a video output system 1C according to a fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] (Embodiment 1) 1 is a block diagram showing the configuration of a video output system 1. The video output system 1 includes a video output device 11, a speaker 12L, a speaker 12R, a display 14, a microphone 15A, a microphone 15B, a microphone 25, a game console 17, a user terminal 51A, a user terminal 51B, and a user terminal 51C. Note that the numbers of microphones, speakers, and user terminals are not limited to those shown in this embodiment.

[0012] FIG. 2 is a schematic plan view of a venue 10. In this example, the venue 10 is a venue where an event is held. FIG. 3 is a schematic view showing the state of the event. A display 14 is installed at the front of the venue 10. A speaker 12L is installed to the left of the display 14, and another speaker 12L is installed to the right of the display 14.

[0013] The first performer 13A and the second performer 13B perform a performance in front of the display 14. The event shown in this example is a game event, and the first performer 13A and the second performer 13B play a game battle as an example of a performance. The content of the game battle is displayed on the display 14.

[0014] The microphone 15A picks up the voice of the first performer 13A. The microphone 15B picks up the voice of the second performer 13B. Furthermore, the microphone 25 picks up the voice of the facilitator 21. The facilitator 21 provides, for example, commentary and explanation.

[0015] The speakers 12L and 12R output the sounds of the game, the voice of the first performer 13A, the voice of the second performer 13B, and the voice of the facilitator 21.

[0016] Users 31A, 31B, and 31C in the venue 10 enjoy the event by viewing the images displayed on the display 14 and the sounds output from the speakers 12L and 12R.

[0017] Fig. 4 is a block diagram showing the configuration of video output device 11. As shown in Fig. 1, video output device 11 is connected to speaker 12L, speaker 12R, display 14, microphone 15A, microphone 15B, microphone 25, game console 17, user terminal 51A, user terminal 51B, and user terminal 51C.

[0018] The video output device 11 is an information processing device such as a general-purpose personal computer, and includes a display 101, a user I / F 102, an audio I / O (Input / Output) 103, a signal processing unit (DSP) 104, a network I / F 105, a CPU 106, a flash memory 107, a RAM 108, and a general-purpose communication I / F 109.

[0019] CPU 106 is a control unit that controls the operation of video output device 11. CPU 106 performs various operations by reading predetermined programs stored in flash memory 107, which is a storage medium, into RAM 108 and executing the programs. Through the programs, CPU 106 functionally configures the user operation receiving unit, video data receiving unit, video data generating unit, performance data generating unit, and output unit of the present invention.

[0020] The program read by CPU 106 does not need to be stored in flash memory 107 within the device itself. For example, the program may be stored in a storage medium of an external device such as a server. In this case, CPU 106 simply reads the program from the server into RAM 108 and executes it each time.

[0021] The audio I / O 103 is connected to the microphone 15A, the microphone 15B, the microphone 25, the speaker 12L, and the speaker 12R via audio cables.

[0022] The network I / F 105 is connected wirelessly or by wire to the user terminal 51A, the user terminal 51B, and the user terminal 51C. The microphone 15A, the microphone 15B, the microphone 25, the speaker 12L, and the speaker 12R may be connected via the network I / F 105.

[0023] The general-purpose communication I / F 109 is a communication I / F conforming to standards such as HDMI (registered trademark) or USB. The general-purpose communication I / F 109 is connected to the game console 17 and the display device 14. Note that the microphone 15A, the microphone 15B, the microphone 25, the speaker 12L, and the speaker 12R may be connected via the general-purpose communication I / F 109.

[0024] The signal processing unit 104 is composed of a DSP for performing sound signal processing and video signal processing. The signal processing unit 104 mixes the sound signal received from the microphone via the audio I / O 103 with the game sound received via the general-purpose communication I / F 109. The signal processing unit 104 also performs synthesis processing for sound effects. The details of the sound effects will be described later. The signal processing unit 104 outputs the processed sound signals to the speakers 12L and 12R via the audio I / O 103. As a result, the speakers 12L and 12R reproduce the game sound, the voice of the first performer 13A, the voice of the second performer 13B, and the voice of the facilitator 21. Note that reproduction of the voice of the first performer 13A, the voice of the second performer 13B, and the voice of the facilitator 21 is not essential to the present invention.

[0025] The signal processing unit 104 also receives a video signal related to a game screen from the game machine 17 via the general-purpose communication I / F 109. The signal processing unit 104 generates an output video signal by combining an effect image with the received video signal. The video signal input from the game machine 17 is an example of the first video data of the present invention. The effect image will be described in detail later. The signal processing unit 104 outputs the processed video signal to the display device 14 via the general-purpose communication I / F 109.

[0026] User terminal 51A, user terminal 51B, and user terminal 51C are information processing terminals (for example, smartphones, personal computers, etc.) owned by user 31A, user 31B, and user 31C, respectively.

[0027] Fig. 5 is a block diagram showing the configuration of user terminal 51A. User terminal 51A, user terminal 51B, and user terminal 51C have the same main configuration and realize the same functions. Therefore, Fig. 6 shows the configuration of user terminal 51A as a representative.

[0028] The user terminal 51A includes a touch panel display 201, a CPU 202, a RAM 203, a network I / F 204, and a flash memory 205.

[0029] Flash memory 205, which is a storage medium, stores an application program related to video output system 1 of this embodiment. CPU 202 reads the application program into RAM 203 to implement predetermined functions. Note that the program read by CPU 202 does not need to be stored in flash memory 205 within its own device. For example, the program may be stored in a storage medium of an external device such as a server. In this case, CPU 202 simply reads the program from the server into RAM 203 and executes it each time.

[0030] CPU 202 accepts a touch operation by the user via touch panel display 201. When CPU 202 accepts a touch operation by the user, it transmits user operation information to video output device 11 via network I / F 204. Note that CPU 202 may also accept information about a touch position on touch panel display 201. The user operation information may include information about the touch position.

[0031] 6 is a flowchart showing the operation of CPU 106 of video output device 11. CPU 106 receives user operation information of user 31A, user 31B, and user 31C from user terminal 51A, user terminal 51B, and user terminal 51C, respectively, via network I / F 105 (S11).

[0032] The CPU 106 generates an effect image and an effect sound based on the received user operation information (S12). The effect image is, for example, a thumbs-up image as shown in FIG. 3. The effect image may be an effect image that changes a part of the game screen, or may be text information such as "good." The effect sound may be, for example, a cheer, applause, a call, a cheer, or a murmur. The effect sound may also be the voice of each user acquired by a microphone (not shown) of the user terminal 51A. The effect sound may also be a machine voice reading out words such as "good," or a recorded voice reading out words such as "good."

[0033] The CPU 106 receives a video signal of a game image (first video data) (S13), synthesizes the video data with an effect image to generate output video data (S14), and outputs the output video data and effect sound (S15).

[0034] As a result, video output device 11 reproduces effect images and effect sounds in accordance with the user's operation. For example, when user 31A operates touch panel display 201 of user terminal 51A, a thumbs-up image of the effect image is displayed on display 14, and effect sounds are reproduced from speaker 12L or speaker 12R. As a result, user 31A can perceive that he or she is participating in the event, as effect images and effect sounds are reproduced in accordance with his or her own operation, and can obtain a sense of unity with the event.

[0035] Note that video output device 11 may change the display position of the effect image according to the touch position on touch panel display 201. In this case, user terminal 51A transmits information indicating the touch position to video output device 11. For example, when the user touches the right side of touch panel display 201, video output device 11 composites the effect image onto the right side of the video displayed on display 14. When the user touches the left side of touch panel display 201, video output device 11 composites the effect image onto the left side of the video displayed on display 14, as shown in FIG. 7.

[0036] Furthermore, when the user touches the lower side of touch panel display 201, video output device 11 composites a performance image below the video displayed on display device 14. When the user touches the upper side of touch panel display 201, video output device 11 composites a performance image above the video displayed on display device 14.

[0037] Furthermore, the video output device 11 may change the sound quality of the effect sound depending on the touch position on the touch panel display 201. The sound quality includes pitch and panning. For example, when the user touches the right side of the touch panel display 201, the video output device 11 increases the level of the sound signal output to the speaker 12R compared to the level of the sound signal output to the speaker 12L so that the effect sound is localized on the right side. When the user touches the left side of the touch panel display 201, the video output device 11 increases the level of the sound signal output to the speaker 12L compared to the level of the sound signal output to the speaker 12R so that the effect sound is localized on the left side. In this way, the video output device 11 performs panning processing depending on the touch position and changes the localization of the effect sound. Furthermore, for example, when the user touches the lower side of the touch panel display 201, the video output device 11 lowers the pitch so that the effect sound becomes lower. When the user touches the upper side of touch panel display 201, video output device 11 raises the pitch of the effect sound so that it becomes a higher pitch.

[0038] This allows the user to change the touch position to play the effect image and effect sound at the position and sound quality of their choice. For example, if the user wants to cheer on the second performer 13B, they can touch the right side of the touch panel display 201, and the effect image and effect sound will be played near the second performer 13B. Therefore, the user can display the effect image near the performer they want to cheer on in accordance with their own operation. Also, the user can play the effect sound near the performer they want to cheer on in accordance with their own operation. This allows the user to feel more connected to the event.

[0039] The effect image and effect sound may be different for each user. In other words, the effect image and effect sound may be configured by effect information including effect image and effect sound generated in response to the respective operations of multiple users. For example, video output device 11 may display a different effect image when an operation is received via user terminal 51A and when an operation is received via user terminal 51B. Furthermore, video output device 11 may play a different effect sound when an operation is received via user terminal 51A and when an operation is received via user terminal 51B.

[0040] (Embodiment 2) Next, Fig. 8 is a block diagram showing the configuration of a video output system 1A according to embodiment 2. Fig. 9 is a schematic plan view of a venue 10. Fig. 10 is a schematic view showing an event. Video output system 1A further includes cameras 16A and 16B in addition to the components of video output system 1. The other configurations are the same as those of video output system 1.

[0041] Camera 16A captures the first actor 13A and microphone 15A. Camera 16B captures the second actor 13B and microphone 15B. Video output device 11 also receives second video data including the video of first actor 13A captured by camera 16A and third video data including the video of second actor 13B captured by camera 16B. Video output device 11 combines the game image (first video data) with the video data of first actor 13A (second video data) and the video data of second actor 13B (third video data) to generate output video data. As a result, as shown in FIG. 10, the display 14 displays the game image combined with the video of first actor 13A and the video of second actor 13B. In the example of FIG. 10, the video output device 11 composites the video of the first performer 13A on the left side of the screen, and the video of the second performer 13B on the right side of the screen.

[0042] When the video output device 11 receives user operation information from each user, it generates a produced image and a produced sound based on the received user operation information. At this time, the video output device 11 associates the produced image and the produced sound (produced information) generated in response to the operations of each of the multiple users with the first performer 13A or the second performer 13B.

[0043] For example, if user 31A touches the right side of the touch panel display 201 of user terminal 51A, video output device 11 associates the rendering information with second performer 13B. Then, video output device 11 composites a rendering image generated in response to user operation of user terminal 51A near the video of second performer 13B. Furthermore, video output device 11 increases the level of the sound signal output to speaker 12R compared to the level of the sound signal output to speaker 12L so that the rendering sound generated in response to user operation of user terminal 51A is localized to the right. For example, as shown in FIG. 10, video output device 11 displays a thumbs-up image corresponding to the operation of user terminal 51A near the video of second performer 13B. Furthermore, video output device 11 plays a "good" sound corresponding to the operation of user terminal 51A near the video of second performer 13B.

[0044] Each user may use a user terminal to designate in advance the performer associated with that user. In this case, regardless of where the user touches the touch panel display, a visual effect and sound effect are reproduced near the designated performer. For example, if user 31B designates an association with first performer 13A using user terminal 51B, video output device 11 composites a visual effect generated in response to user operation of user terminal 51B near the video of first performer 13A. Furthermore, video output device 11 increases the level of the sound signal output to speaker 12L so that the visual effect sound generated in response to user operation of user terminal 51B is localized to the left. In this case, regardless of where user 31B touches the touch panel display 201 of user terminal 51B, video output device 11 displays a thumbs-up image corresponding to user terminal 51B near the video of first performer 13A. Additionally, the video output device 11 plays an "OK" sound corresponding to the user terminal 51B near the video of the first performer 13A.

[0045] In this way, the video output system 1A associates each user operation with each performer and plays back the effected image and effected sound. This allows the user to display the effected image near the performer they want to support. Also, the user can play back the effected sound near the performer they want to support. This allows the user to feel more connected to the event.

[0046] The camera may capture images including the content of the game battle displayed on the display 14. In this case, there may be only one camera. Even if there is only one camera, the video output device 11 can capture video data (first video data) including multiple performers and game images. In this case, the first video data is video data captured by the camera, and the video includes video data of the game screen. The first video data includes video data of the performers.

[0047] (Embodiment 3) Next, Fig. 11 is a block diagram showing the configuration of a video output system 1B according to the third embodiment. Fig. 12 is a schematic diagram showing an event. Video output system 1B further includes microphones 150A and 150B instead of microphones 15A and 15B in video output system 1A. The other configurations are the same as those of video output system 1A in the second embodiment.

[0048] Microphone 150A and microphone 150B have indicators such as LEDs in addition to the functions of microphone 15A and microphone 15B, respectively. When video output device 11 receives user operation information from each user, it controls the lighting of the LEDs of microphone 150A and microphone 150B based on the received user operation information. That is, when video output device 11 receives user operation information from each user, it lights up the LED of microphone 150A or microphone 150B.

[0049] For example, when the user touches the right side of touch panel display 201, video output device 11 lights up the LED of microphone 150B as shown in Fig. 12. When the user touches the left side of touch panel display 201, video output device 11 lights up the LED of microphone 150A.

[0050] Then, video output device 11 acquires video data of first actor 13A, video data of second actor 13B, and video data including game images. That is, in the second embodiment, video output device 11 receives first video data of a device (microphone 150A or microphone 150B) that performs a performance based on a user operation. Then, video output device 11 outputs output video data based on the first video data.

[0051] As a result, the video output device 11 of the second embodiment displays a video captured of a device (microphone 150A or microphone 150B) that performs a performance based on a user operation on the display 14. Therefore, the user can view the device that performs a performance in response to the user's operation, and therefore can perceive that he or she is participating in the event, and can feel a sense of unity with the event.

[0052] Each user may use a user terminal to specify in advance the device of the performer to be associated with that user. In this case, the specified device lights up regardless of where the user touches the touch panel display. For example, if user 31B specifies an association with microphone 150A of first performer 13A using user terminal 51B, video output device 11 lights up the LED of microphone 150A in response to the user operation of user terminal 51B.

[0053] In this case, the user can turn on the microphone of the performer they want to support, which allows the user to feel more connected to the event.

[0054] The device that performs the effects based on user operations is not limited to the microphone LED. For example, the LED on the game controller used by each performer may be turned on. In this case, the game controller is also a device that performs the effects based on user operations.

[0055] In the third embodiment, the camera may also acquire an image including the content of the game battle displayed on the display 14. In this case, the number of cameras may be one. Even if there is one camera, the video output device 11 can acquire video data (first video data) captured from a device that performs effects based on user operations.

[0056] Note that the video output device 11 of the third embodiment may display a device effect and a performance image in response to a user operation on the display device 14. The video output device 11 may display a device effect and a performance image in response to a user operation on the display device 14, and may also play a performance sound. The video output device 11 may display a device effect and a performance image in response to a user operation on the display device 14, and may also play a performance sound.

[0057] Furthermore, for example, the video output device 11 may perform a performance on all devices when it receives a user operation.

[0058] (Fourth embodiment) 13 is a block diagram showing the configuration of a video output system 1C according to the fourth embodiment. The video output system 1C further includes a distribution server 20 and user terminals 51D to 51F. The other configuration is the same as that of the video output system 1 in the first embodiment.

[0059] Distribution server 20 is connected to video output device 11 via the Internet. Video output device 11 transmits output video data and sound data to distribution server 20. The sound data includes sounds related to the game sounds, the voice of first performer 13A, the voice of second performer 13B, and the voice of facilitator 21. Distribution server 20 receives the output video data and sound data.

[0060] User terminals 51D to 51F are connected to distribution server 20 via the Internet. User terminals 51D to 51F are used by different users in different locations. User terminals 51D to 51F have the same configuration and functions as user terminal 51A shown in FIG.

[0061] Distribution server 20 transmits the output video data and audio data to user terminals 51D-51F. User terminals 51D-51F each receive and play the output video data and audio data from distribution server 20. This allows users of user terminals 51D-51F to view the event from their respective remote locations.

[0062] Video output device 11 receives user operation information from each of user terminals 51D to 51F via distribution server 20. Video output device 11 generates a performance image and a performance sound based on the received user operation information. At this time, video output device 11 may change the display position of the performance image in accordance with the touch position on touch panel display 201 of user terminals 51D to 51F. Furthermore, video output device 11 may change the sound quality of the performance sound in accordance with the touch position on touch panel display 201 of user terminals 51D to 51F.

[0063] Video output device 11 generates output video data that is composited with the effected image. Video output device 11 transmits the output video data that is composited with the effected image to display device 14 and distribution server 20. Video output device 11 also includes effect sounds in the sound data and transmits the sound data to distribution server 20.

[0064] As a result, the video output device 11 plays back effect images and effect sounds in response to operations by the remote user. The effect images and effect sounds are also transmitted to and played back by the remote user terminals 51D-51F via the distribution server 20. Note that when changing the sound quality of the effect sounds, the user terminals 51D-51F may perform panning processing and pitch change processing.

[0065] This allows users in remote locations to feel as if they are participating in the event, as the effect images and effect sounds are reproduced in response to their own operations, and they can feel a sense of unity with the event.

[0066] The video output system 1C of the fourth embodiment is an example in which the video output system 1 of the first embodiment is combined with a distribution server 20 and remote user terminals 51D to 51F, but the fourth embodiment can also be combined with the second or third embodiment.

[0067] The description of the present embodiment is illustrative in all respects and is not restrictive. The scope of the present invention is defined not by the above-described embodiments but by the claims. Furthermore, the scope of the present invention is intended to include all modifications that are equivalent to the claims and fall within the scope thereof.

[0068] Video output device 11 may generate multiple effect images and multiple effect sounds simultaneously. However, if the number of effect sounds becomes too large, the user will not be able to distinguish between the effect sounds. Therefore, it is preferable that the upper limit on the number of effect sounds is smaller than the upper limit on the number of effect images. [Explanation of symbols]

[0069] 1, 1A, 1B, 1C...Video output system 10...Venue 11...Video output device 12L, 12R...Speakers 13A…First performer 13B...2nd performer 14...Indicator 15A, 15B...Microphone 16A, 16B...Camera 17...Game console 20...Distribution server 21...Moderator 25...Mike 31A, 31B, 31C...User 51A, 51B, 51C, 51D, 51E, 51F...User terminal 101...Indicator 102...User I / F 103...Audio I / O 104...signal processing unit 105...Network I / F 106...CPU 107...Flash memory 108...RAM 109...General-purpose communication I / F 150A, 150B...Microphone 201...Touch panel display 202...CPU 203...RAM 204...Network I / F 205...Flash memory

Claims

1. Accepts operations from multiple users, generating a visual effect and a sound effect based on the received operation; receiving first video data, second video data including a video of the first actor, and third video data including a video of the second actor; synthesizing the first video data, the second video data, and the third video data to generate output video data; The output video data is further composited with the effect image, A video output method for outputting the output video data in which the effect image is synthesized and the effect sound, the effect image and effect sound are configured as effect information corresponding to the respective operations of the plurality of users, The performance information is associated with either the first performer or the second performer based on the operation positions of each of the plurality of users on the display. Video output method.

2. In the image displayed based on the output image data, the position where the second image data is displayed corresponds to the position of the first actor, and the position where the third image data is displayed corresponds to the position of the second actor. The video output method according to claim 1 .

3. The effect image is synthesized near the second video data or the third video data based on the effect information.

3. The video output method according to claim 1.

4. receiving, from each of the plurality of users, a designation of a performer to be associated in advance; The video output method according to any one of claims 1 to 3.

5. the output video data includes a plurality of the effect images, The effect sound includes a plurality of effect sounds, The upper limit of the number of effect sounds is less than the upper limit of the number of effect images.

5. The video output method according to claim 1.

6. The quality of the performance sound is determined based on the performance information and the position of the first performer or the performance information and the position of the second performer.

6. The video output method according to claim 1.

7. determining the quality of the effect sound based on the operation; 7. The video output method according to claim 1.

8. The timbre includes pitch and panning 8. The video output method according to claim 6 or 7.

9. a user operation receiving unit that receives operations from each of a plurality of users; a performance data generating unit that generates a performance image and a performance sound based on the received operation; a video data receiving unit that receives the first video data, the second video data including the video of the first actor, and the third video data including the video of the second actor; a video data generating unit that synthesizes the first video data, the second video data, and the third video data to generate output video data, and further synthesizes the performance image with the output video data; an output unit that outputs the output video data obtained by combining the effect image and the effect sound; A video output device comprising: the effect image and effect sound are configured as effect information corresponding to the respective operations of the plurality of users, The performance information is associated with either the first performer or the second performer based on the operation positions of each of the plurality of users on the display. Video output device.

10. In the image displayed based on the output image data, the position where the second image data is displayed corresponds to the position of the first actor, and the position where the third image data is displayed corresponds to the position of the second actor. The video output device according to claim 9.

11. The effect image is synthesized near the second video data or the third video data based on the effect information.

11. The video output device according to claim 9 or 10.

12. receiving, from each of the plurality of users, a designation of a performer to be associated in advance; 12. The video output device according to claim 9.

13. a plurality of the effect images and the effect sounds; The upper limit of the number of effect sounds is less than the upper limit of the effect images.

13. The video output device according to claim 9.

14. The quality of the performance sound is determined based on the performance information and the position of the first performer or the performance information and the position of the second performer.

14. The video output device according to claim 9.

15. the effect data generation unit determines the sound quality of the effect sound based on the operation.

15. The video output device according to claim 9.

16. The timbre includes pitch and panning 16. The video output device according to claim 14 or 15.

17. A video output system including a user terminal that accepts operations from a plurality of users and a video output device, The video output device is generating a visual effect and a sound effect based on the operation received by the user terminal; receiving first video data, second video data including a video of the first actor, and third video data including a video of the second actor; synthesizing the first video data with the second video data and the third video data to generate output video data, and further synthesizing the performance image with the output video data; outputting the output video data obtained by combining the effect image and the effect sound; A video output system, comprising: the effect image and effect sound are configured as effect information corresponding to the respective operations of the plurality of users, The performance information is associated with either the first performer or the second performer based on the operation positions of each of the plurality of users on the display. Video output system.

Images