Distribution system

Abstract

To provide a distribution system that gives performers and viewers a sense of realism.SOLUTION: In a distribution system, a distribution device acquires performance video of a performer giving a demonstration and transmits the acquired performance video, a server device receives the performance video transmitted by the distribution device, generates video for distribution on the basis of the received performance video and transmits the generated video for distribution to a receiving device, the receiving device acquires viewer video filmed of a viewer watching the video for distribution transmitted by the server device and transmits the acquired viewer video to the server device, the server device receives the viewer video transmitted by the receiving device and generates viewing status video in which the viewer video is displayed or hidden in a display mode corresponding to the viewing status of the viewer watching the video for distribution and transmits the generated viewing status video to the distribution device, and the distribution device receives the viewing status video transmitted by the server device and displays the received viewing status video on the distribution side display unit.SELECTED DRAWING: Figure 12

Description

Technical Field

[0001] The present invention relates to a distribution system.

Background Art

[0002] There is known a distribution system including a distribution device that distributes videos such as the performance video of a performer performing a demonstration, and a receiving device that receives and displays the distributed video (see, for example, Patent Document 1). .

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the distribution system described in Patent Document 1 and the like, it is difficult to give a sense of presence to the performer and the viewer.

[0005] The present invention has been made in view of the above, and an object thereof is to provide a distribution system capable of giving a sense of presence to the performer and the viewer.

Means for Solving the Problems

[0006] [[ID=�4]]The distribution system according to the present invention includes a distribution device that acquires the performance video of a performer performing a demonstration and transmits the acquired performance video, a server device that receives the performance video transmitted from the distribution device, generates a distribution video based on the received performance video, and transmits the generated distribution video, and a device that receives the distribution video transmitted from the server device and receives the received distribution video. [[ID=六一]] ​​The system includes a receiving device that displays the video for distribution on a receiving-side display unit, and the receiving device receives the video for distribution. The system acquires viewer video footage of the viewer watching the video, and transmits the acquired viewer video. The server device receives the viewer video transmitted from the receiving device and the video for distribution. The viewer's video is displayed or hidden in a display mode that corresponds to the viewer's viewing state. The distribution device generates a video of the viewing status, transmits the generated video of the viewing status, and the distribution device The system receives the video of the viewing status transmitted from the server device and distributes the received video of the viewing status. Displayed on the signal side display. [Effects of the Invention]

[0007] According to the present invention, a distribution system is provided that can give performers and viewers a sense of presence. It is possible. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic diagram showing an example of the distribution system according to this embodiment. [Figure 2] Figure 2 is a functional block diagram showing an example of a distribution device. [Figure 3] Figure 3 is a schematic diagram showing an example of a distribution device and equipment connected to the distribution device. [Figure 4] Figure 4 is a functional block diagram showing an example of a server device. [Figure 5] Figure 5 is a functional block diagram showing an example of a receiving device. [Figure 6] Figure 6 is a schematic diagram illustrating an example of video for distribution. [Figure 7] Figure 7 is a schematic diagram illustrating an example of a video showing viewing conditions. [Figure 8] Figure 8 illustrates an example of how to set the display mode for viewer video. [Figure 9]FIG. 9 is a diagram for explaining an example of setting the display mode of the viewer video. [Figure 10] FIG. 10 is a diagram for explaining an example of setting the display mode of the viewer video. [Figure 11] FIG. 11 is a diagram for explaining an example of setting the display mode of the viewer video. [Figure 12] FIG. 12 is a flowchart showing the operation flow of the distribution system according to the present embodiment. [Figure 13] FIG. 13 is a diagram schematically showing another example of the distribution device and the devices connected to the distribution device. [Figure 14] FIG. 14 is a diagram showing an example of the management screen displayed on the distribution device.

Mode for Carrying Out the Invention

[0009] Hereinafter, an embodiment of the distribution system according to the present invention will be described based on the drawings. Note that the present invention is not limited by this embodiment. Further, the constituent elements in the following embodiment include those that can be replaced by those skilled in the art and are easy to replace, or those that are substantially the same. The constituent elements in the following embodiments include those that can be replaced by those skilled in the art and are easy to replace, or those that are substantially the same. include those that can be replaced by those skilled in the art and are easy to replace, or those that are substantially the same.

[0010] FIG. 1 is a diagram schematically showing an example of the distribution system 100 according to the present embodiment. As shown in FIG. 1, the distribution system 100 includes a distribution device 10, a server device 30, and a receiving device 50. The distribution device 10, the server device 30, and the receiving device 50 are connected via a network NW. The distribution system 100 distributes the video and audio of the demonstration by the demonstrator to the viewers via the network NW. Examples of the demonstration by the demonstrator include, for example, playing musical instruments, singing songs, performing plays, dancing, performing曲艺, performing arts, reciting, presenting a presentation, a wedding ceremony, fitness, giving a lecture, teaching a class, etc. As shown in FIG. 1, the distribution system 100 includes a distribution device 10, a server device 30, and a receiving device 50. The distribution device 10, the server device 30, and the receiving device 50 are connected via a network NW. The distribution system 100 distributes the video and audio of the demonstration by the demonstrator to the viewers via the network NW. Examples of the demonstration by the demonstrator include, for example, playing musical instruments, singing songs, performing plays, dancing, performing曲艺, performing arts, reciting, presenting a presentation, a wedding ceremony, fitness, giving a lecture, teaching a class, etc. Examples of the demonstration by the demonstrator include, for example, playing musical instruments, singing songs, performing plays, dancing, performing曲艺, performing arts, reciting, presenting a presentation, a wedding ceremony, fitness, giving a lecture, teaching a class, etc. Examples of the demonstration by the demonstrator include, for example, playing musical instruments, singing songs, performing plays, dancing, performing曲艺, performing arts, reciting, presenting a presentation, a wedding ceremony, fitness, giving a lecture, teaching a class, etc.

[0011] It should be noted that "曲艺" is a traditional Chinese art form, and there may not be an exact equivalent in English. Here, it is directly transliterated for lack of a more appropriate translation. You can adjust it according to the actual situation.Figure 2 is a functional block diagram showing an example of the distribution device 10. As shown in Figure 2, the distribution device The unit 10 comprises an input unit 11, an output unit 12, a communication unit 13, a control unit 14, and a storage unit 15. Prepare.

[0012] The input unit 11 is connected to input devices such as the shooting unit 16, the audio input unit 17, and the operation unit 18. The distribution device 10 is equipped with some or all of the following: the shooting unit 16, the audio input unit 17, the operation unit 18, etc. It may also be configured as follows. Figure 3 shows the distribution device 10 and the equipment connected to the distribution device 10. This diagram schematically illustrates one example. The imaging unit 16 has, for example, one or more cameras. The filming unit 16 films the performance by performer P and generates a video of the performance. The filming unit 16, for example, They are positioned on the right, center, and left sides. The audio input unit 17 is, for example, one or more microphones It has a voice input unit 17 that captures the performance by the performer and generates performance audio. The input unit 17 may be, for example, built into the shooting unit 16. The audio input unit 17 is Instead of a microphone, or in addition to a microphone, use an electronic instrument or audio mixer to input sound. It may also be equipped with an interface (so-called line input). The operating unit 18 is, for example, a keyboard. It consists of input devices such as a mouse and a touch panel. The operation unit 18 is connected to the distribution device 10. Enter the required information. The operation unit 18 displays, for example, the viewing status shown in the display unit 19, which will be described later. It is possible to perform input operations to select one or more viewer videos from the video feed.

[0013] The output unit 12 is connected to output devices such as the display unit (distribution-side display unit) 19 and the audio output unit 20. The distribution device 10 transmits some or all of the display unit (distribution-side display unit) 19, the audio output unit 20, etc. It may also be configured to include the following. The display unit 19 displays information such as images. For example, projection systems such as projector devices and projection screens, and display panels such as liquid crystal panels. Various display devices such as screens are used. One or more display units 19 are provided. The unit 19 is capable of displaying viewing status video, which will be described later. In this embodiment, the display unit 19 is It is large enough to cover the entire demonstration space 25 where the performers perform, but It is not limited to this. For example, participants could be mobilized to some spaces and displayed in the available spaces. Section 19 may be provided. The audio output section 20 outputs audio information. The audio output section 20, For example, it is composed of speakers, etc.

[0014] The communication unit 13 is capable of sending and receiving information via the network NW. It may perform either wired or wireless communication. The communication unit 13 is a server Information is transmitted and received between the device 30 and the device.

[0015] The control unit 14 handles the processing of the CPU (Central Processing Unit), etc. The device and RAM (Random Access Memory) or ROM (Read It has a storage device such as Only Memory. The control unit 14 controls the distribution device 10 comprehensively. Controls the following: The control unit 14 consists of an input information acquisition unit 21, a communication control unit 22, and an output control unit 23. It also includes a response information acquisition unit 24.

[0016] The input information acquisition unit 21 receives information such as demonstration video, demonstration audio, and operation signals from the input unit 11. The communication control unit 22 acquires various types of information received by the communication unit 13.

[0017] The communication control unit 22 receives the demonstration video and demonstration audio acquired by the input information acquisition unit 21 from the communication unit 13. Then it sends it to the server device 30. The communication control unit 22 sends the presenter's response information, which will be described later, to the communication unit Send the message from 13 to the server device 30.

[0018] The output control unit 23 controls the operation of the display unit 19 and the audio output unit 20. The display unit 19 sets the display content. The output control unit 23 receives information from the server device 30, which will be described later. The transmitted viewing status video is displayed on the display unit 19.

[0019] The response information acquisition unit 24 acquires the performer's response information to the viewing status video displayed on the display unit 19. Receive information. Response information includes, for example, the performer's response to viewer footage displayed in the viewing video. Information indicating that a response was made, and the audience (or receiving device) to whom the performer responded. Information indicating 50), and including.

[0020] The memory unit 15 stores various types of information. The memory unit 15 is, for example, a hard disk drive. It has storage such as a solid-state drive. Note that the storage unit 15 is a rim External storage media such as bubble disks may be used.

[0021] Figure 4 is a functional block diagram showing an example of a server device 30. As shown in Figure 4, The device 30 comprises a communication unit 31, a control unit 32, and a storage unit 33. The communication unit 31 is Information can be communicated between the distribution device 10 and the receiving device 50 via the network NW. .

[0022] The control unit 32 comprehensively controls the operation of the server device 30. The control unit 32 controls the CPU, etc. It has a processing unit and a storage device such as RAM or ROM. The control unit 32 and the communication control unit 34 It includes a video generation unit 35 for distribution, a video generation unit 36 ​​for viewing status, and a volume setting unit 37.

[0023] The communication control unit 34 controls the operation of the communication unit 31. The communication control unit 34 receives from the communication unit 31. The communication control unit 34 receives various information transmitted from the communication unit 31. Let it.

[0024] The distribution video generation unit 35 generates distribution video based on the demonstration video transmitted from the distribution device 10. An image is generated. The video for distribution is to be displayed on the display unit 59 of the receiving device 50, which will be described later. This is an image. The distribution video generation unit 35 may be configured to be included in the distribution device 10. The credit video generation unit 35 may also be configured to be included in the receiving device 50. In this case, the receiving device 5 0 generates video (video for distribution) to be displayed on the display unit 59 based on the demonstration video. .

[0025] The viewing status video generation unit 36 ​​generates viewing status video based on the viewer video transmitted from the receiving device 50. A situational video is generated. The viewing situational video shows the viewing status of viewers watching the video 70 for distribution. This is a video. The viewing status video is a table that shows the viewing status of viewers watching the video 70 for distribution. This is a video in which the viewer's image is displayed or hidden depending on the display mode.

[0026] The volume setting unit 37 sets the volume of the demonstration audio and the viewer audio, which will be described later.

[0027] The memory unit 33 stores various types of information. The memory unit 33 is, for example, a hard disk drive. It has storage such as a solid-state drive. Note that the storage unit 33 is a rim - External storage media such as bubble disks may be used. The storage unit 33 is a receiving device described later. The data for the video to be displayed on the display unit 50 is stored.

[0028] Figure 5 is a functional block diagram showing an example of a receiving device 50. As shown in Figure 5, the receiving device The unit 50 comprises an input unit 51, an output unit 52, a communication unit 53, a control unit 54, and a storage unit 55. To be equipped. The receiving device 50 may be, for example, a smartphone, tablet, or personal computer. Examples include general-purpose terminals such as computers and karaoke terminals. The receiving device 50 receives signals from these general-purpose terminals. It is not limited to this, and a dedicated terminal may also be used. The receiving device 50 may be a terminal owned by the viewer, or the distribution device Owned by a business operator or a business operator that manages facilities such as karaoke bars (facilities equipped with receiving device 50) It may also be a terminal. The terminal device 50 owned by the business operator may be lent by the business operator to the viewer. It may be used by the operator, or by facilities such as karaoke establishments managed by the operator (facilities equipped with a receiving device 50). Viewers may visit and use the facility. In the distribution system 100, the receiving device 50 is One or more, for example, multiple, can be provided.

[0029] The input unit 51 inputs various types of information. The input unit 51 is connected to the shooting unit 56 and the voice input unit 57. It is connected to the control unit 58, etc. Some or all of the shooting unit 56, audio input unit 57, control unit 58, etc. The receiving device 50 may also be configured to include the camera unit. The imaging unit 56 may be, for example, one or more cameras It has a camera. The shooting unit 56 shoots viewers watching the video for distribution and generates viewer video. The audio input unit 57 has, for example, one or more microphones. The system generates viewer audio by capturing the voices of viewers watching the video, such as the sound of applause. The audio input unit 57 may be, for example, built into the shooting unit 56. The operation unit 58 is For example, it is composed of input devices such as a keyboard, mouse, and touch panel. The operation unit 58 is The receiving device 50 receives predetermined information. The operation unit 58 controls, for example, the position of the viewer's icon. This can be used when setting it up.

[0030] The output unit 52 is connected to the display unit (receiving display unit) 59, the audio output unit 60, etc. The receiving device 50 is configured to include some or all of the following: (receiving display unit) 59, audio output unit 60, etc. This may also be done. The display unit 59 displays information such as images. The display unit 59 is, for example, a liquid crystal panel. It has a display panel such as a . The display unit 59 can display the video for distribution 70. Receiving device The display unit 59 of 50 displays the video for distribution 70 as well as the user interface (application) The user interface may display the software's operation screen. It can be a native application (a so-called native application), or it can run in a web browser. It may also be an application (a so-called web application). The display unit 59 is an audio application. The output unit 20 outputs audio information. The audio output unit 20 is composed of, for example, a speaker. It can be done.

[0031] The communication unit 53 can send and receive information via the network NW. It may perform either wired or wireless communication. The communication unit 53 is a server Information is transmitted and received between the device 30 and the device.

[0032] The control unit 54 has a processing unit such as a CPU and a storage device such as RAM or ROM. Unit 54 performs overall control of the receiving device 50. The control unit 54 controls the input information acquisition unit 6 It comprises 1, a communication control unit 62, and an output control unit 63.

[0033] The input information acquisition unit 61 receives information such as the viewer's video, audio, and operation signals from the input unit 51. The communication control unit 62 acquires various information received by the communication unit 53. The signal control unit 62 transmits the viewer's video and audio acquired by the input information acquisition unit 61 from the communication unit 53. Make them believe.

[0034] The output control unit 63 controls the operation of the display unit 59 and the audio output unit 60. The display unit 59 sets the display content. The output control unit 63 sets the viewing content displayed on the display unit 59. The display mode of the user's video is set. The output control unit 23 receives status information from the receiving device 50, which will be described later. Based on this, the display mode of the viewer video is set. Display of viewer video by output control unit 23 The specific settings and operations for each mode will be described later.

[0035] The storage unit 55 is, for example, a storage unit such as a hard disk drive or a solid state drive. It has a memory unit 55, and an external storage medium such as a removable disk is available. It may be used. The memory unit 55 stores various types of information.

[0036] Next, an example of the operation of the distribution system 100 configured as described above will be explained. Shooting unit 1 Units 6 and 17 record and record audio of the predetermined demonstration performed by the performer. This generates video and audio of the performance. The performance by the performer will be, for example, positioned on the right, center, and left sides of the stage. Multiple imaging units 16 may be arranged in different directions, such as on the side, to perform imaging. The demonstration video captured in 6 and the demonstration audio captured in the audio input unit 17 are input to the distribution device 10. This is input to the power unit 11.

[0037] In the distribution device 10, the input information acquisition unit 21 receives the demonstration video and input to the input unit 11. The demonstration audio is acquired. The demonstration audio acquired by the input information acquisition unit 21 is controlled by the communication control unit 22. Video and demonstration audio are transmitted from the communication unit 13 to the server device 30. The server device 30 distributes The system receives the demonstration video and demonstration audio transmitted from the communication device 10.

[0038] The distribution video generation unit 35 generates distribution video based on the demonstration video transmitted from the distribution device 10. The image is generated. Figure 6 is a schematic diagram showing an example of video for distribution. As shown in Figure 6, The video for distribution 70 has a background image 75 which includes a display area 71 and an icon placement area 72. This includes the display area 71, which is the area for displaying the demonstration video 73 transmitted from the distribution device 10. The display area 71 corresponds to, for example, the stage of a performance venue. The icon placement area 72 is It is provided in correspondence with the display area 71. The icon placement area 72 is for viewing the demonstration video. This is an area where the person's icon 74 can be placed. The icon placement area 72 is, for example, in the demonstration venue. This corresponds to the audience seating area. Streaming video 70 is so-called Virtual Reality video. It may also be 360-degree video. The video generation unit 35 generates the video for distribution that is transmitted from the distribution device 10. The video 73 is superimposed onto the display area 71 of the background image 75. The display unit 59 of the receiving device 50 is multi-layered. For example, displays such as large screen displays, smartphones, tablets, and This may be separated into karaoke terminals, etc. The video distribution unit 35 is used when there are multiple display units 59. For example, display area 71 on a large screen display, and the icon placement area smart Even if you generate video for distribution to be displayed on a phone, tablet, or karaoke terminal, Good. In the video for distribution 70, the control unit 58 of the receiving device 50 displays its own icon 74. When you drag or swipe, you can move the position of your own icon 74, When you drag or swipe anywhere other than the body icon 74, the angle at which the video is displayed changes. Alternatively, the range may be made changeable. Also, pinch-in and pinch-chirp gestures on the touch panel may be implemented. The display range and zoom level of the video 70 for distribution can be adjusted by using the out or scroll operation. It would be good to allow this to be changed. For example, if you want to display only demonstration video 73, you can do this. The operation makes the size of the demonstration video 73 the same as the size of the display unit 59 of the receiving device 50. This is possible. Also, when such operations are performed, the display unit 59 of the receiving device 50 will display The audio from icon 74, or the demonstration video 73, which is no longer displayed, is not shown on the display unit 59. In the event that this occurs, the demonstration audio for demonstration video 73 will not be output from the audio output unit 60. That's good too.

[0039] Additionally, viewers access the server device 30 from the receiving device 50 and view the background image 75. Set the icon 74 to be placed at the desired position within the icon placement area 72. The image generation unit 35 generates an icon in the icon placement area 72 of the background image 75 at a set position. Combine 74.

[0040] The distribution video generation unit 35 composites the demonstration video 73 onto the display area 71 of the background image 75, and By compositing the icon 74 into the container placement area 72, the video for distribution 70 is generated. In the example shown in 6, for example, six icons 74 (74a to 74f) are combined into a video for distribution. 70 is shown. In the following explanation, the multiple icons 74 shown will be distinguished. Each icon 74 is then labeled with a code such as Icon 74a, Icon 74b, etc. The following will be indicated. Furthermore, the demonstration by the performer will be filmed using multiple camera units 16 positioned in different directions. In that case, the distribution video generation unit 35 will determine the positional relationship between the display area 71 and the icon 74 based on the Furthermore, the demonstration video to be composited into the video 70 for distribution can be selected from among multiple demonstration videos. For example, if icon 74 is positioned on the upper side of the display area 71, the distribution video generation unit 35 The video 70 for distribution, which is transmitted to the receiving device 50 corresponding to the icon 74, is provided by the performer. It is possible to synthesize a demonstration video 73, which was filmed from the right side of the demonstration. Specifically, for example, To select which of the multiple demonstration images 73 to use, the icon placement area 72 is used. The system divides the area into multiple regions and creates selection areas, and then determines which selection area icon 74 is located in. The distribution video generation unit 35 may then select the demonstration image 73. Section 35 may enlarge or reduce the demonstration image 73 based on the position of the icon 72. In this case, the video generation unit 35 for distribution will, for example, determine the position of the icon 72 in the horizontal direction of the demonstration image 73. In a position close to the performer's face, the vertical direction of demonstration image 73 can be enlarged or reduced around the performer's face image. Good. Also, the video generation unit 35 for distribution is based on the relationship between the display area 71 and the icon 74. The image processing is performed so that the demonstration image 73 changes smoothly in accordance with the movement of icon 74. Preferably, in this case, the video generation unit 35 for distribution can increase the number of shooting units 16 to about several tens. It is preferable to use the expanded video footage or to perform image processing using 3D modeling or the like. Furthermore, the distribution video generation unit 35 does not change the position of the icon 74, and generates a predetermined icon ( For example, when a viewer clicks or taps an icon indicating zoom in / out operation for binoculars, etc. Alternatively, you may switch to an enlarged version of the demonstration image 73. Note that the distribution video generation unit 35 is located at The timing (time) when a specific icon is clicked or tapped is recorded and associated with each viewer. A table showing that viewers whose viewing times match or are similar (close) are likely to be a good match. The display may be added to icon 74. The distribution video generation unit 35 is compatible. For example, a percentage (a numerical value indicating the degree of compatibility) could be used as an icon to indicate compatibility. You can generate the video to display along with 74, or use the 74 icon of a viewer that is compatible with it. You may generate the video to display the image in a larger size, and encourage interaction with other viewers. The video may be generated to be displayed in this way.

[0041] Furthermore, the volume setting unit 37 adjusts the position of the display area 71 and the icon 74 in the video for distribution 70. Based on the arrangement, the volume of the demonstration audio can be set. For example, the volume setting unit 37 The closer the icon 74 is positioned to the display area 71, the more the corresponding icon 74 will be displayed. The volume of the demonstration audio transmitted to the communication device 50 can be set to be increased. Furthermore, the volume setting unit 37 adjusts the volume setting unit 37 as the further the icon 74 is positioned from the display area 71. Set the volume of the demonstration audio transmitted to the receiver 50 corresponding to ICON 74 to be low. This allows the sound to be heard in the same way as when watching a performance at a performance venue. The voice can be heard. Also, for the same reason, the volume setting unit 37 is positioned above the display area 71. Depending on the position in the left-right direction, such as the side, center side, left side, etc., the audio components included in the performance audio You can also adjust the volume. For example, the volume setting unit 37 is set so that the icon 74 is not good When positioned to the side, you may increase the volume of the instrument being played on the left side. The control unit 37 may set not only the volume but also the frequency characteristics. Additionally, the direction can be set to the icon 74. By adding information to indicate the directionality of the sound, the volume setting unit 37 controls the icon 74. The volume, audio components, frequency characteristics, etc., may be changed depending on the direction.

[0042] The generated video 70 and demonstration audio for distribution are controlled by the communication control unit 34 and received by the receiving device 5 It will be released at 0.

[0043] The receiving device 50 receives the video for distribution 70 transmitted from the server device 30. Communication control Unit 62 acquires the received video for distribution 70. Output control unit 63 outputs the acquired video for distribution The image 70 is displayed on the display unit 59. Viewers view the video 70 for distribution displayed on the display unit 59. It can be viewed.

[0044] The camera unit 56 films viewers watching the video 70 for distribution and generates viewer footage. The voice input unit 57 captures the voice of viewers watching the video for distribution 70 and generates viewer audio. The viewer's video and audio are input to the input unit 51. The input information acquisition unit 61 receives the input. The captured viewer video and viewer audio are acquired under the control of the communication control unit 62. The viewer's video and audio are transmitted from the communication unit 53 to the server device 30.

[0045] The server device 30 receives viewer video and viewer audio. The communication control unit 34 also receives viewer video and audio. The received viewer audio is transmitted to a receiving device 50 that is different from the receiving device 50, for example. This allows you to perceive the cheers and other sounds of other audience members when watching a performance at a performance venue. Similarly, viewers can see each other's reactions to the video streamed on 70. This is possible. In this case, the volume setting unit 37 will place the icon in the icon placement area 72. The volume of the listener's audio can be set based on the relative positions of the 74s. For example, the sound The quantity setting unit 37 adjusts the amount of each icon 74 as they are placed closer together. The volume of the listener's voice transmitted to the corresponding receiving device 50 can be set to be increased. This is possible. Also, the volume setting unit 37 adjusts the volume setting unit 37 so that the icons 74 are far apart from each other. The volume of the viewer's voice transmitted to the receiving device 50 corresponding to the other party's icon 74 will decrease. It can be configured in this way.

[0046] The distribution video generation unit 35 replaces the acquired viewer video with an icon 74, or with an icon. In addition to n74, it can be combined into the icon placement area 72. In this case, one viewer With the viewer's video displayed, the video for distribution 70 is transmitted to each receiving device 50. The viewer's video feed is then streamed to other viewers. This action allows the demonstration to proceed at the demonstration venue. Just as you can see what other audience members are doing when watching a show, viewers can also see the video 70 for distribution. This allows viewers to understand the reactions of other viewers. Furthermore, this action allows them to understand the reactions before the performance begins. During breaks or after the performance has ended, viewers who are near Icon 74 can meet each other. You can enable it to talk. The position of your own icon 74 can be changed by dragging that icon 74. You can move it using operations such as drag and drop, or for example, the position and orientation of the smartphone. It is also possible to use sensors that acquire data such as the above to make the device move in accordance with the operation of the smartphone. Buttons for forward, backward, and right turns may be provided, or other user interface elements may be adapted. You may use it as you wish.

[0047] The viewing status video generation unit 36, for example, receives the viewer video and viewer audio, and icons. Based on the position of the icon 74 set in the placement area 72, the viewer can view the video for distribution 70. The system detects the viewer's viewing status. The viewing status video generation unit 36 ​​displays the video in a manner corresponding to the viewing status. The system generates a viewing status video that shows or hides the listener's video. 6. For viewers whose own viewer image is displayed as viewing video in the viewing status video, It may be notified that this has been done. Specifically, the viewing status video generation unit 36 ​​receives the receiving device 50 The appearance of the icon 74 displayed may be changed, or the receiving device 50 may be notified with text, images, etc. It is also permissible to do so. Furthermore, the viewing status video generation unit 36 ​​will display the video as a viewer video on the receiving device 50. Before displaying, you may ask the viewer to confirm. Note that the viewer will use the receiving device 50 to display their own The scope of public access for the viewer's video and audio can be set, and the video generation unit 35 for distribution will configure the set scope of public access. Based on this, the acquired viewer video may be combined into the icon placement area 72. Also, the receiving device In setting 50, viewers may be allowed to add other viewers as friends. One method is to use the icons of 74 other viewers who are not yet friends with you. Then move your own icon 74 within a predetermined distance, and the icons of viewers who are not registered as friends 7 By tapping or clicking 4, you can send a friend request to viewers who are not yet your friends. It is preferable to allow this. When a viewer who receives a friend request accepts the request, they become friends. You can register to share. The sharing range that can be set on the receiving device 50 is, for example, viewing status video, friends Regarding the viewer video from our receiving device 50, and the viewer video from the receiving device 50 of viewers other than our friends. It is preferable that each of these settings can be set to be public or private.

[0048] Figure 7 is a schematic diagram showing an example of viewing status video. As shown in Figure 7, viewing status video The image 80 includes one or more viewer images 81. Each receiving device 50 has a viewer image 81. The video is filmed. The viewing status video generation unit 36 ​​generates one video according to the viewer's viewing status. The above viewer images 81 can be placed in predetermined positions. In Figure 7, for example, six views This shows the case where auditory video 81 (81a~81f) is displayed. In the following explanation, When distinguishing between the multiple viewer images 81 shown in the diagram, viewer image 81a, viewer image 81b Each viewer video 81 is indicated by a code, such as the above. In this case, viewer video 8 1a is the viewer's video corresponding to icon 74a of the video 70 for distribution shown in Figure 6, etc. In addition, viewer video 81b corresponds to the viewer's icon 74b of the distribution video 70. Assume it is a video. Similarly, viewer videos 81c, 81d, 81e, and 81f are distributed These are viewer videos corresponding to icons 74c, 74d, 74e, and 74f of Credit Video 70. Let's assume that.

[0049] The viewing status video generation unit 36, for example, determines the position of the display area 71 and the position of the icon 74. The display mode of the viewer's video can be set based on the spatial relationship.

[0050] Figure 8 illustrates an example of the settings for displaying viewer video. As shown in Figure 8, The situational video generation unit 36 ​​determines that the icon 74 is near the display area 71 within the icon placement area 72. Viewers located in the neighboring region 72a (corresponding to icons 74a, 74c, and 74f) For viewers, viewer video 81 (81b, 81d, 81e) is displayed in viewing status video 80. This indicates that the viewer (icons 74b, 74) does not have icon 74 located in the neighboring region 72a. For viewers corresponding to d and 74e, the viewer image will not be displayed in the viewing status video 80. It can be made to look like this. Note that in Figure 8, the icon placement area 72 is displayed as a seat. However, the viewing status video generation unit 36 ​​may, for example, not display seats and instead display them as free space. Good. Also, the right to view the demonstration video 73 is the same as a reserved seat ticket for the actual demonstration venue. As a right to reserve a seat, the viewing status video generation unit 36 ​​displays an icon when displaying the display area 71. This makes it possible to position the icon 74 only in the viewer's designated seat within the placement area 72. It is also acceptable to set the ticket price so that viewers are charged more for seats in the front. You may use images of seats that mimic the seats shown in Figure 8, or images of seats in actual halls, etc. This allows viewers to enjoy the atmosphere of the venue in addition to the streamed video. The video generation unit 36 ​​displays the viewing status of viewers whose icons 74 are located in the nearby area 72a. By generating the image to be displayed on image 80, the viewing experience in the front seats is similar to that of actually being at the venue. Only the performer can see the performer, creating a sense of presence for both the performer and the audience. It can provide. In addition, the viewing status video generation unit 36 ​​only provides information to viewers located in the front seats. By generating the video to be displayed, we can create a sense of realism for both the performer and the audience within limited resources. While providing this, the viewer video 81 can be displayed on the viewing status video 80. Here, not limited The resources mentioned include, for example, the display area of ​​the viewing status video 80, the processing power of the server device 80, and This refers to various restrictions such as communication load on the network. Viewing status video 80 is viewing The video may include not only the person's image 80, but also images of icons 74 and viewer avatars, etc. The auditory situation video generation unit 36 ​​may be configured to move the icon 74 around the demonstration venue. The area surrounding the performance venue includes, for example, the lobby, shop, or waiting room within the performance venue facilities, or Examples include restaurants and other establishments near the demonstration venue. (Icon 74: Demonstration venue and surrounding area) Movement may be made possible through images that mimic entrances and exits, or in a 3D virtual space. It may be made movable. The viewing status video generation unit 36 ​​generates the icon 74. Only viewers who are inside the performance hall may have their viewer video 81 displayed on the viewing status video 80. Furthermore, the viewing status video generation unit 36 ​​is designed to allow viewers to concentrate on the demonstration audio within the demonstration venue. It may automatically reduce the volume of other viewers' audio to a predetermined value or even to zero. In this case as well, the viewing situation video generation unit 36 ​​generates the performer and viewer within the limited resources. It is possible to display the viewer's video 81 on the viewing status video 80 while giving both the viewer and the listener a sense of presence. The viewing status video generation unit 36 ​​also uses voice recognition to analyze the content of conversations between viewers. Extract information about the performer from the topics discussed in the conversation and display it as text around icon 74. It is also acceptable to have a large audience share topics about the performers after the performance has ended. It becomes easier to talk.

[0051] Figure 9 illustrates an example of the settings for displaying viewer video. As shown in Figure 9, The situation video generation unit 36 ​​moves between the position of the display area 71 and the positions of icons 74a to 74f. Viewer video 81a is placed within the viewing situation video 80 so that the relative positions of the hand side and the left side are the same. ~81f can be displayed. In this configuration, when viewed from the stage side in an actual demonstration venue... The viewer image 81 can be displayed in the same manner as when looking at the audience seats.

[0052] Figure 10 is a diagram illustrating an example of the settings for the display mode of viewer video. As shown in Figure 10, The viewing status video generation unit 36 ​​generates a viewer icon 74 that is positioned close to the display area 71. The viewer video 81 is displayed relatively large, and the icon 74 is located far from the display area 71. The viewer video 81 of the positioned viewer can be displayed relatively small. For example, Viewer video 8 corresponding to icons 74c and 74f, which are positioned closest to the display area 71. 1c and 81f are displayed most prominently in the viewing status video 80. Also, the display area 71 The viewer video 81a corresponding to icon 74a, which is positioned second closest to the viewer, It is displayed as the second largest element in the video footage 80. It is also the third closest element to the display area 71. The viewer videos 81d and 81e, corresponding to the placed icons 74d and 74e, show the viewing status. It is displayed as the third largest element in the video 80. It is also positioned furthest from the display area 71. The viewer video 81b corresponding to the icon 74b is the smallest in the viewing status video 80. This will be displayed. In this manner, when viewing the audience from the stage side in an actual performance venue... The viewer video 81 can be displayed in a similar manner. Note that the viewer video 81 is static. It can be either still images or videos, and it can dynamically switch between still images or switch between still images and videos as needed. It is permissible. The position of icon 74 in the virtual space and the position of viewer video 81 seen by the performer are By linking these elements, it becomes possible to give performers a sense of realism. In addition, viewers will have diverse needs. There are desires, for example, "I want to go to the front," "I want the performers to remember my face," "I want to do poorly" Requests such as "I have a performer I support" and "I'd be embarrassed to be seen by the performer" Viewers can intuitively input into the system. In addition, the distribution system 100 allows viewers to... By dynamically changing the viewer video 81 while responding to the diverse needs of the listeners, the displayable The number of viewer videos 81 can also be increased or decreased. The distribution system 100 is a viewer By dynamically changing the viewer video 81 while responding to the diverse needs of users, appropriate display is achieved. It can provide a more immersive experience. Additionally, it allows for tiered billing for viewers, depending on the amount they pay. The display mode of the viewing status video 80 may be changed accordingly.

[0053] Furthermore, the viewing status video generation unit 36, for example, depending on the position of the performer P1 relative to the display unit 19 Then, the display mode of the viewer's video can be set.

[0054] Figure 11 illustrates an example of the settings for the display mode of viewer video. As shown in Figure 11, The viewing status video generation unit 36 ​​generates an area of ​​the display unit 19 that corresponds to the position where the performer P1 is located. Viewing status video can be generated so that viewer video 81 is displayed. This makes it easier for the performer to understand the viewer's video 81. Also, if there are multiple performers P1, In a configuration where the listener can select a specific performer, the viewing status video generation unit 36 ​​displays the display unit 19 Within the area corresponding to the position of the performer selected by the viewer, the viewer who selected that performer will see the area. In this embodiment, The viewer's video feed 81 can be displayed near the performer selected by the viewer. Specifically, the distribution device 10 or server device 30 performs face detection and gaze detection using the imaging unit 16. Outlet, skeleton detection, etc., or radiation thermometer or ToF (Time of Flight) sensor The performer's position may be determined using other sensors such as a sensor. The viewing status video generation unit 36 Based on the performer's position, viewer video 81 is generated. In particular, viewers support a specific performer. If images such as the following are displayed, the viewing status video generation unit 36 ​​will generate the text contained in the cheering image. Alternatively, image recognition of facial images, etc., is used to position viewer video 81 in an easily visible location for the performer being supported. It may also be made to display. The viewing status video generation unit 36 ​​records the detection of cheering images, Alternatively, the cheering sounds can be recognized using speech recognition, and a database can be created that associates each viewer with the performer they are supporting. By creating a video, viewer videos 81 of viewers supporting a specific performer are displayed to the specific performer. The video may be generated to be displayed in a position easily visible to the performer. The viewing status video generation unit 36 The viewer video 81 may be generated in a way that dynamically changes in accordance with the performer's movements.

[0055] The viewing status video generated as described above is controlled by the communication control unit 34 and communicated to the communication unit 31. The video is then transmitted to the distribution device 10. The distribution device 10 receives the transmitted viewing status video. The signal control unit 22 acquires the received viewing status video. The output control unit 23 then outputs the acquired viewing status video. The situational video is displayed on the display unit 19.

[0056] Furthermore, the viewing status video generation unit 36 ​​determines the degree of viewer engagement with the video 70 for distribution. The display mode of the viewer's video can be set according to the level of assertiveness indicated. When watching video 70, for example, when people are cheering for the performers, the volume of the cheers is loud. The movements are large, they move in response to the performer's movements, they are dancing, and they are cheering for the performer. They are using it, smiling, crying with emotion (their emotions are stirred), the viewers' faces In situations where viewers can make positive comments or take positive actions regarding the video 70 for distribution, such as saying that it is visible in the viewer's footage. This is an indicator that will have a high value in combination. The control unit 32 performs image recognition, face recognition, and By appropriately combining voice recognition, skeletal authentication, etc., or by using a radiation thermometer or ToF (Time of Flight) thermometer. Viewer engagement may be measured using other sensors, such as (of Flight) sensors. Furthermore, the level of engagement is determined by whether it is permitted to display the viewer's video feed in the viewing status video. There is no record of viewers uttering negative or prohibited words in relation to the video 70 being streamed. In this way, a high value is obtained when there is no negative behavior towards the video 70 for distribution. Including the example shown above, the control unit 32 calculates a score for each predetermined item and, according to the score... The level of engagement can be set. The viewing status video generation unit 36 ​​generates, for example, when the level of engagement is above a certain standard. The viewer video 81 of the above viewer is displayed, and the viewer video of the viewer whose level of engagement is below the standard is displayed. The control unit 32 can generate a viewing status video 80 such that image 81 is hidden. The level of engagement may be calculated based on the image recognition results of the viewing status video, or viewers may comment in the comment section. The level of enthusiasm may be calculated based on the content of the text comments entered in, etc. Viewers' SNS (Social Networking Service) accounts It may also be possible to link with the SNS, and the control unit 32 calculates the level of enthusiasm by referring to the SNS information. It is also permissible to use the distribution system 100 in school classes, etc., to view the video feed. Narube 36 deliberately prioritizes displaying viewers who are calculated to have a low level of engagement, such as sleeping students. Viewer video may be generated in this manner.

[0057] Figure 14 shows an example of a management screen that the operator of the distribution device 10 checks. In the example of the surface, the management status of users 1 to 30, the forced exit button, and the brightness of the display unit 19. Volume control and viewer volume control are displayed. The user's management status includes the display name. , whether viewer video 81 is being displayed, whether the viewer's face is visible in viewer video 81, N This includes the number of times the G-word was uttered. It also includes smile score, cheer score, movement score, and response score. Support item scores are displayed, and the level of enthusiasm is determined by the sum of these scores. In this example, the level of assertiveness was calculated as the sum of each score, but calculations using predetermined coefficients or the like may also be performed. In the example management screen shown in Figure 14, the management status of users 1 through 30 is displayed. However, it only shows the management status of the user who is displaying the viewing status video, or the score and status. You may choose to display only the management status of users whose status has changed. A score can be calculated for each item. Note that the calculation of the score for each specified item is done via the management screen. This can be done automatically by the control unit of the server device, without requiring a display.

[0058] The performer can respond to the viewing status video 80 displayed on the display unit 19. The response information acquisition unit 24 receives responses from the performer to the viewing status video displayed on the display unit 19. When performing this action, the response information of the performer is acquired. The response information acquisition unit 24 acquires the performer's gaze. The system may detect the issue and obtain response information based on the detection result. In this case, the response information acquisition unit 24 For example, the system can detect the performer's gaze based on the performance video captured by the camera unit 16. The response information acquisition unit 24, based on the detection result, determines that the performer is intently watching the display unit 19. The system detects whether the user is looking at the display unit 19, and if so, it determines which part of the display unit 19 the user is looking at. The response information acquisition unit 24 detects the viewer's image displayed on the display unit 19 when the performer's gaze is visible. If it is detected that the performer is intently watching the area or its vicinity, the performer will be notified of the viewer's video feed. It is determined that a response is being made to the performer. In this case, the response information acquisition unit 24 determines that the performer is watching The system extracts viewer footage from the location and its vicinity, and then applies the extracted viewer footage to the relevant section. The response information acquisition unit 24 identifies the viewer (or receiving device 50) who is performing the demonstration. The response information includes information indicating that a person is responding and information indicating the audience to whom the performer's response is directed. It will be acquired as follows.

[0059] Examples of performers responding to viewer video are limited to simply looking at the viewer video. No. For example, the performer can speak to the viewer's video, wave, point, or make eye contact. The performer or operator of the broadcasting device 10 clicks or taps the viewer's video using the control unit 18. It may also be selected by doing, etc. In the example in Figure 3, the operation unit 18 controls the distribution device 10 The illustration is modeled after the mouse used by the author, but the control unit 18 used by the demonstrator is: For example, to allow use during demonstrations, a button could be added to the microphone, or it could be portable. It may also be a terminal capable of carrying data. The response information acquisition unit 24 acquires, for example, demonstration video and demonstration sound. Based on the voice, the performer's voice and the viewer's video that the performer spoke to are identified. The response information is obtained as response information. The response information acquisition unit 24, for example, based on the demonstration video, the performer The fact that they waved, pointed, made eye contact, and the viewing of the target of these actions. The video of the performer is acquired as response information. The response information acquisition unit 24 also receives the performer's video from the operation unit 18. If you select viewer video, you will have responded by making a selection, and the selection will be subject to The viewer's video feed is acquired as response information.

[0060] The communication control unit 22 receives the response information acquired by the response information acquisition unit 24 from the communication unit 13 to the server. The device 30 is instructed to send the information. The server device 30 receives the response information sent from the distribution device 10. The communication control unit 34 acquires the response information.

[0061] The server device 30 changes the display mode of at least a portion of the video for distribution based on the response information. It can be made to do this. For example, the video generation unit 35 for distribution can make the viewer, who is the target of the performer's response, available for viewing. Regarding the video 70 for distribution to be transmitted to the recipient's receiving device 50, an icon 74 indicating the viewer The display mode can be changed. The distribution video generation unit 35 can, for example, display the icon 74. The state in which the display changes over time, such as disappearing, expanding or contracting, moving, deforming, changing color, or a combination thereof. You can also use "Mr. / Ms."

[0062] As a result of this operation, the display unit 59 of the viewer's receiving device 50, which is the target of the performer's response, Icon 74 is displayed in a changed display state. The viewer can see the display state of icon 74. By visually observing the changes in appearance, it is possible to understand that a response has been received from the performer. In the distribution system 100 related to this, the distribution video 70 distributed by the performer is viewed by the viewer. Two-way communication is possible, from the audience to the performers, and from the performers to the audience. It is possible.

[0063] Figure 12 is a flowchart showing the operation flow of the distribution system 100 according to this embodiment. Yes. As shown in Figure 12, the distribution system 100 includes a distribution device 10, a server device 30, The operation is triggered by the activation of the receiving device 50, or by the start of shooting or sound recording operations. Start. The filming unit 16 and the audio input unit 17 film and record the performance by the performer. Sound is generated, and demonstration video and demonstration audio are generated (step S101). The generated demonstration video and The demonstration audio is input to the input unit 11. The communication control unit 22 receives the input demonstration video and demonstration audio. The audio is sent from the communication unit 13 to the server device 30 (step S102). 30 receives the demonstration video and demonstration audio transmitted from the distribution device 10 (step S10 3) The distribution video generation unit 35 composites the demonstration video 73 onto the display area 71 of the background image 75. (Step S104).

[0064] Meanwhile, viewers access the server device 30 from the receiving device 50 and arrange the icons 74. The settings are configured (step S105). The distribution video generation unit 35 of the server device 30 is configured Icon 74 is superimposed at the position (step S106). This results in the video for distribution 70 The generated video for distribution 70 is received by the communication unit 31. Send to location 50 (step S107).

[0065] The receiving device 50 receives the video for distribution 70 transmitted from the server device 30 (step S108). The received video for distribution 70 is acquired by the communication control unit 62 and output control unit 6 As a result of step 3, it is displayed on the display unit 59 (step S109). The viewer sees the information displayed on the display unit 59. You can watch the 70 videos intended for distribution.

[0066] The camera unit 56 and the audio input unit 57 photograph and view viewers who are watching the video 70 for distribution. The audio is captured and viewer video and viewer audio are generated (step S110). The image and viewer audio are input to the input unit 51 and, under the control of the communication control unit 62, are transmitted to the communication unit 53. The data is then sent to the server device 30 (step S111).

[0067] The server device 30 receives viewer video and viewer audio (step S112). The situation video generation unit 36 ​​detects the viewing status of viewers who are watching the video for distribution 70, and the viewing status The system generates a viewing status video that displays or hides the viewer's video in a display manner corresponding to the step. (P S113).

[0068] The viewing status video is transmitted from the communication unit 31 to the distribution device 10 under the control of the communication control unit 34. (Step S114). The distribution device 10 receives the transmitted viewing status video (Step S114). (S115). Viewing status video is acquired by the communication control unit 22 and output control unit 23. The result is displayed in the display unit 19 (step S116).

[0069] The response information acquisition unit 24 receives responses from the performer to the viewing status video displayed on the display unit 19. If so, the response information of the performer is obtained (step S117). The communication control unit 22, The response information acquired by the response information acquisition unit 24 is transmitted from the communication unit 13 to the server device 30. (Step S118). The server device 30 receives the response information sent from the distribution device 10. Do (Step S119).

[0070] The server device 30 changes the display mode of at least a portion of the video for distribution based on the response information. (Step S120). The display unit of the viewer's receiving device 50, which is the target of the performer's response. At 59, the icon 74 is displayed in a changed display state (step S121). Viewers can see the change in the display of icon 74, indicating that the performer is responding. This allows us to understand that... Note that in the flowchart shown in Figure 12, the distribution device 10 and the server device... The operation in the device 30 and the receiving device 50 is marked as "end" after each operation is completed, but the end The system repeats a series of operations until the operation is received, a predetermined time has elapsed, or a predetermined number of operations (loops) have elapsed. It is preferable to perform the process in a loop.

[0071] As described above, the distribution system 100 according to this embodiment provides the demonstration video of the demonstrator performing the demonstration. A distribution device 10 that acquires 73 and transmits the acquired demonstration video 73, and a transmission device 10 that transmits The system receives the demonstration video 73 and generates a video for distribution 70 based on the received demonstration video 73. a server device 30 that transmits the generated video for distribution 70, and a server device 30 that transmits A receiving device 50 that receives the video for distribution 70 and displays the received video for distribution 70 on the display unit 59. The receiving device 50 is equipped with viewer video 81 which is a video of a viewer watching the video 70 for distribution. The server device 30 receives the data and transmits the acquired viewer video 81, and the server device 30 transmits the data from the receiving device 50. The system receives viewer video 81 and displays a table corresponding to the viewing status of the viewer watching the distribution video 70. A viewing status video 80 is generated in which the viewer video 81 is shown or hidden in the display mode, and the generated viewing The distribution device 10 transmits the listening status video 80, and the distribution device 10 receives the listening status video transmitted from the server device 30. The system receives the video 80 and displays the received viewing status video 80 on the display unit 19.

[0072] In this configuration, the receiving device 50 acquires the viewer video 81, and the server device 30 A viewing status video 80 is generated in the distribution device 10, and the viewing status video 80 is displayed on the display unit Since it is displayed on 19, the performer will see the viewing status video 80 displayed on the display unit 19. This makes it easier to understand the viewing status of viewers.

[0073] In the distribution system 100 according to this embodiment, the distribution device 10 displays on the display unit 19 When a performer responds to a viewer video 81, response information is obtained, and the obtained response information The server device 30 sends a report and receives the response information sent from the distribution device 10. Based on the response information, the display mode of at least a portion of the video for distribution 70 is changed. According to Narishige, viewers can see changes in the display of the video 70 for distribution, and thus receive information from the performer. It is possible to know when a response has been received. Therefore, communication from the performer to the audience is possible. It becomes easy to do.

[0074] In the distribution system 100 according to this embodiment, the distribution device 10 includes the presenter and the display unit 19 The viewer video 81 is displayed in a display mode that corresponds to the positional relationship with the performer. This makes it easier for the viewer to recognize the video 81.

[0075] In the distribution system 100 according to this embodiment, the server device 30 displays the demonstration video 73. A display area 71 for showing, and an area corresponding to the display area 71 for viewers to view the demonstration video 73. A video for distribution 70 is generated, which includes an icon placement area 72 on which an icon 74 can be placed, and state information The report includes the positional relationship between the display area 71 and the icon 74. According to this configuration, the display area 7 Depending on the positional relationship between 1 and icon 74, various display modes are generated for the viewing status video 80. It is possible.

[0076] In the distribution system 100 according to this embodiment, the status information is for the video to be distributed 70. Including the viewer's level of engagement, the server device 30 displays viewer video 8 of viewers whose level of engagement falls below the standard. A viewing status video 80 is generated so that 1 is hidden. According to this configuration, the video for distribution 7 The display unit 19 can selectively display the viewing status of viewers who are highly active relative to 0. ru.

[0077] The technical scope of the present invention is not limited to the embodiments described above, and the invention does not depart from the spirit of the present invention. Modifications can be made as appropriate within a reasonable range. For example, in the above embodiment, the distribution device 10 distributes The example given was a situation where the environment in which the equipment is placed is one without an audience, but this is not the only example. Figure 13 schematically shows another example of the distribution device 10 and the equipment connected to the distribution device 10. This is a diagram. As shown in Figure 13, the configuration is such that audience seats 26 are arranged around the demonstration space 25. This is also acceptable. In this case, the display units 19A, 19B, and 19C are visible from the demonstration space 25. It is positioned behind the audience seating area 26. With this configuration, the performers will be able to interact with the audience in audience seating area 26. It is possible to grasp both the response and the viewer's reaction from the receiving device 50. Also, the audience seats 26 The audience and the viewers of the receiving device 50 share their reactions to the performer's performance. Yes, it is possible. Also, the demonstration video 73 may consist of multiple videos. For example, the large video 70 for distribution By making the size sufficiently larger compared to the size of the demonstration video 73 and icon 74, viewing The user can move icon 74, move closer to the demonstration video 73 as appropriate, or change the display range. You can then view the demonstration. For example, you can place the demonstration video 73 on multiple websites. Viewers can watch multiple demonstration videos by switching between multiple websites. This is also acceptable. By placing multiple demonstration videos 73, multiple performers can perform on multiple stages simultaneously. Sometimes demonstrations are held at events known as festivals, exhibitions, or academic conferences, including multiple lectures. Alternatively, events such as poster sessions can be held simultaneously. In all embodiments described above, each function (operation) is performed by the distribution device 10, the server device 30, Although each was described as either an implementation in part of the receiving device 50, these are merely examples. The system as a whole consists of the distribution device 10, the server device 30, and the receiving device 50. It is sufficient that the action is performed; it does not limit the entity that performs the function. The distribution system 100 includes only the functions (operations) of the distribution device 10 and the server device 30. Alternatively, the configuration may not include any of the functions (operations) of the receiving device 50. [Explanation of Symbols]

[0078] P1...Performer, NW...Network, 10...Distribution device, 11, 51...Input section, 12, 5 2…Output unit, 13,31,53…Communication unit, 14,32,54…Control unit, 15,33,55 ...Memory unit, 16, 56...Shooting unit, 17, 57...Voice input unit, 18, 58...Operation unit, 19, 19A, 19B, 19C, 59... Display unit, 20, 60... Audio output unit, 21, 61... Input information Information acquisition unit, 22, 34, 62... Communication control unit, 23, 63... Output control unit, 24... Response information acquisition unit 25…Demonstration space, 26…Audience seating, 30…Server equipment, 35…Video generation unit for distribution 36...Viewing status video generation unit, 37...Volume setting unit, 50...Receiving device, 70...Video for distribution, 71...Display area, 72...Icon placement area, 72a...Nearby area, 73...Demonstration video, 74... Icon, 75...Background image, 80...Viewing status video, 81...Viewer video, 100...Streaming system Tem

Claims

1. A function for acquiring video, generating a video for distribution based on the acquired video, and transmitting the generated video for distribution, A function to receive the transmitted video for distribution, display the received video for distribution, acquire viewer video showing viewers watching the displayed video for distribution, generate viewing status video for viewers watching the video for distribution from the acquired viewer video, and transmit the generated viewing status video. A function to receive the transmitted viewing status video and to display the received viewing status video on the display unit. Equipped with, The aforementioned viewing status video includes icons placed by the viewer. The video for distribution includes a display area for displaying the video and an icon placement area corresponding to the display area where icons of viewers who view the video can be placed. Based on the positional relationship between the display area and the positioned icons, the display mode of the icons in the viewing status video is changed. Distribution system.

2. A function for acquiring video, generating a video for distribution based on the acquired video, and transmitting the generated video for distribution, A function to receive the transmitted video for distribution, display the received video for distribution, acquire viewer video showing viewers watching the displayed video for distribution, generate viewing status video for viewers watching the video for distribution from the acquired viewer video, and transmit the generated viewing status video. The function includes receiving the transmitted viewing status video and displaying the received viewing status video on a display unit viewed by the performer. Equipped with, The aforementioned viewer video detects the position of the performer and changes its display mode according to the positional relationship between the performer and the display unit. Distribution system.

3. A function for acquiring video, generating a video for distribution based on the acquired video, and transmitting the generated video for distribution, A function to receive the transmitted video for distribution, display the received video for distribution, acquire viewer video showing viewers watching the displayed video for distribution, generate viewing status video for viewers watching the video for distribution from the acquired viewer video, and transmit the generated viewing status video. A function to receive the transmitted viewing status video and to display the received viewing status video on the display unit. Equipped with, For viewers whose level of engagement with the streamed video, determined from their actions while watching the streamed video, falls below a certain threshold, their viewer video will be hidden in the viewing status video. Distribution system.

Images