Distribution System

The distribution system enhances realism by incorporating dynamic video generation and interaction features, enabling performers and viewers to engage in two-way communication.

JP7608920B2Active Publication Date: 2025-01-07JVC KENWOOD CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021051230
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-25
Publication Date
2025-01-07
Estimated Expiration
2041-03-25

AI Technical Summary

Technical Problem

Existing distribution systems fail to provide a sense of realism to performers and viewers, particularly in scenarios involving demonstrations or performances.

Method used

A distribution system that includes a distribution device, server device, and receiving device, which generate and display videos based on viewer interactions, allowing for dynamic display modes and viewer responses to enhance realism.

Benefits of technology

The system provides a heightened sense of realism by allowing performers and viewers to interact and respond to each other's actions, mimicking a live performance environment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007608920000001
    Figure 0007608920000001
  • Figure 0007608920000002
    Figure 0007608920000002
  • Figure 0007608920000003
    Figure 0007608920000003
Patent Text Reader

Abstract

To give a sense of reality to a performer and a viewer.SOLUTION: A distribution system includes a distribution device that acquires a demonstration video of a performer who performs a demonstration and transmits the acquired demonstration video, a server device that receives the demonstration video transmitted from the distribution device, generates the distribution video on the basis of the received demonstration video, and transmits the generated distribution video, and a receiving device that receives the distribution video transmitted from the server device and displays the received distribution video on a receiving side display unit, and the receiving device acquires a viewer video obtained by capturing a viewer viewing the distribution video, and transmits the acquired viewer video, the server device receives the viewer video transmitted from the receiving device, generates a viewing situation video in which the viewer video is displayed or hidden in a display mode according to the viewing state of the viewer viewing the distribution video, and transmits the generated viewing situation video, and the distribution device receives the viewing situation video transmitted from the server device, and displays the received viewing situation video on the distribution side display unit.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a distribution system. [Background technology]

[0002] 2. Description of the Related Art There is known a distribution system that includes a distribution device that distributes video, such as a performance video of a performer performing a demonstration, and a receiving device that receives and displays the distributed video (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3832318 Summary of the Invention [Problem to be solved by the invention]

[0004] In the distribution system described in Patent Document 1 and the like, it is difficult to give a sense of realism to the performer and the audience.

[0005] The present invention has been made in consideration of the above, and has an object to provide a distribution system that can give a sense of realism to performers and viewers. [Means for solving the problem]

[0006] The distribution system of the present invention comprises a distribution device that acquires performance video of a performer giving a demonstration and transmits the acquired performance video; a server device that receives the performance video transmitted from the distribution device, generates video for distribution based on the received performance video and transmits the generated video for distribution; and a receiving device that receives the video for distribution transmitted from the server device and displays the received video for distribution on a receiving side display unit, wherein the receiving device acquires viewer video captured of the viewer watching the video for distribution and transmits the acquired viewer video, the server device receives the viewer video transmitted from the receiving device and generates viewing status video in which the viewer video is displayed or hidden in a display mode corresponding to the viewing state of the viewer watching the video for distribution and transmits the generated viewing status video, and the distribution device receives the viewing status video transmitted from the server device and displays the received viewing status video on the distribution side display unit. Effect of the Invention

[0007] According to the present invention, it is possible to provide a distribution system that can give a sense of realism to performers and viewers. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a distribution system according to the present embodiment. [Diagram 2] FIG. 2 is a functional block diagram illustrating an example of a distribution device. [Diagram 3] FIG. 3 is a diagram illustrating an example of a distribution device and devices connected to the distribution device. [Figure 4] FIG. 4 is a functional block diagram illustrating an example of a server device. [Diagram 5] FIG. 5 is a functional block diagram illustrating an example of a receiving device. [Figure 6] FIG. 6 is a diagram illustrating an example of a video for distribution. [Figure 7] FIG. 7 is a diagram illustrating an example of the viewing status image. [Figure 8]FIG. 8 is a diagram for explaining a setting example of the display mode of the viewer video. [Figure 9] FIG. 9 is a diagram for explaining a setting example of the display mode of the viewer video. [Figure 10] FIG. 10 is a diagram for explaining a setting example of the display mode of the viewer video. [Figure 11] FIG. 11 is a diagram for explaining an example of setting the display mode of the viewer video. [Figure 12] FIG. 12 is a flowchart showing the flow of operations of the distribution system according to this embodiment. [Figure 13] FIG. 13 is a diagram illustrating another example of a distribution device and a device connected to the distribution device. [Figure 14] FIG. 14 is a diagram showing an example of a management screen displayed on the distribution device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of a distribution system according to the present invention will be described with reference to the drawings. Note that the present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that are replaceable and easy for a person skilled in the art, or those that are substantially the same.

[0010] FIG. 1 is a diagram showing a schematic diagram of an example of a distribution system 100 according to the present embodiment. As shown in FIG. 1, the distribution system 100 includes a distribution device 10, a server device 30, and a receiving device 50. The distribution device 10, the server device 30, and the receiving device 50 are connected via a network NW. The distribution system 100 distributes video and audio of a performance by a performer to viewers via the network NW. Examples of performances by performers include playing musical instruments, singing songs, theater, dance, acrobatics, entertainment, recitation, presentations, weddings, fitness, lectures, classes, and the like.

[0011] 2 is a functional block diagram showing an example of the distribution device 10. As shown in FIG. 2, the distribution device 10 includes an input unit 11, an output unit 12, a communication unit 13, a control unit 14, and a storage unit 15.

[0012] The input unit 11 is connected to input devices such as a photographing unit 16, an audio input unit 17, and an operation unit 18. The distribution device 10 may be configured to include some or all of the photographing unit 16, the audio input unit 17, and the operation unit 18. FIG. 3 is a diagram showing an example of the distribution device 10 and the devices connected to the distribution device 10. The photographing unit 16 has, for example, one or more cameras. The photographing unit 16 photographs a performance by a performer P to generate a performance video. The photographing unit 16 is disposed, for example, on the right side, the center side, and the left side. The audio input unit 17 has, for example, one or more microphones. The audio input unit 17 collects the performance by the performer to generate a performance audio. The audio input unit 17 may be configured to be built into the photographing unit 16. The audio input unit 17 may include an interface (so-called line input) for inputting the sound of an electronic musical instrument, an audio mixer, etc. instead of or in addition to a microphone. The operation unit 18 is configured with an input device such as a keyboard, a mouse, a touch panel, etc. The operation unit 18 inputs predetermined information to the distribution device 10. The operation unit 18 can perform an input operation for selecting one or more viewer videos from the viewing status video displayed on the display unit 19 described later, for example.

[0013] The output unit 12 is connected to output devices such as a display unit (distribution side display unit) 19 and an audio output unit 20. The distribution device 10 may be configured to include a part or all of the display unit (distribution side display unit) 19 and the audio output unit 20. The display unit 19 displays information such as an image. As the display unit 19, various display devices such as a projection system such as a projector device and a projection screen, a display panel such as a liquid crystal panel, etc. are used. One or more display units 19 are provided. The display unit 19 can display a viewing situation video, which will be described later. In this embodiment, the display unit 19 is sized to cover the entire performance space 25 where the performer performs the performance, but is not limited to this. For example, participants may be mobilized to a part of the space, and the display unit 19 may be placed in the vacant space. The audio output unit 20 outputs audio information. The audio output unit 20 is composed of, for example, a speaker, etc.

[0014] The communication unit 13 is capable of transmitting and receiving information via the network NW. The communication unit 13 may perform either wired communication or wireless communication. The communication unit 13 transmits and receives information to and from the server device 30.

[0015] The control unit 14 has a processing device such as a CPU (Central Processing Unit) and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The control unit 14 comprehensively controls the distribution device 10. The control unit 14 has an input information acquisition unit 21, a communication control unit 22, an output control unit 23, and a response information acquisition unit 24.

[0016] The input information acquisition unit 21 acquires information such as a performance video, a performance sound, an operation signal, etc. input to the input unit 11. The communication control unit 22 acquires various information received by the communication unit 13.

[0017] The communication control unit 22 causes the communication unit 13 to transmit the performance video and performance audio acquired by the input information acquisition unit 21 to the server device 30. The communication control unit 22 causes the communication unit 13 to transmit response information of the performer, which will be described later, to the server device 30.

[0018] The output control unit 23 controls the operations of the display unit 19 and the audio output unit 20. The output control unit 23 sets the display content of the display unit 19. The output control unit 23 displays, on the display unit 19, a viewing status video transmitted from a server device 30, which will be described later.

[0019] The response information acquisition unit 24 acquires response information of the performer to the viewing situation video displayed on the display unit 19. The response information includes, for example, information indicating that the performer has responded to the viewer video displayed in the viewing video, and information indicating the viewer (or the receiving device 50) to whom the performer has responded.

[0020] The storage unit 15 stores various types of information. The storage unit 15 has a storage such as a hard disk drive, a solid state drive, etc. Note that an external storage medium such as a removable disk may be used as the storage unit 15.

[0021] Fig. 4 is a functional block diagram showing an example of server device 30. As shown in Fig. 4, server device 30 includes a communication unit 31, a control unit 32, and a storage unit 33. The communication unit 31 is capable of communicating information with the distribution device 10 and the receiving device 50 via the network NW.

[0022] The control unit 32 comprehensively controls the operation of the server device 30. The control unit 32 has a processing unit such as a CPU, and a storage unit such as a RAM or a ROM. The control unit 32 has a communication control unit 34, a distribution video generation unit 35, a viewing status video generation unit 36, and a volume setting unit 37.

[0023] The communication control unit 34 controls the operation of the communication unit 31. The communication control unit 34 acquires various information received by the communication unit 31. In addition, the communication control unit 34 causes the communication unit 31 to transmit the various information.

[0024] Video for distribution generating unit 35 generates video for distribution based on the video of the performance transmitted from distribution device 10. The video for distribution is video to be displayed on display unit 59 of receiving device 50, which will be described later. Video for distribution generating unit 35 may be configured to be provided in distribution device 10. Also, video for distribution generating unit 35 may be configured to be provided in receiving device 50. In this case, receiving device 50 generates video (video for distribution) to be displayed on display unit 59 based on the video of the performance.

[0025] The viewing status video generator 36 generates a viewing status video based on the viewer video transmitted from the receiving device 50. The viewing status video is video that shows the viewing status of the viewer viewing the video for distribution 70. The viewing status video is video in which the viewer video is displayed or not displayed in a display mode that corresponds to the viewing state of the viewer viewing the video for distribution 70.

[0026] The volume setting unit 37 sets the volume of the performance sound and the viewer sound, which will be described later.

[0027] The storage unit 33 stores various information. The storage unit 33 has storage such as a hard disk drive or a solid state drive. Note that an external storage medium such as a removable disk may be used as the storage unit 33. The storage unit 33 stores data of a video to be distributed to be displayed on a display unit of the receiving device 50 described later.

[0028] FIG. 5 is a functional block diagram showing an example of a receiving device 50. As shown in FIG. 5, the receiving device 50 includes an input unit 51, an output unit 52, a communication unit 53, a control unit 54, and a storage unit 55. Examples of the receiving device 50 include general-purpose terminals such as smartphones, tablets, personal computers, and karaoke terminals. The receiving device 50 is not limited to these general-purpose terminals, and may be a dedicated terminal. The receiving device 50 may be a terminal owned by a viewer, or may be a terminal owned by a distribution company or a company that manages a facility such as a karaoke store (a facility equipped with the receiving device 50). The terminal device 50 owned by the company may be lent to a viewer by the company and used by the viewer, or may be used by a viewer visiting a facility such as a karaoke store managed by the company. In the distribution system 100, one or more receiving devices 50, for example, a plurality of receiving devices 50, are provided.

[0029] The input unit 51 inputs various information. The input unit 51 is connected to the image capture unit 56, the audio input unit 57, the operation unit 58, etc. The receiving device 50 may be configured to include some or all of the image capture unit 56, the audio input unit 57, the operation unit 58, etc. The image capture unit 56 has, for example, one or more cameras. The image capture unit 56 captures an image of a viewer watching the video for distribution to generate a viewer image. The audio input unit 57 has, for example, one or more microphones. The audio input unit 57 collects the voice or clapping sound of the viewer watching the video for distribution to generate a viewer voice. The audio input unit 57 may be configured to be built into the image capture unit 56, for example. The operation unit 58 is configured by an input device such as a keyboard, a mouse, a touch panel, etc. The operation unit 58 inputs predetermined information to the receiving device 50. The operation unit 58 can be used, for example, when setting the position of the viewer's icon.

[0030] The output unit 52 is connected to a display unit (receiving side display unit) 59, an audio output unit 60, etc. The receiving device 50 may be configured to include a part or all of the display unit (receiving side display unit) 59, the audio output unit 60, etc. The display unit 59 displays information such as images. The display unit 59 has a display panel such as a liquid crystal panel. The display unit 59 is capable of displaying a distribution video 70. The display unit 59 of the receiving device 50 may display a user interface (operation screen of application software) in addition to the distribution video 70. The user interface may be a dedicated application (a so-called native application) or an application that runs on a web browser (a so-called web application). The display unit 59 and the audio output unit 20 output audio information. The audio output unit 20 is configured, for example, by a speaker, etc.

[0031] The communication unit 53 is capable of transmitting and receiving information via the network NW. The communication unit 53 may perform either wired communication or wireless communication. The communication unit 53 transmits and receives information to and from the server device 30.

[0032] The control unit 54 has a processing device such as a CPU, and a storage device such as a RAM or a ROM. The control unit 54 performs overall control of the receiving device 50. The control unit 54 has an input information acquisition unit 61, a communication control unit 62, and an output control unit 63.

[0033] The input information acquisition unit 61 acquires information such as the viewer's video, audio, and operation signals input to the input unit 51. The communication control unit 62 acquires various information received by the communication unit 53. In addition, the communication control unit 62 causes the communication unit 53 to transmit the viewer's video and audio acquired by the input information acquisition unit 61.

[0034] The output control unit 63 controls the operation of the display unit 59 and the audio output unit 60. The output control unit 63 sets the display content of the display unit 59. The output control unit 63 sets the display mode of the viewer video to be displayed on the display unit 59. The output control unit 23 sets the display mode of the viewer video based on status information from the receiving device 50, which will be described later. Specific setting operations of the display mode of the viewer video by the output control unit 23 will be described later.

[0035] The storage unit 55 has a storage such as a hard disk drive, a solid state drive, etc. Note that an external storage medium such as a removable disk may be used as the storage unit 55. The storage unit 55 stores various types of information.

[0036] Next, an example of the operation of the distribution system 100 configured as described above will be described. The filming unit 16 and the audio input unit 17 film and collect audio, respectively, of a given performance given by a performer, to generate a performance video and a performance audio. Note that the performance by the performer may be filmed by a plurality of filming units 16 arranged in different directions, for example, on the right side, the center side, the left side, etc. The performance video filmed by the filming unit 16 and the performance audio collected by the audio input unit 17 are input to the input unit 11 of the distribution device 10.

[0037] In the distribution device 10, the input information acquisition unit 21 acquires the performance video and performance audio input to the input unit 11. Under the control of the communication control unit 22, the performance video and performance audio acquired by the input information acquisition unit 21 are transmitted from the communication unit 13 to the server device 30. The server device 30 receives the performance video and performance audio transmitted from the distribution device 10.

[0038] The video for distribution generating unit 35 generates the video for distribution based on the demonstration video transmitted from the distribution device 10. FIG. 6 is a diagram showing an example of the video for distribution. As shown in FIG. 6, the video for distribution 70 includes a display area 71 and a background image 75 in which an icon arrangement area 72 is provided. The display area 71 is an area in which the demonstration video 73 transmitted from the distribution device 10 is displayed. The display area 71 corresponds to, for example, a stage of a demonstration venue. The icon arrangement area 72 is provided corresponding to the display area 71. The icon arrangement area 72 is an area in which icons 74 of viewers who watch the demonstration video can be arranged. The icon arrangement area 72 corresponds to, for example, an audience seat of a demonstration venue. The video for distribution 70 may be a so-called Virtual Reality video or a 360-degree video. The video for distribution generating unit 35 composites the demonstration video 73 transmitted from the distribution device 10 into the display area 71 of the background image 75. The display unit 59 of the receiving device 50 may be divided into a plurality of displays, for example, a large-screen display and a smartphone, tablet, karaoke terminal, or the like. When the display unit 59 is a plurality of displays, the distribution video generating unit 35 may generate the distribution video so that, for example, the display area 71 is displayed on a large-screen display and the icon arrangement area is displayed on a smartphone, tablet, karaoke terminal, or the like. In the distribution video 70, when the user drags or swipes the user's own icon 74 on the operation unit 58 of the receiving device 50, the user's own icon 74 can be moved, and when the user drags or swipes a position other than the user's own icon 74, the angle or range in which the video is displayed may be changed. In addition, the display range and the magnification of the distribution video 70 may be changed by pinching in and out or scrolling on the touch panel. For example, when only the performance video 73 is to be displayed, the size of the performance video 73 can be made the same as the size of the display unit 59 of the receiving device 50 by such an operation. In addition, when such an operation is performed, the audio from the icon 74 that is no longer displayed on the display unit 59 of the receiving device 50, or the performance audio of the performance video 73 when the performance video 73 is no longer displayed on the display unit 59, may not be output from the audio output unit 60.

[0039] The viewer also accesses server device 30 from receiving device 50 and sets icon 74 to be placed at a desired position within icon placement area 72 of background image 75. Distribution video generation unit 35 composites icon 74 at the set position within icon placement area 72 of background image 75.

[0040] The video for distribution generating unit 35 generates the video for distribution 70 by compositing the performance video 73 with the display area 71 of the background image 75 and compositing the icon 74 with the icon arrangement area 72. In the example shown in FIG. 6, the video for distribution 70 is shown with, for example, six icons 74 (74a to 74f) combined. In the following description, when the multiple icons 74 shown in the figure are to be distinguished, they are indicated by symbols indicating the individual icons 74, such as icon 74a, icon 74b, etc. In addition, when a performance by a performer is photographed by multiple shooting units 16 arranged in different directions, the video for distribution generating unit 35 can select a performance video to be composited into the video for distribution 70 from the multiple performance videos based on the positional relationship between the display area 71 and the icon 74. For example, when the icon 74 is arranged on the right side of the display area 71, the video for distribution generating unit 35 can composite the video for distribution 70 to be transmitted to the receiving device 50 corresponding to the icon 74 with a performance video 73 photographed from the right side of the performance by the performer. Specifically, for example, regarding which of the multiple demonstration images 73 to select, the icon arrangement area 72 may be divided into multiple selection areas, and the distribution image generation unit 35 may select the demonstration image 73 based on which selection area the icon 74 is located. The distribution image generation unit 35 may also enlarge or reduce the demonstration image 73 based on the position of the icon 72. In this case, the distribution image generation unit 35 may enlarge or reduce the demonstration image 73 horizontally around a position close to the position of the icon 72, and the demonstration image 73 vertically around the face image of the performer. In addition, the distribution image generation unit 35 preferably processes images so that the demonstration image 73 changes smoothly in accordance with the movement of the icon 74 based on the relationship between the display area 71 and the icon 74. In this case, the distribution image generation unit 35 preferably processes images using images obtained by increasing the number of the shooting units 16 to several tens, or by using 3D modeling, etc. In addition, the distribution video generation unit 35 may switch to an enlarged image of the demonstration image 73 when the viewer clicks or taps a specified icon (for example, an icon indicating a zoom operation such as binoculars) without changing the position of the icon 74.The distribution video generation unit 35 may record the timing (time) at which a predetermined icon is clicked or tapped in association with each viewer, and may display a display indicating good compatibility for viewers with the same or similar (close) timing in addition to the icon 74. The distribution video generation unit 35 may generate a video to display, as a display indicating good compatibility, a percentage (a numerical value indicating the degree of compatibility), for example, together with the icon 74, or may generate a video to display the icon 74 of a viewer with good compatibility in a larger size, or may generate a video to display the viewer as another viewer recommended for interaction.

[0041] The volume setting unit 37 can set the volume of the performance sound based on the positional relationship between the display area 71 and the icon 74 in the distribution video 70. For example, the volume setting unit 37 can set the volume of the performance sound to be transmitted to the receiving device 50 corresponding to the icon 74 to be louder as the icon 74 is located closer to the display area 71. The volume setting unit 37 can set the volume of the performance sound to be transmitted to the receiving device 50 corresponding to the icon 74 to be louder as the icon 74 is located farther from the display area 71. This operation allows the sound to be heard in the same way as when watching the performance at a performance venue. For the same purpose, the volume setting unit 37 may adjust the volume of each sound component included in the performance sound according to the left-right position such as the right side, center side, left side, etc. of the display area 71. As a specific example, the volume setting unit 37 may increase the volume of the instrument being performed on the left side when the icon 74 is located on the left side. The volume setting unit 37 may set not only the volume but also the frequency characteristics. Furthermore, by adding information indicating a direction to the icon 74 and imparting sound directionality, the volume setting unit 37 may change the volume, sound components, frequency characteristics, and the like depending on the direction of the icon 74.

[0042] The generated distribution video 70 and live performance audio are distributed to the receiving device 50 under the control of the communication control unit 34.

[0043] Receiving device 50 receives video for distribution 70 transmitted from server device 30. Communications control unit 62 acquires the received video for distribution 70. Output control unit 63 causes display unit 59 to display the acquired video for distribution 70. Viewers can view video for distribution 70 displayed on display unit 59.

[0044] The imaging unit 56 images the viewer watching the video for distribution 70 and generates a viewer video. The audio input unit 57 picks up the audio of the viewer watching the video for distribution 70 and generates viewer audio. The viewer video and viewer audio are input to the input unit 51. The input information acquisition unit 61 acquires the input viewer video and viewer audio. Under the control of the communication control unit 62, the acquired viewer video and viewer audio are transmitted from the communication unit 53 to the server device 30.

[0045] The server device 30 receives the viewer video and the viewer voice. The communication control unit 34 can transmit the received viewer voice to, for example, a receiving device 50 different from the receiving device 50. This operation allows the viewers to understand the reactions of the other viewers to the distribution video 70, just as the cheers of the other spectators can be understood when watching a live performance at a live performance venue. In this case, the volume setting unit 37 can set the volume of the viewer voice based on the positional relationship between the icons 74 arranged in the icon arrangement area 72. For example, the volume setting unit 37 can set the volume of the viewer voice to be transmitted to the receiving device 50 corresponding to the other icon 74 so that the closer the icons 74 are arranged, the higher the volume of the viewer voice to be transmitted to the receiving device 50 corresponding to the other icon 74. The volume setting unit 37 can also set the volume of the viewer voice to be transmitted to the receiving device 50 corresponding to the other icon 74 so that the farther the icons 74 are arranged, the lower the volume of the viewer voice to be transmitted to the receiving device 50 corresponding to the other icon 74.

[0046] The distribution image generating unit 35 can composite the acquired viewer image in the icon arrangement area 72 instead of or in addition to the icon 74. In this case, the distribution image 70 is transmitted to each receiving device 50 with the viewer image of one viewer displayed. That is, the viewer image of one viewer is distributed to other viewers. This operation allows viewers to understand the state of other viewers with respect to the distribution image 70, just as the state of other spectators can be understood when watching a performance at a performance venue. This operation may also allow viewers whose icons 74 are located nearby to talk to each other before the start of the performance, during a break, or after the performance is finished. The position of the user's own icon 74 may be moved by an operation such as dragging and dropping the icon 74, or may be moved in accordance with the operation of the smartphone using a sensor that acquires the position, direction, etc. of the smartphone, or buttons for moving forward, backward, facing right, etc. may be provided, or other user interfaces may be used as appropriate.

[0047] The viewing status video generating unit 36 ​​detects the viewing state of the viewer viewing the video for distribution 70, for example, based on the received viewer video and viewer voice and the position of the icon 74 set in the icon arrangement area 72. The viewing status video generating unit 36 ​​generates a viewing status video in which the viewer video is displayed or not displayed in a display mode according to the viewing status. The viewing status video generating unit 36 ​​may also notify a viewer whose own viewer image is displayed as a viewing video in the viewing status video that the image is being displayed. Specifically, the viewing status video generating unit 36 ​​may change the mode of the icon 74 displayed on the receiving device 50, or may notify the receiving device 50 by using text, images, or the like. The viewing status video generating unit 36 ​​may also confirm with the viewer that the icon 74 will be displayed before being displayed as a viewer video on the receiving device 50. The viewer may set the public range of his / her viewing video and voice on the receiving device 50, and the video generating unit for distribution 35 may combine the acquired viewer video into the icon arrangement area 72 based on the set public range. The receiving device 50 may also allow a viewer to register other viewers as friends. A preferred method of friend registration is, for example, to move one's own icon 74 within a predetermined distance from the icon 74 of another viewer who has not registered the viewer as a friend, and to tap or click on the icon 74 of the viewer who has not registered the viewer as a friend, thereby sending a friend request to the viewer who has not registered the viewer as a friend. If the viewer who has received the friend request accepts the request, the two viewers can register each other as friends. As for the range of disclosure that can be set on the receiving device 50, for example, it is preferred that the viewing status video, the viewer video of the friend's receiving device 50, and the viewer video of the receiving device 50 of a viewer other than the friend can each be set to public or private.

[0048] FIG. 7 is a diagram showing an example of a viewing situation video. As shown in FIG. 7, the viewing situation video 80 includes one or more viewer videos 81. The viewer videos 81 are videos captured by each receiving device 50. The viewing situation video generating unit 36 ​​can arrange one or more viewer videos 81 at a predetermined position according to the viewing situation of the viewer. FIG. 7 shows a case where, for example, six viewer videos 81 (81a to 81f) are displayed. In the following description, when the multiple viewer videos 81 shown in the figure are to be distinguished, they are represented by symbols indicating the individual viewer videos 81, such as viewer video 81a, viewer video 81b, etc. In this case, the viewer video 81a is assumed to be a video of a viewer corresponding to the icon 74a of the video for distribution 70 shown in FIG. 6 and the like. The viewer video 81b is assumed to be a video of a viewer corresponding to the icon 74b of the video for distribution 70. Similarly, viewer videos 81c, 81d, 81e, and 81f are assumed to be videos of the viewers corresponding to icons 74c, 74d, 74e, and 74f of video 70 for distribution, respectively.

[0049] The viewing status image generating section 36 can set the display mode of the viewer image based on the positional relationship between the position of the display area 71 and the position of the icon 74, for example.

[0050] FIG. 8 is a diagram for explaining a setting example of the display mode of the viewer video. As shown in FIG. 8, the viewing situation video generating unit 36 ​​can display viewer video 81 (81b, 81d, 81e) in the viewing situation video 80 for viewers (viewers corresponding to icons 74a, 74c, 74f) whose icons 74 are arranged in the neighborhood region 72a near the display region 71 in the icon arrangement region 72, and can display no viewer video in the viewing situation video 80 for viewers (viewers corresponding to icons 74b, 74d, 74e) whose icons 74 are not arranged in the neighborhood region 72a. Note that, although the icon arrangement region 72 is displayed as a seat in FIG. 8, the viewing situation video generating unit 36 ​​may display it as a free space, for example, without displaying a seat. Also, the right to view the live performance video 73 may be a right to seat reservation, similar to a seat reservation ticket at an actual live performance venue, and the viewing situation video generating unit 36 ​​may position the icon 74 only in the viewer's designated seat in the icon arrangement region 72 when displaying the display region 71. In this case, the viewer may be charged a higher price for the seats in the front. By using seat images that mimic the seats shown in FIG. 8 or images of an actual hall, the viewer can enjoy the atmosphere of the venue in addition to the distributed video. The viewing situation video generating unit 36 ​​generates a video that displays the viewer whose icon 74 is located in the vicinity area 72a in the viewing situation video 80, so that the performer can see only the viewer in the front seats, just as if he or she were actually at the venue, and this gives a sense of realism to both the performer and the viewer. The viewing situation video generating unit 36 ​​generates a video that displays only the viewer in the front seats, so that the viewer video 81 can be displayed in the viewing situation video 80 while giving a sense of realism to both the performer and the viewer within limited resources. Here, the limited resources refer to various restrictions, such as the display area of ​​the viewing situation video 80, the processing capacity of the server device 80, and the communication load on the network NW. The viewing situation video 80 may include not only the viewer video 80 but also images of the icons 74 and the viewer's avatars. Furthermore, the viewing situation image generating section 36 may be configured to move the icon 74 around the venue.Examples of the surroundings of the performance venue include lobbies, shops, or waiting rooms in the performance venue facilities, or restaurants near the performance venue facilities. The icon 74 may be moved between the performance venue and the surroundings of the performance venue via an image that resembles an entrance or exit, or may be moved in a three-dimensional virtual space. The viewing situation video generating unit 36 ​​may display the viewer video 81 in the viewing situation video 80 only for the viewer whose icon 74 is in the performance venue. The viewing situation video generating unit 36 ​​may automatically reduce the volume of the voices of other viewers in the performance venue to a predetermined value or set it to zero so that the viewer can concentrate on the sound of the performance. Even in this case, the viewing situation video generating unit 36 ​​can display the viewer video 81 in the viewing situation video 80 while giving a sense of realism to both the performer and the viewer with limited resources. The viewing situation video generating unit 36 ​​may also recognize the contents of the conversation between the viewers, extract contents related to the performer from the topic of the conversation, and display the contents in text around the icon 74. In this case, after the performance has ended, it becomes easy for a large number of viewers to share topics related to the performer and have conversations.

[0051] Fig. 9 is a diagram for explaining a setting example of the display mode of the viewer video. As shown in Fig. 9, the viewing situation video generating unit 36 ​​can display viewer videos 81a to 81f in the viewing situation video 80 so that the positional relationship on the right and left sides between the position of the display area 71 and the positions of the icons 74a to 74f is the same. With this mode, the viewer video 81 can be displayed in the same mode as when the audience seating side is viewed from the stage side at an actual concert venue.

[0052] FIG. 10 is a diagram for explaining a setting example of the display mode of the viewer video. As shown in FIG. 10, the viewing status video generating unit 36 ​​can display the viewer video 81 of the viewer whose icon 74 is arranged in a position close to the display area 71 relatively large, and display the viewer video 81 of the viewer whose icon 74 is arranged in a position far from the display area 71 relatively small. For example, the viewer video 81c, 81f corresponding to the icons 74c, 74f arranged in a position closest to the display area 71 is displayed largest in the viewing status video 80. Also, the viewer video 81a corresponding to the icon 74a arranged in a position second closest to the display area 71 is displayed second largest in the viewing status video 80. Also, the viewer video 81d, 81e corresponding to the icons 74d, 74e arranged in a position third closest to the display area 71 are displayed third largest in the viewing status video 80. Also, the viewer video 81b corresponding to the icon 74b arranged in a position farthest from the display area 71 is displayed smallest in the viewing status video 80. This aspect allows the viewer video 81 to be displayed in the same manner as when the audience seating is viewed from the stage side at an actual performance venue. The viewer video 81 may be a still image or a moving image, and the still image may be dynamically switched, or the still image and the moving image may be switched as appropriate. By linking the position of the icon 74 in the virtual space with the position of the viewer video 81 seen by the performer, it is possible to give the performer a sense of realism. In addition, viewers have various requests, and the viewer can intuitively input requests such as "I want to go to the front," "I want the performer to remember my face," "There is a performer I am cheering for at a lower level," and "I am embarrassed to be seen by the performer" to the system. In addition, the distribution system 100 can increase or decrease the number of viewer videos 81 that can be displayed by dynamically changing the viewer video 81 while responding to various requests of the viewer. In addition, the distribution system 100 can give a sense of realism through appropriate display by dynamically changing the viewer video 81 while responding to various requests of the viewer. In addition, a tiered charge may be set for the viewer, and the display mode of the viewing situation video 80 may be changed according to the amount of the charge.

[0053] Furthermore, the viewing situation image generating section 36 can set the display mode of the viewer image according to the position of the performer P1 relative to the display section 19, for example.

[0054] FIG. 11 is a diagram for explaining a setting example of the display mode of the viewer image. As shown in FIG. 11, the viewing situation image generating unit 36 ​​can generate the viewing situation image so that the viewer image 81 is displayed in an area of ​​the display unit 19 corresponding to the position of the performer P1. This mode makes it easier for the performer to grasp the viewer image 81. In addition, in a configuration in which there are multiple performers P1 and the viewer can select a specific performer, the viewing situation image generating unit 36 ​​can generate the viewing situation image so that the viewer image 81 of the viewer who selected the performer is displayed in an area of ​​the display unit 19 corresponding to the position of the performer selected by the viewer. This mode makes it possible to display the viewer image 81 of the viewer near the performer selected by the viewer. Specifically, the distribution device 10 or the server device 30 may identify the position of the performer using face detection, gaze detection, skeletal detection, etc. using the imaging unit 16, or other sensors such as a radiation thermometer or a ToF (Time of Flight) sensor. The viewing situation image generating unit 36 ​​generates the viewer image 81 based on the position of the performer. In particular, when a viewer posts an image or the like supporting a specific performer, the viewing situation video generating unit 36 ​​may perform image recognition of characters or facial images contained in the cheering image, and display the viewer video 81 in a position where the performer being cheered for can be easily seen. The viewing situation video generating unit 36 ​​may record the detection of the cheering image, or perform voice recognition of the cheering voice, and create a database that associates each viewer with the performer they are cheering for, thereby generating a video in which the viewer video 81 of the viewer cheering for a specific performer is displayed in a position where the specific performer can easily be seen. The viewing situation video generating unit 36 ​​may generate the viewer video 81 so that it changes dynamically in accordance with the movements of the performer.

[0055] The viewing status video generated as described above is transmitted from the communication unit 31 to the distribution device 10 under the control of the communication control unit 34. The distribution device 10 receives the transmitted viewing status video. The communication control unit 22 acquires the received viewing status video. The output control unit 23 displays the acquired viewing status video on the display unit 19.

[0056] The viewing status image generating unit 36 ​​can set the display mode of the viewer image according to the degree of enthusiasm of the viewer toward the video for distribution 70. The degree of enthusiasm is an index that has a high value when the viewer behaves positively toward the video for distribution 70, such as cheering for the performer, cheering loudly, moving loudly, moving in response to the performer's movements, dancing, using cheering goods for the performer, smiling, crying with emotion (emotionally moved), and the viewer's face being shown in the viewer image, when viewing the video for distribution 70. The control unit 32 may measure the viewer's degree of enthusiasm by appropriately combining image recognition, face recognition, voice recognition, skeletal authentication, etc., with respect to the viewing status image, or by using other sensors such as a radiation thermometer or a ToF (Time of Flight) sensor. In addition, the degree of positivity is high when the viewer does not behave negatively toward the video for distribution 70, for example, the viewer's viewer video is permitted to be displayed in the viewing situation video, and the viewer has no history of uttering negative or prohibited words toward the video for distribution 70. The control unit 32 can calculate a score for each predetermined item, including the example shown above, and set the degree of positivity according to the score. The viewing situation video generation unit 36 ​​can generate the viewing situation video 80, for example, so that the viewer video 81 of a viewer whose degree of positivity is equal to or higher than a standard is displayed, and the viewer video 81 of a viewer whose degree of positivity is below the standard is not displayed. The control unit 32 may calculate the degree of positivity based on the image recognition result of the viewing situation video, or may calculate the degree of positivity based on the content of a text comment entered by the viewer in a comment field or the like. In addition, the control unit 32 may be configured to be linked to the viewer's account such as an SNS (Social Networking Service), and the control unit 32 may calculate the degree of positivity by referring to information on the SNS. Furthermore, when the distribution system 100 is used in a school class or the like, the viewing status image generating unit 36 ​​may generate a viewer image so as to give priority to and display a viewer whose level of engagement is calculated to be low, such as a sleeping student.

[0057] FIG. 14 is an example of a management screen that the operator of the distribution device 10 confirms. In the example of the management screen shown in FIG. 14, the management status of users 1 to 30, a forced exit button, brightness management of the display unit 19, and volume management of the viewers are displayed. The management status of the users includes the display name, whether the viewer video 81 is being displayed, whether the viewer's face is displayed in the viewer video 81, and the number of times the NG word was uttered. In addition, a smile score, a cheering score, a movement score, and a cheering goods score are displayed, and the positiveness is defined as the total value of these. In this example, the positiveness is the total value of each score, but a calculation using a predetermined coefficient or the like may be performed. In the example of the management screen shown in FIG. 14, the management status of users 1 to 30 is displayed, but only the management status of the users who are displaying the viewing status video, or only the management status of the users whose scores or status have changed, may be displayed. In this way, the score can be calculated for each predetermined item. The calculation of the score for each predetermined item may be performed automatically by the control unit of the server device, without being displayed on the management screen.

[0058] The performer can respond to the viewing situation image 80 displayed on the display unit 19. When the performer responds to the viewing situation image displayed on the display unit 19, the response information acquisition unit 24 acquires the response information of the performer. The response information acquisition unit 24 may detect the performer's line of sight and acquire the response information based on the detection result. In this case, the response information acquisition unit 24 can detect the performer's line of sight based on the performance image captured by the capture unit 16, for example. The response information acquisition unit 24 detects whether the performer is gazing at the display unit 19 based on the detection result, and if the performer is gazing at the display unit 19, detects which position on the display unit 19 the performer is gazing at. When it is detected that the performer's line of sight is gazing at a portion of the display unit 19 where the viewer image is displayed or the vicinity thereof, the response information acquisition unit 24 determines that the performer is responding to the viewer image. In this case, the response information acquisition unit 24 extracts the viewer image that is shown at the position where the performer is gazing and in the vicinity thereof, and identifies the viewer (or the receiving device 50) that corresponds to the extracted viewer image. In this way, the response information acquisition unit 24 acquires, as response information, information indicating that the performer is responding and information indicating the viewer to whom the performer is responding.

[0059] Examples of the performer's response to the viewer image are not limited to turning his / her gaze to the viewer image. For example, the performer may call out to the viewer image, wave his / her hand, point his / her finger, or send his / her gaze, or the performer or the operator of the distribution device 10 may select the viewer image by clicking or tapping on the viewer image using the operation unit 18. In the example of FIG. 3, the operation unit 18 is a picture imitating a mouse used by the operator of the distribution device 10, but the operation unit 18 used by the performer may be, for example, a microphone with an additional button or a portable terminal so that it can be used during the performance. The response information acquisition unit 24 acquires, as response information, the fact that the performer has called out to the viewer and the viewer image to which the performer called out, for example, based on the performance image and the performance audio. The response information acquisition unit 24 acquires, as response information, the fact that the performer has waved his / her hand, pointed his / her finger, or sent his / her gaze, and the viewer image to which these are the targets, for example, based on the performance image. Furthermore, when the performer selects a viewer image using the operation unit 18, the response information acquisition unit 24 acquires, as response information, the fact that a response has been made by selection and the viewer image that is the subject of the selection.

[0060] The communication control unit 22 causes the communication unit 13 to transmit the response information acquired by the response information acquisition unit 24 to the server device 30. The server device 30 receives the response information transmitted from the distribution device 10. The communication control unit 34 acquires the response information.

[0061] The server device 30 can change the display mode of at least a part of the video for distribution based on the response information. For example, the video for distribution generating unit 35 can change the display mode of the icon 74 representing the viewer to whom the performer responded, for the video for distribution 70 to be transmitted to the receiving device 50 of the viewer. The video for distribution generating unit 35 can change the display mode of the icon 74 over time, for example, by blinking, enlarging or reducing, moving, deforming, changing color, or a combination of these.

[0062] This operation causes icon 74 to be displayed in a changed state on display unit 59 of receiving device 50 of the viewer to whom the performer is responding. By visually checking the change in the display mode of icon 74, the viewer can understand that the performer has responded. In distribution system 100 according to this embodiment, two-way communication can be carried out between the viewer and the performer, and vice versa, regarding distribution video 70 distributed by the performer.

[0063] FIG. 12 is a flowchart showing the flow of the operation of the distribution system 100 according to this embodiment. As shown in FIG. 12, the distribution system 100 starts its operation (start) when the distribution device 10, the server device 30, and the receiving device 50 are started, or when an operation to start shooting or collecting sound is initiated. The shooting unit 16 and the audio input unit 17 shoot and collect sound of a performance by a performer, and generate a performance video and a performance audio (step S101). The generated performance video and performance audio are input to the input unit 11. The communication control unit 22 causes the communication unit 13 to transmit the input performance video and performance audio to the server device 30 (step S102). The server device 30 receives the performance video and performance audio transmitted from the distribution device 10 (step S103). The distribution video generation unit 35 composites the performance video 73 with the display area 71 of the background image 75 (step S104).

[0064] Meanwhile, the viewer accesses server device 30 from receiving device 50 and sets the arrangement of icon 74 (step S105). Video for distribution generation unit 35 of server device 30 composites icon 74 at the set position (step S106). This generates video for distribution 70. Communications control unit 22 causes communication unit 31 to transmit the generated video for distribution 70 to receiving device 50 (step S107).

[0065] Receiving device 50 receives video for distribution 70 transmitted from server device 30 (step S108). The received video for distribution 70 is acquired by communication control unit 62 and displayed on display unit 59 by output control unit 63 (step S109). The viewer can view video for distribution 70 displayed on display unit 59.

[0066] The image capturing unit 56 and the audio input unit 57 capture images of the viewers watching the video for distribution 70 and collect the audio of the viewers to generate the viewer images and the viewer audio (step S110). The viewer images and the viewer audio are input to the input unit 51 and are transmitted from the communication unit 53 to the server device 30 under the control of the communication control unit 62 (step S111).

[0067] The server device 30 receives the viewer video and the viewer audio (step S112). The viewing status video generator 36 detects the viewing state of the viewer who is viewing the video for distribution 70, and generates a viewing status video in which the viewer video is displayed or not displayed in a display mode according to the viewing state (step S113).

[0068] The viewing status video is transmitted from communication unit 31 to distribution device 10 under the control of communication control unit 34 (step S114). Distribution device 10 receives the transmitted viewing status video (step S115). The viewing status video is acquired by communication control unit 22 and displayed on display unit 19 by output control unit 23 (step S116).

[0069] When the performer responds to the viewing situation video displayed on the display unit 19, the response information acquisition unit 24 acquires the response information of the performer (step S117). The communication control unit 22 causes the communication unit 13 to transmit the response information acquired by the response information acquisition unit 24 to the server device 30 (step S118). The server device 30 receives the response information transmitted from the distribution device 10 (step S119).

[0070] The server device 30 changes the display mode of at least a part of the video to be distributed based on the response information (step S120). The icon 74 with the changed display mode is displayed on the display unit 59 of the receiving device 50 of the viewer to whom the performer responded (step S121). The viewer can understand that there has been a response from the performer by visually checking the change in the display mode of the icon 74. Note that in the flowchart shown in FIG. 12, the process ends after each operation in the distribution device 10, the server device 30, and the receiving device 50 is completed, but it is preferable to repeatedly perform (loop) a series of operations until an end operation is received, a predetermined time has elapsed, or a predetermined number of times (loops) have elapsed.

[0071] As described above, distribution system 100 according to this embodiment includes distribution device 10 which acquires performance video 73 of a performer performing a performance and transmits the acquired performance video 73, server device 30 which receives performance video 73 transmitted from distribution device 10, generates video for distribution 70 based on the received performance video 73 and transmits the generated video for distribution 70, and receiving device 50 which receives video for distribution 70 transmitted from server device 30 and displays the received video for distribution 70 on display unit 59, wherein receiving device 50 acquires viewer video 81 capturing a viewer watching video for distribution 70 and transmits the acquired viewer video 81, server device 30 receives viewer video 81 transmitted from receiving device 50 and generates viewing status video 80 in which viewer video 81 is displayed or not in a display mode corresponding to the viewing status of the viewer watching video for distribution 70 and transmits the generated viewing status video 80, and distribution device 10 receives viewing status video 80 transmitted from server device 30 and displays the received viewing status video 80 on display unit 19.

[0072] According to this configuration, viewer video 81 is acquired in the receiving device 50, viewing status video 80 is generated in the server device 30, and the viewing status video 80 is displayed on the display unit 19 in the distribution device 10, so that the performer can easily grasp the viewing status of the viewer by looking at the viewing status video 80 displayed on the display unit 19.

[0073] In distribution system 100 according to this embodiment, distribution device 10 acquires response information when a performer responds to viewer video 81 displayed on display unit 19, and transmits the acquired response information, and server device 30 receives the response information transmitted from distribution device 10 and changes the display mode of at least a part of video for distribution 70 based on the received response information. With this configuration, a viewer can know that there has been a response from the performer by checking the change in the display mode of video for distribution 70. This makes it easy for the performer to communicate with the viewer.

[0074] In the distribution system 100 according to the present embodiment, the distribution device 10 displays the viewer video 81 in a display mode that corresponds to the positional relationship between the performer and the display unit 19. This configuration makes it easier for the performer to recognize the viewer video 81.

[0075] In the distribution system 100 according to this embodiment, the server device 30 generates a distribution video 70 including a display area 71 for displaying a demonstration video 73 and an icon arrangement area 72 corresponding to the display area 71 and capable of arranging icons 74 of viewers watching the demonstration video 73, and the status information includes the positional relationship between the display area 71 and the icons 74. With this configuration, a viewing status video 80 can be generated in a variety of display forms according to the positional relationship between the display area 71 and the icons 74.

[0076] In the distribution system 100 according to the present embodiment, the status information includes the viewer's level of enthusiasm for the video for distribution 70, and the server device 30 generates the viewing status video 80 such that the viewer video 81 of a viewer whose level of enthusiasm is below a standard is not displayed. With this configuration, the viewing status of a viewer who is highly active in the video for distribution 70 can be selectively displayed on the display unit 19.

[0077] The technical scope of the present invention is not limited to the above embodiment, and can be modified as appropriate without departing from the gist of the present invention. For example, in the above embodiment, the environment in which the distribution device 10 is placed is described as an example in which there is no audience, but the present invention is not limited to this. FIG. 13 is a diagram showing another example of the distribution device 10 and the equipment connected to the distribution device 10. As shown in FIG. 13, the configuration may be such that the audience seats 26 are placed relative to the performance space 25. In this case, the display units 19A, 19B, and 19C are placed behind the audience seats 26 as viewed from the performance space 25. With this configuration, the performer can grasp both the reaction of the audience in the audience seats 26 and the reaction of the viewer of the receiving device 50. In addition, the reaction to the performance by the performer can be shared between the audience in the audience seats 26 and the viewer of the receiving device 50. In addition, the performance video 73 may be a plurality of videos. For example, by making the size of the distribution video 70 sufficiently larger than the sizes of the demonstration video 73 and the icon 74, the viewer can view the demonstration by moving the icon 74, moving closer to the demonstration video 73 as appropriate, or changing the display range. For example, the demonstration video 73 may be arranged on multiple websites, and the viewer can view multiple demonstration videos 73 by moving between the multiple websites. By arranging multiple demonstration videos 73, it is possible to implement an event called a festival in which multiple performers simultaneously perform on multiple stages, or an event in which multiple lectures or poster sessions are held simultaneously, such as an exposition or academic conference. In all of the above-described embodiments, each function (operation) has been described as being part of (implemented in) the distribution device 10, the server device 30, or the receiving device 50, but this is merely an example, and it is sufficient that each function (operation) of the distribution device 10, the server device 30, or the receiving device 50 is implemented as the entire system, and the entity implementing the function (operation) is not limited. Furthermore, the distribution system 100 may have a configuration including only the functions (operations) of the distribution device 10 and the server device 30, and not including the functions (operations) of the receiving device 50. [Explanation of symbols]

[0078] P1...performer, NW...network, 10...distribution device, 11,51...input section, 12,52...output section, 13,31,53...communication section, 14,32,54...control section, 15,33,55...storage section, 16,56...shooting section, 17,57...audio input section, 18,58...operation section, 19,19A,19B,19C,59...display section, 20,60...audio output section, 21,61...input information acquisition section, 22,34,62...communication control section, 2 3,63...output control unit, 24...response information acquisition unit, 25...performance space, 26...audience seats, 30...server device, 35...distribution video generation unit, 36...viewing status video generation unit, 37...volume setting unit, 50...receiving device, 70...distribution video, 71...display area, 72...icon arrangement area, 72a...nearby area, 73...performance video, 74...icon, 75...background image, 80...viewing status video, 81...viewer video, 100...distribution system

Claims

1. a distribution device that acquires a video of a performer performing a demonstration and transmits the acquired video of the demonstration; a server device that receives the video of the demonstration transmitted from the distribution device, generates a video for distribution based on the received video of the demonstration, and transmits the generated video for distribution; a receiving device that receives the video to be distributed transmitted from the server device and displays the received video to be distributed on a receiving-side display unit; Equipped with The receiving device acquires a viewer image showing a viewer watching the video for distribution, and transmits the acquired viewer image; the server device receives the viewer video transmitted from the receiving device, generates a viewing status video of the viewer viewing the video for distribution, and transmits the generated viewing status video; The distribution device receives the viewing status video transmitted from the server device, and displays the received viewing status video on a distribution side display unit. A distribution system comprising: The distribution device has a detection unit that detects the position of the performer, and the server device generates the viewer video in a display mode that corresponds to the positional relationship between the performer and the distribution side display unit. Delivery system.

2. When there are a plurality of performers and the viewer selects any one of the performers, the server device generates a viewing situation image so as to display the viewer image of the selected viewer in an area of ​​the distribution side display unit where the selected performer is easily visible. The distribution system according to claim 1 .

3. When there are a plurality of performers and the viewer selects any one of the performers, the server device generates a viewing situation image so as to display the viewer image of the selected viewer in an area of ​​the distribution side display unit close to the selected performer. The distribution system according to claim 1 .

4. A distribution device that acquires a video of a performer performing a demonstration and transmits the acquired video of the demonstration; a server device that receives the video of the demonstration transmitted from the distribution device, generates a video for distribution based on the received video of the demonstration, and transmits the generated video for distribution; a receiving device that receives the video to be distributed transmitted from the server device and displays the received video to be distributed on a receiving-side display unit; Equipped with The receiving device acquires a viewer image showing a viewer watching the video for distribution, and transmits the acquired viewer image; the server device receives the viewer video transmitted from the receiving device, generates a viewing status video of the viewer viewing the video for distribution, and transmits the generated viewing status video; The distribution device receives the viewing status video transmitted from the server device, and displays the received viewing status video on a distribution side display unit. A distribution system comprising: the server device generates a video for distribution including a display area for displaying the video of the demonstration and an icon arrangement area corresponding to the display area and capable of arranging icons of viewers who will be viewing the video of the demonstration; Generate a viewing situation image for displaying or not displaying the viewer image based on a positional relationship between the display area and the icon. Delivery system.

5. The server device generates a viewing status image in which the viewer image is displayed when the icon is placed in an area close to the display area, and the viewer image is not displayed when the icon is placed in an area far from the display area.

5. The distribution system according to claim 4.

6. A distribution device that acquires a video of a performer performing a demonstration and transmits the acquired video of the demonstration; a server device that receives the video of the demonstration transmitted from the distribution device, generates a video for distribution based on the received video of the demonstration, and transmits the generated video for distribution; a receiving device that receives the video to be distributed transmitted from the server device and displays the received video to be distributed on a receiving-side display unit; Equipped with The receiving device acquires a viewer image showing a viewer watching the video for distribution, and transmits the acquired viewer image; the server device receives the viewer video transmitted from the receiving device, generates a viewing status video of the viewer viewing the video for distribution, and transmits the generated viewing status video; The distribution device receives the viewing status video transmitted from the server device, and displays the received viewing status video on a distribution side display unit. A distribution system comprising: The server device generates the viewing situation video such that the viewer video of the viewer whose degree of enthusiasm for the video to be distributed, determined from the viewer's behavior with respect to the video to be distributed while viewing the video to be distributed, is below a standard is not displayed. Delivery system.

7. The server device selects a specific viewer from among a plurality of viewers who watch the video for distribution, displays the viewer's image in a viewing status image in the video for distribution distributed to the selected viewer, and hides the viewer's image in a viewing status image in the video for distribution distributed to the unselected viewer. The distribution system according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • System and method for tracking event and providing feedback of virtual conference

    JP2020173853A

  • Video distribution system and program for video distribution

    JP3832318B2

  • Event Production and Distribution Networks, Systems, Apparatuses, and Methods Related Thereto

    US20200404344A1

  • Information processing system, information processing method and computer program

    WO2019234879A1