Computer program, method and server device

Abstract

To provide a computer program, a method, and a server device for viewing a moving image prepared in advance separately from a moving image including an animation of a distributor's avatar together.SOLUTION: In a moving image distribution system, a computer program installed in a distributor's terminal device transmits configuration data including at least audio data and motion data used by a viewer's terminal device for generating a first moving image, or the first moving image generated based on the configuration data to the viewer's terminal device via a first server device, receives and reproduces a second moving image from a second server device different from the first server device, synchronizes with access data indicating a method of accessing the second moving image stored in the second server device and reproducing the second moving image by the distributor's terminal device, and transmits reproduction data including at least one piece of instruction data instructing the operation of the viewer's terminal device with respect to the second moving image to the viewer's terminal device via the first server device.SELECTED DRAWING: Figure 6A

Description

Technical Field

[0001] The technology disclosed in this application relates to a computer program, a method, and a server device used for transmitting a video including an animation of a distributor's avatar to a viewer's terminal device.

Background Art

[0002] A technology used for transmitting a video including an animation of a distributor's avatar to a viewer's terminal device is described in Japanese Patent Application Laid-Open No. 2020-39029 (Patent Document 1). In the technology described in this patent document, a video including an animation of this distributor's avatar generated based on the motion data of the distributor (performer) is distributed from a server device to each viewer's terminal device. Note that the entire Patent Document 1 is incorporated herein by reference.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] On the premise of the technology in which a video including an animation of a distributor's avatar is transmitted to a viewer's terminal device as described above, a service that enables the distributor and the viewer to watch and enjoy a video prepared separately from the above video together is expected.

[0005] Therefore, the technology disclosed in this application provides a computer program, a method, and a server device that enable a distributor and a viewer to watch together a video prepared separately from a video including an animation of the distributor's avatar.

Means for Solving the Problems

[0006] A computer program according to one aspect can cause at least one processor mounted on a distributor's terminal device to, when executed, transmit, via a first server device, configuration data including at least audio data and motion data used by a viewer's terminal device to generate a first video, or a first video generated based on the configuration data, to the viewer's terminal device, receive and play a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, transmit access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and at least one of reproduction data including instruction data that synchronizes with the reproduction of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video, to the viewer's terminal device via the first server device. A method according to one aspect is a method executed by at least one processor mounted on a distributor's terminal device that executes instructions readable by a computer, wherein the at least one processor, by executing the instructions, transmits, via a first server device, configuration data including at least audio data and motion data used by a viewer's terminal device to generate a first video, or a first video generated based on the configuration data, to the viewer's terminal device, receives and plays a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, and transmits access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and at least one of reproduction data including instruction data that synchronizes with the reproduction of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video, to the viewer's terminal device via the first server device. Another aspect of the computer program, when executed by at least one processor mounted on the viewer's terminal device, is to receive configuration data including at least audio data and motion data, or a first video generated based on the configuration data, from the distributor's terminal device via a first server device, generate and play the first video using the configuration data, or play the received first video, receive a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, receive access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and at least one of playback data including instruction data that synchronizes with the playback of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video via the first server device, and cause the at least one processor to function so as to play the second video according to the playback data. Another aspect of the method is a method executed by at least one processor mounted on a viewer's terminal device that executes instructions readable by a computer, wherein the at least one processor, by executing the instructions, receives configuration data including at least audio data and motion data, or a first video generated based on the configuration data, from the distributor's terminal device via a first server device, generates and plays the first video using the configuration data, or plays the received first video, receives a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, receives access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and at least one of playback data including instruction data that synchronizes with the playback of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video via the first server device, and plays the second video according to the playback data. A server device according to one aspect is a server device provided separately from a server device that distributes a second video to a terminal device of a distributor and a terminal device of a viewer, and includes at least one processor. The at least one processor receives configuration data including at least audio data and motion data used by the terminal device of the viewer to generate a first video from the terminal device of the distributor and transmits the configuration data to the terminal device of the viewer, or distributes the first video generated based on the configuration data to the terminal device of the viewer, access data indicating a method for accessing the second video stored in the second server device and played back by the terminal device of the distributor, and playback data including at least one of instruction data that synchronizes with the playback of the second video by the terminal device of the distributor and instructs the operation of the terminal device of the viewer with respect to the second video are received from the terminal device of the distributor and transmitted to the terminal device of the viewer. A method according to yet another aspect is a method executed by at least one processor that executes computer-readable instructions installed on a server device provided separately from a server device that distributes a second video to a terminal device of a distributor and a terminal device of a viewer. By executing the instructions, the at least one processor receives configuration data including at least audio data and motion data used by the terminal device of the viewer to generate a first video from the terminal device of the distributor and transmits the configuration data to the terminal device of the viewer, or transmits the first video generated based on the configuration data to the terminal device of the viewer, access data indicating a method for accessing the second video stored in the second server device and played back by the terminal device of the distributor, and playback data including at least one of instruction data that synchronizes with the playback of the second video by the terminal device of the distributor and instructs the operation of the terminal device of the viewer with respect to the second video are received from the terminal device of the distributor and transmitted to the terminal device of the viewer.

[0007] This section of "Summary of the Invention" is described to introduce various selected concepts in a simplified form, and these various concepts will be described later in the section of "Detailed Description of the Invention". All trademarks used in this specification are the property of their respective owners. The description in this section of "Summary of the Invention" is not intended to identify the important or essential features of the invention described in the claims, nor is it intended to limit the technical scope of the invention described in the claims. The above-mentioned or other objects, features, and effects of the invention described in the claims will become more apparent from the description in the section of "Detailed Description of the Invention" with reference to the accompanying drawings.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6A

Figure 6B

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14A

Figure 14B

Figure 15

Figure 16

Figure 17

Figure 18

DETAILED DESCRIPTION OF THE INVENTION

[0009] This specification is described in the sense of representative various embodiments and is not intended to be limited by any method. As used in this application, singular forms such as "one," "the," "above," "the," "the," "this," "that," etc. can include the plural form unless clearly indicated otherwise. Also, the term "including" can mean "comprising" or "having." Further, the terms "coupled," "coupled," "associated," "associated," "connected" or "connected" include mechanical, electrical, magnetic and optical methods of coupling, connecting or associating objects with each other, along with other methods, and do not exclude the presence of intermediate elements between objects thus coupled, coupled, associated, associated, connected or connected.

[0010] The various systems, methods and devices described in this specification should not be construed as being limited by any method. In fact, the present disclosure is directed to any novel features and aspects of each of the disclosed various embodiments, combinations of these various embodiments with each other, and combinations of some of these various embodiments with each other. The various systems, methods and devices described in this specification are not limited to a particular aspect, a particular feature, or a combination of such a particular aspect and a particular feature, and the objects and methods described in this specification do not require the presence of one or more specific effects or the solution of problems. Furthermore, various features or aspects of the various embodiments described in this specification, or parts of such features or aspects, can be used in combination with each other.

[0011] Among the various methods disclosed in this specification, the operations of some of the methods are, for convenience, described along a specific order. However, the description by such a method should be understood to include rearranging the order of the above operations unless the specific order is required by the following specific text. For example, a plurality of operations described in sequence may, in some cases, be rearranged or executed simultaneously. Furthermore, for the purpose of simplification, the accompanying drawings do not show various ways in which the various matters and methods described in this specification can be used together with other matters and methods. In addition, this specification may use terms such as "generate", "cause to occur", "display", "receive", "evaluate", and "distribute". These terms are high-level descriptions of the various actual operations to be performed. The various actual operations corresponding to these terms may vary depending on the specific implementation and can be easily recognized by those skilled in the art having the benefit of the disclosure of this specification.

[0012] The theory of operation, scientific principle, or other theoretical descriptions presented in this specification in relation to the apparatus or method of the present disclosure are provided for a better understanding and are not intended to limit the technical scope. The apparatus and method in the appended claims are not limited to the apparatus and method that operate by the method described by such a theory of operation.

[0013] Any of the various methods disclosed herein is implemented using a plurality of computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media such as one or more optical media disks, a plurality of volatile memory components, or a plurality of non-volatile memory components), and can further be executed on a computer. Here, the plurality of volatile memory components include, for example, DRAM or SRAM. Also, the plurality of non-volatile memory components include, for example, hard drives and solid state drives (SSDs). Further, the computer includes any computer available in the market, including, for example, smartphones and other mobile devices having hardware for performing calculations.

[0014] Any of such computer-executable instructions for implementing the techniques disclosed herein, together with any data generated and used during the implementation of the various embodiments disclosed herein, can be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions can be, for example, part of an individual software application or part of a software application accessed or downloaded via a web browser or other software applications (such as remote computing applications). Such software can be executed, for example, on a single local computer (as an agent executed on any suitable computer available in the market, for example) or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such networks) using one or more network computers.

[0015] For the sake of clarity, only certain selected aspects of various software-based implementations are described. Other detailed matters well-known in the art are omitted. For example, the technology disclosed herein is not limited to a specific computer language or program. For example, the technology disclosed herein can be implemented by software described in C, C++, Java, or any other suitable programming language. Similarly, the technology disclosed herein is not limited to a specific computer or a specific type of hardware. Specific details of suitable computers and hardware are well-known and need not be described in detail herein.

[0016] Furthermore, any of such software-based embodiments (e.g., including a plurality of computer-executable instructions for causing a computer to execute any of the various methods disclosed herein) can be uploaded, downloaded, or accessed remotely by suitable communication means. Such suitable communication means include, for example, the Internet, the World Wide Web, an intranet, a software application, a cable (including an optical fiber cable), magnetic communication, electromagnetic communication (including RF communication, microwave communication, infrared communication), electronic communication, or other such communication means.

[0017] Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. Note that the same reference numerals are assigned to common components in the drawings. Also, it should be noted that components shown in one drawing may be omitted in another drawing for the sake of convenience of explanation. Furthermore, note that the attached drawings are not necessarily drawn to an exact scale.

[0018] 1. Configuration of Video Distribution System In the video distribution system disclosed in the present application, briefly speaking, a distributor can use the terminal device to distribute configuration data including audio data related to the audio uttered by the distributor and motion data related to the motion of the distributor to the terminal devices of each viewer via a first server device (e.g., a broadcast server device). Thereby, the terminal device of each viewer can generate and display a first video using the received configuration data. Here, the first video can be a video including an animation of the distributor's avatar synchronized with the performance of the distributor.

[0019] Note that instead of the configuration data, the terminal device of the distributor can also transmit a first video generated based on this configuration data to the terminal devices of each viewer via the first server device. Thereby, the terminal device of each viewer can display the received first video.

[0020] Furthermore, the terminal device of the distributor and the terminal devices of each viewer can directly receive and display a second video from a second server device (e.g., a video distribution server device) without passing through the first server device. Here, the second video can be a video selected by the terminal device of the distributor from among a plurality of videos pre-stored in the second server device. Thereby, both the terminal device of the distributor and the terminal devices of each viewer can receive and display the same second video.

[0021] In particular, the distributor's terminal device can transmit the playback data (playback information) to the terminal devices of each viewer via the first server device. The playback data can include access data (access information) (URL) indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and / or instruction data (instruction information) for instructing the operation of the terminal device of each viewer with respect to the second video. Each viewer's terminal device can play the second video received from the second server device according to the playback data received from the first server device. Thereby, each viewer's terminal device can play the second video at a timing synchronized with the playback of the second video by the distributor's terminal device.

[0022] FIG. 1 is a block diagram showing an example of the configuration of a video distribution system according to an embodiment. As shown in FIG. 1, the video distribution system 1 can include a plurality of terminal devices 10 that can be connected to a communication line (communication network) 2, and a plurality of server devices 20 that can be connected to the communication line 2. Each terminal device 10 can be connected to each of the plurality of server devices 20 via the communication line 2.

[0023] In FIG. 1, for example, terminal devices 10A to 10D are shown as the plurality of terminal devices 10, but one or more terminal devices 10 other than these can be used in the same manner. Similarly, in FIG. 1, for example, the first server device 20A and the second server device 20B are shown as the plurality of server devices 20, but one or more server devices 20 other than these can be used in the same manner. Note that the communication lines not shown can include, without limitation, a mobile phone network, a wireless network (e.g., an RF connection via Bluetooth, WiFi (such as IEEE 802.11a / b / n), WiMax, cellular, satellite, laser, infrared), a fixed phone network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and / or an Ethernet network.

[0024] Furthermore, in one embodiment, the video distribution system 1 may also include one or more studio units 30 connected to the communication line 2. Each studio unit 30 can be connected to a plurality of server devices 20 or a plurality of terminal devices 10 via the communication line 2. In FIG. 1, for example, studio units 30A and 30B are shown as one or more studio units 30, but one or more other studio units 30 can be used in the same way. Each studio unit 30 can have the same functions as the terminal device 10 or the server device 20 described later.

[0025] 1-1. Terminal Device 10 The plurality of terminal devices 10 can include one or more terminal devices 10 of the distributor (here, the terminal device 10A) and one or more terminal devices 10 of the viewers (here, the terminal devices 10B to 10D). By having a common configuration, each terminal device 10 can be either a terminal device for distributing videos (the distributor's terminal device 10) or a terminal device for viewing videos (the viewer's terminal device 10).

[0026] When each terminal device 10 operates as a terminal device for distributing the first video (the distributor's terminal device), it can execute an installed video distribution application (which may be middleware, or a combination of an application and middleware. The same applies hereinafter). Thereby, each terminal device 10 can acquire operation data regarding the operation of its distributor and voice data regarding the voice spoken by its distributor, and can transmit configuration data including at least these operation data and voice data to the first server device 20A via the communication line 2. Alternatively, each terminal device 10 can also transmit the first video generated based on this configuration data to the first server device 20A via the communication line 2.

[0027] Such configuration data or the first video is distributed by the first server device 20A to each viewer's terminal device 10 via the communication line 2. Each viewer's terminal device 10 can receive the configuration data or the first video by executing the installed video viewing application (which may be middleware, or a combination of an application and middleware. The same applies hereinafter).

[0028] Also, when each terminal device 10 operates as a terminal device (viewer's terminal device) for viewing the first video, it can receive the configuration data or the first video distributed by the distributor's terminal device 10 via the first server device 20A by executing the installed video viewing application. In this case, when each terminal device 10 that executes the video viewing application receives the configuration data, it can generate and display the first video using the configuration data. On the other hand, when each terminal device 10 that executes the video viewing application receives the first video, it can display this first video.

[0029] On the other hand, when each terminal device 10 operates as a distributor's terminal device and as a viewer's terminal device, it can execute the installed video receiving application (which may be middleware, or a combination of an application and middleware. The same applies hereinafter). By executing this video receiving application, each terminal device 10 can directly access the second server device 20B without going through the first server device 20A and receive and display (play back) the second video.

[0030] Note that the video distribution application for distributing the first video and the video viewing application for viewing the first video can be installed and executed on each terminal device 10 as an integrated single application or as separate applications.

[0031] Also, the video reception application for receiving the second video from the second server device 20B can be installed and executed on each terminal device 10 as a separate application from the above-described video distribution application for distributing the video and the video viewing application for viewing the first video. In one embodiment, the video reception application for receiving the second video from the second server device 20B can be an Embedded Player.

[0032] Each terminal device 10 can be any terminal device capable of executing such operations, including, without limitation, smartphones, tablets, mobile phones (feature phones), and / or personal computers, etc.

[0033] 1-2. Server Device 20 FIG. 1 shows, as an example, a first server device 20A and a second server device 20B as a plurality of server devices 20. Here, as an example, the first server device 20A is a "broadcast server device", and the second server device 20B is a "video distribution server device". The names "broadcast server device" and "video distribution server device" are merely exemplary names and can be any names.

[0034] The broadcast server device (hereinafter referred to as the "BC server device") 20A can receive configuration data or the first video from the terminal device 10 of the distributor and distribute it to the terminal devices 10 of each viewer. Further, the BC server device 20A can receive reproduction data (including access data and / or instruction data) from the terminal device 10 of the distributor and distribute it to the terminal devices 10 of each viewer.

[0035] The video distribution server device 20B can store a plurality of videos in advance. This video distribution server device 20B can distribute any one of the plurality of videos as a second video to the terminal device 10 of the distributor and the terminal devices 10 of each viewer that have accessed this video distribution server device 20B.

[0036] 1-3. Studio Unit 30 The studio unit 30 can be arranged in a studio, a room, a hall, etc., which is a place where a distributor (performer) distributes a video. As described above, the studio unit 30 can perform the same functions as the terminal device 10 and / or the server device 20.

[0037] 2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal device 10 and the server device 20 will be described.

[0038] 2-1. Hardware Configuration of Terminal Device 10 An example of the hardware configuration of each terminal device 10 will be described with reference to FIG. 2. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device 10 (server device 20) shown in FIG. 1 (in FIG. 2, the reference numerals in parentheses are described in relation to the server device 20 as will be described later).

[0039] As shown in FIG. 2, each terminal device 10 can mainly include a central processing unit 11, a main storage device 12, an input / output interface device 13, an input device 14, an auxiliary storage device 15, and an output device 16. These devices are connected to each other by a data bus and / or a control bus.

[0040] The central processing unit 11, also referred to as the "CPU", can perform operations on the instructions and data stored in the main memory device 12 and store the results of those operations in the main memory device 12. Further, the central processing unit 11 can control the input device 14, the auxiliary storage device 15, the output device 16, etc. via the input / output interface device 13. The terminal device 10 can include one or more such central processing units 11.

[0041] The main memory device 12, also referred to as the "memory", can store the instructions and data received via the input / output interface device 13 from the input device 14, the auxiliary storage device 15, and the communication line 30 (such as the server device 20, etc.), as well as the operation results of the central processing unit 11. The main memory device 12 can include, without limitation, computer-readable media such as volatile memory (e.g., registers, caches, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). As can be easily understood, the term "computer-readable recording medium" can include media for data storage such as memory and storage, rather than transmission media such as modulated data signals, i.e., temporary signals.

[0042] The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12. It can store instructions and data (computer programs) that constitute the above-described specific applications (such as applications for video distribution, video viewing, and video reception) and web browser applications. Further, when controlled by the central processing unit 11, the auxiliary storage device 15 can transmit these instructions and data (computer programs) to the main storage device 12 via the input / output interface device 13. The auxiliary storage device 15 can include, without being limited thereto, a magnetic disk device and / or an optical disk device, etc.

[0043] The input device 14 is a device that captures data from the outside, and can include, without being limited thereto, a touch panel, buttons, a keyboard, a mouse, and / or sensors, etc. As will be described later, the sensors can include, without being limited thereto, sensors including one or more cameras, etc. and / or one or more microphones, etc.

[0044] The output device 16 can include, without being limited thereto, a display device, a touch panel, and / or a printer device, etc.

[0045] In such a hardware configuration, the central processing unit 11 can sequentially load instructions and data (computer programs) that constitute a specific application stored in the auxiliary storage device 15 into the main storage device 12, and can compute the loaded instructions and data. Thereby, the central processing unit 11 can control the output device 16 via the input / output interface device 13, or can also perform transmission and reception of various data with other devices (such as the server device 20 and / or other terminal devices 10) via the input / output interface device 13 and the communication line 2.

[0046] As a result, by executing a specific installed application, the terminal device 10 can execute at least one of the operations exemplified below (including various operations to be described in detail later). · Appropriate operations for generating configuration data or a first video and transmitting it to the terminal devices 10 of each viewer via the BC server device 20A · Appropriate operations for accessing the video distribution server device 20B and receiving a second video from this video distribution server device 20B · Appropriate operations for transmitting playback data to the terminal devices 10 of each viewer via the BC server device 20A while the second video is being played · Appropriate operations for receiving configuration data or a first video distributed by another terminal device 10 · Appropriate operations for generating and displaying a first video using the configuration data received from another terminal device 10 · Appropriate operations for displaying the first video received from another terminal device 10 · Appropriate operations for displaying (playing back) the second video received from the video distribution server device 20B according to the playback data received from the BC server device 20A, etc.

[0047] Note that the terminal device 10 may also include one or more microprocessors and / or a graphics processing unit (GPU) instead of or together with the central processing unit 11.

[0048] 2-2. Hardware Configuration of Server Device 20 An example of the hardware configuration of each server device 20 will also be described with reference to FIG. 2. As the hardware configuration of each server device 20 (the BC server device 20A and the video distribution server device 20B), for example, the same configuration as that of each of the above-described terminal devices 10 can be used. Therefore, the reference numerals for the components of each server device 20 are shown in parentheses in FIG. 2.

[0049] As shown in FIG. 2, each server device 20 can mainly include a central processing unit 21, a main memory device 22, an input / output interface device 23, an input device 24, an auxiliary storage device 25, and an output device 26. These devices are connected to each other by a data bus and / or a control bus.

[0050] The central processing unit 21, the main memory device 22, the input / output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26 can be substantially the same as the central processing unit 11, the main memory device 12, the input / output interface device 13, the input device 14, the auxiliary storage device 15, and the output device 16 included in each of the above-described terminal devices 10.

[0051] In such a hardware configuration, the central processing unit 21 can sequentially load instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 25 into the main memory device 22, and calculate the loaded instructions and data. Thereby, the central processing unit 21 can control the output device 26 via the input / output interface device 23, or can also transmit and receive various data to and from other devices (for example, each terminal device 10, etc.) via the input / output interface device 23 and the communication line 2.

[0052] Thereby, the BC server device 20A can execute at least one of the operations exemplified below (including various operations to be described in detail later). · An appropriate operation for distributing the configuration data or the first video transmitted by the terminal device 10 of each distributor to the terminal device 10 of each viewer. (· An appropriate operation for generating a first video using the configuration data transmitted by the terminal device 10 of each distributor and distributing the generated first video to the terminal device 10 of each viewer) · An appropriate operation for distributing the reproduction data transmitted by the terminal device 10 of each distributor to the terminal device 10 of each viewer, etc.

[0053] Similarly, the video distribution server device 20B can execute at least one of the operations (including various operations to be described in detail later) exemplified below. · Appropriate operations for storing a plurality of videos · Appropriate operations for distributing, as a second video, the video specified by each terminal device 10 to that terminal device 10 among the plurality of stored videos, etc.

[0054] Note that the server device 20 can also include one or more microprocessors and / or a graphics processing unit (GPU) instead of or together with the central processing unit 21.

[0055] 2-3. Hardware Configuration of Studio Unit 30 As described above, the studio unit 30 can perform the same functions as the terminal device 10 and / or the BC server device 20A. Therefore, the studio unit 30 can have the same hardware configuration as the terminal device 10 or the BC server device 20A described above.

[0056] 3-1. Functions of Terminal Device 10 An example of the functions of the terminal device 10 will be described with reference to FIG. 3. FIG. 3 is a block diagram schematically showing an example of the functions of the terminal device 10 shown in FIG. 1.

[0057] As shown in FIG. 3, the terminal device 10 can mainly include a configuration data generation unit 100, a communication unit 110, a video playback unit 120, a playback data generation unit 130, a video generation unit 140, a display unit 150, a storage unit 160, and a user interface unit 170.

[0058] (1) Configuration Data Generation Unit 100 When the terminal device 10 operates as the terminal device of the distributor, the configuration data generation unit 100 can generate configuration data including at least operation data related to the operation of the distributor and voice data related to the voice emitted by the distributor, for example, every unit time. The operation data can be data that records the digital representation of the operation of the distributor's face or the like in association with a time stamp. The voice data can be data that records the digital representation of the voice emitted by the distributor in association with a time stamp.

[0059] In order to generate such configuration data, the configuration data generation unit 100 can include, for example, an acquisition unit 102 and a processing unit 104.

[0060] The acquisition unit 102 can include one or more first sensors 102a (for example, a camera 102c) that acquire data related to the body of the distributor, and one or more second sensors 102b (for example, a microphone 102d) that acquire voice data related to the speech emitted by the distributor.

[0061] The first sensor 102a can include, for example, a radiation unit (not shown) that emits infrared rays toward the face or the like of the distributor, and an infrared camera (not shown) that detects the infrared rays reflected by the face or the like of the distributor. Alternatively, the first sensor 102a can include an RGB camera (not shown) that captures the face or the like of the distributor, and an image processing unit that processes the image captured by this camera.

[0062] The second sensor 102b can, for example, detect the voice emitted by the distributor and output it as a voice signal.

[0063] The processing unit 104 can detect changes in the expression of the presenter and changes in the relative position of the presenter from a predetermined time point (for example, the initial time point when detection started) using the data detected by the first sensor 102a. As a result, the processing unit 104 can generate motion data indicating changes in the presenter's face or the like in association with time stamps. Such motion data can include, for example, data indicating how each part of the presenter's face or the like has changed and how the relative position of the presenter has changed for each unit time identified by a time stamp.

[0064] For example, the motion data can be obtained using a motion capture system. As will be readily understood by those skilled in the art having the benefits of the present disclosure, suitable motion capture systems that can be used with the apparatus and method disclosed in the present application include optical motion capture systems using passive markers or active markers or no markers, and inertial and magnetic non-optical systems. The motion data can be obtained using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal oxide semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data.

[0065] Furthermore, the processing unit 104 can generate audio data by recording the audio signal detected by the second sensor 102b in association with time stamps. For example, the processing unit 104 can generate this audio data as an audio file such as an MPEG file.

[0066] In this way, the processing unit 104 can generate configuration data including at least audio data and motion data.

[0067] In addition, the processing unit 104 can also include avatar data in the configuration data. The avatar data is three-dimensional model data for rendering the avatar of the distributor. The avatar data may include data for rendering the avatar body and texture data applied to the avatar body. The data for rendering the avatar body may include polygon data and skeleton (bone) data for expressing the movement of the avatar. The texture data may include a plurality of part data (for example, eyes, eyebrows, nose, ears, clothes, etc.) applied to the avatar.

[0068] (2) Communication Unit 110 The communication unit 110 can communicate various data used for video distribution and / or viewing, between the BC server device 20A and the video distribution server device 20B.

[0069] For example, when the terminal device 10 operates as the distributor's terminal device 10, the communication unit 110 can transmit or receive at least one of the following data.

[0070] (Data transmitted by the communication unit 110) · Configuration data generated by the configuration data generation unit 100 (this can be distributed to each viewer's terminal device 10 via the BC server device 20A) · The first video generated by the video generation unit 140 based on the configuration data generated by the configuration data generation unit 100 (this can be distributed to each viewer's terminal device 10 via the BC server device 20A) · Reproduction data (this can be distributed to each viewer's terminal device 10 via the BC server device 20A)

[0071] (Data received by the communication unit 110) · The second video from the video distribution server device 20B

[0072] On one hand, for example, when the terminal device 10 operates as a viewer's terminal device 10, the communication unit 110 can transmit or receive at least one of the following data.

[0073] (Data transmitted by the communication unit 110) · Access data (URL) included in the reproduction data received from the distributor's terminal device 10 (this can be transmitted to the video distribution server device 20B)

[0074] (Data received by the communication unit 110) · Configuration data (or the first video) and reproduction data transmitted by the distributor's terminal device 10 via the BC server device 20A · The second video from the video distribution server device 20B

[0075] (3) Video Playback Unit 120 The video playback unit 120 can play back the second video transmitted by the video distribution server device 20B and received by the communication unit 110.

[0076] In particular, when the terminal device 10 operates as a viewer's terminal device 10, the video playback unit 120 can play back the second video according to the reproduction data received by the communication unit 110 from the distributor's terminal device 10 via the BC server device 20A.

[0077] (4) Playback Data Generation Unit 130 When the terminal device 10 operates as a distributor's terminal device 10, the reproduction data generation unit 130 can generate reproduction data to be transmitted to each viewer's terminal device 10. The reproduction data can include, for example, at least one of the following access data and instruction data.

[0078] (i) Access data The access data may be data indicating a method for accessing a second video stored in the video distribution server device 20B and currently being played by the terminal device 10 of the distributor, which is the second video.

[0079] One aspect of the access data may be a URL (Uniform Resource Locator). Another aspect of the access data may be a URI (Uniform Resource Identifier). Each viewer's terminal device 10 can access the video distribution server device 20B by specifying this URL or URI in the video receiving application, and receive from this video distribution server device 20B the same second video that the current distributor's terminal device 10 has received from the video distribution server device 20B and is playing.

[0080] (ii) Instruction data (instruction information) The instruction data may be data for instructing the operation of each viewer's terminal device 10 with respect to the second video stored in the video distribution server device 20B and currently being played by the terminal device 10 of the distributor, in synchronization with the playback of this second video by the terminal device 10 of the distributor. This instruction data can include, for example, at least one of the following instructions, or at least one of the following commands. · Instructing a specific playback position (such as a timestamp, etc.) of the second video (or a command instructing to play the second video from a specific playback position) Thereby, each viewer's terminal device 10 can jump to the instructed playback position and play from that playback position. · Instructing a fixed playback position (such as a timestamp, etc.) of the second video (or a command instructing to pause the playback of the second video) Thereby, each viewer's terminal device 10 can pause the playback of the second video. · Indicating the playback position (such as a time stamp) of the second video that changes over time (or a command to resume the playback of the paused second video) As a result, the terminal device 10 of each viewer can resume the playback of the paused second video) · Indicating the playback position (such as a time stamp) of the second video that changes over time at a normal 1 / X times (X is a positive or negative number) the time (or a command to play the second video at a playback speed of X times) As a result, the terminal device 10 of each viewer can change the playback speed and playback direction of the second video)

[0081] Note that the playback data generation unit 130 can generate playback data including such access data and / or instruction data for each unit time. The unit time may be fixed, variable, or a combination of fixed and variable. The unit time can be, for example, a time included in the range of 0.01 seconds to 1 minute, and preferably, a time included in the range of 0.05 seconds to 1 second.

[0082] (5) Video Generation Unit 140 When the terminal device 10 operates as the distributor's terminal device 10, the video generation unit 140 can generate the first video using the configuration data generated by the configuration data generation unit 100 of the terminal device 10. On the other hand, when the terminal device 10 operates as the viewer's terminal device 10, the video generation unit 140 can generate the first video using the configuration data transmitted by the distributor's terminal device 10 and received by the communication unit 110 of the terminal device 10.

[0083] Specifically, the video generation unit 140 can perform rendering on the avatar data of the distributor included in the configuration data by applying the motion data (motion data) included in this configuration data. Thereby, the video generation unit 140 can generate a video (first video) including the animation of the distributor's avatar that moves in synchronization with the distributor's actions. The rendering referred to here can include any technology well-known to those skilled in the art, and can be, for example, a rendering process including perspective projection and hidden surface elimination (rasterization). Such a rendering process can also include processes such as shading (shadow processing) and / or texture mapping.

[0084] Furthermore, the video generation unit 140 can combine the audio data (e.g., MPEG file) included in the configuration data with the first video thus generated. Specifically, the video generation unit 140 can incorporate the audio data into the first video so that the time stamp included in the motion data matches (or substantially matches) the stamp included in the audio data. Thereby, in the second video, the animation of the distributor's avatar that moves according to the distributor's actions and the distributor's speech reproduced based on the audio data can be synchronized or substantially synchronized.

[0085] Note that the video generation unit 140 can also use any other well-known technology to generate the first video including the animation of the distributor's avatar based on the motion data related to the distributor's actions. Such well-known technologies include the technology called "Blend Shapes" described on the website specified by the following URL. https: / / developer.apple.com / documentation / arkit / arfaceanchor / 2928251-blendshapes Note that the entire content described on this website is incorporated herein by reference.

[0086] When using this technology, the video generation unit 140 can adjust the parameters of each of one or more feature points corresponding to the actions of the distributor among a plurality of feature points of the upper body (such as the face) of the distributor. As a result, the video generation unit 140 can generate a video of an avatar that follows the actions of the distributor.

[0087] (6) Display Unit 150 The display unit 150 can display various data used for video distribution and / or viewing. For example, the display unit 150 can display the first video generated by the video generation unit 140 and / or the second video played back by the video playback unit 120.

[0088] (7) Storage Unit 160 The storage unit 160 can store various data used for video distribution and / or viewing.

[0089] (8) User Interface Unit 170 The user interface unit 170 can input various data used for video distribution and / or viewing via user operations.

[0090] 3-2. Functions of Broadcast (BC) Server Device 20A An example of the functions of the BC server device 20A will be described with reference to FIG. 4. FIG. 4 is a block diagram schematically showing an example of the functions of the broadcast server device 20A shown in FIG. 1. As shown in FIG. 4, the BC server device 20A can mainly include a communication unit 200 and a storage unit 210. Further, the BC server device 20A can also include a video generation unit 220 as an option.

[0091] The communication unit 200 can communicate various data used for video distribution between the terminal device 10 of the distributor and / or the terminal device 10 of the viewer. For example, the communication unit 200 can distribute the configuration data or the first video received from the terminal device 10 of the distributor to the terminal device 10 of each viewer. Also, the communication unit 200 can distribute the playback data received from the terminal device 10 of the distributor to the terminal device 10 of each viewer.

[0092] The storage unit 210 can store various data used for video distribution and received from the communication unit 200.

[0093] As an option, when the video generation unit 220 receives configuration data from the terminal device 10 of the distributor, it can generate the first video using this configuration data instead of the terminal device 10 of each viewer. The first video generated in this way can be distributed to the terminal device 10 of each viewer by the communication unit 200. The video generation unit 220 can have the same configuration as the video generation unit 140 of the terminal device 10 in order to generate the first video from the received configuration data.

[0094] 3-3. Functions of Video Distribution Server Device 20B An example of the functions of the video distribution server device 20B will be described with reference to FIG. 5. FIG. 5 is a block diagram schematically showing an example of the functions of the video distribution server device 20B shown in FIG. 1. As shown in FIG. 5, the video distribution server device 20B can mainly include a communication unit 300 and a storage unit 310.

[0095] The communication unit 300 can communicate various data used for video distribution between the terminal device 10 of the distributor and / or the terminal device 10 of the viewer. For example, the communication unit 300 can receive access data (such as a URL) from the terminal device 10 of the distributor and / or the terminal device 10 of each viewer. Further, among the plurality of videos pre-stored in the storage unit 310, the communication unit 300 can distribute, as the second video, the video identified by the access data received from the terminal device 10 of the distributor (or the terminal device 10 of each viewer) to the terminal device 10 of the distributor (or the terminal device 10 of each viewer).

[0096] The storage unit 310 can be used for video distribution and store various data received from the communication unit 300. In particular, the storage unit 310 can receive and store a plurality of videos from the communication unit 300 in advance.

[0097] 3-4. Functions of Studio Unit 30 As described above, the studio unit 30 can perform the same functions as the terminal device 10 and / or the BC server device 20A. Therefore, the studio unit 30 can have the functions of the terminal device 10 described with reference to FIG. 3 and / or the functions of the BC server device 20A described with reference to FIG. 4.

[0098] 4. Operations of Video Distribution System 1 Next, the operations performed in the video distribution system 1 having the above configuration will be described with reference to FIGS. 6A and 6B. FIGS. 6A and 6B are flowcharts showing an example of the operations performed in the video distribution system 1 shown in FIG. 1.

[0099] First, in step (hereinafter referred to as "ST") 400, the terminal device 10A of the distributor (for example, distributor A) can start and execute a video distribution application.

[0100] In ST402, the terminal device 10A of the distributor A can generate configuration data every unit time and transmit it to the BC server device 20A. The BC server device 20A can distribute the configuration data received from the terminal device 10A of the distributor A every unit time to the terminal devices 10 of each viewer who is executing the video distribution application. Note that the terminal device 10A of the distributor A may generate a first video including the animation of the avatar of the distributor A and the audio signal related to the speech of the distributor A using the generated configuration data, and display it to the distributor A.

[0101] In ST404, the terminal device 10 of each viewer can generate and display a first video including the animation of the avatar of the distributor A and the audio signal related to the speech of the distributor A using the configuration data received from the BC server device 20A every unit time. FIG. 7 shows an example of the first video displayed on the terminal device 10 of each viewer. As shown in FIG. 7, the first video can include the animation of the avatar 502 of the distributor A.

[0102] The operations in ST402 and ST404 as described above can be repeatedly executed every unit time. In parallel with the operations in ST402 and ST404 that are repeated in this way, ST406 to ST434 described below can be executed.

[0103] In ST406, in a state where the terminal device 10A of the distributor A is executing a video distribution application, according to an operation via a user interface by the distributor A (for example, an operation in which the distributor A taps a video reception icon displayed at the lower part of the screen, etc.), the video reception application can be started and executed. In one embodiment, the terminal device 10A of the distributor A can execute the video reception application and receive the second video 530 from the video distribution server device 20B. However, in another embodiment, the terminal device 10A of the distributor A can also receive the second video from a video distribution server device selected from among a plurality of video distribution server devices. In this case, the terminal device 10A displays video reception icons corresponding to each of the plurality of video distribution server devices (video distribution services) at the lower part of the screen, for example, and the distributor A can tap the video reception icon corresponding to the desired video distribution service. As a result, the terminal device 10A can execute the video reception application corresponding to the video reception icon thus selected by the distributor A and receive the second video from the corresponding video distribution server device.

[0104] In ST408, the terminal device 10A of the distributor A can specify predetermined access data (e.g., a URL or URI that identifies a web page for video search provided by the video distribution server device 20B) in the video reception application. As a result, the terminal device 10A of the distributor A can receive the web page for video search from the video distribution server device 20B. FIG. 8 shows an example of the web page for video search displayed on the terminal device 10A of the distributor A. As shown in FIG. 8, the terminal device 10A of the distributor A can display the web page 512 for video search received from the video distribution server device 20B in a region 510 different from the region where the first video 500 is displayed. This web page 512 may include a region 514 for inputting a search keyword. Note that such a web page 512 is received and displayed only by the terminal device 10A of the distributor A, and is neither received nor displayed on the terminal devices 10 of each viewer. The terminal device 10 of each viewer can still display the first video 500 as illustrated in FIG. 7.

[0105] In ST410, the terminal device 10A of the distributor A can transmit a search keyword input according to an operation via the user interface by the distributor A to the video distribution server device 20B. As a result, the terminal device 10A of the distributor A can receive and display data (playback candidate data) regarding a plurality of candidate videos related to the search keyword from the video distribution server device 20B. As shown in FIG. 9, the terminal device 10A of the distributor A can receive and display, as data regarding a plurality of candidate videos, for example, data 520 regarding the first candidate video, data 522 regarding the second candidate video, and data 524 regarding the third candidate video. The data 520 regarding the first candidate video can include the title "Drama II Final Episode" of this first candidate video. Similarly, the data 522 regarding the second candidate video and the data 524 regarding the third candidate video can also include the title "Cooking Class Episode 2" of the second candidate video and the title "News at 21:00" of the third candidate video, respectively. Note that the data regarding each candidate video can also include the thumbnail of the candidate video, the description of the candidate video, the number of times the candidate video has been viewed by other users (such as distributors and / or viewers), and / or comments posted for the candidate video.

[0106] Also, the data 520 to 524 regarding such a plurality of candidate videos are received and displayed only by the terminal device 10A of the distributor A, and are neither received nor displayed on the terminal devices 10 of each viewer. As illustrated in FIG. 7, the terminal device 10 of each viewer can still display the first video 500.

[0107] In ST412, the terminal device 10A of the distributor A can transmit data indicating the selected video (second video) input according to an operation via the user interface by the distributor A to the video distribution server device 20B. This data corresponds to access data (such as URL or URI) indicating a method for accessing the second video stored by the video distribution server device 20B and being played by the terminal device 10A of the distributor A. Thereby, the terminal device 10A of the distributor A can receive and display (play) the second video from the video distribution server device 20B. Thereby, as shown in FIG. 10, the terminal device 10A of the distributor A can play and display the second video 530, for example, above the first video 500.

[0108] In ST414, the terminal device 10A of the distributor A can transmit playback data including the above access data and instruction data that synchronizes with the second video by the terminal device 10A and instructs the operation of the terminal device 10 of each viewer with respect to this second video, not to the video distribution server device 20B but to the BC server device 20A this time. At this point, the terminal device 10A of the distributor A can indicate the current playback position of the second video in the terminal device 10A in the instruction data.

[0109] In ST416, the BC server device 20A can transmit the playback data received from the terminal device 10A of the distributor A to the terminal device 10 of each viewer.

[0110] In ST418, each viewer's terminal device 10 can start and execute a video receiving application triggered by receiving the playback data from the BC server device 20A while the video distribution application is being executed.

[0111] Referring to FIG. 6B, in ST420, in the video reception application of each viewer's terminal device 10, the access data (contained in the reproduction data received in the above ST418) can be specified. Thereby, each viewer's terminal device 10 can access the video distribution server device 20B and receive a second video from this video distribution server device 20B.

[0112] In ST422, each viewer's terminal device 10 can reproduce and display the second video received from the video distribution server device 20B according to the reproduction position specified by the instruction data (contained in the reproduction data received in the above ST418). Similar to the terminal device 10A of distributor A, each viewer's terminal device 10 can reproduce and display the second video 530, for example, above the first video 500, as illustrated in FIG. 10 (showing the first video 500 and the second video 530 displayed by the terminal device 10A of distributor A).

[0113] In ST424, the terminal device 10A of distributor A that is reproducing the second video can transmit the reproduction data to each viewer's terminal device 10 via the BC server device 20A every unit time. Here, the access data contained in the reproduction data is the same as the access data transmitted in the above ST414. The reason for the terminal device 10A of distributor A to transmit the same access data via the reproduction data every unit time is to ensure that even for a terminal device 10 of a viewer who starts watching the first video of distributor A midway, the access data can be obtained and the same second video as that currently being reproduced by the terminal device 10A of distributor A can be received. Also, the instruction data contained in the reproduction data can indicate the current reproduction position of the second video in the terminal device 10A.

[0114] In ST426, each viewer's terminal device 10 can reproduce and display the second video according to the reproduction position specified by the instruction data (contained in the reproduction data received in the above ST424).

[0115] Although omitted in FIG. 6B, the above-described ST424 and ST426 are repeatedly executed.

[0116] As a result, the terminal device 10 of each viewer can continue to play the second video at a timing synchronized with or substantially synchronized with the playback of the second video by the terminal device 10A of the distributor A. However, due to a time lag or the like that occurs between the time when the terminal device 10A of the distributor A transmits playback data in a certain unit time and the time when the terminal device 10 of each viewer receives this playback data via the BC server device 20A, there is a possibility that a time lag may occur between the playback position of the second video by the terminal device 10A of the distributor A and the playback position of the second video by the terminal device 10 of each viewer.

[0117] In ST428, consider an event in which the terminal device 10B of a certain viewer (for example, viewer B) temporarily pauses the playback of the second video according to an operation via the user interface by the distributor B. Such an event may occur when the distributor B is unable to temporarily view the second video due to necessity. In this case, the terminal device 10A of the distributor A and the terminal devices 10 of other viewers can still continue to play the second video as described above.

[0118] After that, in ST430, similar to ST424 described above, the terminal device 10A of the distributor A that is playing the second video can transmit the playback data to the terminal device 10 of each viewer via the BC server device 20A every unit time.

[0119] In ST432, the terminal device 10B of viewer B can resume the playback of the second video according to the operation via the user interface by distributor B. The terminal device 10B can resume the playback of the second video from the playback position specified by the instruction data included in the playback data (the latest playback data) received in ST430, rather than at the playback position paused in ST428. Thereby, the terminal device 10B of viewer B can play the second video at the timing synchronized with the playback position of the second video in the terminal device 10A of distributor A, rather than at a different (delayed) timing from the terminal device 10A of distributor A.

[0120] Next, in ST434, the terminal device 10A of distributor A and the terminal devices 10 of each viewer can end the playback of the second video. In this case, the terminal device 10 of each viewer can still generate and display the first video 500 using the configuration data transmitted from the terminal device 10A of distributor A via the BC server device 20A (the terminal device 10A of distributor A can also generate and display the first video 500 using the configuration data).

[0121] Finally, when the terminal device 10A of distributor A stops transmitting the configuration data, the process ends.

[0122] 5. Modification Example In the various embodiments described above, while the terminal device 10 of each viewer receives and plays back the second video 530 from the video distribution server device 20B, it can also generate and display the first video 500 using the configuration data received from the BC server device 20A. This means that the terminal device 10 of each viewer outputs both the audio signal included in the second video 530 and the audio signal included in the first video 500 from an output unit such as a speaker (not shown). In this case, for a viewer who wants to listen to the audio signal included in the second video 530, the audio signal included in the first video 500 may make it difficult to hear the audio signal included in the second video 530. Similarly, for a viewer who wants to listen to the audio signal included in the first video 500, the audio signal included in the second video 530 may make it difficult to hear the audio signal included in the first video 500.

[0123] Therefore, the terminal device 10 of each viewer can have a mixing function that enables adjusting the level of the audio signal included in the second video 530 independently of the audio signal included in the first video 500. Thus, it is a well-known technique to implement a function of independently adjusting the levels of a plurality of input audio signals by software (or a software module) or the like.

[0124] In one embodiment, the function of independently adjusting the levels of a plurality of input audio signals can be executed in conjunction with an operation via a user interface by each viewer. For example, as illustrated in FIG. 11, the terminal device 10 of each viewer can display a slider 600 for adjusting the level of the audio signal included in the first video 500 in association with the first video 500, and display a slider 630 for adjusting the level of the audio signal included in the second video 530 in association with the second video 530. It can be said that both the slider 600 and the slider 630 are objects that can be moved by an operation via a user interface by each viewer.

[0125] By the viewer raising or lowering the slider 630 via the user interface, the viewer's terminal device 10 can increase or decrease the level of the audio signal included in the second video 530 independently of the audio signal included in the first video 500. Along with this, the viewer's terminal device 10 may display a numerical value (here, for example, "6") indicating the level of the audio signal included in the second video 530, for example, to the right of the slider 630.

[0126] Similarly, by the viewer raising or lowering the slider 600 via the user interface, the viewer's terminal device 10 can increase or decrease the level of the audio signal included in the first video 500 independently of the audio signal included in the second video 530. Along with this, the viewer's terminal device 10 may display a numerical value (here, for example, "2") indicating the level of the audio signal included in the first video 500, for example, to the right of the slider 600.

[0127] Note that FIG. 11 shows a configuration in which each viewer's terminal device 10 displays both a slider 600 for adjusting the level of the audio signal included in the first video 500 associated with the first video 500 and a slider 630 for adjusting the level of the audio signal included in the second video 530 associated with the second video 530. However, each viewer's terminal device 10 can also display only either one of the slider 600 for adjusting the level of the audio signal included in the first video 500 associated with the first video 500 and the slider 630 for adjusting the level of the audio signal included in the second video 530 associated with the second video 530.

[0128] FIG. 12 is a schematic diagram showing another example of the first video 500 and the second video 530 simultaneously displayed by the terminal device 10 of each viewer shown in FIG. 1. As is clear from a comparison between FIG. 12 and FIG. 11, the terminal device 10 of each viewer can move the area for displaying the second video 530 in conjunction with an operation via the user interface by that viewer (for example, a drag operation and a swipe operation on the area for displaying the second video 530). In addition to or instead of this, the terminal device 10 of each viewer can also move the area for displaying the first video 500 in conjunction with an operation via the user interface by that viewer (for example, a drag operation and a swipe operation on the area for displaying the first video 500).

[0129] FIG. 13 is a schematic diagram showing yet another example of the first video 500 and the second video 530 simultaneously displayed by the terminal device 10 of each viewer shown in FIG. 1. As is clear from a comparison between FIG. 12 and FIG. 13, the terminal device 10 of each viewer can enlarge or reduce the area for displaying the second video 530 in conjunction with an operation via the user interface by that viewer (for example, a drag operation and a swipe operation on the area for displaying the second video 530). Further, the terminal device 10 of each viewer can enlarge and display the second video 530 on the whole or substantially the whole of the display area of this terminal device 10 in conjunction with an operation via the user interface by that viewer (for example, a drag operation and a swipe operation on the area for displaying the second video 530) (in this case, the first video 500 is not displayed). In addition to or instead of this, the terminal device 10 of each viewer can also expand or contract the area for displaying the first video 500 in conjunction with operations via the user interface by that viewer (for example, drag operations and swipe operations on the area for displaying the first video 500, etc.). Further, the terminal device 10 of each viewer can, in conjunction with operations via the user interface by that viewer (for example, drag operations and swipe operations on the area for displaying the first video 500, etc.), expand and display the first video 500 over the entire or substantially the entire display area of this terminal device 10 (in this case, the second video 530 is not displayed). Note that FIG. 13 shows an example in which when the viewer tilts the terminal device 10 so that the longitudinal direction of the terminal device 10 is along the horizontal direction, the terminal device 10 arranges the area for displaying the first video 500 and the area for displaying the second video 530 along the longitudinal direction as described above.

[0130] In the various embodiments described above, the case where the terminal device 10 of the distributor distributes the configuration data to the terminal device 10 of each viewer via the BC server device 20A has been described. However, in another embodiment, the terminal device 10 of the distributor can also transmit, via the BC server device 20A, not the configuration data but the first video generated based on this configuration data to the terminal device 10 of each viewer. In this case, generating the first video based on the configuration data may be executed by the terminal device 10 of the distributor or may be executed by the BC server device 20A that receives the configuration data from the terminal device 10 of the distributor. Thereby, since the terminal device 10 of each viewer can receive the generated first video, there is no need to perform the process of generating the first video based on the configuration data. Therefore, the processing capacity and power consumption (for example, the processing capacity and power consumption of the central processing unit 11) used in the terminal device 10 of each viewer can be suppressed.

[0131] Also, in the various embodiments described above, the case where the distributor's terminal device 10 transmits playback data including both access data and instruction data has been described. The reason for the distributor's terminal device 10 to transmit access data every unit time is, as described above, that when the distributor starts receiving the second video, the distributor has not received the distribution of the first video from the distributor, and consideration is given to viewers who have started receiving the distribution of the first video from the distributor midway (hereinafter referred to as "late-joining viewers"). By the distributor's terminal device 10 transmitting access data every unit time, the terminal device 10 of such late-joining viewers can access the video distribution server device 20B using this access data by receiving the access data from the distributor's terminal device 10 sooner or later. Therefore, the terminal device 10 of late-joining viewers can surely receive the second video from the video distribution server device 20B.

[0132] However, in another embodiment, without considering late-joining viewers, the distributor's terminal device 10 transmits playback data including both access data and instruction data until a predetermined time (for example, a time in the range of 1 minute to 10 minutes, etc.) has elapsed since the time when the distributor's terminal device 10 starts receiving the second video from the video distribution server device 20B, but after the above-mentioned predetermined time has elapsed, the distributor's terminal device 10 may transmit playback data including only instruction data.

[0133] Furthermore, in another embodiment, the distributor's terminal device 10 can also receive the second video from the video distribution server device 20B by a live distribution method (streaming distribution method) instead of a pre-stored video. In this case, the distributor's terminal device 10 and each viewer's terminal device 10 do not receive the whole or most of the second video from the video distribution server device 20B at once, but only sequentially receive a part of the second video in real time. As a result, it is often basically difficult for the distributor's terminal device 10 to change the playback position of the second video. Therefore, when the distributor's terminal device 10 receives the second video from the video distribution server device 20B by a live distribution method (streaming distribution method), it can transmit playback data containing only access data to each viewer's terminal device 10 every unit time. Even in this case, all the terminal devices 10 that access the video distribution server device 20B using the access data at a certain timing will receive substantially the same part of the second video from the video distribution server device 20B. That is, when the video distribution server device 20B distributes the second video to each terminal device 10 according to the live distribution method (streaming distribution method), it will continue to distribute this second video to all the terminal devices 10 at substantially the same timing. Therefore, the distributor's terminal device 10 and each viewer's terminal device 10 can receive the second video at mutually substantially synchronized timings.

[0134] In the various embodiments described above, in a state where the terminal device 10 of a single distributor distributes the first video (the first video including the avatar of this distributor) alone, the case where the video receiving application is started and executed to search for and receive the second video from the video distribution server device 20B has been described. However, in another embodiment, in a state where the terminal devices 10 of a plurality of distributors cooperate to distribute the first video (the first video including the avatars of each of these plurality of distributors), any one of the terminal devices 10 of the selected distributors among these plurality of distributors can start and execute the video receiving application to search for and receive the second video from the video distribution server device 20B. Note that the cooperation of the terminal devices 10 of a plurality of distributors to distribute the first video may also be referred to as "collaborative distribution (collaboration distribution)".

[0135] Hereinafter, with reference to FIGS. 14A and 14B, a specific example in which any one of the terminal devices of the distributors searches for and receives the second video in a state where the terminal devices of a plurality of distributors cooperate to perform collaborative distribution will be described. FIGS. 14A and 14B are flowcharts showing another example of operations performed in the video distribution system 1 shown in FIG. 1. Among the operations shown in FIGS. 14A and 14B, the description of the operations similar to those described above with reference to FIGS. 6A and 6B will be omitted.

[0136] Referring to FIG. 14A, first, in ST400', the terminal device 10A of distributor A can execute the same operations as those in ST400 and ST402 described above with reference to FIG. 6A. Next, in ST404', the terminal device 10 of each viewer can execute the same operations as those in ST404 described above with reference to FIG. 6A.

[0137] Next, in ST405, the terminal devices 10 of a plurality of distributors can execute collaborative distribution regarding the first video. The operations related to this collaborative distribution will be described with reference to FIG. 15. FIG. 15 is a flowchart for explaining an example of operations related to collaborative distribution performed in the video distribution system 1 shown in FIG. 1.

[0138] Here, a distributor (distributor A) who has already started distributing the first video and conducts a collaborative distribution in cooperation with other distributors is referred to as the "host distributor". Also, a viewer who has already started receiving the first video by the host distributor and conducts a collaborative distribution in cooperation with the host distributor as a guest is referred to as the "guest distributor". To conduct a collaborative distribution, there must be a host distributor and at least one guest distributor. Here, for the sake of simplicity of explanation, the case where at least one guest participant is two guest participants (the first guest distributor E and the second guest distributor F) will be described.

[0139] First, in ST41, the terminal device 10E of the first guest distributor E can transmit participation application data to the BC server device 20A according to the operation of the first guest distributor E. Note that the participation application data can include identification data for identifying the first guest distributor E. By the same method, in ST42, the terminal device 10F of the second guest distributor F can transmit participation application data to the BC server device 20A according to the operation of the second guest distributor F.

[0140] In ST43, the BC server device 20A can transmit a notice of the participation application to the terminal device 10A of the host distributor A together with the identification data of each guest distributor who has submitted the participation application. In response to receiving the notice of the participation application from the BC server device 20A, the terminal device 10A can display a screen for approving the participation application and allow the host distributor A to select approval or denial of the participation application. When approval is selected by the host distributor, in ST44, the terminal device 10A can notify the BC server device 20A that the participation application has been approved, together with the identification data of the approved guest distributor.

[0141] In ST45, the BC server device 20A can transmit a participant list including identification data of guest distributors whose participation applications have been approved to the terminal device 10A of host distributor A, and the terminal devices 10E of approved guest distributor E and 10F of guest distributor F.

[0142] In ST46, by recognizing that the received participant list contains the identification data of the second guest distributor F, the terminal device 10F of the second guest distributor F can recognize that the participation application has been approved. Thereby, the terminal device 10F can generate configuration data for each unit of time and transmit it to the BC server device 20A. This configuration data can be the same as that generated by the terminal device 10A of distributor A as described above with reference to FIG. 6A (ST402) and the like.

[0143] In ST47, the BC server device 20A can transmit the configuration data received from the terminal device 10F to the terminal device 10A of host distributor A, the terminal device 10E of the first guest distributor E, and the terminal devices of each viewer (here, for example, the terminal device 10B of viewer B).

[0144] In ST48, the terminal device 10A of host distributor A can generate configuration data for each unit of time and transmit it to the BC server device 20A in the same manner as in ST402 described above. In ST49, the BC server device 20A can transmit the configuration data received from the terminal device 10A to the terminal device 10E of the first guest distributor E, the terminal device 10F of the second guest distributor F, and the terminal devices of each viewer.

[0145] In ST50, the terminal device 10E of the first guest distributor E can recognize that the participation application has been approved by recognizing that the identification data of the first guest distributor E is included in the received participant list. As a result, the terminal device 10E can generate configuration data for each unit of time and transmit it to the BC server device 20A. This configuration data can be the same as that generated by the terminal device 10A of the distributor A as described above with reference to FIG. 6A (ST402) and the like.

[0146] In ST51, the BC server device 20A can transmit the configuration data received from the terminal device 10E to the terminal device 10A of the host distributor A, the terminal device 10F of the second guest distributor F, and the terminal devices of each viewer.

[0147] Note that the timing at which each of the terminal device 10A, the terminal device 10E, and the terminal device 10F transmits the configuration data to other terminal devices 10 is not limited to the timing illustrated in FIG. 15, and they may be parallel to each other or occur in any order.

[0148] In ST52, the terminal device 10A of the host distributor A can generate the first video using the configuration data generated by the terminal device 10A, the configuration data of the terminal device 10E of the first guest distributor E received from the BC server device 20A, and the configuration data of the terminal device 10F of the second guest distributor F received from the BC server device 20A. The terminal device 10A can generate the first video by the same method as described above with reference to FIG. 6A (ST402) and the like. The first video generated in this way can be an animation including the avatar of the host distributor A, the avatar of the first guest distributor E, and the avatar of the second guest distributor F. Note that as the avatar of the first guest distributor E (or the avatar of the second guest distributor F), for example, the one included in the configuration data received from the terminal device 10E (or the terminal device 10F) of the first guest distributor E (or the second guest distributor F) via the BC server device 20A can be used.

[0149] In ST53, the terminal device 10E of the first guest distributor E can generate a first video using the configuration data generated by the terminal device 10E, the configuration data of the host distributor A's terminal device 10A received from the BC server device 20A, and the configuration data of the second guest distributor F's terminal device 10F received from the BC server device 20A. The terminal device 10E can generate the first video by the same method as described above with reference to FIG. 6A (ST404) and the like. The first video generated in this way can be an animation including the avatar of the host distributor A, the avatar of the first guest distributor E, and the avatar of the second guest distributor F. Note that, as the avatar of the second guest distributor F (or the avatar of the host distributor A), for example, the one included in the configuration data received from the terminal device 10F of the second guest distributor F (or the terminal device 10A of the host distributor A) via the BC server device 20A can be used.

[0150] In ST54, the terminal device 10F of the second guest distributor F can generate a first video using the configuration data generated by the terminal device 10F, the configuration data of the host distributor A's terminal device 10A received from the BC server device 20A, and the configuration data of the first guest distributor E's terminal device 10E received from the BC server device 20A. The terminal device 10F can generate the first video by the same method as described above with reference to FIG. 6A (ST404) and the like. The first video generated in this way can be an animation including the avatar of the host distributor A, the avatar of the first guest distributor E, and the avatar of the second guest distributor F. Note that, as the avatar of the first guest distributor E (or the avatar of the host distributor A), for example, the one included in the configuration data received from the terminal device 10E of the first guest distributor E (or the terminal device 10A of the host distributor A) via the BC server device 20A can be used.

[0151] In ST55, the terminal device 10 of each viewer (e.g., terminal device 10B) can generate a first video using the configuration data of the host distributor A's terminal device 10A received from the BC server device 20A, the configuration data of the first guest distributor E's terminal device 10E received from the BC server device 20A, and the configuration data of the second guest distributor F's terminal device 10F received from the BC server device 20A. The terminal device 10 of each viewer can generate the first video by the same method as described above with reference to FIG. 6A (ST404) and the like. The first video generated in this way can be an animation including the avatar of host distributor A, the avatar of the first guest distributor E, and the avatar of the second guest distributor F. Note that, as the avatar of the first guest distributor E (or the avatar of the second guest distributor F), the terminal device 10 of each viewer can use, for example, that included in the configuration data received from the terminal device 10E of the first guest distributor E (or the terminal device 10F of the second guest distributor F) via the BC server device 20A. Similarly, as the avatar of host distributor A, the terminal device 10 of each viewer can use, for example, that included in the configuration data received from the terminal device 10A of host distributor A via the BC server device 20A.

[0152] An example of the first video 500 generated and displayed by each of the terminal devices 10A, 10E, 10F, and 10B is shown in FIG. 16. FIG. 16 is a schematic diagram showing an example of the first video generated and displayed by each terminal device 10 used in relation to the collaborative distribution shown in FIG. 15.

[0153] As illustrated in FIG. 16, the first video 500 generated and displayed by each terminal device 10 can be an animation including the avatar 502 of host distributor A, the avatar 504 of the first guest distributor E, and the avatar 506 of the second guest distributor F. In one embodiment, each terminal device 10 can generate and display a first video in which the avatar 502 of host distributor A, the avatar 504 of the first guest distributor E, and the avatar 506 of the second guest distributor F are arranged in the lower left region, the lower right region, and the upper left region, respectively.

[0154] In the embodiment shown in FIG. 15, the case where each terminal device 10 generates a first video using the configuration data of the terminal device 10A of the host distributor A, the configuration data of the terminal device 10E of the first guest distributor E, and the configuration data of the terminal device 10F of the second guest distributor F has been described.

[0155] However, in another embodiment, each terminal device 10 of the distributors (host distributor A, first guest distributor E, and second guest distributor F) generates a first video using each configuration data in the same manner as above, while each viewer's terminal device 10 can also receive and display the first video generated by the terminal device 10 of any one of the distributors via the BC server device 20A. In this case, each distributor's terminal device 10 transmits the configuration data to the terminal device 10 of other distributors via the BC server device 20A as described above, but there is no need to transmit the configuration data to each viewer's terminal device 10.

[0156] In yet another embodiment, only the terminal device 10A of the host distributor A generates the first video, and the other terminal devices 10 simply receive and display the first video generated by the terminal device 10A via the BC server device 20A without generating the first video using the configuration data. In this case, each of the terminal devices 10 of the first guest distributor E and the second guest distributor F transmits the configuration data to the terminal device 10A of the host distributor A via the BC server device 20A, but there is no need to transmit the configuration data to the terminal devices of other guest distributors and each viewer's terminal device 10. Also, the terminal device 10A of the host distributor A does not need to transmit the configuration data to any terminal device 10 via the BC server device 20A.

[0157] Also, in one embodiment, the BC server device 20A can operate as a single server device as illustrated in FIG. 15. However, in another embodiment, the BC server device 20A (the first server device) can also include a plurality of server devices (a plurality of first server devices) that can be connected to communicate with each other. In this case, among these plurality of server devices, one server device can mainly handle the transmission and reception of data, etc. between the terminal device of each distributor and the terminal devices of each viewer when each distributor individually distributes the first video (for convenience, referred to as "single distribution") as illustrated in FIGS. 6A and 6B. On the other hand, among these plurality of server devices, the other server device can mainly handle the transmission and reception of data between the terminal device of the host distributor and the terminal devices of each guest distributor, and the transmission and reception of data between the terminal device of the host distributor and the terminal devices of each guest distributor and the terminal devices of each viewer when performing collaborative distribution as illustrated in FIG. 15. In this way, by sharing the operations to be borne (distributing the generated load) for each of the two types of server devices, each server device can execute such operations at a higher speed by concentrating on the operations it is responsible for.

[0158] In the example shown in FIG. 15, among the BC server devices 20A, one server device mainly responsible for single distribution can be responsible for operations related to, for example, ST41 to ST45. Subsequently, the other server device mainly responsible for collaborative distribution can take over from the one server device and be responsible for operations related to ST46 to the end of collaborative distribution. Note that the timing of switching from one server device to the other server device can be at any point in time.

[0159] The operations in ST46 to ST55 shown in FIG. 15 can be repeatedly executed every unit time. In parallel with the operations in ST46 to ST55 that are repeated in this way, the operations in ST406' to ST434' described below can be executed.

[0160] Next, returning to FIG. 14A, in ST406’, among a plurality of distributors (host distributor A, first guest distributor E, and second guest distributor F), any one of the distributors can, in the same manner as in the above-described ST406, execute an operation via the user interface, whereby the terminal device 10 can start and execute a video reception application. The operation in ST406’ can be executed by any distributor (of the terminal device 10) who wishes to search for and distribute the second video among the plurality of distributors. Alternatively, the operation in ST406’ can be executed by the terminal device 10 of a distributor randomly selected by the BC server device 20A among the plurality of distributors. Hereinafter, it is assumed that the terminal device 10E of the first guest distributor E among the plurality of distributors executes the operation in ST406’.

[0161] In ST408’, the terminal device 10E can execute the operation in the above-described ST408. Here, the web page 512 illustrated in FIG. 8 is received and displayed only by the terminal device 10E of the distributor E, and is not received or displayed by the terminal devices 10 of other distributors and the terminal devices 10 of each viewer.

[0162] In ST410’, the terminal device 10E can execute the operation in the above-described ST410. Here, data 520 to 524, etc. (see FIG. 9) regarding the candidate videos are also received and displayed only by the terminal device 10E of the distributor E, and are not received or displayed by the terminal devices 10 of other distributors and the terminal devices 10 of each viewer.

[0163] In ST412’, the terminal device 10E can execute the operation in the above-described ST412. In ST414’, the terminal device 10E can execute the operation in the above-described ST414.

[0164] In ST416’, the BC server device 20A can transmit the reproduction data received from the terminal device 10E not only to the terminal devices 10 of each viewer but also to the terminal devices 10 of other distributors (distributor A and distributor F).

[0165] In ST418’, not only the terminal device 10 of each viewer but also the terminal devices 10 of other distributors (distributor A and distributor F) can start and execute a video reception application triggered by receiving reproduction data from the BC server device 20A.

[0166] Next, referring to FIG. 14B, in ST420’, not only the terminal device 10 of each viewer but also the terminal devices 10 of other distributors can execute the operations in the above-described ST420. As a result, the terminal devices 10 of other distributors can also receive the second video from the video distribution server device 20B in the same manner as the terminal devices 10 of each viewer.

[0167] In ST422’, not only the terminal device 10 of each viewer but also the terminal devices 10 of other distributors can execute the operations in the above-described ST422. As a result, the terminal devices 10 of other distributors can also reproduce and display the second video received from the video distribution server device 20B according to the reproduction position specified by the instruction data (included in the reproduction data received in the above ST418’) in the same manner as the terminal devices 10 of each viewer.

[0168] In ST424’, the terminal device 10E of distributor E that is reproducing the second video can execute the operations in the above-described ST424. Here, the terminal device 10E can transmit the reproduction data not only to the terminal devices 10 of each viewer but also to the terminal devices 10 of other distributors (distributor A and distributor F) via the BC server device 20A.

[0169] In ST426’, not only the terminal device 10 of each viewer but also the terminal devices 10 of other distributors can execute the operations in the above-described ST426. As a result, the terminal devices 10 of other distributors can also reproduce and display the second video according to the reproduction position specified by the instruction data included in the reproduction data received in the above ST424’.

[0170] In ST428’, it is conceivable that the terminal device 10F of a certain distributor (for example, the second guest distributor F) pauses the playback of the second video according to an operation via the user interface by the distributor F.

[0171] In ST430’, similar to ST430 described above, the terminal device 10E of the distributor E that is playing the second video can transmit the playback data to the terminal devices 10 of each viewer and the terminal devices 10 of other distributors (distributor A and distributor F) via the BC server device 20A every unit time.

[0172] In ST432’, as described in ST432 above, the terminal device 10F of the distributor F can resume the playback of the second video according to an operation via the user interface by the distributor F. Here, the terminal device 10F of the distributor F can resume the playback of the second video from the playback position specified by the instruction data included in the playback data (the latest playback data) received in ST430’ instead of the playback position paused in ST428’.

[0173] In ST434’, the terminal devices 10 of all distributors and the terminal devices 10 of each viewer can end the playback of the second video. In this case, since ST46 to ST55 described above are being executed in parallel, each terminal device 10 can still display the first video.

[0174] Next, with reference to FIGS. 17 and 18, specific examples of the display modes of the first video and the second video applicable to at least one of the terminal devices 10 of each viewer and the terminal devices 10 of each distributor when such collaborative distribution is executed will be described. FIG. 17 is a schematic diagram showing an example of the first video and the second video generated and displayed by each terminal device 10 used in relation to the collaborative distribution shown in FIG. 15. FIG. 18 is a schematic diagram showing another example of the first video and the second video generated and displayed by each terminal device 10 used in relation to the collaborative distribution shown in FIG. 15.

[0175] First, as illustrated in FIG. 17, when the terminal device 10 displays the first video and the second video, first, the terminal device 10 can divide the display area of the terminal device 10 to generate a plurality of display areas (for example, an upper display area and a lower display area). Further, the terminal device 10 can display the first video 500 in one of these plurality of display areas and display the second video 530 in another of these plurality of display areas. FIG. 17 shows an example in which the terminal device 10 displays the first video 500 in the lower display area and the second video 530 in the upper display area. However, the terminal device 10 can also display the first video 500 in the upper display area and the second video 530 in the lower display area.

[0176] When the terminal device 10 displays both the first video 500 and the second video 530 (for example, in FIG. 17), compared to the case where only the first video 500 is displayed without displaying the second video 530 (for example, in FIG. 16), it is necessary to reduce the display area available for displaying the first video 500. Further, during collaborative distribution, it is necessary to arrange the avatars of a plurality of distributors in the first video 500. Therefore, when the terminal device 10 generates the first video using the configuration data of each distributor's terminal device 10 in a situation where collaborative distribution is being executed, the avatar 502 of the host distributor A, the avatar 504 of the first guest distributor E, and the avatar 506 of the second guest distributor F can generate the first video 500 arranged horizontally as an example, as illustrated in FIG. 17. On the other hand, in a situation where collaborative distribution is being executed, when the terminal device 10A of the host distributor A generates the first video using the configuration data of each distributor's terminal device 10 and transmits it to each viewer's terminal device 10, the terminal device 10A generates the first video 500 in which the avatar 502 of the host distributor A, the avatar 504 of the first guest distributor E, and the avatar 506 of the second guest distributor F are arranged horizontally as an example, as illustrated in FIG. 17, and can transmit such a first video 500 to each viewer's terminal device 10 via the BC server device 20A.

[0177] Regarding the aspect illustrated in FIG. 18, when the terminal device 10 displays the first video and the second video, first, the terminal device 10 can divide the display area of the terminal device 10 to generate a plurality of display areas (for example, the display area on the right and the display area on the left). Further, the terminal device 10 can display the first video 500 in one of these plurality of display areas and display the second video 530 in another of these plurality of display areas. FIG. 18 shows an example in which the terminal device 10 displays the first video 500 in the left display area and the second video 530 in the right display area. However, the terminal device 10 can also display the first video 500 in the right display area and the second video 530 in the left display area.

[0178] As described above, when the terminal device 10 displays both the first video 500 and the second video 530 (for example, in FIG. 18), compared to the case where only the first video 500 is displayed without displaying the second video 530 (for example, in FIG. 16), it is necessary to reduce the display area available for displaying the first video 500. Further, during collaborative distribution, it is necessary to arrange the avatars of a plurality of distributors in the first video 500. Therefore, when the terminal device 10 generates the first video using the configuration data of the terminal devices 10 of each distributor in the situation where collaborative distribution is being executed, the avatar 502 of the host distributor A, the avatar 504 of the first guest distributor E, and the avatar 506 of the second guest distributor F can generate the first video 500 arranged vertically as an example, as illustrated in FIG. 18. On the other hand, in a situation where collaborative distribution is being executed, when the terminal device 10A of host distributor A generates a first video using the configuration data of the terminal devices 10 of each distributor and transmits it to the terminal devices 10 of each viewer, the terminal device 10A generates a first video 500 in which the avatar 502 of host distributor A, the avatar 504 of first guest distributor E, and the avatar 506 of second guest distributor F are arranged vertically as illustrated in FIG. 18, and can transmit such first video 500 to the terminal devices 10 of each viewer via the BC server device 20A.

[0179] As described above, according to the various embodiments described above, a first server device that distributes a first video including the animation of the avatar of the distributor to the terminal devices of each viewer, and a second server device that distributes a second video prepared separately from the first video to the terminal device of the distributor and the terminal devices of each viewer are provided independently of each other. Thereby, in a system in which a first video including the animation of the avatar of the distributor is transmitted to the terminal devices of the viewers, the distributor and the viewers can enjoy watching a second video prepared separately from the first video together.

[0180] Further, the terminal device of the distributor can transmit playback data including access data indicating a method for accessing the second video stored in the second server device and currently being played by the terminal device of the distributor, and / or instruction data for instructing the operation of the terminal devices of each viewer in synchronization with the playback of the second video by the terminal device of the distributor, to the terminal devices of each viewer via the first server device that distributes the first video. Thereby, the terminal device of each viewer can access the second server device and play the second video received from the second server device according to the playback data. Therefore, the terminal device of each viewer can play the second video at a timing substantially synchronized with the playback of the second video by the terminal device of the distributor.

[0181] Furthermore, from the time when the distributor's terminal device accesses the second server device (ST406 in FIG. 6A) to the time when the distributor's terminal device starts receiving the second video selected by the distributor's terminal device from the second server device (ST412), during the search period that continues, the first server device does not transmit the data received by the distributor's terminal device from the second server device (e.g., a web page received from the second server device, etc.) to each viewer's terminal device. Thereby, when the distributor's terminal device accesses the second server device, personal information etc. (user ID and password used for logging in to the second server device, and the history of videos received by the distributor from the second server device so far, etc.) input by this distributor via the user interface is prevented from being erroneously transmitted to each viewer's terminal device.

[0182] Furthermore, in the various embodiments described above, the same server device does not adopt a configuration in which it distributes the configuration data (or the first video) and the second video to each viewer's terminal device and distributes the second video to the distributor's terminal device. In reality, the server device (the first server device) that distributes the configuration data (or the first video) to each viewer's terminal device and the server device (the second server device) that distributes the second video to each viewer's terminal device and the distributor's terminal device are each provided separately and independently. Thereby, the second server device does not need to distribute the configuration data (or the first video) to each viewer's terminal device, and basically only transmits the second video to each viewer's terminal device and the distributor's terminal device. Therefore, it is possible to suppress the occurrence of a situation where a relatively large delay occurs between the time when the second video, which is relatively likely to be large in volume, reaches each viewer's terminal device and the time when the second video reaches the distributor's terminal device due to the communication resources or bandwidth being taken away by the transmission of the configuration data (or the first video). On the one hand, the first server device does not need to distribute the second video, which is relatively likely to have a large capacity, to the terminal devices of each viewer, and basically only distributes the configuration data (or the first video) to the terminal devices of each viewer. Therefore, by preventing the communication resources from being occupied by the transmission of the second video, it is possible to suppress the occurrence of a situation where a relatively large delay occurs between the time when the configuration data (or the first video) reaches the terminal devices of each viewer and the terminal devices of each viewer display the first video, and the time when the terminal device of the distributor displays the first video.

[0183] Also, according to the various embodiments described above, the server device (the first server device) that distributes the configuration data (or the first video) to the terminal devices of each viewer and the server device (the second server device) that distributes the second video to the terminal devices of each viewer and the terminal device of the distributor are each provided separately and independently. As a result, the first server device does not distribute the second video stored or prepared by the second server device to the terminal devices of each viewer or the terminal device of the distributor. That is, each terminal device can receive all the second videos directly from the second server device, rather than from the first server device. Therefore, when the company operating the first server device is different from the company operating the second server device, the company operating the first server device does not infringe on the copyright of the second video owned by the company operating the second server device. Thereby, the company operating the first server device can provide the second video to the terminal device of the distributor and the terminal devices of each viewer without infringing on the copyright of the second video owned by the company operating the second server device.

[0184] The various embodiments described above can be implemented in combination with each other as long as no contradiction or inconvenience occurs.

[0185] Considering the many possible embodiments to which the principles of the invention disclosed in this specification can be applied, it should be understood that the various illustrated embodiments are merely preferred examples and should not be considered as limiting the technical scope of the invention according to the claims to these preferred examples. In fact, the technical scope of the invention according to the claims is defined by the appended claims. Therefore, for all that belongs to the technical scope of the invention described in the claims, we claim the grant of a patent as our invention.

[0186] 6. Supplementary Note The computer program according to the first aspect can cause at least one processor mounted on the distributor's terminal device to function so as to transmit, via the first server device, configuration data including at least audio data and motion data used by the viewer's terminal device to generate a first video, or the first video generated based on the configuration data, to the viewer's terminal device, receive and play a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, transmit access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and playback data including at least one of instruction data that synchronizes with the playback of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video, to the viewer's terminal device via the first server device. The computer program according to the second aspect can cause the at least one processor in the first aspect to function so as to transmit the playback data to the viewer's terminal device via the first server device at fixed or variable unit time intervals. The computer program according to the third aspect can cause the at least one processor to function so as to stop the reproduction of the second video by the viewer's terminal device by transmitting the instruction data for fixing the reproduction position of the second video or the instruction data including a command for instructing the stop of the second video when the terminal device of the distributor stops the reproduction of the second video, as in the first aspect or the second aspect described above. The computer program according to the fourth aspect can cause the at least one processor to function so as to resume the reproduction of the second video by the viewer's terminal device by transmitting the instruction data for changing the reproduction position of the second video over time or the instruction data including a command for instructing the reproduction of the second video when the terminal device of the distributor resumes the reproduction of the second video, as in the third aspect described above. In the computer program according to the fifth aspect, receiving and reproducing the second video from the second server device may include receiving reproduction candidate data regarding a plurality of videos that are reproduction candidates from the second server device and receiving the second video requested by the terminal device of the distributor from among the plurality of videos from the second server device, in any one of the first aspect to the fourth aspect described above. The computer program according to the sixth aspect can cause the at least one processor to function so as not to transmit at least the reproduction candidate data and the second video to the viewer's terminal device via the first server device, as in the fifth aspect described above. The computer program according to the seventh aspect can cause the at least one processor to function so as to receive the second video from the second server device by transmitting the access data for identifying the second video selected by the terminal device of the distributor from among the plurality of videos to the second server device, as in the fifth aspect or the sixth aspect described above. The computer program according to the eighth aspect can cause the at least one processor to "be a host distributor's terminal device that distributes the first video in cooperation with the guest distributor's terminal device, and transmit configuration data including at least audio data and motion data generated by the host distributor's terminal device to the guest distributor's terminal device via the first server device, receive configuration data including at least audio data and motion data generated by the guest distributor's terminal device from the guest distributor's terminal device via the first server device, generate the first video including the host distributor's avatar and the guest distributor's avatar using the configuration data of the host distributor's terminal device and the configuration data of the guest distributor's terminal device, receive the playback candidate data regarding a plurality of videos that are playback candidates from the second server device, and receive the second video requested by the host distributor's terminal device from among the plurality of videos from the second server device." The computer program according to the ninth aspect can cause the at least one processor to "be the host distributor's terminal device randomly selected from among the host distributor's terminal device and the guest distributor's terminal device, and receive the playback candidate data from the second server device" in the eighth aspect. The computer program according to the tenth aspect can cause the at least one processor to "be a terminal device of a guest distributor that distributes a first video in cooperation with the terminal device of the host distributor, and transmit configuration data including at least audio data and motion data generated by the terminal device of the guest distributor to the terminal device of the host distributor via the first server device, receive configuration data including at least audio data and motion data generated by the terminal device of the host distributor from the terminal device of the host distributor via the first server device, generate the first video including the avatar of the guest distributor and the avatar of the host distributor using the configuration data of the terminal device of the guest distributor and the configuration data of the terminal device of the host distributor, receive the reproduction candidate data regarding a plurality of videos as reproduction candidates from the second server device, and receive the second video requested by the terminal device of the guest distributor from the plurality of videos from the second server device." The computer program according to the eleventh aspect can cause the at least one processor to "be the terminal device of the guest distributor randomly selected from among the terminal device of the guest distributor and the terminal device of the host distributor, and receive the reproduction candidate data from the second server device." in the tenth aspect. The computer program according to the twelfth aspect can include "a first computer program that causes the at least one processor to transmit the configuration data or a first video generated based on the configuration data to the terminal device of the viewer via the first server device, and a second computer program that is activated by the first computer program and causes the at least one processor to receive and reproduce the second video from the second server device." in any one of the first aspect to the seventh aspect. In the computer program according to the 13th aspect, in any one of the 1st aspect to the 12th aspect above, "the at least one processor may include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)". The method according to the 14th aspect is "a method executed by at least one processor mounted on a terminal device of a distributor that executes instructions readable by a computer, wherein the at least one processor executes the instructions to transmit at least configuration data including audio data and motion data used by a viewer's terminal device to generate a first video, or a first video generated based on the configuration data, to the viewer's terminal device via a first server device, and to transmit a second video different from the first server device to the distributor's terminal device and the viewer's terminal device. Receiving and playing the second video from a second server device, transmitting access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and synchronization with the playback of the second video by the distributor's terminal device, Transmitting at least one of playback data including instruction data for instructing the operation of the viewer's terminal device with respect to the second video to the viewer's terminal device via the first server device". In the method according to the 15th aspect, in the 14th aspect above, "the at least one processor may include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)". The computer program according to the 16th aspect, when executed by at least one processor mounted on the viewer's terminal device, receives configuration data including at least audio data and motion data, or a first video generated based on the configuration data, from the distributor's terminal device via a first server device, generates and plays the first video using the configuration data, or plays the received first video, and receives a second video from a second server device different from the first server device that distributes the second video to the distributor's terminal device and the viewer's terminal device, and receives access data indicating a method for accessing the second video stored in the second server device and played by the distributor's terminal device, and at least one of reproduction data including instruction data that synchronizes with the reproduction of the second video by the distributor's terminal device and instructs the operation of the viewer's terminal device with respect to the second video via the first server device, and causes the at least one processor to function so as to play the second video according to the reproduction data. The computer program according to the 17th aspect can cause the at least one processor to function so as to play the second video according to the reproduction position of the second video indicated by the received instruction data in the 16th aspect. The computer program according to the 18th aspect can cause the at least one processor to function so as to stop the reproduction of the second video when the operation data regarding the viewer's operation indicates the stop of the second video, and play the second video from the reproduction position indicated by the instruction data when the operation data indicates the resumption of the reproduction of the second video, in the 16th aspect or the 17th aspect. The computer program according to the 19th aspect can cause the at least one processor to function so as to adjust the level of the audio included in the second video independently of the audio included in the first video, in any one of the 16th aspect to the 18th aspect. The computer program according to the 20th aspect can cause the at least one processor to function so as to display, in association with the second video, a movable object for adjusting the level of the audio included in the second video, as in the 19th aspect. The computer program according to the 21st aspect can cause the at least one processor to function so as to enlarge, reduce, and / or move the area for displaying the second video, in any one of the 16th aspect to the 20th aspect. The computer program according to the 22nd aspect can cause the at least one processor to function so as to receive configuration data including at least audio data and operation data from the terminal device of the host distributor via the first server device, receive configuration data including at least audio data and operation data from the terminal devices of at least one guest distributor via the first server device, generate a first video using the configuration data of the terminal device of the host distributor and the configuration data of the terminal devices of the at least one guest distributor, divide the display area of the viewer's terminal device to generate a plurality of display areas, display the first video in one of the plurality of display areas, and display the second video in another one of the plurality of display areas. The computer program according to the 23rd aspect can cause the at least one processor to function so as to generate the first video in which the avatar of the host distributor and the avatars of the two or more guest distributors are arranged in a row along the horizontal direction or the vertical direction, in the 22nd aspect where the terminal devices of the at least one guest distributor include the terminal devices of two or more guest distributors. The computer program according to the 24th aspect can cause the at least one processor to function as follows: In any one of the 16th aspect to the 21st aspect, receive, from the host distributor's terminal device via the first server device, a first video generated by the host distributor's terminal device and including the host distributor's avatar and the avatars of at least one guest distributor, divide the display area of the viewer's terminal device to generate a plurality of display areas, display the first video in one of the plurality of display areas, and display the second video in another of the plurality of display areas. In the computer program according to the 25th aspect, in the 24th aspect, the first video can include the host distributor's avatar and the avatars of the two or more guest distributors arranged in a row along the horizontal direction or the vertical direction. The computer program according to the 26th aspect can cause the at least one processor to function as follows: In any one of the 22nd aspect to the 25th aspect, display the first video in the upper display area or the lower display area of the plurality of display areas, and display the second video in the lower display area or the upper display area of the plurality of display areas. In the computer program according to the 27th aspect, in any one of the 22nd aspect to the 26th aspect, when the one display area in which the first video is displayed displays only the first video without displaying the second video, the size of the display area in which the first video is displayed can be smaller than the display area in which the first video is displayed when the second video is not displayed. In the computer program according to the 28th aspect, in any one of the 22nd aspect to the 27th aspect, the at least one processor can include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU). The method according to the 29th aspect is a method executed by at least one processor mounted on a viewer's terminal device that executes instructions readable by a computer, wherein the at least one processor, by executing the instructions, receives configuration data including at least audio data and motion data, or a first video generated based on the configuration data, from a distributor's terminal device via a first server device, generates and plays back the first video using the configuration data, or plays back the received first video, and distributes a second video to the distributor's terminal device and the viewer's terminal device. The method receives the second video from a second server device different from the first server device, and receives, via the first server device, playback data including at least one of access data indicating a method for accessing the second video stored in the second server device and played back by the distributor's terminal device, and instruction data for instructing an operation of the viewer's terminal device with respect to the second video in synchronization with the playback of the second video by the distributor's terminal device, and plays back the second video according to the playback data. In the method according to the 30th aspect, in the 29th aspect, "the at least one processor may include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)". The server device according to the 31st aspect is a server device provided separately from the server device that distributes the second video to the terminal device of the distributor and the terminal device of the viewer, and includes at least one processor. The at least one processor receives configuration data including at least audio data and motion data used by the terminal device of the viewer to generate the first video from the terminal device of the distributor and transmits it to the terminal device of the viewer, or distributes the first video generated based on the configuration data to the terminal device of the viewer. The server device receives playback data including at least one of access data indicating a method for accessing the second video stored in the second server device and played back by the terminal device of the distributor, and instruction data for instructing the operation of the terminal device of the viewer with respect to the second video in synchronization with the playback of the second video by the terminal device of the distributor from the terminal device of the distributor and transmits it to the terminal device of the viewer, and is configured as such. In the server device according to the 32nd aspect, in the 31st aspect described above, the at least one processor may include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU). The method according to the 33rd aspect is a method executed by at least one processor that executes computer-readable instructions mounted on a server device provided separately from the server device that distributes the second video to the terminal device of the distributor and the terminal device of the viewer. By executing the instructions, the at least one processor receives configuration data including at least audio data and motion data used by the viewer's terminal device to generate a first video from the distributor's terminal device and transmits it to the viewer's terminal device, or transmits the first video generated based on the configuration data to the viewer's terminal device. The access data indicating a method for accessing the second video stored in the second server device and played back by the distributor's terminal device, and the playback data including at least one of the instruction data for synchronizing the playback of the second video by the distributor's terminal device and instructing the operation of the viewer's terminal device with respect to the second video are received from the distributor's terminal device and transmitted to the viewer's terminal device. In the method according to the 34th aspect, in the 33rd aspect described above, "the at least one processor may include a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)".

Explanation of Signs

[0187] 1 Video distribution system 2 Communication line (communication network) 10, 10A~10D Terminal device 20 Server device 20A First server device (broadcast server device) 20B Second server device (video distribution server device) 30, 30A, 30B Studio unit 100 Configuration data generation unit 102 Acquisition unit 104 Processing unit 110 Communication unit 120 Video playback unit 130 Playback data generation unit 140 Video generation unit 150 Display unit 160 Memory unit 170 User interface unit

Claims

1. A first terminal device, a first means for transmitting first data for causing the second terminal device to display an avatar video of a user of the first terminal device; a second means for receiving and playing a second video; a third means for synchronizing with the playback of the second video by the first terminal device and transmitting playback data including instruction data for instructing an operation of the second terminal device with respect to the second video to the second terminal device; a fourth means for receiving second data for causing the second terminal device to display an avatar video of a user of the second terminal device from the second terminal device, and functioning as such; a computer program in which the third means transmits the playback data including the instruction data for fixing the playback position of the second video or the instruction data including a command for instructing the stop of the second video when the first terminal device stops the playback of the second video.

2. The computer program according to claim 1, wherein the third means transmits the playback data including the instruction data for changing the playback position of the second video over time or the instruction data including a command for instructing the playback of the second video when the first terminal device resumes the playback of the second video.

3. The first means transmits the first data to the second terminal device via a first server device, the fourth means receives the second data from the second terminal device via the first server device, The computer program according to claim 1 or 2, wherein the second means receives the second video from a second server device different from the first server device.

4. The first data is configuration data including at least voice data and motion data of a user of the first terminal device, or an avatar video of the user of the first terminal device generated based on the configuration data, The second data is configuration data including at least voice data and motion data of a user of the second terminal device, or an avatar video of the user of the second terminal device generated based on the configuration data. The computer program according to any one of claims 1 to 3.

5. A first terminal device, a first means for transmitting first data for causing the second terminal device to display an avatar video of a user of the first terminal device; a second means for receiving playback candidate data regarding a plurality of videos that are playback candidates, and receiving and playing a second video requested by the first terminal device among the plurality of videos; Third means for transmitting to the second terminal device reproduction data including at least one of access data indicating a method for accessing the second video being played by the first terminal device and instruction data that synchronizes with the reproduction of the second video by the first terminal device and instructs the operation of the second terminal device with respect to the second video. A computer program that functions as fourth means for receiving from the second terminal device second data for displaying an avatar video of a user of the second terminal device.

6. The first means transmits the first data to the second terminal device via a first server device. The fourth means receives the second data from the second terminal device via the first server device. The second means receives the reproduction candidate data from a second server device different from the first server device and receives the second video from the second server device. The access data is stored in the second server device. The computer program according to claim 5.

7. The computer program according to claim 6, wherein the first terminal device is caused to function so as not to transmit at least the reproduction candidate data and the second video to the second terminal device via the first server device.

8. The second means receives the second video from the second server device by transmitting the access data for identifying the second video to the second server device. The computer program according to claim 6 or claim 7.

9. The first data is configuration data including at least voice data and motion data of a user of the first terminal device, or an avatar video of the user of the first terminal device generated based on the configuration data. The second data is configuration data including at least voice data and motion data of a user of the second terminal device, or an avatar video of the user of the second terminal device generated based on the configuration data. The computer program according to claim 6.

10. The third means transmits the reproduction data to the second terminal device at fixed or variable unit time intervals. The computer program according to any one of claims 1 to 9.

11. A first step in which first means transmits first data for displaying an avatar video of a user of a first terminal device to a second terminal device. A second step in which second means receives and plays a second video. A third step of transmitting, to the second terminal device, playback data including at least one of access data indicating a method for accessing the second video being played by the first terminal device and playback data including instruction data for instructing an operation of the second terminal device with respect to the second video and synchronized with the playback of the second video by the first terminal device. A fourth step of receiving, from the second terminal device, second data for causing the avatar video of the user of the second terminal device to be displayed. The third means transmits the playback data including the instruction data for fixing the playback position of the second video or the instruction data including a command for instructing the stop of the second video when the first terminal device stops the playback of the second video.

12. A first step of transmitting, to the second terminal device, first data for causing the avatar video of the user of the first terminal device to be displayed. A second step of receiving playback candidate data regarding a plurality of videos as playback candidates, receiving, from among the plurality of videos, a second video requested by the first terminal device, and playing back the second video. A third step of transmitting, to the second terminal device, access data indicating a method for accessing the second video being played by the first terminal device and playback data including at least one of access data indicating a method for accessing the second video being played by the first terminal device and playback data including instruction data for instructing an operation of the second terminal device with respect to the second video and synchronized with the playback of the second video by the first terminal device. A fourth step of receiving, from the second terminal device, second data for causing the avatar video of the user of the second terminal device to be displayed.

13. The method according to claim 11 or 12, wherein the third means transmits the playback data in parallel with transmitting the second data in order to cause the avatar video and the second video to be played back simultaneously at the second terminal device.

14. A second terminal device, a first means for receiving, from the first terminal device, first data for causing the avatar video of the user of the first terminal device to be displayed; a second means for playing back the avatar video of the user of the first terminal device based on the first data; a third means for receiving a second video; a fourth means for receiving playback data including instruction data for instructing an operation of the second terminal device with respect to the second video and synchronized with the playback of the second video by the first terminal device; a fifth means for playing back the second video according to the playback data. Function as sixth means for transmitting second data for causing the first terminal device to display an avatar video of the second terminal device to the first terminal device. The fifth means When operation data regarding an operation of a user of the second terminal device indicates stopping of the second video, stop the playback of the second video. A computer program that, when the operation data indicates resuming playback of the second video, plays back the second video from the playback position indicated by the instruction data.

15. The computer program according to claim 14, wherein the fifth means plays back the second video according to the playback position of the second video indicated by instruction data included in the received playback data.

16. A second terminal device First means for receiving first data for causing the first terminal device to display an avatar video of a user of the first terminal device from the first terminal device. Second means for playing back an avatar video of a user of the first terminal device based on the first data. Third means for receiving a second video. Fourth means for receiving playback data including at least one of access data indicating a method for accessing the second video being played back by the first terminal device and instruction data for instructing an operation of the second terminal device with respect to the second video in synchronization with the playback of the second video by the first terminal device. Fifth means for playing back the second video according to the playback data. Function as sixth means for transmitting second data for causing the first terminal device to display an avatar video of the second terminal device to the first terminal device. The computer program according to claim 14, wherein the fifth means adjusts the level of the audio included in the second video independently of the audio included in the avatar video.

17. The computer program according to claim 16, wherein the fifth means displays a movable object for adjusting the level of the audio included in the second video in association with the second video.

18. The computer program according to any one of claims 14 to 17, wherein the second terminal device functions as seventh means for enlarging, reducing, and / or moving a region for displaying the second video.

19. The computer program according to any one of claims 14 to 18, wherein the fourth means receives the playback data in parallel with receiving the first data in order to play back the avatar video of the user of the first terminal device and the second video simultaneously on the second terminal device.

20. A first step in which a first means receives first data for causing a first terminal device to display an avatar video of a user of the first terminal device from the first terminal device; A second step in which a second means plays back an avatar video of a user of the first terminal device based on the first data; A third step in which a third means receives a second video; A fourth step in which a fourth means receives playback data including instruction data for instructing an operation of a second terminal device with respect to the second video in synchronization with the playback of the second video by the first terminal device; A fifth step in which a fifth means plays back the second video according to the playback data; A sixth step in which a sixth means transmits second data for causing the second terminal device to display an avatar video of the second terminal device to the first terminal device, wherein the fifth means stops the playback of the second video when operation data regarding an operation of a user of the second terminal device indicates stopping of the second video, and plays back the second video from a playback position indicated by the instruction data when the operation data indicates resumption of playback of the second video, a video control method.

21. A first step in which a first means receives first data for causing a first terminal device to display an avatar video of a user of the first terminal device from the first terminal device; A second step in which a second means plays back an avatar video of a user of the first terminal device based on the first data; A third step in which a third means receives a second video; A fourth step in which a fourth means receives playback data including at least one of access data indicating a method for accessing the second video being played back by the first terminal device and instruction data for instructing an operation of a second terminal device with respect to the second video in synchronization with the playback of the second video by the first terminal device; A fifth step in which a fifth means plays back the second video according to the playback data; A sixth step in which a sixth means transmits second data for causing the second terminal device to display an avatar video of the second terminal device to the first terminal device, wherein the fifth means adjusts the level of the audio included in the second video independently of the audio included in the avatar video, a video control method.

22. A first means for receiving, from the first terminal device, first data for causing a second terminal device to display an avatar video of a user of the first terminal device and transmitting the first data to the second terminal device; Second means for receiving playback data including at least one of instruction data that synchronizes with the playback of the second video by the first terminal device and instructs the operation of the second terminal device with respect to the second video from the first terminal device and transmitting the playback data to the second terminal device. Third means for receiving second data for displaying the avatar video of the user of the second terminal device from the second terminal device and transmitting the second data to the first terminal device. The second means receives the playback data including the instruction data for fixing the playback position of the second video or the instruction data including a command for instructing the stop of the second video from the first terminal device when the first terminal device stops the playback of the second video and transmits the playback data to the second terminal device. A server device.

23. The server device according to claim 22, which is different from the device that distributes the second video.

24. A server device First means for receiving first data for displaying the avatar video of the user of the first terminal device from the first terminal device and transmitting the first data to the second terminal device, Second means for receiving playback data including at least one of instruction data that synchronizes with the playback of the second video by the first terminal device and instructs the operation of the second terminal device with respect to the second video from the first terminal device and transmitting the playback data to the second terminal device, Functioning as third means for receiving second data for displaying the avatar video of the user of the second terminal device from the second terminal device and transmitting the second data to the first terminal device, The second means receives the playback data including the instruction data for fixing the playback position of the second video or the instruction data including a command for instructing the stop of the second video from the first terminal device when the first terminal device stops the playback of the second video and transmits the playback data to the second terminal device. A program.

25. A first step in which the first means receives first data for displaying the avatar video of the user of the first terminal device from the first terminal device and transmits the first data to the second terminal device, A second step in which the second means receives playback data including at least one of instruction data that synchronizes with the playback of the second video by the first terminal device and instructs the operation of the second terminal device with respect to the second video from the first terminal device and transmits the playback data to the second terminal device. The third step includes a third step of receiving, from the second terminal device, second data for causing the avatar video of the user of the second terminal device to be displayed, and transmitting the second data to the first terminal device. The second means receives, from the first terminal device, the reproduction data including the instruction data for fixing the reproduction position of the second video or the instruction data including a command for instructing the stop of the second video when the first terminal device stops the reproduction of the second video, and transmits the reproduction data to the second terminal device.

Images