Video distribution system, server device, and program

Abstract

To provide a real-time moving image distribution technology utilizing a robot.SOLUTION: An operator performs remote operation of a robot 30 using an operator terminal 20a. When receiving operation information depending on the remote operation from the operator terminal 20a, a management server 10 transmits the operation information to the robot 30. The robot 30 and the operator terminal 20a image an object according to the operator's operation to create a moving image (including voice) and transmit the moving image to the management server 10. When receiving respective moving images from the robot 30 and the operator terminal 20a, the management server 10 performs live distribution of the moving images to viewer terminals 20b.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a video distribution system, a server device, and a program.

Background Art

[0002] In recent years, television conference systems using the Internet have become widespread, and robots (for example, telepresence robots) are known that allow users located remotely to not only talk while seeing each other's faces but also operate the direction and position of the camera (see Patent Document 1).

[0003] Robots are expected to be utilized in various fields. For example, by installing robots in facilities such as art museums, museums, and aquariums, users living remotely can remotely operate the robots and use them as avatars to view various exhibits as if they were inside the facility.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By the way, with the recent increase in the functionality of electronic devices, real-time distribution of video data such as live TV broadcasts using smartphones and the like (so-called live distribution) has attracted attention.

[0006] By applying such live distribution to robots, for example, an operator who operates a robot inside a facility can use the camera mounted on the robot to acquire video data inside the facility and perform live distribution of this data to viewers. However, no technology has yet been proposed to meet such an idea.

[0007] The present invention has been made in view of the above-described circumstances, and one of its objects is to provide a real-time video distribution technology that utilizes a robot.

Means for Solving the Problems

[0008] A video distribution system according to one aspect of the present disclosure includes a first receiving unit that receives a first video acquired by a robot, a second receiving unit that receives operation information of the robot from an operator's terminal, a third receiving unit that receives a second video acquired by the operator's terminal, a transmitting unit that transmits the operation information of the robot to the robot, and a distribution unit that distributes the first video and the second video to a viewer's terminal.

Effects of the Invention

[0009] According to the present invention, it is possible to provide a real-time video distribution technology that utilizes a robot.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

[0011] Hereinafter, an embodiment of the present invention will be described. Note that the following embodiments are examples for explaining the present invention, and the present invention is not limited to only the embodiments. Further, the present invention can be variously modified without departing from the gist thereof. Furthermore, those skilled in the art can adopt embodiments in which each element described below is replaced with an equivalent one, and such embodiments are also included in the scope of the present invention. In the following, for ease of understanding, an embodiment in which the present invention is realized using an information processing apparatus (or computer) will be described as an example, but the present invention is not limited thereto.

[0012] A. This Embodiment FIG. 1 is a diagram showing a network configuration of a video distribution system 1 according to this embodiment. The video distribution system 1 includes a plurality of non-fixed robots 30, an operator terminal 20a capable of operating each robot 30, a management server 10 that live-distributes video data (hereinafter abbreviated as video) acquired by the robots 30 and the operator terminal 20a, and a viewer terminal 20b capable of receiving and viewing the live-distributed video. Each robot 30, the operator terminal 20a, the viewer terminal 20b, and the management server 10 can communicate with each other via a communication network N. Note that FIG. 1 illustrates one robot 30, one operator terminal 20a, two viewer terminals 20b, and one management server 10, but the number of robots 30, operator terminals 20a, viewer terminals 20b, and management servers 10 is arbitrary.

[0013] One or more parts of the communication network N may be a wired network or a wireless network. The communication network N includes, by way of example and not limitation, an Ad Hoc Network, an intranet, an extranet, a Virtual Private Network (VPN), a Local Area Network (LAN), a Wireless LAN (WLAN), a Wide Area Network (WAN), a Wireless WAN (WWAN), a Metropolitan Area Network (MAN), a part of the Internet, a part of the Public Switched Telephone Network (PSTN), a mobile phone network, ISDNs (Integrated Service Digital Networks), Wireless LANs, LTE (Long Term Evolution), CDMA (Code Division Multiple Access), short-range wireless communication such as Bluetooth (registered trademark), satellite communication, etc., or a combination of two or more of these.

[0014] <Overview of the video distribution system 1> FIG. 2 is an image diagram for explaining the overview of the video distribution system 1. The robot 30 is installed in a facility such as an aquarium. The operator remotely operates the robot 30 using the operator terminal 20a. When the management server 10 receives operation information corresponding to the remote operation from the operator terminal 20a (S1), it transmits this to the robot 30 (S2).

[0015] The robot 30 and the operator terminal 20a are equipped with a camera and a microphone. The robot 30 and the operator terminal 20a image an object (for example, fish swimming in an aquarium) according to the operation of the operator to generate a video (including audio), and transmit it to the management server 10.

[0016] To illustrate with an example, in the case of the robot 30, it generates videos (the first video) representing fish swimming in the water tank, etc., while in the case of the operator terminal 20a, it generates videos (the second video) representing the face of the operator, etc. Note that hereinafter, it is assumed that the video includes audio, but a configuration without audio may also be used. When the management server 10 receives each video from the robot 30 and the operator terminal 20a (S3, S4), it live-streams these to the viewer terminal 20b (S5).

[0017] According to such a video distribution system 1, an operator who operates a robot within a facility can acquire videos of an object viewed from various angles by using a camera or the like mounted on the robot 30 or the operator terminal 20a, and can live-stream this to viewers. Hereinafter, the configurations of the management server 10, the operator terminal 20a, the viewer terminal 20b, and the robot 30 will be described.

[0018] <Configuration> The management server 10 is configured by an information processing device such as a server computer, and has functions such as controlling the operation of the robot 30 and live-streaming videos acquired by the robot 30 and the operator terminal 20a to the viewer terminal 20b. The management server 10 may be configured by one information processing device, or may be configured by a plurality of information processing devices such as cloud computing or edge computing, for example. The detailed functions of the management server 10 will be described later.

[0019] The operator terminal 20a is an information processing device used by an operator for operating the robot 30, etc. The operator terminal 20a has an input unit that receives input of operation information by the operator, a display unit that displays videos and the like acquired by the robot 30, etc., and a communication unit that transmits and receives various data to and from the management server 10 and the robot 30 via the communication network N.

[0020] The operator terminal 20a is a general-purpose or dedicated information processing device such as, for example, a smartphone, a tablet terminal, a PDA (Personal Digital Assistants), a personal computer, a head-mounted display, or an operation system for a specific purpose. The operator terminal 20a may be constituted by a dedicated information processing device for operating the robot 30. Note that, in order to remotely operate the robot 30, a VR device, a tactile glove, or the like may be used as the operator terminal 20a.

[0021] The viewer terminal 20b is an information processing device used by a viewer who views a video live-streamed by the management server 10, and is capable of viewing videos such as those live-streamed by the management server 10. The viewer terminal 20b is a general-purpose or dedicated information processing device such as, for example, a smartphone, a tablet terminal, a PDA (Personal Digital Assistants), a personal computer, a head-mounted display, or an operation system for a specific purpose.

[0022] The robot 30 is constituted by, for example, a telepresence robot or an avatar robot, and may have a moving part such as wheels. The robot 30 includes an image and audio input unit including a camera, a microphone, etc., a driving unit capable of being remotely operated by the operator terminal 20a, and a communication unit that transmits and receives various data to and from the management server 10 and the operator terminal 20a via the communication network N. The robot 30 is arranged in various places, and one or more robots are installed, for example, in a facility such as an aquarium. These robots 30 are non-fixed robots, and the term "non-fixed" includes the case where the robot 30 is a mobile type having a driving unit for movement such as wheels, and the case where the robot 30 is a wearable type that a person can wear and has a driving unit for operations such as a manipulator.

[0023] Mobile robots are shown, for example, in Patent Document 1. The moving part of a mobile robot includes those that run on one wheel, two wheels, or multiple wheels, those that run on caterpillars, those that run on rails, those that move by jumping, those that walk on two legs, four legs, or multiple legs, those that navigate on water or underwater by screws, and those that fly by propellers or the like. Wearable robots are disclosed, for example, in MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa and Masahiko Inami, "Fusion: full body surrogacy for collaborative communication," Proceeding SIGGRAPH '18 ACM SIGGRAPH 2018 Emerging Technologies Article No. 7. Further, the robot 30 includes vehicles and heavy machinery that can perform autonomous or semi-autonomous driving, drones, airplanes, etc. Also, the robot 30 includes a robot installed in a sports stadium or the like and equipped with a camera that can move on rails. Also, the robot 30 includes a satellite-type robot launched into space that can control its attitude and the shooting direction of the camera. Note that these robots 30 may be equipped with a robot hand or a robot arm that can grip or adsorb an object.

[0024] The robot 30 operates based on a command from the operator terminal 20a that has successfully authenticated the user. Here, user authentication may be performed by a known method, and information for user authentication may be registered in advance.

[0025] (Functional Configuration of Management Server 10) FIG. 3 is a block diagram showing the functional configuration of the management server (server device) 10. The management server 10 has, as the configuration of its main functions, a storage unit 11, a control unit 12, a reception unit 13, a transmission unit 14, and a distribution unit 15. The functions of the management server 10 are realized by the processor of the management server 10 executing programs and the like stored in the storage unit 11.

[0026] The storage unit 11 stores user information IF1, operation authority information IF2, and the like. The user information IF1 includes a user ID, user attributes, and the like. The user ID is information for identifying each user (such as an operator or a viewer). The user attributes include information related to the attributes of the user, such as the user name, gender, age, family composition, address, contact information, workplace, annual income, hobbies, preferences, and the like.

[0027] The operation authority information IF2 is information related to the operation authority of the robot 30. Specifically, the operation authority information IF2 is registered in association with a robot ID for identifying the robot 30 to be the operation target, an operator ID for identifying the user (i.e., the operator) having the operation authority of the robot 30, information defining the range of operations that the operator can perform (for example, operation time, operation content, etc.; hereinafter, the operation range), and the like. Note that the operation authority information IF2 may be a preset fixed one, or may be configured to be arbitrarily set and changed by an operator or the like.

[0028] FIG. 4A is a diagram illustrating an operation authority setting screen P1 displayed on the operator terminal 20a. The operator sets new operation authority information IF2 by appropriately operating according to the display of the operation authority setting screen P1.

[0029] For example, the operator can grant an operation authority that permits a specific viewer (for example, a viewer who has thrown in a certain amount or more of coins) to operate the robot for 3 minutes. Of course, it is not limited to this. For example, when granting operation authority to several viewers, it is also possible to shift the operation authority at several-minute intervals and let each viewer experience operating the robot.

[0030] Figure 4B is an explanatory diagram when operation authority is granted. Figure 4B assumes a case where there is a user who initially has operation authority (hereinafter referred to as the host operator) Ho, six users (hereinafter referred to as participants) Pa who can be granted (delegated) operation authority, and users (i.e., viewers) Vi who can only watch the live-streamed video. The participants Pa may be determined by, for example, a planner who plans an online experience (such as an online tour of an aquarium) using the robot 30. The planner plans the online experience and sells participation slots. By purchasing a participation slot, a user can participate in the online experience as a participant rather than as a viewer. The host operator Ho can make a voice call (see A and F shown in Figure 4B) with each participant Pa during the online experience and can also grant operation authority to each participant Pa. The operator Ho can set and manage the operation authority for each participant Pa by using, for example, an operation screen P1 as shown in Figure 4A.

[0031] Note that the method of determining the participants Pa is not limited to the above example. For example, the host operator Ho may determine them by himself / herself. Also, when the viewer Vi meets a predetermined condition, the viewer Vi may be allowed to participate in the online experience as a participant Pa. For example, a viewer Vi who wins a random lottery or a viewer Vi who has accumulated a specific number of points above a predetermined level may be allowed to participate in the online experience as a participant Pa.

[0032] The control unit 12 controls the reception of the operation information of the robot according to the operation authority information of the robot 30 set as described above. Specifically, when the control unit 12 receives the operation information of the robot 30 from the operator terminal 20a or the like, it refers to the operation authority information IF2 to determine whether to permit the reception of the operation information. For example, based on the comparison result between the operation information and the operation authority information IF2, if the control unit 12 determines that the operator does not have a legitimate operation authority, it rejects the reception of the operation information. On the other hand, based on the comparison result between the operation information and the operation authority information, if the control unit 12 determines that the operator has a legitimate operation authority, it permits the reception of the operation information.

[0033] The receiving unit (first to third receiving units) 13 receives various data transmitted from the robot 30, the operator terminal 20a, and the viewer terminal 20b. For example, the receiving unit 13 receives a video (first video) acquired by the robot 30, a video (second video) acquired by the operator terminal 20a, the operation information of the robot 30 transmitted from the operator terminal 20a, and the like.

[0034] The transmitting unit 14 transmits the operation information of the robot 30 received from the operator terminal 20a to the corresponding robot 30.

[0035] The distribution unit 15 live-distributes the videos received from the robot 30 and the operator terminal 20a to each viewer terminal 20b. The viewer terminal 20b displays the live-distributed video (live video) on the display device.

[0036] FIG. 5 is a diagram illustrating the screen P2 of the live video displayed on the viewer terminal 20b. As shown in FIG. 5, on the screen P2 of the live video, the face video P21 of the operator is displayed, and the facility video P22 showing the inside of the facility acquired by the first camera of the robot 30, the foot video P23 showing the feet of the robot 30 acquired by the second camera of the robot 30, the face image P24 of the viewer who has thrown in a predetermined amount or more of coins (or a participant shown in FIG. 4B), etc. are displayed.

[0037] In addition, on the live video screen P2, for example, the number of viewers, comments from each viewer on the live broadcast, reactions ("like", "applause", etc.), questions, and furthermore, acceptance of votes for quizzes for viewers (such as multiple-choice questions), and vote results may be displayed.

[0038] By delivering such a video to the viewer terminal 20b in real time, each viewer can enjoy the live video in an atmosphere full of a sense of presence as if they were inside the facility.

[0039] (Physical configurations of the management server 10, the operator terminal 20a, and the viewer terminal 20b) FIG. 6 is a diagram showing the hardware configuration of a computer (information processing device) 200 implemented in the management server 10, the operator terminal 20a, and the viewer terminal 20b.

[0040] The computer 200 includes a CPU (Central Processing Unit) 210a corresponding to an arithmetic unit, a RAM (Random Access Memory) 210b corresponding to a storage unit, a ROM (Read only Memory) 210c corresponding to a storage unit, a communication device 210d, an input device 210e, a display device 210f, an audio device 210g, and a camera 210h. These components are connected to be able to transmit and receive data to and from each other via a bus. In this example, the case where the computer 200 is composed of a single computer is described, but the computer 200 may be realized by combining a plurality of computers. Also, the configuration shown in FIG. 6 is an example, and the computer 200 may have configurations other than these, or may not have some of these configurations.

[0041] The CPU 210a is a control unit that performs control related to the execution of programs stored in the RAM 210b or the ROM 210c, as well as data calculation and processing. The CPU 210a is an arithmetic unit that executes programs for live-streaming videos using the robot 30 or displaying live-streamed videos. The CPU 210a receives various data from the input device 0e and the communication device 210d, and displays the calculation results of the data on the display device 210f, outputs voice from the audio device 210g, or stores it in the RAM 210b.

[0042] The RAM 210b is a rewritable data storage unit among the storage units, and may be composed of, for example, a semiconductor memory element. The RAM 210b may store data such as various programs executed by the CPU 210a. Note that these are examples, and other data may be stored in the RAM 210b, or some of these may not be stored.

[0043] The ROM 210c is a data-readable storage unit among the storage units, and may be composed of, for example, a semiconductor memory element. The ROM 210c may store, for example, programs and data that are not rewritten.

[0044] The communication device 210d is an interface that connects the computer 200 to other devices via the communication network N.

[0045] The input device 210e accepts data input, and may include, for example, a keyboard and a touch panel. Further, the input device 210e may include a microphone for voice input.

[0046] The display device 210f visually displays the calculation results by the CPU 210a, and may be composed of, for example, an LCD (Liquid Crystal Display). The display device 210f may display videos captured by the camera of the robot 30, videos captured by the camera mounted on the computer 200, and the like.

[0047] The audio device 210g is for outputting sound and may include, for example, an audio decoder and a speaker.

[0048] The camera 210h includes an imaging element for capturing still images or moving images, and transmits the captured moving images to the display device 210f or the robot 30. Note that the moving images may include still images, sound, and the like.

[0049] (Physical Configuration of Robot 30) FIG. 7 is a diagram showing the hardware configuration of a computer (information processing device) 300 mounted on the robot 30.

[0050] The computer 300 includes a CPU 310a corresponding to an arithmetic unit, a RAM 310b corresponding to a storage unit, a ROM 310c corresponding to a storage unit, a communication device 310d, an input device 310e, a display device 310f, a drive device 310g, and a camera 310h. These components are connected to be able to transmit and receive data to and from each other via a bus. Note that the configuration shown in FIG. 7 is an example, and the computer 300 may have configurations other than these, or may not have some of these configurations.

[0051] The CPU 310a is a control unit that performs control related to the execution of programs stored in the RAM 310b or the ROM 310c, arithmetic operations, and processing of data. The CPU 310a is an arithmetic unit that executes a program for acquiring moving images using the robot 30. The CPU 310a receives various data from the input device 310e and the communication device 310d, and displays the arithmetic result of the data on the display device 310f or stores it in the RAM 310b. Further, the CPU 310a controls the drive device 310g to control the operation of the robot 30.

[0052] The RAM 310b is a rewritable part of the storage unit and may be composed of, for example, semiconductor memory elements. The RAM 310b may store various programs executed by the CPU 310a. Note that these are examples, and the RAM 310b may store data other than these, or may not store some of these.

[0053] The ROM 310c is a part of the storage unit from which data can be read and may be composed of, for example, semiconductor memory elements. The ROM 310c may store, for example, programs and data that are not rewritten.

[0054] The communication device 310d is an interface that connects the robot 30 to other devices via the communication network N.

[0055] The input device 310e accepts data input and may include, for example, a keyboard and a touch panel. Further, the input device 310e may include a microphone for voice input.

[0056] The display device 310f visually displays the calculation results by the CPU 310a and may be composed of, for example, an LCD. The display device 310f may display a video captured by the camera of the robot 30 or the like.

[0057] The drive device 310g includes remotely operable actuators and includes moving parts such as wheels and manipulators. When the robot 30 is a mobile robot, the drive device 310g includes at least moving parts such as wheels, but may also include a manipulator. When the robot 30 is a wearable type, the drive device 310g includes at least a manipulator.

[0058] The camera 310h is configured to include a first camera that captures the front of the robot 30 (i.e., inside the facility) and a second camera that captures the area at the feet of the robot 30. The camera 310h includes an image sensor that captures still images or moving images, and transmits the captured moving images to a display device 310f, a management server 10, and the like. Note that the moving images may include still images, audio, and the like.

[0059] The physical configurations of the computers 200 and 300 described above are examples and do not necessarily have to be independent configurations. For example, the computers 200 and 300 may be equipped with an LSI in which the CPU 20a, the RAM 20b, and the ROM 20c are integrated.

[0060] <Processing Flow> FIG. 8 is a flowchart showing an example of the processing executed by the management server 10 according to the present embodiment. As a premise, it is assumed that the operator is permitted to remotely operate the robot 30 installed in the facility by using the operator terminal 20a, and that a moving image as shown in FIG. 5 is live-streamed to the viewer terminal 20b or the like.

[0061] The operator operates the operator terminal 20a to start the remote operation of the robot 30 in order to live-stream the state inside the facility to the viewer. When the operator terminal 20a receives an operation by the operator, it transmits operation information including the operator ID and the like to the management server 10. When the management server 10 receives the operation information from the operator terminal 20a (step Sa1), it refers to the operation authority information IF2 to determine whether or not the operator has a legitimate operation authority (step Sa2).

[0062] When the management server 10 determines that the operation content indicated in the operation information (such as the gripping operation of the robot hand) exceeds the operation permission range indicated in the operation authority information and thus does not have a legitimate operation authority (step Sa2; NO), it rejects the reception of the operation information (step Sa3) and proceeds to step Sa6. In this case, the management server 10 may return a message indicating that the operation information cannot be received to the operator terminal 20a, together with the reason why the operation information cannot be received.

[0063] On the other hand, when the management server 10 determines that it has a legitimate operation authority based on the comparison result between the operation information and the operation authority information (step Sa2; YES), it permits the reception of the operation information (step Sa4). In this case, the management server 10 transmits the received operation information to the robot 30 (step Sa5).

[0064] When the robot 30 receives the operation information from the management server 10, it starts operating according to such operation information (here, a command to live-stream the state inside the facility). Specifically, the robot 30 sequentially transmits facility videos taken by a camera to the management server 10. Similarly, the operator terminal 20a also sequentially transmits face videos of the operator taken by a camera to the management server 10.

[0065] When the management server 10 receives facility videos acquired by the robot 30, face videos of the operator acquired by the operator terminal 20a, etc., it live-streams these videos to the viewer terminal 20b (step Sa6).

[0066] Thereafter, the management server 10 determines whether the end timing of the live-streaming has arrived (step Sa7). As an example, when the management server 10 receives an end command for the live-streaming from the operator terminal 20a, it determines that the end timing of the live-streaming has arrived (step Sa7; YES). In this case, the management server 10 ends the live-streaming to the viewer terminal 20b, etc. (step Sa8) and ends the process.

[0067] On the other hand, when the management server 10 determines that the end timing of the live distribution has not arrived (step Sa7; NO), it proceeds to step Sa9 and determines whether the operation authority of the robot 30 should be newly set. As an example, when the management server 10 receives a setting request for operation authority information from the operator terminal 20a, it determines that the operation authority of the robot 30 should be newly set (step Sa9; YES). In this case, the management server 10 displays an operation authority setting screen P1 (see FIG. 4) on the operator terminal 20a and prompts the setting of operation authority information. Note that the setting of operation authority information includes changes (such as addition and modification) to the existing operation authority information.

[0068] Based on the operation information by the operator, the management server 10 newly sets the operation authority information of the robot 30 (step Sa10), and returns to step Sa2. Then, the management server 10 determines whether the operator has a legitimate operation authority based on the changed operation authority information of the robot 30. Since the subsequent processing has already been described, it is omitted here.

[0069] On the other hand, when the management server 10 determines that the operation authority information of the robot 30 should not be newly set (step Sa9; NO), it returns to step Sa2 and determines whether the operator has a legitimate operation authority. Since the subsequent processing has already been described, it is omitted here.

[0070] As described above, according to this embodiment, the operator can obtain a video showing the state inside the facility by using the robot 30 or the camera mounted on the operator terminal 20a, and distribute this video to the viewers in real time. On the other hand, the viewers can enjoy a live video full of a sense of presence as if they were inside the facility by watching the video distributed in real time.

[0071] B. Modified Example Although not specifically mentioned in the above-described embodiment, when the operator terminal 20a and the viewer terminal 20b are equipped with a tactile feedback function (such as a vibration motor or a resonant actuator), the tactile data acquired from the robot 30 may be fed back to the operator terminal 20a and the viewer terminal 20b.

[0072] As an example, the robot 30 uses a mounted tactile sensor or the like to detect information that can sense the tactile sensation of a human hand or the like. The robot 30 transmits the detected information as tactile data to the management server 10. The management server (distribution unit) 10 transmits the tactile data acquired by the robot 30 to the operator terminal 20a and the viewer terminal 20b equipped with the tactile feedback function. According to such a configuration, an operator, a viewer, etc. can realistically experience the feeling when the robot 30 touches an object (for example, a living thing).

[0073] Also, in the above-described embodiment, an example of the mode in which the same video is distributed to the operator terminal 20a and the viewer terminal 20b is illustrated, but the gist is not limited to this. For example, for the viewer terminal 20b, the viewer may be able to select (set) in advance the type of video to be distributed.

[0074] The viewer operates the viewer terminal 20b to select only the facility video P22 acquired by the robot 30 as the video to be distributed (hereinafter also referred to as the distribution target video). The viewer terminal 20b sends a request for the distribution target video to the management server 10 in response to such a selection operation. When the management server (distribution unit) 10 receives a request for the distribution target video from the viewer terminal 20b, it processes the video acquired from the robot 30 and the operator terminal 20a based on the received request for the distribution target video, and distributes the processed video to the viewer terminal 20b as the distribution target video. According to such a configuration, it becomes possible to provide a video (content) with a higher degree of satisfaction to viewers and the like.

[0075] Also, it may be configured such that a pointer can be superimposed on any part of the video distributed to the viewer terminal 20b or the like. The operator operates the operator terminal 20a to specify the location where the pointer should be displayed and the like. The operator terminal 20a sends such a display operation to the management server 10. When the management server (distribution unit) 10 receives the display operation from the operator terminal 20a, it generates a video with a pointer superimposed on any part of the video (hereinafter also referred to as a superimposed video), and distributes it to the viewer terminal 20b or the like. As a result, on the display device of the viewer terminal 20b or the like, a screen P3 of the superimposed video with the pointer Po superimposed on any part is displayed (see FIG. 9).

[0076] According to such a configuration, the operator can easily introduce to viewers, for example, the ecology of rare animals that are rarely seen, by using the pointer. Note that not only the pointer but also comments by the operator may be configured to be superimposable.

[0077] C. Others The embodiments and modifications described above are for facilitating the understanding of the present invention and are not for limiting and interpreting the present invention. Each element and its arrangement, material, condition, shape, size, etc. are not limited to those illustrated and can be changed as appropriate. Also, it is possible to partially replace or combine each element with each other.

[0078] Furthermore, in the present embodiments and modifications, the "part" and "device" do not simply mean physical means, but also include cases where the functions of the "part" and "device" are realized by software. Also, even if the function of one "part" or "device" is realized by two or more physical means or devices, or the functions of two or more "parts" or "devices" are realized by one physical means or device, it is acceptable.

Explanation of Reference Numerals

[0079] 1... Video distribution system, 10... Management server, 11... Memory unit, 12... Control unit, 13... Receiver, 14... Transmitter, 15... Distribution unit, 20a... Operator terminal, 20b... Viewer terminal, 30... Robot, IF1... User information, IF2... Operation authority information.

Claims

1. A first receiving unit that receives a first video acquired by a robot; A second receiving unit that receives operation information of the robot from an operator's terminal; A third receiving unit that receives a second video acquired by the operator's terminal; A transmitting unit that transmits the operation information of the robot to the robot; A distribution unit that distributes the first video and the second video to a viewer's terminal, and when the distribution unit receives a display operation of a pointer by the operator, generates a superimposed video in which the pointer is superimposed on the first video according to the display operation, and distributes the superimposed video to the viewer's terminal. A video distribution system.

2. A first receiving unit that receives a first video acquired by a robot; A second receiving unit that receives operation information of the robot from an operator's terminal; A third receiving unit that receives a second video acquired by the operator's terminal; A transmitting unit that transmits the operation information of the robot to the robot; A distribution unit that distributes the first video and the second video to a viewer's terminal, and the viewer's terminal has a tactile feedback function, and the distribution unit transmits tactile data acquired by the robot to the viewer's terminal. A video distribution system.

3. The video distribution system according to claim 1 or 2, further comprising a control unit that controls reception of the operation information of the robot based on operation authority information that defines operation authority for the robot.

4. When the control unit receives a setting operation of the operation authority information by the operator, the control unit sets new operation authority information according to the setting operation, and determines whether to permit reception of the operation information of the robot based on the set new operation authority information. The video distribution system according to claim 3.

5. When the distribution unit receives a request for a distribution target video from the viewer, the distribution unit processes the first video and the second video based on the request, and distributes the processed video to the viewer's terminal. The video distribution system according to any one of claims 1 to 4.

6. A first receiving unit that receives a first video acquired by a robot; A second receiving unit that receives operation information of the robot from an operator's terminal; A third receiving unit that receives a second video acquired by the operator's terminal; A transmitting unit that transmits the operation information of the robot to the robot; A distribution unit that distributes the first video and the second video to a viewer's terminal, and The distribution unit is a server device that, when receiving a pointer display operation by the operator, generates an overlay video in which the pointer is overlaid on the first video according to the display operation, and distributes the overlay video to the viewer's terminal.

7. A first receiving unit that receives a first video acquired by a robot; A second receiving unit that receives operation information of the robot from the operator's terminal; A third receiving unit that receives a second video acquired by the operator's terminal; A transmitting unit that transmits the operation information of the robot to the robot; A distribution unit that distributes the first video and the second video to the viewer's terminal, and the viewer's terminal has a tactile feedback function, The distribution unit is a server device that transmits tactile data acquired by the robot to the viewer's terminal.

8. A program for causing a computer to function as a first receiving unit that receives a first video acquired by a robot; function as a second receiving unit that receives operation information of the robot from the operator's terminal; function as a third receiving unit that receives a second video acquired by the operator's terminal; function as a transmitting unit that transmits the operation information of the robot to the robot; function as a distribution unit that distributes the first video and the second video to the viewer's terminal, and when the distribution unit receives a pointer display operation by the operator, generates an overlay video in which the pointer is overlaid on the first video according to the display operation, and distributes the overlay video to the viewer's terminal.

9. A program for causing a computer to function as a first receiving unit that receives a first video acquired by a robot; function as a second receiving unit that receives operation information of the robot from the operator's terminal; function as a third receiving unit that receives a second video acquired by the operator's terminal; function as a transmitting unit that transmits the operation information of the robot to the robot; function as a distribution unit that distributes the first video and the second video to the viewer's terminal, and the viewer's terminal has a tactile feedback function, and the distribution unit is a program that transmits tactile data acquired by the robot to the viewer's terminal.

Images