Server device, distribution system and control method thereof

Abstract

To provide a distribution control technique for shooting data utilizing robots.SOLUTION: A robot 30 transmits shooting data for distribution acquired by a first camera C1 and personal shooting data acquired by a second camera C2 to a management server 10 (S1 and S2). Upon receiving the shooting data for distribution from the robot 30, the management server 10 stores it in a shooting database for distribution DB1 and distributes it live to terminals 20 of respective users (S3). Upon receiving the personal shooting data from the robot 30, the management server 10 stores it in a personal shooting database DB2 and only transmits it to the terminal 20 of a specific user who gave the shooting instructions (S4).SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a server device, a distribution system, and a control method thereof. [Background technology]

[0002] In recent years, video conferencing systems using the Internet have become widespread, and robots (e.g., telepresence robots) are known that not only allow users to talk face-to-face, but also allow users in remote locations to control the direction and position of the camera (see Patent Document 1).

[0003] Robots are expected to be used in a variety of fields. For example, if a robot is installed in an art museum, museum, aquarium, or other facility, users living in a remote location can remotely control the robot and use it as their avatar, allowing them to view various exhibits as if they were actually in the facility. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-062308 Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, with the recent increase in the functionality of electronic devices, real-time distribution of video data, such as live television broadcasts, using smartphones and the like (so-called live distribution) has been attracting attention.

[0006] By applying this type of live streaming to robots, for example, an operator operating a robot within a facility could use the robot's onboard camera to capture video, images, audio, and other data (hereinafter referred to as "photographed data") from within the facility, and then live-stream this to viewers, or the operator could later edit the photographed data as appropriate to create original content. However, no technology that meets this need has yet been proposed.

[0007] The present invention has been made in consideration of the above-described circumstances, and one of its objects is to provide a technology for controlling distribution of photographed data using a robot. [Means for solving the problem]

[0008] A distribution system according to one embodiment of the present disclosure is a system including a robot that operates based on operation information received via a communication network, and a server device that controls the operation of the robot, wherein the robot includes an imaging unit that includes a first camera that acquires shooting data for distribution in accordance with a first shooting instruction from an operator, and a second camera that acquires personal shooting data in accordance with a second shooting instruction from users including the operator and viewers, and a transmission unit that transmits the shooting data for distribution and the personal shooting data to the server device, and the server device includes a distribution unit that distributes the shooting data for distribution to each user's terminal, and a transmission unit that transmits the personal shooting data to the terminal of the user that issues the second shooting instruction. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a technique for controlling distribution of photographed data using a robot. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing a network configuration of a distribution system according to an embodiment of the present invention; [Figure 2] FIG. 1 is an image diagram for explaining an overview of a distribution system. [Figure 3]FIG. 10 is a diagram illustrating a live screen. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of a management server. [Figure 5] FIG. 2 is a block diagram showing the functional configuration of the robot. [Figure 6] FIG. 2 is a diagram showing the hardware configuration of computers implemented in the management server, the operator terminal, and the viewer terminal. [Figure 7] FIG. 2 is a diagram illustrating the hardware configuration of a computer implemented in the robot. [Figure 8] 10 is a flowchart illustrating an example of a process executed by a management server. [Figure 9] FIG. 10 is a diagram illustrating an example of a destination setting screen according to Modification 1. [Figure 10] FIG. 10 is a diagram illustrating an example of a shooting restriction setting screen according to Modification 2. [Figure 11] FIG. 11 is a diagram illustrating a live screen according to Modification 3. DETAILED DESCRIPTION OF THE INVENTION

[0011] An embodiment of the present invention will be described below. Note that the following embodiment is an example for explaining the present invention, and is not intended to limit the present invention to only this embodiment. Furthermore, the present invention can be modified in various ways without departing from the gist of the present invention. Furthermore, a person skilled in the art can adopt an embodiment in which each element described below is replaced with an equivalent, and such an embodiment is also included in the scope of the present invention. Furthermore, for ease of understanding, the following description will be given taking as an example an embodiment in which the present invention is realized using an information processing device (or computer), but the present invention is not limited thereto.

[0012] A. This embodiment FIG. 1 illustrates a network configuration of a distribution system 1 according to the present embodiment. The distribution system 1 includes free-standing robots 30, operator terminals 20a capable of operating each robot 30, a management server 10 that live-streams image data acquired by the robots 30, and viewer terminals 20b capable of receiving and viewing the live-streamed image data. The robots 30, the operator terminals 20a, the viewer terminals 20b, and the management server 10 are capable of communicating with each other via a communication network N. While FIG. 1 illustrates one robot 30, one operator terminal 20a, two viewer terminals 20b, and one management server 10, the number of robots 30, operator terminals 20a, viewer terminals 20b, and management servers 10 may be any number. In the following description, when there is no need to distinguish between operators and viewers, they will be referred to as "users," and the operator terminals 20a and viewer terminals 20b will be referred to as "user terminals 20."

[0013] One or more portions of the communication network N may be a wired network or a wireless network, and the communication network N may include, by way of example and without limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the public switched telephone network (PSTN), a cellular network, integrated service digital networks (ISDNs), wireless LANs, long term evolution (LTE), code division multiple access (CDMA), short range wireless communications such as Bluetooth, satellite communications, or a combination of two or more thereof.

[0014] <Outline of Distribution System 1> FIG. 2 is an image diagram for explaining an overview of the distribution system 1. As shown in FIG. The robot 30 is installed in a facility such as an aquarium. The robot 30 is equipped with a first camera C1 that acquires shooting data for distribution and a second camera C2 that acquires shooting data for personal use. The first camera C1 can be operated by an operator who has the authority to operate the robot 30. On the other hand, the second camera C2 can be operated not only by the operator but also by viewers who watch the live-streamed shooting data. In this embodiment, it is assumed that the second camera C2 has higher resolution and functionality than the first camera C1, but this is not limited to this. Hereinafter, an instruction from the operator to acquire shooting data for distribution will be referred to as a "first operation instruction," and an instruction from each user to acquire personal shooting data will be referred to as a "second operation instruction."

[0015] The robot 30 transmits the photographed data for distribution acquired by the first camera C1 and the photographed data for personal use acquired by the second camera C2 to the management server 10 (S1, S2).

[0016] When the management server 10 receives the photographed data for distribution from the robot 30, it stores the photographed data in the photographed data for distribution database DB1 and also distributes the data live to the terminals 20 of the respective users (S3).

[0017] On the other hand, when the management server 10 receives personal photography data from the robot 30, it stores it in the personal photography database DB2 and transmits it only to the terminal 20 of the specific user who gave the photography instruction (i.e., the second operation instruction) (S4).

[0018] FIG. 3 is a diagram illustrating an example of a live screen P1 displayed on the terminal 20 of the user who has issued the second operation instruction. The live screen P1 not only displays a live image P11 based on the image data for distribution acquired by the first camera C1 of the robot 30, but also displays a pinpoint image P12 based on personal image data acquired by the second camera C2 of the robot 30 in response to a user's instruction to take a picture. Here, an enlarged image of a living thing in which the user has shown interest is displayed as the pinpoint image P12.

[0019] As described above, according to this embodiment, each user's terminal 20 displays a live image P11 based on the image data for distribution, and if the user instructs the terminal 20 to take a picture, a pinpoint image P12 based on personal image data is also displayed. By viewing these images, each user can enjoy a realistic live experience, as if they were actually inside the facility. The configurations of the management server 10, the operator terminal 20a, the viewer terminal 20b, and the robot 30 will be described below.

[0020] <Configuration> The management server 10 is configured with an information processing device such as a server computer, and has functions such as controlling the operation of the robot 30, live streaming the shooting data for distribution acquired by the robot 30 to each user's terminal 20, and, when personal shooting data is acquired by the robot 30, transmitting the data to the terminal 20 of the specific user who instructed the shooting. The management server 10 may be configured with one information processing device, or may be configured with multiple information processing devices, such as cloud computing or edge computing. The detailed functions of the management server 10 will be described later.

[0021] The operator terminal 20a is an information processing device used by an operator to operate the robot 30. The operator terminal 20a has an input unit that accepts input of operation information by the operator, a display unit that displays photographic data acquired by the robot 30, and a communication unit that transmits and receives various data to and from the management server 10 and the robot 30 via the communication network N.

[0022] The operator terminal 20a is, for example, a general-purpose or dedicated information processing device such as a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), a personal computer, a head-mounted display, or an operating system for a specific purpose. The operator terminal 20a may be configured as an information processing device dedicated to operating the robot 30. Note that, in order to remotely operate the robot 30, a VR device, a haptic glove, or the like may be used as the operator terminal 20a.

[0023] The viewer terminal 20b is an information processing device used by a viewer, and enables the viewer to view the captured data acquired by the robot 30. The viewer terminal 20b is, for example, a general-purpose or dedicated information processing device such as a smartphone, a tablet terminal, a PDA (Personal Digital Assistant), a personal computer, a head-mounted display, or an operating system for a specific purpose.

[0024] The robot 30 may be, for example, a telepresence robot or an avatar robot, and may have a moving part such as wheels. The robot 30 has an image / audio input part including a camera, a microphone, etc., a driving part that can be remotely controlled by the operator terminal 20a, and a communication part that transmits and receives various data to and from the management server 10, the operator terminal 20a, and the viewer terminal 20b via a communication network N. The robot 30 is placed in various locations, and one or more robots 30 are installed in a facility such as an aquarium. These robots 30 are not fixed in place, and "not fixed" includes a mobile robot 30 having a driving part such as wheels for movement, and a wearable robot 30 having a driving part such as a manipulator that can be worn by a person and operates.

[0025] A mobile robot is shown, for example, in Patent Document 1. The moving parts of a mobile robot include those that run on one, two, or multiple wheels, those that run on caterpillar tracks, those that run on rails, those that move by hopping, those that walk on two, four, or multiple legs, those that navigate on or underwater using propellers, and those that fly using propellers or the like. A wearable robot is disclosed, for example, in MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami, "Fusion: Full Body Surrogacy for Collaborative Communication," Proceeding SIGGRAPH '18 ACM SIGGRAPH 2018 Emerging Technologies Article No. 7. Furthermore, the robot 30 may be an autonomous or semi-autonomous vehicle or heavy machinery, a drone, or an airplane. The robot 30 may also be a robot equipped with a camera that is installed in a sports stadium or the like and can move on rails. The robot 30 may be a satellite-type robot launched into space, and may be capable of controlling its attitude and the direction of camera photography. The robot 30 may also be equipped with a robot hand or robot arm that can grasp or suck an object.

[0026] The robot 30 operates based on commands from the operator terminal 20a for which user authentication has been successful. Here, the user authentication may be performed using a known method, and information for user authentication may be registered in advance.

[0027] (Functional configuration of management server 10) FIG. 4 is a block diagram showing the functional configuration of the management server (server device) 10. As shown in FIG. The management server 10 has, as its main functional components, a storage unit 11, a control unit 12, a receiving unit 13, a transmitting unit 14, and a distribution unit 15. The functions of the management server 10 are realized by the processor of the management server 10 executing programs stored in the storage unit 11, etc.

[0028] The storage unit 11 includes a delivery photography database DB1, a personal photography database DB2, a user database DB3, an operation authority database DB4, and the like.

[0029] The photography database for distribution DB1 stores photography data for distribution acquired by the first camera C1 of the robot 30. The photography data for distribution includes date and time information and location information indicating the date and time and location at which the photography data was acquired, a robot ID for identifying the robot 30, and the like.

[0030] The personal photography database DB2 stores personal photography data acquired by the second camera C2 of the robot 30. The personal photography data includes date and time information and location information indicating the date and time and location at which the photography data was acquired, a robot ID for identifying the robot 30, and a user ID for identifying a specific user (for example, operator A or viewer B) who instructed the personal photography.

[0031] User information is stored in the user database DB3. The user information is personal information of users who are allowed to use the system 1, and includes a user ID for identifying each user (such as an operator or viewer), and user attribute information relating to the user's attributes, such as the user name, gender, age, family composition, address, contact details, email address, place of employment, annual income, hobbies, and preferences.

[0032] The operation authority database DB4 stores operation authority information. The operation authority information is information relating to the operation authority of the robot 30. The operation authority information includes a robot ID for identifying the robot 30 to be operated, an operator ID for identifying a user (i.e., an operator) who has the operation authority of the robot 30, and information specifying the range of operation allowed by the operator (for example, operation time, operation content, etc.; hereinafter, "operable range"). Note that the operation authority information may be preset and fixed, or may be configured to be freely set and changeable by the operator, etc.

[0033] The control unit 12 controls the acceptance of operation information of the robot 30 according to the operation authority information of the robot 30 set as described above. Specifically, when the control unit 12 receives operation information of the robot 30 from the operator terminal 20a or the like, the control unit 12 determines whether to permit acceptance of the operation information by referring to the operation authority information. For example, if the control unit 12 determines that the operator does not have legitimate operation authority based on the comparison result between the operation information and the operation authority information, it rejects acceptance of the operation information. On the other hand, if the control unit 12 determines that the operator has legitimate operation authority based on the comparison result between the operation information and the operation authority information, it permits acceptance of the operation information.

[0034] The receiving unit 13 receives various data transmitted from the robot 30 and each user's terminal 20 (i.e., the operator terminal 20a and the viewer terminal 20b). For example, the receiving unit 13 receives image data for distribution or personal use acquired by the robot 30, operation information of the robot 30 transmitted from the operator terminal 20a, and the like.

[0035] The transmitting unit 14 transmits the operation information of the robot 30 received from the operator terminal 20a to the corresponding robot 30. The transmitting unit (first transmitting unit) 14 also transmits a first photographing instruction to the robot 30 instructing the operator to photograph for distribution, and transmits a second instruction to the robot 30 instructing each user to photograph for personal use. Furthermore, the transmitting unit (second transmitting unit) 14 transmits personal photographing data acquired by the robot 30 to the terminal 20 of the specific user who instructed the photographing.

[0036] The distribution unit 15 live-distributes the photographed data for distribution acquired by the robot 30 to each user's terminal 20. Each user's terminal 20 displays the live-distributed photographed data on a display device.

[0037] (Functional configuration of robot 30)

[0038] FIG. 5 is a block diagram showing the functional configuration of the robot 30. The robot 30 has, as its main functional components, an imaging unit 31, a memory unit 32, a receiving unit 33, and a transmitting unit 34. The functions of the robot 30 are realized by the processor of the robot 30 executing a program stored in the memory unit 32, etc.

[0039] The imaging unit 31 obtains imaging data of various objects (for example, exhibits, living creatures, etc.) within the facility in accordance with operational instructions from the user.

[0040] The storage unit 32 stores various data and programs, as well as photographed data for distribution and photographed data for personal use acquired by the cameras C1 and C2.

[0041] The receiving unit 33 receives various data transmitted from the management server 10 and each user's terminal 20 (i.e., the operator terminal 20a and the viewer terminal 20b). For example, the receiving unit 33 receives operation information of the robot 30 transmitted from the operator terminal 20a.

[0042] The transmitting unit 34 transmits the personal photographic data acquired by the robot 30 via the management server 10 to the terminal 20 of the specific user who instructed the photographing.

[0043] (Physical configuration of the management server 10, the operator terminal 20a, and the viewer terminal 20b) FIG. 6 is a diagram showing the hardware configuration of a computer (information processing device) 200 implemented in the management server 10, the operator terminal 20a, and the viewer terminal 20b.

[0044] The computer 200 includes a central processing unit (CPU) 210a corresponding to a calculation unit, a random access memory (RAM) 210b corresponding to a storage unit, a read-only memory (ROM) 210c corresponding to a storage unit, a communication device 210d, an input device 210e, a display device 210f, an audio device 210g, and a camera 210h. These components are connected via a bus so that they can transmit and receive data to and from each other. While this example describes a case where the computer 200 is configured by a single computer, the computer 200 may also be realized by combining multiple computers. The configuration shown in FIG. 6 is an example, and the computer 200 may have other components or may not have some of these components.

[0045] The CPU 210a is a control unit that controls the execution of programs stored in the RAM 210b or the ROM 210c and performs data calculations and processing. The CPU 210a is a calculation unit that executes programs for live streaming of photographed data using the robot 30 and displaying the live-streamed photographed data. The CPU 210a receives various data from the input device 0e and the communication device 210d, and displays the results of calculations on the data on the display device 210f, outputs sound from the audio device 210g, and stores the data in the RAM 210b.

[0046] The RAM 210b is a storage unit in which data can be rewritten, and may be configured, for example, with a semiconductor memory element. The RAM 210b may store data such as various programs executed by the CPU 210a. Note that these are merely examples, and the RAM 210b may store data other than these, or may not store some of these.

[0047] The ROM 210c is a storage unit from which data can be read, and may be configured, for example, with a semiconductor memory element. The ROM 210c may store, for example, programs and data that are not rewritten.

[0048] The communication device 210d is an interface that connects the computer 200 to other devices via the communication network N.

[0049] The input device 210e accepts data input and may include, for example, a keyboard and a touch panel, and may also include a microphone for voice input.

[0050] The display device 210f visually displays the results of calculations performed by the CPU 210a and may be configured with, for example, an LCD (Liquid Crystal Display). The display device 210f may display photographic data for distribution or personal photographic data acquired by the robot 30.

[0051] The sound device 210g is for outputting sound and may include, for example, an audio decoder and a speaker.

[0052] The camera 210h includes an imaging element that captures still images or moving images, and transmits the captured still images, moving images, etc. as imaging data to the display device 210f and the robot 30. The imaging data may also include sound, etc.

[0053] (Physical configuration of robot 30) FIG. 7 is a diagram showing the hardware configuration of a computer (information processing device) 300 implemented in the robot 30. As shown in FIG.

[0054] The computer 300 includes a CPU 310a corresponding to a calculation unit, a RAM 310b corresponding to a storage unit, a ROM 310c corresponding to a storage unit, a communication device 310d, an input device 310e, a display device 310f, a drive device 310g, and a camera 310h. These components are connected via a bus so that they can transmit and receive data to and from each other. Note that the configuration shown in FIG. 7 is an example, and the computer 300 may include other components or may not include some of these components.

[0055] The CPU 310a is a control unit that controls the execution of programs stored in the RAM 310b or the ROM 310c and performs data calculations and processing. The CPU 310a is a calculation unit that executes programs for obtaining moving images using the robot 30. The CPU 310a receives various data from the input device 310e and the communication device 310d, and displays the results of calculations on the data on the display device 310f and stores them in the RAM 310b. The CPU 310a also controls the drive device 310g, which controls the operation of the robot 30.

[0056] The RAM 310b is a rewritable storage device and may be implemented, for example, by a semiconductor memory device. The RAM 310b may store various programs executed by the CPU 310a. Note that these are merely examples, and the RAM 310b may store other data or may not store all of the programs.

[0057] The ROM 310c is a storage unit from which data can be read, and may be configured, for example, with a semiconductor memory element. The ROM 310c may store, for example, programs and data that are not rewritten.

[0058] The communication device 310d is an interface that connects the robot 30 to other devices via the communication network N.

[0059] The input device 310e accepts data input and may include, for example, a keyboard and a touch panel, and may also include a microphone for voice input.

[0060] The display device 310f visually displays the results of calculations performed by the CPU 310a, and may be configured with, for example, an LCD. The display device 310f may also display video images captured by a camera on the robot 30.

[0061] The driving device 310g includes a remotely controlled actuator, a moving part such as wheels, a manipulator, etc. When the robot 30 is a mobile robot, the driving device 310g includes at least a moving part such as wheels, but may also include a manipulator. When the robot 30 is a wearable robot, the driving device 310g includes at least a manipulator.

[0062] Camera 310h includes a first camera C1 that acquires image capture data for distribution in accordance with an operation instruction (first operation instruction) from an operator, and a second camera C2 that acquires personal image capture data in accordance with an operation instruction (second operation instruction) from each user. Camera 310h includes an imaging element that captures still images or videos, and transmits the captured still images, videos, etc. as image capture data to display device 310f, management server 10, etc. Note that the image capture data may also include audio, etc.

[0063] <Processing flow> 8 is a flowchart showing an example of processing executed by the management server 10 according to this embodiment. It is assumed that an operator X is permitted to remotely operate a robot 30 installed in a facility, and that a specific viewer Y uses the robot 30 to obtain personal shooting data while the operator X is remotely operating the robot 30.

[0064] The operator X operates the operator terminal 20a to start remotely controlling the robot 30 in order to live stream the state of the facility to viewers. When the operator terminal 20a accepts the operation by the operator X, it transmits operation information including the operator ID and the like to the management server 10. The operation information transmitted to the management server 10 includes an instruction by the operator X to acquire photographed data for distribution (i.e., a first operation instruction).

[0065] When the management server 10 receives operation information including a first operation instruction from the operator terminal 20a (step Sa1), it transmits the operation information to the robot 30 (step Sa2).

[0066] When the robot 30 receives the operation information from the management server 10, the robot 30 starts acquiring photographic data for distribution by the first camera C1 in accordance with the first operation instruction included in the operation information. Then, the robot 30 sequentially transmits the acquired photographic data for distribution to the management server 10.

[0067] When the management server 10 sequentially receives the photographed data for distribution acquired by the robot 30 (step Sa3), it stores the photographed data in the photographed data for distribution database DB1 and transmits the data to each user's terminal 20 (operator terminal 20a and viewer terminal 20b), thereby starting live distribution (step Sa4). Each user starts viewing the live image or the like using their own terminal 20.

[0068] After starting the live distribution, the management server 10 starts to determine whether or not a second operation instruction has been issued by any user (step Sa5). If the management server 10 does not receive the second operation instruction (step Sa5; NO), the management server 10 returns to step Sa4 and continues the live distribution.

[0069] On the other hand, when the management server 10 receives a second operation instruction from the viewer terminal 20b of the viewer Y, for example, by the viewer Y inputting an instruction to obtain personal shooting data (i.e., a second operation instruction) (step Sa5; YES), it transmits the second operation instruction to the robot 30 (step Sa6).

[0070] When the robot 30 receives the second operation instruction from the viewer Y from the management server 10, the robot 30 starts acquiring personal photographed data by the second camera C2 in accordance with the second operation instruction. The robot 30 sequentially transmits the acquired personal photographed data to the management server 10.

[0071] When the management server 10 receives the personal photographic data acquired by the robot 30 (step Sa7), it transmits it only to the terminal 20 of the specific user who instructed the photographing (here, viewer terminal 20b of viewer Y) (step Sa8).

[0072] As a result, not only the live image P11 but also the pinpoint image P12 that viewer Y instructed to be captured is displayed on viewer terminal 20b of viewer Y (see FIG. 3). This allows each user to enjoy a live experience that is so realistic it makes them feel as if they were actually inside the facility.

[0073] Furthermore, each user can use the robot 30 to edit pinpoint image P12 and other images (i.e., personal shooting data) that they have taken themselves, to create original content. To explain this in an example, a user (assumed to be viewer Y here) who has acquired personal shooting data later uses his or her own terminal 20 to access the management server 10. Viewer Y selects the personal shooting data for which he or she has instructed the shooting, and instructs various editing (insertion of subtitles, comments, sound effects, advertisements, etc.). In this case, viewer Y may perform various editing operations by appropriately combining not only his or her personal shooting data, but also shooting data for distribution. The management server (editing department) 10 generates original content by editing personal shooting data, etc., based on instructions from viewer Y, and presents it on viewer terminal 20b of viewer Y. Later, viewer Y uses, for example, a social networking service (SNS) to share the generated original content with various groups and people (for example, friends, family, etc.).

[0074] With this configuration, each user can create original content based on the personal shooting data they have acquired, allowing them to share the excitement they felt through the live experience with a variety of people. The original content may be automatically generated by the management server 10. Specifically, the management server 10 may automatically edit (for example, insert sound effects) personal shooting data selected by a user to generate the original content. The original content may be free or paid depending on whether or not it contains advertisements.

[0075] B. Variations <Variation 1> In the above-described embodiment, when personal photography is performed using the second camera C2, the personal photography data is transmitted only to the terminal 20 of the user who issued the photography instruction (second operation instruction), but this is not intended to be limiting. For example, the user who issued the second operation instruction may be able to set the destination of the personal photography data themselves. Note that while all users may be able to set the destination, only an operator who has the authority to operate the robot 30 may be able to set the destination. In other words, viewers who do not have the authority to operate the robot 30 may not be able to freely set the destination. Furthermore, the timing for setting the destination is not limited to after the second operation instruction is issued, but may be before the second operation instruction is issued.

[0076] FIG. 9 is a diagram illustrating an example of a destination setting screen P2 displayed on the operator terminal 20a when the operator issues a second operation instruction. The operator operates the operator terminal 20a to input that a specific viewer (for example, viewers A1 to A5) is to be set as the destination. When the management server (first reception unit) 10 receives the setting of the destination of the personal photographed data from the operator terminal 20a, it reads out the user information (email address, etc.) of the destination from the storage unit 11. Thereafter, when the management server (transmission unit) 10 receives the personal photographed data by the operator from the robot 30, it transmits the personal photographed data by the operator to the set destination.

[0077] With this configuration, the operator can encourage active communication by sharing acquired personal photographic data (for example, enlarged photos of valuable exhibits) with specific viewers in real time. In the above example, specific viewers are set as destinations, but people other than viewers (for example, family members or friends) may also be set as destinations.

[0078] <Variation 2> Furthermore, the acquisition of personal photographed data may be restricted. For example, certain facilities such as art galleries and museums may impose some restrictions on photography, such as setting up no-photography areas. In particular, since personal photography can be performed not only by the operator but also by viewers, there is a concern that personal photography may be performed in places where photography is prohibited, if no restrictions are imposed. To prevent such problems, for example, the operator who has the authority to operate the robot 30 may be able to set photography restriction information that restricts the acquisition of personal photographed data.

[0079] FIG. 10 is a diagram illustrating an example of the photographing restriction setting screen P3 displayed on the operator terminal 20a. 10, the photography restriction information can be set to include photography-prohibited areas that prohibit the acquisition of personal photography data, objects that prohibit photography (valuable exhibits, etc.), time periods during which photography is prohibited, etc. Furthermore, rather than completely prohibiting photography, it may be possible to restrict photography in specific modes, such as prohibiting flash photography.

[0080] The operator inputs the above-mentioned photography restriction information by operating the operator terminal 20a. When the management server (second reception unit) 10 receives the setting of photography restriction information from the operator terminal 20a, it stores it in the memory unit 11. Thereafter, when the management server (transmission unit, determination unit) 10 receives an instruction to acquire personal photography data from any user, it determines whether or not to permit personal photography (i.e., second photography instruction) based on the sensing information of the robot 30 and the photography restriction information. The sensing information of the robot 30 includes, for example, position information, time information, image information, etc. of the robot 30, and this information is acquired by various sensors (GPS sensor, timer, camera, etc.) mounted on the robot 30.

[0081] When the management server (notification unit) 10 permits photography, for example, because the robot 30 is not in a photography prohibited area, it notifies the robot 30 of a second photography instruction. The robot 30 starts acquiring personal photography data by the second camera C2 in accordance with the second photography instruction notified from the management server 10. The subsequent operations are the same as those in this embodiment, and therefore will not be described here.

[0082] In the above example, the operator sets the photography restriction information, but the present invention is not limited to this. For example, the photography restriction information may be set by a facility manager or a system operator. Alternatively, the photography restriction information may be registered on a predetermined website, and the robot 30 may access and download the information as needed.

[0083] <Variation 3> FIG. 11 is a diagram illustrating a live screen P4 displayed on the terminal 20 of each user according to the third modification. The live screen P4 not only displays a live image P11 based on the shooting data for distribution and a pinpoint image P12 based on personal shooting data, but also displays a facial image P13 of the operator acquired by the operator terminal 20a and facial images P14 of viewers who have donated a predetermined amount or more. By displaying such live screens in real time on each user's terminal 20, each viewer can enjoy a more realistic live experience.

[0084] C. Other The above-described embodiment and modifications are intended to facilitate understanding of the present invention and are not intended to limit the present invention. The elements, their arrangement, materials, conditions, shapes, sizes, etc. are not limited to those exemplified and can be modified as appropriate. Furthermore, elements can be partially substituted or combined with each other.

[0085] Furthermore, in this embodiment and its modifications, a "unit" or "device" does not simply mean a physical means, but also includes cases where the functions of the "unit" or "device" are realized by software. Also, the functions of one "unit" or "device" may be realized by two or more physical means or devices, or the functions of two or more "units" or "devices" may be realized by one physical means or device. [Explanation of symbols]

[0086] 1...Distribution system, 10...Management server, 11...Memory unit, 12...Control unit, 13...Receiving unit, 14...Transmitting unit, 15...Distribution unit, 20a...Operator terminal, 20b...Viewer terminal, 30...Robot, 31...Imaging unit, 32...Memory unit, 33...Receiving unit, 34...Transmitting unit, DB1...Distribution shooting database, DB2...Personal shooting database, DB3...User database, DB4...Operation authority database.

Claims

1. A system including a robot that operates based on operation information received via a communication network, and a server device that controls the operation of the robot, The robot an imaging unit including a first camera that acquires imaging data for distribution in accordance with a first imaging instruction from an operator, and a second camera that acquires imaging data for personal use in accordance with a second imaging instruction from users including the operator and viewers; a transmission unit that transmits the distribution photographed data and the personal photographed data to the server device, The server device a distribution unit that distributes the photographed data for distribution to each of the users' terminals; a transmission unit that transmits the personal photographing data to a terminal of the user that issues the second photographing instruction; an editing unit that edits the personal photographed data in accordance with an instruction from the user who issues the second photographing instruction; A distribution system comprising:

2. The server device a first reception unit that receives a setting of a destination of the personal photographed data from the user who issues the second photographing instruction; The transmission unit The distribution system according to claim 1 , wherein the personal photographed data is transmitted to a set destination.

3. The first reception unit When the user who issues the second photographing instruction is the operator, accepting a setting of a destination of the personal photographing data; The distribution system according to claim 2 , wherein the destinations include persons other than the operator.

4. The server device a second reception unit that receives setting of photography restriction information that restricts acquisition of the personal photography data; a determination unit for determining whether or not to permit the second photographing instruction based on the photographing restriction information, The distribution system according to claim 1 , wherein the transmission unit transmits the second image capturing instruction that has been permitted to the robot.

5. A system comprising a robot that operates based on operation information received via a communication network, and a server device that controls the operation of the robot, The robot an imaging unit including a first camera that acquires imaging data for distribution in accordance with a first imaging instruction from an operator, and a second camera that acquires imaging data for personal use in accordance with a second imaging instruction from users including the operator and viewers; a transmission unit that transmits the distribution photographed data and the personal photographed data to the server device, The server device a distribution unit that distributes the photographed data for distribution to each of the users' terminals; a transmission unit that transmits the personal photographing data to a terminal of the user that issues the second photographing instruction; a first reception unit that receives a setting of a destination of the personal photographed data from the user who issues the second photographing instruction, The first reception unit When the user who issues the second photographing instruction is the operator, accepting a setting of a destination of the personal photographing data; The transmission unit Sending the personal photographed data to a set destination, A distribution system, wherein the destination includes a person other than the operator.

6. A control method for a system including a robot that operates based on operation information received via a communication network and a server device that controls the operation of the robot, comprising: The robot acquiring photographed data for distribution in accordance with a first photographing instruction from an operator; acquiring personal photographing data in accordance with a second photographing instruction from a user including the operator and a viewer; transmitting the photographed data for distribution and the photographed data for personal use to the server device; The server device The photographed data for distribution is distributed to each of the users' terminals; transmitting the personal photographing data to a terminal of the user who issues the second photographing instruction; A control method for a distribution system, the personal photographed data being edited in accordance with an instruction from the user who issues the second photographing instruction.

7. A server device that controls a robot that operates based on operation information received via a communication network, a first transmission unit that transmits a first photographing instruction to the robot by an operator to instruct the robot to photograph for distribution, and transmits a second photographing instruction to the robot by a user including the operator and a viewer to instruct the robot to photograph for personal use; a receiving unit that receives, from the robot, photographed data for distribution in response to the first photographing instruction and photographed data for personal use in response to the second photographing instruction; a distribution unit that distributes the photographed data for distribution to each of the users' terminals; a second transmission unit that transmits the personal photographing data to a terminal of the user that issues the second photographing instruction; an editing unit that edits the personal photographic data in accordance with an instruction from the user who issues the second photographing instruction; A server device comprising:

Images