Information processing system, information processing device, and information processing method

Abstract

To provide an information processing system, an information processing device, an information processing method, and an information processing program that can stably provide video based on video data transmitted from an autonomously moving mobile device.SOLUTION: An information processing system according to the present disclosure includes an acquisition unit (601) that acquires radio wave conditions in an environment, and a creation unit (602) that creates an operation plan based on the radio wave conditions and radio wave strength required to transmit video data used for distribution.SELECTED DRAWING: Figure 2

Description

Technical Field

[0006] ,

[0001] The present disclosure relates to an information processing system, an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Live distribution is known in which a performance such as a music live is photographed and the photographed video data and audio data are distributed in real time. In live distribution, cost reduction and content expansion are required. Under such a background, it has been proposed to use a robot that autonomously moves for photographing in live distribution.

[0003] When photographing and distributing using a moving robot, it is desirable that the photographed video data and audio data be transmitted wirelessly from the robot. This is because of reasons such as wanting to move freely in all directions on the stage where the performance is being held for photographing and wanting to minimize the impact on the performers and equipment on the stage. Patent Document 1 discloses a mobile robot equipped with wireless communication means and capable of being remotely operated.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when transmitting video data by wireless communication, depending on the radio wave conditions, there is a risk that the quality of the video may deteriorate due to the transmitted video data or the video may be interrupted by the video data. Such deterioration in video quality and interruption of the distributed video are extremely serious problems in live distribution.

[0006] This disclosure aims to provide an information processing system, information processing device, information processing method, and information processing program capable of stably providing video data transmitted from an autonomously moving mobile device. [Means for solving the problem]

[0007] The information processing system relating to this disclosure comprises an acquisition unit that acquires radio wave conditions in the environment, and a creation unit that creates an operation plan based on the radio wave conditions and the radio wave intensity required to transmit video data used for distribution. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram illustrating the video distribution system related to this disclosure. [Figure 2] This is a schematic diagram showing an example configuration of an information processing system as a video distribution system according to the embodiment. [Figure 3] This is an example of a functional block diagram illustrating the functions of the information processing device according to the embodiment. [Figure 4] This is a block diagram showing the hardware configuration of an example of an information processing device according to the embodiment. [Figure 5] This is an example functional block diagram illustrating the functions of a video selection device applicable to the embodiment. [Figure 6] This is a schematic diagram showing an example of a video selection screen displayed on a screen by the display unit of a video selection device, applicable to the embodiment. [Figure 7A] This is a schematic diagram showing an example of the appearance of a mobile device applicable to the embodiment. [Figure 7B] This is a schematic diagram showing an example of the appearance of a mobile device applicable to the embodiment. [Figure 8] Block diagram showing a hardware configuration of an example of a mobile device applicable to the embodiment. [Figure 9] This is an example functional block diagram illustrating the functions of a mobile device applicable to the embodiment. [Figure 10]It is a schematic diagram showing an example of a visualization screen displaying the visualization of radio wave conditions according to the first embodiment and the movement path of a mobile device according to an operation plan. [Figure 11] It is a schematic diagram showing an example of applying the visualization screen according to the first embodiment to a screen representing a three-dimensional space. [Figure 12] It is a schematic diagram showing an example of a visualization screen according to the first modification of the first embodiment. [Figure 13] It is a schematic diagram showing an example of an operation on a slider in a visualization screen according to the first modification of the first embodiment. [Figure 14] It is a schematic diagram for explaining the generation of an electric field strength map and the creation of an operation plan according to the first modification of the first embodiment. [Figure 15] It is a diagram for explaining that the state of radio waves transmitted from a mobile device varies depending on the orientation of the mobile device. [Figure 16] It is a flowchart showing an example of an operation plan creation process according to the second modification of the first embodiment. [Figure 17A] It is a diagram for explaining the division of a path and the takeover of the operation of the mobile device 10 according to the second embodiment. [Figure 17B] It is a diagram for explaining the division of a path and the takeover of the operation of the mobile device 10 according to the second embodiment. [Figure 18] It is a flowchart showing an example of an operation plan creation process according to the second embodiment. [Figure 19] It is a schematic diagram showing an example of a video selection screen by a video selection device according to the third embodiment. [Figure 20] It is a schematic diagram showing an enlarged view of a display area according to the third embodiment. [Figure 21] It is a schematic diagram for explaining a process of obtaining the risk of interruption of a currently distributed video. [Figure 22] It is a flowchart showing an example of a video switching process according to the risk level in a video selection device according to the third embodiment. [Figure 23]It is a schematic diagram for explaining a process of obtaining the risk of interruption of a video being distributed according to a modification of the third embodiment. [Figure 24] It is a schematic diagram showing an example in which a position where video disturbance is detected is reflected in a radio wave situation map according to a modification of the third embodiment.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. In the following embodiments, the same parts are denoted by the same reference numerals, and redundant explanations are omitted.

[0010] Hereinafter, embodiments of the present disclosure will be described in the following order. 1. About the video distribution system related to the present disclosure 2. Configurations applicable to the embodiments of the present disclosure 3. First embodiment 3-1. First modification of the first embodiment 3-2. Second modification of the first embodiment 4. Second embodiment 5. Third embodiment 5-1. Modification of the third embodiment

[0011] [1. About the video distribution system related to the present disclosure] Prior to the description of each embodiment of the present disclosure, for easy understanding, a video distribution system related to the present disclosure will be schematically described. FIG. 1 is a schematic diagram for explaining a video distribution system related to the present disclosure. In the example of FIG. 1, the video distribution system includes a plurality of mobile devices 10, a receiver 20 for receiving video data transmitted from each mobile device 10, a video selection device 40 for selecting video data for distribution from each video data received by the receiver 20, and a robot operation device 30 for remotely operating each mobile device 10.

[0012] The mobile device 10 is equipped with a camera 100 and has a transmitter (not shown) and an antenna 101 for transmitting video data to the receiver 20. Although not shown, the mobile device 10 also has a receiver and an antenna for receiving control signals from the robot operating device 30. Furthermore, the mobile device 10 is equipped with a drive mechanism for rotating and moving its housing, and can change the orientation of the camera 100 and move in response to control signals from the robot operating device 30.

[0013] Each mobile device 10 is positioned, for example, on a stage 50. The stage 50 is where performers 51 who perform, stage equipment, or other equipment (collectively referred to here as equipment, etc. 52) are placed. The mobile devices 10 move on the stage 50 according to control signals transmitted from the robot operation device 30 and pre-programmed movements, and take pictures with the camera 100. In each mobile device 10, the video data obtained from the camera 100 is transmitted by the antenna 101 and received by the receiver 20.

[0014] The receiver 20 transfers the video data received from each mobile device 10 to the video selection device 40. The video selection device 40 may also receive video data from cameras other than the cameras 100 of the mobile devices 10, such as cameras carried by people for filming, or cameras fixed or movable on predetermined pedestals, via wired or wireless communication. The video selection device 40 is a so-called switcher, which displays the video from each video data on a display and selects the video data to output from each video data in real time according to user operations corresponding to the performance of, for example, the performer 51. The video data selected by the video selection device 40 is transferred to, for example, the distribution server 3. The distribution server 3 transmits the transferred video data to, for example, the internet, on a network 2.

[0015] Video data transmitted to network 2 is received by each user terminal 4 connected to network 2. Each user operating each user terminal 4 can view the video data received via network 2 by displaying it on the display of their respective user terminal 4.

[0016] In existing technologies, depending on the relative positions of the receiver 20, the mobile device 10, and the performers 51 and equipment 52 on the stage, there is a possibility that the video data transmitted from the mobile device 10 may have difficulty reaching the receiver 20. In such radio wave conditions, the transmitted video may be interrupted. In video distribution, interruptions in the transmitted video must be avoided.

[0017] In this embodiment, the video distribution system acquires radio wave conditions indicating the radio wave conditions within the environment in which the mobile device 10 operates (for example, on the stage 50). Based on the acquired radio wave conditions and information on radio wave strength necessary and sufficient for transmitting video data, the video distribution system creates an operation plan for each mobile device 10 to move autonomously and perform shooting. Therefore, when shooting while moving with the mobile device 10, interruptions in the distributed video can be avoided. Accordingly, according to this embodiment, it is possible to stably provide video using video data transmitted from autonomously moving mobile devices.

[0018] The radio wave strength refers to the signal strength of the signal received by the receiver 20 when the signal transmitted from the mobile device 10 at a predetermined signal strength is received by the receiver 20. Furthermore, a map of radio wave strengths on the stage 50 can be generated based on the signal strengths of signals transmitted from the mobile device 10 at multiple locations on the stage 50, and location information indicating the location from which the signal was transmitted.

[0019] [2. Configurations applicable to embodiments of this disclosure] Next, a configuration applicable to the embodiments of this disclosure will be described. Figure 2 is a schematic diagram showing the configuration of an example of an information processing system as a video distribution system according to the embodiment.

[0020] In Figure 2, the information processing system 1 includes a mobile device 10, a receiver 20, a video selection device 40, an information processing device 60, and a transmitter 22. The environment in which the mobile device 10 operates is the same as Stage 50 described using Figure 1, so its description is omitted here.

[0021] The mobile device 10 has a camera 100 mounted on a housing 105, as well as antennas 101t and 101r, a transmitter 102 and a receiver 103, and a mobile mechanism 104. The transmitter 102 of the mobile device 10 transmits a signal containing video data captured by the camera 100 from antenna 101t at a predetermined signal strength. Here, the mobile device 10 can acquire position information indicating its own position and transmit the acquired position information included in the signal. The transmitted signal is received by antenna 21 and passed to receiver 20. In addition, a signal transmitted from antenna 23 of transmitter 22 is received by antenna 101r and passed to receiver 103.

[0022] Furthermore, for example, Wi-Fi (Wireless Fidelity) (registered trademark) can be used as the communication method between the mobile device 10 (transmitter 102 and receiver 103) and the receiver 20 and transmitter 22. The communication method between the mobile device 10 and the receiver 20 and transmitter 22 is not limited to Wi-Fi. In addition, data transmission and reception between the receiver 20 and the video selection device 40 and information processing device 60 can be performed using wired or wireless communication. In the case of wireless communication, Wi-Fi can be used.

[0023] Furthermore, although this example describes the receiver 103 and antenna 101r as only receiving signals transmitted from the transmitter 22, this is not limited to this example. For example, the receiver 103 may have both a signal receiving function and a signal transmitting function, enabling bidirectional communication with the transmitter 22 using a predetermined communication method such as Wi-Fi.

[0024] In the mobile device 10, the moving mechanism 104 is provided on the bottom surface of the housing 105 and is driven by a drive unit (not shown) to rotate and move the mobile device 10.

[0025] For the purposes of this explanation, the mobile device 10 is assumed to have an antenna 101t for transmitting signals and an antenna 101r for receiving signals, but this is not limited to this example. For example, the mobile device 10 may transmit and receive signals using only one antenna.

[0026] The receiver 20 transfers the video data received from the mobile device 10 to the video selection device 40. The receiver 20 also measures the intensity of the signal containing the video data received from the mobile device 10 and acquires signal intensity information. The receiver 20 transfers the acquired signal intensity information to the information processing device 60. Here, the signal intensity information may include identification information that identifies the mobile device 10 that transmitted the signal, and position information that indicates the location of the mobile device 10.

[0027] In the following, unless otherwise specified, "transmitting a signal containing video data" will be referred to as "transmitting video data," and "receiving a signal containing video data" will be referred to as "receiving video data," etc.

[0028] The information processing device 60 includes the functions of a radio wave condition acquisition unit 601 and an operation plan creation unit 602.

[0029] The signal strength information transmitted from the receiver 20 is passed to the radio wave condition acquisition unit 601 as radio wave conditions in the environment including the mobile device 10 and the receiver 20. The radio wave condition acquisition unit 601 analyzes the radio wave conditions passed from the receiver 20. The radio wave conditions include, for example, signal strength and location information indicating the location from which the signal was transmitted. In other words, the radio wave condition acquisition unit functions as an acquisition unit that acquires radio wave conditions in the environment. The radio wave condition acquisition unit 601 passes the information indicating the analyzed radio wave conditions to the operation plan creation unit 602.

[0030] The motion plan creation unit 602 creates a motion plan to control the movement path and orientation of the mobile device 10 based on the radio wave condition information received from the radio wave condition acquisition unit 601. In other words, the motion plan creation unit 602 functions as a creation unit that creates a motion plan based on the radio wave condition and the radio wave strength required to transmit the video data used for distribution. The motion plan creation unit 602 then transfers the information indicating the created motion plan to the transmitter 22.

[0031] The transmitter 22 transmits a signal from the antenna 73 that includes information indicating the operation plan transferred from the information processing device 60. This signal is received by the antenna 101r in the mobile device 10 and taken into the mobile device 10 via the receiver 103. The mobile device 10 is controlled to move and rotate according to the movement path and orientation indicated in the operation plan, based on the information indicating the operation plan that it has taken into account.

[0032] Figure 3 is an example of a functional block diagram illustrating the functions of the information processing device 60 according to the embodiment. In Figure 3, the information processing device 60 according to the embodiment includes a radio wave condition acquisition unit 601, an operation plan creation unit 602, a map generation unit 603, a display unit 604, an input unit 605, and a communication unit 606.

[0033] These radio wave condition acquisition unit 601, operation plan creation unit 602, map generation unit 603, display unit 604, input unit 605, and communication unit 606 are configured, for example, by running an information processing program according to the embodiment on a CPU (Central Processing Unit). However, the radio wave condition acquisition unit 601, operation plan creation unit 602, map generation unit 603, display unit 604, input unit 605, and communication unit 606 may be configured by hardware circuits that work together.

[0034] In Figure 3, the display unit 604 generates screen information and displays the screen according to the generated screen information on a display owned by or connected to the information processing device 60. The input unit 605 accepts user input. The communication unit 606 controls communication between the information processing device 60 and external devices. For example, the communication unit 606 controls communication between the information processing device 60 and the video selection device 40, receiver 20, and transmitter 22. The communication unit 606 also controls communication to the network.

[0035] The radio wave condition acquisition unit 601 acquires the radio wave conditions in the environment (for example, on the stage 50) transmitted from the receiver 20. The radio wave condition acquisition unit 601 can, for example, determine the radio wave intensity distribution in the environment based on the radio wave conditions transmitted from each mobile device 10, and acquire the determined radio wave intensity distribution as the radio wave conditions in the environment.

[0036] The motion plan creation unit 602 creates a motion plan to control the operation of each mobile device 10 based on the placement information of performers 51 and various pieces of equipment 52 on the stage 50 and the radio wave conditions acquired by the radio wave conditions acquisition unit 601. Here, the placement information of performers 51 and various pieces of equipment 52 on the stage 50 is assumed to be created in advance as 2D or 3D map information by, for example, a performer who is in charge of the performance on the stage 50, and input into the motion plan creation unit 602.

[0037] The map generation unit 603 generates a radio wave condition map that visualizes the radio wave conditions acquired by the radio wave condition acquisition unit 601. For example, the map generation unit 603 generates a map showing the distribution of radio wave strength as a radio wave condition map based on the signal strength and location information included in the radio wave conditions. The generated radio wave condition map is displayed on the display as a map screen by the display unit 604.

[0038] Figure 4 is a block diagram showing the hardware configuration of an example of an information processing device 60 according to the embodiment. In Figure 4, the information processing device 60 includes a CPU 6000, a ROM (Read Only Memory) 6001, a RAM (Random Access Memory) 6002, a display control unit 6003, a storage device 6004, a data I / F 6005, and a communication I / F 6006, all of which are connected to each other via a bus 6010 so as to be able to communicate with each other.

[0039] The storage device 6004 is a non-volatile storage medium such as a hard disk drive or flash memory. The CPU 6000 operates using the RAM 6002 as work memory according to the programs stored in the ROM 6001 and the storage device 6004, and controls the overall operation of the information processing device 60.

[0040] The display control unit 6003 generates a display signal that can be displayed by the display 6020 based on the display control signal generated by the CPU 6000 according to the program. The display control unit 6003 supplies the generated display signal to the display 6020. The display 6020 displays the screen according to the supplied display signal.

[0041] The data interface (I / F) 6005 is an interface for inputting and outputting data to and from external devices. In this example, an input device 6021, including a pointing device such as a mouse and a keyboard, is connected to the data I / F 6005. However, the input device 6021 may be a device built into the information processing device 60. The communication I / F 6006 controls communication to the network.

[0042] Communication between the information processing device 60, the video selection device 40, the receiver 20, and the transmitter 22 is performed using the data I / F 6005 and the communication I / F 6006 as appropriate.

[0043] In the information processing device 60, the CPU 6000 executes the information processing program according to the embodiment, thereby configuring the above-mentioned radio wave condition acquisition unit 601, operation plan creation unit 602, map generation unit 603, display unit 604, input unit 605, and communication unit 606 as modules, for example, on the main memory area of ​​the RAM 6002.

[0044] The information processing program can be obtained from an external source (e.g., a server) via a network such as a LAN or the Internet, for example, through communication via the communication I / F 6006, and installed on the information processing device 60. However, the information processing program may also be provided stored on a removable storage medium such as a CD (Compact Disk), DVD (Digital Versatile Disk), or USB (Universal Serial Bus) memory.

[0045] In the above description, a single information processing device 60 was described as including the functions of the radio wave condition acquisition unit 601 and the operation plan creation unit 602, but this is not limited to this example. For example, the functions of the radio wave condition acquisition unit 601 and the operation plan creation unit 602 can also be configured to be included in separate information processing devices that are communicated with each other.

[0046] Figure 5 is an example functional block diagram illustrating the functions of a video selection device 40 applicable to the embodiment. In Figure 5, the video selection device 40 includes a video processing unit 400, a display unit 401, and an operation unit 402.

[0047] The display unit 401 displays an image on the display according to the display signal output from the video processing unit 400. The operation unit 402 receives user input and passes control signals corresponding to the user input to the video processing unit 400.

[0048] The video processing unit 400 receives multiple video data as input. The video processing unit 400 performs a synthesis process to display each input video, which is composed of the multiple input video data, and the output video to be output from the video processing unit 400, on a single screen. The video processing unit 400 then transfers a display signal to the display unit 401 for displaying the screen synthesized by the synthesis process on the display.

[0049] Furthermore, the video processing unit 400 outputs the video data of the video selected from each input video as output video data from the video selection device 40 based on user operations on the operation unit 402. In addition, the video processing unit 400 can apply predetermined effect processing to the video data of the video selected from each input video in response to user operations on the operation unit 402.

[0050] Figure 6 is a schematic diagram showing an example of a video selection screen displayed on a display by the display unit 401 of the video selection device 40, which is applicable to the embodiment.

[0051] In Figure 6, the video selection screen 403 includes an output video display area 410 and an input video display area 420. In this example, the output video display area 410 includes a display area 411 where the video being output is displayed and a display area 412 where candidate output videos are displayed.

[0052] On the other hand, the input video display area 420 includes multiple display areas 421, each displaying an input video captured by a different camera. In this example, the input video display area 420 includes multiple (eight in this example) display areas 421, making it possible to view multiple input videos simultaneously. In the example in Figure 6, the input video display area 420 includes eight display areas 421, making it possible to view eight input videos simultaneously. Furthermore, for nine or more input videos, this can be handled, for example, by switching the display in the input video display area 420. The number of display areas 421 included in the input video display area 420 is not limited to eight; it may be seven or less, or nine or more. Also, in this example, video from seven cameras identified by camera IDs [1c] to [7c] is displayed as input video in each display area 421.

[0053] The user can specify which video to output from each input video displayed in the input video display area 420 by operating the control unit 402. In the example shown in the figure, the input video with camera ID [2c] is specified as the video to be output, as indicated by the thick border around the display area 421. In the output video display area 410, the video with camera ID [2c] specified in the input video display area 420 is displayed in the display area 411 as the output video currently being output.

[0054] Display area 412 displays the next output video to be output after the output video displayed in display area 411. The video processing unit 400 can also apply predetermined effects to the output video displayed in display area 411, for example, in response to user operations on the operation unit 402. Furthermore, when switching the output video from the video displayed in display area 411 to the video displayed in display area 412, the video processing unit 400 can apply transition effects such as crossfading to accompany the switching of the output video.

[0055] The video selection device 40 can be configured with hardware components including a CPU, a DSP (Digital Signal Processor), RAM, a storage device, and an interface that supports multiple video data sets.

[0056] Figures 7A and 7B are schematic diagrams showing examples of the appearance of the mobile device 10 applicable to the embodiment. Figure 7A is a perspective view showing the appearance of the mobile device 10, and Figure 7B is a view of the mobile device 10 from the bottom side.

[0057] The mobile device 10 illustrated in Figure 7A has an external shape that is close to a cylindrical shape. The outer housing, housing 105, includes an upper housing 105a and a lower housing 105b. A gap is provided between the upper housing 105a and the lower housing 105b. Sensors for recognizing the surrounding environment are provided at the same height as the gap. The gap is formed so as not to interfere with recognition by the sensors.

[0058] An opening is formed in the upper part of the upper housing 105a so as not to obstruct imaging by the camera 100. The camera 100 is mounted so as to be rotatable horizontally relative to the housing 105. An antenna 101 is also provided at a predetermined position on the upper housing 105a so as not to obstruct imaging by the camera 100. Here, the antenna 101 is considered to integrate the functions of the antennas 101t and 101r described above. Of the antennas 101t and 101r, at least antenna 101t is provided, for example, on a part of the perimeter of the housing 105.

[0059] In Figure 7B, the moving mechanism 104 moves the moving device 10 in any direction on the stage 50 and also rotates the moving device 10. In the example shown in Figure 7B, the moving mechanism 104 is composed of a plurality of rollers. The rollers are incorporated into, for example, a trolley (not shown) and contact the stage 50 through an opening formed below the lower housing 105b. The moving mechanism 104 may be composed of, for example, Mecanum wheels, to enable omnidirectional movement and rotation of the moving device 10. This allows the moving device 10 to escape from a situation where it is trapped by a person without unnecessary rotation, or to freely position itself in an intricate arrangement of equipment.

[0060] Furthermore, the mobile device 10 is capable of independently controlling the orientation of the housing 105 (with the direction in which the antenna 101 is installed being the rear) and the shooting direction of the camera 100. In other words, the mobile device 10 is capable of moving and rotating the housing 105 while maintaining the direction in which the camera 100 is shooting.

[0061] Figure 8 is a block diagram showing the hardware configuration of an example of a mobile device 10 applicable to the embodiment. In Figure 8, the mobile device 10 includes a CPU 1000, a ROM 1001, a RAM 1002, a mobile mechanism drive unit 1003, a storage device 1004, a sensor I / F 1005, a camera I / F 1006, and a communication I / F 1007, all of which are connected to each other via a bus 1010 for communication.

[0062] The storage device 1004 is a non-volatile storage medium such as a hard disk drive or flash memory. The CPU 1000 controls the overall operation of the mobile device 10 using the RAM 1002 as work memory, according to the programs stored in the ROM 1001 and the storage device 1004.

[0063] The mobile mechanism drive unit 1003 includes a power source such as a motor and a drive circuit for driving the power source, and drives the mobile mechanism 104 according to instructions from the CPU 1000. The sensor I / F 1005 is an interface to the sensor 120 and transfers the sensor output signal output from the sensor 120 to the bus 1010. The sensor 120 includes at least a position sensor that acquires the current position of the mobile device 10. The sensor 120 may acquire the current position by combining a gyro sensor and an acceleration sensor, or it may acquire the current position by communication via Wi-Fi (registered trademark) or by a predetermined beacon.

[0064] Camera I / F 1006 is an interface to camera 100 and transmits and receives various data such as video data, shooting control data, and status information to and from camera 100. Communication I / F 1007 controls communication between transmitter 102 and receiver 103.

[0065] Figure 9 is an example functional block diagram illustrating the functions of the mobile device 10 applicable to the embodiment.

[0066] In Figure 9, the mobile device 10 includes an imaging unit 110, a sensor information acquisition unit 111, a communication unit 112, and a drive control unit 113. These imaging unit 110, sensor information acquisition unit 111, communication unit 112, and drive control unit 113 are configured, for example, by a program being executed on a CPU. However, these imaging unit 110, sensor information acquisition unit 111, communication unit 112, and drive control unit 113 may also be configured by hardware circuits that work together.

[0067] The imaging unit 110 controls the shooting operation of the camera 100. The sensor information acquisition unit 111 acquires sensor information based on the sensor output signal from the sensor 120. For example, the sensor information acquisition unit 111 acquires position information indicating at least the current position of the mobile device 10 based on the sensor output signal.

[0068] The communication unit 112 controls the transmission process by the transmitter 102 and the reception process by the receiver 103 via the communication interface 1007.

[0069] The drive control unit 113 generates a control signal to drive the moving mechanism 104 and passes it to the moving mechanism drive unit 1003. For example, the drive control unit 113 receives motion plan data from the communication unit 112, which shows the motion plan created by the motion plan creation unit 602 in the information processing device 60. The drive control unit 113 generates a drive signal to drive the moving mechanism 104 according to the received motion plan data. The moving device 10 then performs autonomous movement based on the motion plan.

[0070] The mobile device 10 stores the received operation plan data in the storage device 1004 or RAM 1002. Furthermore, if the mobile device 10 receives new operation plan data, it may overwrite the already stored operation plan data with the newly received data.

[0071] [3. First Embodiment] Next, a first embodiment of this disclosure will be described.

[0072] In the first embodiment, the information processing device 60 generates an operation plan for the mobile device 10 based on the radio wave conditions acquired by the radio wave condition acquisition unit 601, using the operation plan creation unit 602. At this time, the operation plan creation unit 602 creates an operation plan for the mobile device 10 so that the mobile device 10 moves while avoiding areas where the radio wave strength is below a threshold, so that the video data transmitted from the mobile device 10 can be received by the receiver 20 without interruption.

[0073] Furthermore, the information processing device 60 visualizes the radio wave conditions using the map generation unit 603 and presents them to the user. At this time, the map generation unit 603 explicitly presents the areas where the radio wave intensity is below a threshold for the visualized radio wave conditions.

[0074] Figure 10 is a schematic diagram showing an example of a visualization screen 70 that displays the radio wave conditions according to the first embodiment and the movement path of the mobile device 10 based on the operation plan.

[0075] As shown in Figure 10, initially, the mobile device 10 is positioned on the far right side of the diagram of the stage 50. Equipment 52 placed between the mobile device 10 and the receiver 20 creates an area where the radio wave strength is below a threshold. In the example in Figure 10, the map generation unit 603 visualizes this area where the radio wave strength is below the threshold, i.e., an area where there is a high probability that the transmitted video data will be interrupted or distorted, as a dangerous area 200 on the visualization screen 70.

[0076] Furthermore, the map generation unit 603 displays route A, which follows the motion plan created by the motion plan creation unit 602, on the visualization screen 70. As shown in Figure 10, route A is set to avoid the hazardous area 200.

[0077] Furthermore, the map generation unit 603 sequentially updates the position of the mobile device 10 on the visualization screen 70 as the mobile device 10 moves on the stage 50. In addition, the map generation unit 603 sequentially updates the display of the danger zone 200 if the radio wave conditions change.

[0078] Furthermore, the map generation unit 603 may display on the visualization screen 70 dangerous areas 200 based on radio wave conditions estimated from the relationship between the structure of the environment, such as the positional relationship between the equipment 52 placed on the stage 50 and the antenna 20. For example, areas where there is no obstruction to the radio waves transmitted from the antenna 20 can be presumed to have good radio wave conditions. On the other hand, areas where there is obstruction to the radio waves transmitted from the antenna 20 can be presumed to have somewhat worse radio wave conditions, and the map generation unit 603 can display such areas as dangerous areas 200.

[0079] Figure 11 is a schematic diagram showing an example of applying the visualization screen according to the first embodiment to a screen representing a three-dimensional space. For example, if the user is wearing a so-called see-through type head-mounted display (AR (Augmented Reality) glasses) that allows images of real space to pass through, a display indicating the danger area 200 can be superimposed on the image of stage 50 that is visible through the AR glasses.

[0080] For convenience, in this explanation, the glasses portion of the AR glasses will be referred to as the screen, and the image seen through the glasses and projected onto the user's eye will be considered the image displayed on the screen. Furthermore, the camera (not shown) is assumed to be mounted on a mobile device 10drn (e.g., a drone) that can move freely up, down, left, right, forward, and backward in real space, and can also be stationary within real space.

[0081] In the example shown in Figure 11, the visualization screen 71 displayed on the AR glasses includes the performer 51 and equipment 52, which are real-world images, as well as the display of the hazardous area 200 generated by the map generation unit 603. In this example, the performer 51 on the right side of the visualization screen 71 and the equipment 52 on the left side generate areas where the radio wave intensity is below a threshold, and these are displayed as hazardous areas 200.

[0082] Furthermore, the map generation unit 603 displays the path B, which includes height information in three-dimensional space, on the visualization screen 71, according to the motion plan created by the motion plan creation unit 602. In this example as well, the path B is set to avoid the hazardous area 200, as shown in Figure 11.

[0083] In this manner, the information processing device 60 according to the embodiment explicitly displays on the visualization screen 70 or 71 the high-risk areas 200 where the transmitted video data is likely to be interrupted, based on the radio wave strength. This allows the user to easily confirm that the mobile device 10 or 10drn is moving in a way that prevents interruptions or distortions in the transmitted video data.

[0084] Furthermore, it is conceivable that the user may manually operate the mobile device 10 or 10'. Even in this case, since the hazardous area 200 is explicitly displayed on the visualization screen 70 or 71', it is easy to operate the mobile device 10 or 10' in a way that does not cause interruptions or distortions in the transmitted video data.

[0085] (3-1. First modified example of the first embodiment) Next, a first modification of the first embodiment will be described. The information processing device 60 according to the first modification of the first embodiment allows the user to specify the acceptable level of radio wave intensity, which is evaluated as an absolute value, on a visualization screen that includes visualization information based on radio wave conditions. In the information processing device 60, the operation plan creation unit 602 determines the path of the mobile device 10 and creates an operation plan according to the radio wave intensity level specified by the user.

[0086] Figure 12 is a schematic diagram showing an example of a visualization screen 80 according to a first modified example of the first embodiment.

[0087] In Figure 12, the visualization screen 80 includes a radio wave conditions map 800. In the example in Figure 12, the radio wave conditions map 800 visualizes the distribution of radio wave intensity at stage 50 using contour lines.

[0088] For example, prior to starting filming with the mobile device 10, the user moves the mobile device 10 across the stage 50 with the performers 51 and equipment 52 positioned on the stage, measuring the radio wave intensity at each position. The measured radio wave intensity at each position is input to the information processing device 60 in association with the measurement location and passed to, for example, the radio wave condition acquisition unit 601.

[0089] The radio wave condition acquisition unit 601 normalizes the radio wave strength at each location provided by the unit using a predetermined method and classifies the normalized radio wave strength at each location into levels. For example, the radio wave condition acquisition unit 601 classifies each normalized radio wave strength into five groups according to its value. Of the five groups classified into levels, the radio wave condition acquisition unit 601 assigns the group with the highest radio wave strength value to level Lv1, the group with the lowest radio wave strength value to level Lv5, and groups with intermediate values ​​to levels Lv4, Lv3, and Lv2 in ascending order of value.

[0090] The map generation unit 603 generates a radio wave condition map 800, shown in Figure 12, with contour lines corresponding to each level, based on the radio wave intensity at each location classified as levels Lv1 to Lv5 by the radio wave condition acquisition unit 601. In the example in Figure 12, each area corresponding to levels Lv1 to Lv5 is colored with a density corresponding to the level. For example, in the radio wave condition map 800 example in Figure 12, the densely colored area is the level Lv5 area, and the uncolored area is the Lv1 area.

[0091] Furthermore, in the example shown in Figure 12, the mobile device 10 and the route R based on the operation plan for the mobile device 10 are superimposed on the radio wave strength display in the radio wave conditions map 800.

[0092] In the visualization screen 80 of Figure 12, the slider 801 located on the right side allows the user to specify an acceptable level for radio wave intensity by operating the knob 802. The acceptable level for radio wave intensity indicates the maximum level of radio wave intensity that is permitted for the transmission of video data by the mobile device 10. For example, the motion planning unit 602 creates an motion plan for the mobile device 10, using the specified acceptable level of radio wave intensity as the lower limit of the radio wave intensity when transmitting video data.

[0093] In this example, the radio wave strength is classified into five discrete values ​​to generate the radio wave conditions map 800, but this is not limited to this example. For example, the radio wave strength could be classified into even finer stages to generate the radio wave conditions map 800, or the radio wave strength could be treated as analog information, and the electric field strength as a continuous value, and the radio wave conditions map 800 could be generated using a gradient or similar method.

[0094] Figure 13 is a schematic diagram showing an example of operation on the slider 801 in the visualization screen 80, relating to a first modification of the first embodiment. In Figure 13, sections (a), (b), and (c) show examples of moving the knob 802 to levels Lv1, Lv3, and Lv4, respectively. In each radio wave condition map 800, it can be seen that the radio wave condition map 800 is updated according to the position of the knob 802, and the filled area is changed. In the radio wave condition map 800, the area of ​​the level specified by the knob 802, that is, the unfilled area, is the area in which the mobile device 10 is moved according to the operation plan.

[0095] In the example in section (a) of Figure 13, level Lv1 is defined as the acceptable level, and only the area of ​​radio wave intensity corresponding to level Lv1 is shown as an unfilled area. On the other hand, the path R of the mobile device 10 extends beyond the area of ​​level Lv1, which is the acceptable level. For example, the motion planning unit 602 can avoid creating a motion plan for such a path R that extends beyond the area indicated by the acceptable level.

[0096] In contrast, in the example in section (b) of Figure 13, level Lv3 is set as the acceptable level, and the area corresponding to the acceptable level is expanded compared to the example in section (a). The motion planning unit 602 can create a motion plan for the mobile device 10 using the route R within the area indicated by this expanded acceptable level. On the other hand, in this case, since the route R in the motion plan is set to include the area of ​​level Lv3 where the radio wave strength is lower than level Lv1, there is a risk that interruptions or distortions may occur in the video data transmitted from the mobile device 10.

[0097] In the example in section (c) of Figure 13, level Lv4 is set as the acceptable level, and the area corresponding to the level of education is further expanded compared to the example in section (b). The motion planning unit 602 can create a motion plan for the mobile device 10 using route R within the area indicated by this expanded acceptable level, and can also create a new motion plan for another mobile device 10' using route R'. In this case, route R' in the new motion plan is set to include the area of ​​level Lv4, where the radio wave intensity is even lower than level Lv3. Therefore, the risk of interruptions or distortions occurring in the video data transmitted from the mobile device 10 is even greater than in the example in section (b).

[0098] Figure 14 is a schematic diagram illustrating the generation of a radio wave conditions map 800 and the creation of an operation plan according to a first modification of the first embodiment. The map generation unit 603 generates a radio wave conditions map (step S10) based on the radio wave intensity at each position on the stage 50, which is acquired prior to the shooting by the mobile device 10, as described above. The radio wave conditions map generated here is a static radio wave conditions map of the initial state.

[0099] Furthermore, the map generation unit 603 generates a radio wave conditions map based on the location information and radio wave strength acquired from the mobile device 10 during shooting and movement (step S11). This radio wave conditions map is updated sequentially in accordance with the shooting and movement of the mobile device 10.

[0100] Furthermore, the map generation unit 603 obtains the tolerance level specified by the user using the slider 801 on the visualization screen 80 (step S12).

[0101] The map generation unit 603 generates and updates the radio wave conditions map 800 based on these static radio wave conditions maps, sequentially updated radio wave conditions maps, and the permissible levels specified by the user (step S13). Here, the map generation unit 603 presents the areas in the radio wave conditions map 800 in which the operation of the mobile device 10 is permitted.

[0102] The motion plan creation unit 602 acquires a motion plan, either automatically or manually (step S14). The motion plan creation unit 602 modifies the motion plan acquired in step S14 based on the radio wave conditions map 800 generated by the map generation unit 603 in step S13. For example, the map generation unit 603 reflects the motion plan modified by the motion plan creation unit 602 in the radio wave conditions map 800, for example, as the route of the mobile device 10, and presents it to the user.

[0103] The revised operation plan is the same as the original operation plan obtained in step S14, but with the movement range of the mobile device 10 restricted according to the permissible level in the radio wave conditions map 800. For example, if the goal is to move the mobile device 10 back and forth equally in front of the performer 51 in order to photograph the performer 51, a constraint can be imposed to ensure that the mobile device 10 does not move outside the area based on the permissible level.

[0104] Thus, according to the first modification of the first embodiment, the area in which the mobile device 10 moves can be set based on the radio wave conditions map 800. This allows the user to set the area in which the mobile device 10 moves more freely while suppressing the risk of video interruption.

[0105] (3-2. Second Modification of the First Embodiment) Next, a second modification of the first embodiment will be described. In the second modification of the first embodiment, the orientation of the moving device 10 is further controlled.

[0106] Figure 15 illustrates how the state of radio waves transmitted from the mobile device 10 differs depending on the orientation of the mobile device 10. In Figure 15, mobile devices 10a, 10b, and 10c are equipped with antennas 101ta, 101tb, and 101tc, respectively, for transmitting video data. In the example in Figure 15, there are no obstructions to the radio waves between the antennas 101ta and 101tb and the receiver 20 in mobile devices 10a and 10b. Therefore, the receiver 20 can receive the signals transmitted from mobile devices 10a and 10b without any problems.

[0107] On the other hand, in the mobile device 10c, the antenna 101tc is oriented in the opposite direction to the receiver 20 relative to the mobile device 10c. Therefore, the signal transmitted from the antenna 101tc may not be received with sufficient signal strength by the receiver 20 because the mobile device 10c itself acts as an obstruction. Thus, in the second modification of the first embodiment, the autonomous movement of the mobile device 10 is optimized so that the antenna 101t is oriented as much as possible toward the receiver 20.

[0108] Figure 16 is a flowchart illustrating an example of the process for creating an action plan according to a second modification of the first embodiment. In step S100, the action plan creation unit 602 creates an action plan automatically or manually. In the next step S101, the action plan creation unit 602 compares the position of the receiver 20 for receiving video data, which is installed at a known site (e.g., stage 50), with the position of the mobile device 10 based on the action plan created in step S100.

[0109] In the next step, S102, the motion plan creation unit 602 creates a motion plan that corrects the orientation of the mobile device 10 based on the result of comparing the position of the receiver 20 in step S101 with the position of the mobile device 10 according to the motion plan. More specifically, in the motion plan created in step S100, the motion plan creation unit 602 corrects the orientation of the mobile device 10 (housing 105) so that the antenna 101t of the transmitter 102 that transmits video data on the mobile device 10 faces the direction of the receiver 20.

[0110] Thus, in the second modification of the first embodiment, the motion planning unit 602 creates a motion plan for the mobile device 10 such that the antenna 101t for transmitting video data is always facing the receiver 20 when the mobile device 10 is moving while taking pictures. As a result, the mobile device 10 itself is prevented from becoming an obstacle to the signal transmitting the video data, and stable transmission of video data becomes possible.

[0111] [4. Second Embodiment] Next, a second embodiment of the present disclosure will be described. In the second embodiment, the path of the mobile device 10 according to the operation plan is divided according to the radio wave conditions, and at the division point, the operation is handed over from one mobile device 10 to another mobile device 10.

[0112] Figures 17A and 17B illustrate the division of the path and the handover of the operation of the mobile device 10 according to the second embodiment. In Figure 17A, three performers 51a, 51b, and 51c are positioned on the stage 50, and we consider the case where performers 51a, 51b, and 51c are photographed sequentially from right to left in the figure. In this case, assuming there are no obstacles to the movement of the mobile device 10d and the reception of video data transmitted from the mobile device 10d, the operation plan will be, for example, a path R through which the mobile device 10d moves from right to left on the stage 50.

[0113] Here, as shown in Figure 17A, the hazardous area 200 is located close to the portion of the path R in which the mobile device 10d moves from performer 51a to performer 51b. In this case, when the mobile device 10d passes through the space 210 between the hazardous area 200 and the edge of the stage 50 (the lower edge in the figure), there is a risk that the video data transmitted from the mobile device 10d may be interrupted. Furthermore, if the mobile device 10d is moving autonomously, passing through the space 210 at the edge of the stage 50 also poses a risk to the operation of the mobile device 10d itself.

[0114] Therefore, as shown in Figure 17B, the motion planning unit 602 creates a motion plan for the mobile device 10d using a path Ra that moves the mobile device 10d to just before the danger zone 200. Furthermore, the motion planning unit 602 creates a motion plan for a different mobile device 10e using a path Rb that starts from a position beyond the danger zone 200.

[0115] In other words, the motion planning unit 602 divides the path R shown in Figure 17A at a position that is close to the hazardous area 200 and corresponds to a narrow space 210 through which the mobile device 10d must pass, and creates motion plans for the divided paths Ra and Rb, respectively. Based on these motion plans for path Ra and path Rb, the operation of the mobile device 10d is handed over to the mobile device 10e.

[0116] In this way, even if the mobile device 10d crosses or approaches the hazardous area 200, the operation of mobile device 10d can be handed over to mobile device 10e, thereby preventing interruptions in the video data of performers 51a to 51c. Furthermore, even if the path R includes an area that poses a risk to the passage of mobile device 10d, the risk associated with movement can be reduced by having the operation of mobile device 10d handed over to mobile device 10e across that area.

[0117] Furthermore, when the operation of the mobile device 10d is handed over to the mobile device 10e as described above, it is also possible to control the video selection device 40 to connect the video data transmitted from the mobile device 10d with the video data transmitted from the mobile device 10e.

[0118] In other words, the motion planning unit 602 can communicate with the mobile device 10 to know its current position, and therefore can accurately grasp the timing at which the operation is handed over from mobile device 10d to mobile device 10e. Using this information indicating the handover timing, the motion planning unit 602 can instruct the video selection device 40 to automatically switch between the input video from mobile device 10d and the input video from mobile device 10e.

[0119] Furthermore, the motion planning unit 60, for example, can use information indicating the timing to virtually integrate the video data transmitted from the mobile devices 10d and 10e, respectively, as if they were video data captured by a single camera, for example, in front of the video selection device 40. This integrated video data, obtained by integrating the video data transmitted from the mobile devices 10d and 10e, is then input to the video selection device 40. In this way, a user operating the video selection device 40 can switch and edit input videos without being aware of the handover of operations from mobile device 10d to mobile device 10e.

[0120] Figure 18 is a flowchart illustrating an example of the process for creating an operation plan according to the second embodiment. In step S200, the operation plan creation unit 602 creates an operation plan automatically or manually. In the next step S201, the operation plan creation unit 602 compares the route R created in step S200 with the radio wave conditions acquired by the radio wave conditions acquisition unit 601.

[0121] In the next step S202, the operation plan creation unit 602 determines whether or not it is necessary to divide the route R based on the operation plan in step S201 and the radio wave conditions. For example, the operation plan creation unit 602 may determine that it is necessary to divide the route R if the route R crosses or approaches the dangerous area 200 based on the radio wave conditions to a distance of less than or equal to a predetermined distance, or if the route R includes a portion with a width of less than or equal to a predetermined width.

[0122] If the motion planning unit 602 determines in step S202 that it is necessary to divide the path R (step S202, "Yes"), it proceeds to step S203. In step S203, the motion planning unit 602 divides the path R into paths Ra and Rb, and creates motion plans for the transfer of operation from the moving device 10d to the moving device 10e, for each of the moving devices 10d and 10e.

[0123] On the other hand, if the motion planning unit 602 determines in step S202 that it is not necessary to divide the route R (step S202, "No"), it proceeds to step S204. In step S204, the motion planning unit 602 creates a motion plan using a detour route as needed. For example, the motion planning unit 602 may create a motion plan using a detour route if there is a route that is further away from the danger area 200 or a wider route that does not change the target of photography relative to the original route R.

[0124] After processing in step S203 or step S204, the motion plan creation unit 602 moves the process to step S205. In step S205, the motion plan creation unit 602 presents the motion plan created in step S203 or step S204 to the user, for example, using a screen display. Once the user approves the presented motion plan, the motion plan creation unit 602 moves the process to step S206 and executes the motion plan created in step S203 or step S204.

[0125] [5. Third Embodiment] Next, a third embodiment of the present disclosure will be described. In the third embodiment, the video selection screen 403 of the video selection device 40 displays the signal strength of the video data transmitted from each mobile device 10, and information showing the change in signal strength.

[0126] Figure 19 is a schematic diagram showing an example of a video selection screen 403 by a video selection device 40 according to a third embodiment. In the example in Figure 19, each display area 421 on the video selection screen 403 is provided with an indicator 434 that shows the signal strength of video data transmitted from the corresponding mobile device 10, and a transition display 430 that includes information showing the transition of the signal strength of the video data. The transition display 430 is overlaid on the video displayed in the display area 421, for example, with a predetermined transparency.

[0127] Figure 20 is a schematic diagram showing an enlarged view of the display area 421 according to the third embodiment. In Figure 20, the indicator 434 located in the upper left of the display area 421 indicates the current signal strength of the video data transmitted from the mobile device 10 corresponding to the display area 421 (in this example, the mobile device 10 equipped with camera ID [2c] camera 100).

[0128] The transition display 430, located at the bottom of the display area 421, shows signal strength on the vertical axis and the passage of time to the right on the horizontal axis. Bar 433 indicates the current time, and level indicator line 432 indicates the acceptable level for the signal strength. The characteristic line 431 shows the transition of the signal strength of the video data transmitted from the mobile device 10 corresponding to the display area 421. On the characteristic line 431, the area to the right of bar 433, which indicates the current time, shows a predicted value for the signal strength. This predicted value can be determined, for example, based on the operation plan for the mobile device 10 and the radio wave conditions (radio wave conditions map).

[0129] By checking this transition display 430, the user can determine whether or not there is a possibility that the image displayed in the corresponding display area 421 may be interrupted. For example, if there is a portion of the characteristic line 431 to the right of the bar 433 that exceeds the level indicator line 432, the user can determine that there is a possibility that the image displayed in the display area 421 may be interrupted in the near future (for example, a few seconds later).

[0130] For example, if a user determines, based on the transition display 430, that there is a possibility that the video displayed in the display area 421 designated as the output video may be interrupted, the user can determine that there is a high risk of the video being streamed being interrupted. In this case, the user can switch the output video to the video from camera 100 with a different camera ID. This prevents the video being streamed being interrupted.

[0131] In addition to this, it is also possible to have the video selection device 40 automatically perform the process of switching the output video to the video from camera 100 with a different camera ID, for example, by having the information processing device 60 instruct the video selection device 40 to do so.

[0132] Figure 21 is a schematic diagram illustrating the process for determining the risk of interruption in the video being streamed, according to the third embodiment.

[0133] The mobile device 10 executes the motion plan provided in advance by the motion plan creation unit 602 and estimates its current position (step S300). The mobile device 10 transmits the motion plan and position information indicating the estimated current position. The motion plan and position information transmitted from the mobile device 10 are received by the information processing device 60. The mobile device 10 moves and takes pictures according to the motion plan (step S301) and transmits the captured video data (step S302).

[0134] In the video selection device 40, the video data transmitted in step S302 is selected as the video to be output.

[0135] The video data transmitted from the mobile device 10 is received by the receiver 20. The receiver 20 transfers the received video data to the video selection device 40 (step S303). The receiver 20 also passes signal strength information based on the video data transmitted from the mobile device 10 to the information processing device 60 as radio wave conditions in the environment including the mobile device 10 and the receiver 20 (step S304).

[0136] The information processing device 60 predicts the degree of risk of interruption of the video data transmitted from the mobile device 10 based on prior information (for example, the location of the receiver 20, the arrangement of the performers 51 and equipment 52) ​​and the radio wave conditions transmitted from the receiver 20 (step S305).

[0137] The information processing device 60 predicts the probability that the video will be interrupted if the mobile device 10 moves from the current point in time, based on, for example, the operation plan of the mobile device 10, location information indicating the position of the mobile device 10, and a radio wave condition map based on radio wave conditions. For example, based on the operation plan, location information, and radio wave condition map, if the mobile device 10 moves to an area with weak radio wave strength, it is predicted that the probability of the video being interrupted is high, depending on the radio wave strength at the destination. The information processing device 60 transmits a value indicating this probability to the video selection device 40 as a risk prediction result.

[0138] The video selection device 40 can automatically switch the currently outputting video to video captured by a different camera 100, according to the risk level prediction result transmitted from the information processing device 60. The video selection device 40 may also display a message indicating that there is a risk of the currently outputting video being interrupted, prompting the user to switch videos.

[0139] Figure 22 is a flowchart illustrating an example of the video switching process in the video selection device 40 according to the risk level, according to the third embodiment.

[0140] In step S400, the video selection device 40 obtains a prediction result from the information processing device 60 that predicts the level of risk for the video being output. In the next step S401, the video selection device 40 checks the predicted level of risk N seconds later (where N is a positive value) based on the prediction result obtained in step S400. Note that N seconds may be a value pre-set in the video selection device 40 or a value set by the user.

[0141] In the next step, S402, the video selection device 40 determines whether the risk level confirmed in step S401 exceeds a threshold. If the video selection device 40 determines that the risk level is below a preset threshold (step S402, "No"), it returns to step S400. On the other hand, if the video selection device 40 determines that the risk level exceeds the threshold (step S402, "Yes"), it moves the process to step S403.

[0142] In step S403, the video selection device 40 switches the currently outputting video to a video from another video input. More specifically, the video selection device 40 switches the mobile device 10 that transmits the video to be used for output from the current mobile device 10 to another mobile device 10. Alternatively, the video selection device 40 informs the user that there is a risk of the currently outputting video being interrupted.

[0143] Furthermore, there are various ways to select the video to switch to when the video selection device 40 switches the currently outputting video to a video from another video input. For example, the most frequently used video can be pre-registered as the video to be used for switching (displayed in the display area 412 where candidate output videos are displayed), and the currently outputting video can be switched to this registered video. The video to be registered for switching is not limited to the most frequently used video. For example, a highly versatile video, such as a video of the stage 50 taken from a wide angle showing the entire stage 50, can be registered as the video to be used for switching.

[0144] For example, the target video could be video data transmitted under good radio wave conditions. Furthermore, the target video could be video shot with a similar composition to the currently output video. Whether or not the composition is similar can be determined based on the position and orientation of the mobile device 10 taking the video.

[0145] Thus, according to the third embodiment, the video selection device 40 switches the output video according to the level of risk to the output video determined by the information processing device 60. Alternatively, it prompts the user to switch the output video according to the level of risk. This prevents accidents such as interruptions or distortions in the video being streamed.

[0146] (5-1. Modified form of the third embodiment) Next, a modified version of the third embodiment will be described. In the third embodiment described above, the degree of danger to the output video was determined based on the radio wave conditions. In contrast, in the modified version of the third embodiment, the degree of danger is determined based on the output video.

[0147] Figure 23 is a schematic diagram illustrating a modification of the third embodiment for determining the risk of interruption in the video being streamed. Figure 23 shows the configuration shown in Figure 21 with the addition of the received video determination process shown in step S310. In Figure 21, the information processing device 60 determines whether or not there is video distortion due to the received video data based on the radio wave conditions transmitted from the receiver 20 (step S310).

[0148] The information processing device 60 predicts, for example, the presence or absence of image distortion based on signal strength information included in the radio wave conditions. For example, the information processing device 60 can quantify the signal strength indicated by the signal strength information, and if the value indicating the signal strength is smaller than a predetermined value, it can predict that image distortion will occur. However, the information processing device 60 may also directly detect the presence or absence of distortion from the image data. For example, the information processing device 60 can detect the presence or absence of image distortion based on the continuity of the image. In this case, the presence or absence of image distortion can also be detected by the image selection device 40.

[0149] For example, in a filming location, if, for instance, an unconventional device is used for the receiver 20, it may be necessary to make decisions based on the video footage. One example is when the receiver 20 does not have a function to measure signal strength. The modified version of the third embodiment is suitable for use in such cases.

[0150] Furthermore, if video distortion is detected during the distribution of video data captured by the mobile device 10, the location (coordinates) where the distortion was detected can be acquired and recorded, and this location can be reflected in the radio wave condition map 800.

[0151] Figure 24 is a schematic diagram showing an example of a modification of the third embodiment in which the locations where image distortion is detected are reflected in the radio wave conditions map 800. In Figure 24, the locations where image distortion is detected are indicated on the radio wave conditions map 800 by marks 810. The user can set the route of the mobile device 10 by referring to each mark 810 on the radio wave conditions map 800. The information indicated by these marks 810 is closer to the raw information at the shooting site, and is therefore expected to be an effective hint for the route of the mobile device 10.

[0152] Furthermore, the effects described herein are merely illustrative and not limiting, and other effects may also occur.

[0153] Furthermore, this technology can also be configured as follows. (1) An acquisition unit that acquires the radio wave conditions in the environment, Based on the aforementioned radio wave conditions and the radio wave strength required to transmit the video data used for distribution, a creation unit creates an operation plan, Equipped with, Information processing system. (2) The device further includes a moving device comprising a shooting function, a transmission function for transmitting video data captured by the shooting function, and a moving mechanism for rotating and moving the housing, The acquisition unit is, The radio wave conditions within the environment in which the mobile device operates are acquired. The aforementioned creation unit, Based on the aforementioned radio wave conditions and the radio wave intensity required for the mobile device to transmit the video data used for distribution, an operation plan is created that shows the planned operation of the mobile device. The information processing system described in (1) above. (3) The moving device includes a first moving device and a second moving device. The aforementioned creation unit, Based on the aforementioned radio wave conditions and radio wave intensity, an operation plan is created for the handover of operations from the first mobile device to the second mobile device. The information processing system described in (2) above. (4) The aforementioned creation unit, The operation plan is created based on the risks associated with the movement of the first mobile device. The information processing system described in (3) above. (5) A map generation unit that generates a map visualizing the aforementioned radio wave conditions, A display unit that displays the aforementioned map, Furthermore, An information processing system as described in any one of (2) to (4) above. (6) The aforementioned creation unit, The operation plan is created based on the acceptable level for the radio wave intensity in the radio wave conditions, which is set for the map. The information processing system described in (5) above. (7) The aforementioned creation unit, The operation plan is created based on the tolerance level set according to the user operation based on the map displayed on the display unit. The information processing system described in (6) above. (8) The map generation unit, The map is updated based on the tolerance level set according to the user operation. The information processing system described in (7) above. (9) A video display unit that receives the video data transmitted from the mobile device and displays a video based on the received video data, A video selection unit that selects a video to be used for distribution from the video displayed on the aforementioned video display unit, Furthermore, The aforementioned creation unit, Based on the radio wave conditions and the operation plan, the system predicts the progression of the radio wave conditions for the mobile device and displays information indicating the predicted progression of the radio wave conditions on the video display unit. An information processing system as described in any one of (2) to (8) above. (10) The aforementioned creation unit, Based on information showing the predicted changes in the radio wave conditions for each of the aforementioned mobile devices, the video data to be used for distribution is selected from the video data transmitted from each of the aforementioned mobile devices. The information processing system described in (9) above. (11) A determination unit that determines whether or not there is distortion in the video data transmitted from the mobile device. Furthermore, Based on the presence or absence of the aforementioned disturbance, the video data to be used for distribution is selected. The information processing system described in (10) above. (12) A map generation unit that generates a map visualizing the aforementioned radio wave conditions, A display unit that displays the aforementioned map, Furthermore, The aforementioned creation unit, The position of the mobile device at the time the video data, which was determined to have the aforementioned disturbance, was transmitted is obtained, and information indicating the obtained position is displayed on the map. The information processing system described in (11) above. (13) The aforementioned mobile device is The antenna for transmitting the video data using the aforementioned transmission function is located on a part of the perimeter of the housing of the mobile device, The aforementioned creation unit, The operation plan is created, which includes information that controls the orientation of the mobile device based on the position of the antenna. An information processing system as described in any one of (2) to (12) above. (14) An acquisition unit that acquires the radio wave conditions in the environment, A creation unit creates an operation plan based on the aforementioned radio wave conditions and the radio wave strength required to transmit video data. Equipped with, Information processing device. (15) Executed by the processor, The acquisition step involves obtaining the radio wave conditions within the environment, A creation step involves creating an operation plan based on the aforementioned radio wave conditions and the radio wave strength required to transmit video data. Having, Information processing methods. (16) The acquisition step involves obtaining the radio wave conditions within the environment, A creation step involves creating an operation plan based on the aforementioned radio wave conditions and the radio wave strength required to transmit video data. An information processing program that causes a computer to execute something. [Explanation of Symbols]

[0154] 1. Information Processing System 10,10',10a,10b,10c,10d,10e,10drn Mobile device 20,103 receivers 21, 23, 101, 101t, 101ta, 101tb, 101tc, 101r antenna 22,102 Transmitters 40 Video Selection Device 50 stages 51 Performers 52 Equipment, etc. 60 Information Processing Devices 70,71,80 Visualization screen 100 Cameras 104 Moving mechanism 105 cabinets 110 Imaging Unit 111 Sensor Information Acquisition Unit 112 Communications Department 113 Drive control unit 200 Danger Zone 403 Video Selection Screen 411,412,421 display area 430 Progress display 434 Indicator 601 Radio wave condition acquisition unit 602 Action Planning Department 603 Map generation unit 604 Display section 605 Input section 606 Communications Department 800 Radio Wave Conditions Map 801 Slider 802 Knob 810 Mark

Claims

1. A mobile device comprising a transmission function for transmitting video data and a mobile mechanism for rotating and moving the housing, An acquisition unit that acquires radio wave conditions in the environment in which the mobile device operates, Based on the aforementioned radio wave conditions and the radio wave strength required to transmit the video data, a creation unit plans a route for the mobile device to continue transmitting the video data and creates an operation plan including the planned route for the mobile device. Equipped with, Information processing system.

2. A map generation unit that generates a map visualizing the aforementioned radio wave conditions, A display unit that displays the aforementioned map, Furthermore, The information processing system according to claim 1.

3. The map is a map showing the distribution of radio wave intensity based on the signal intensity and location information included in the radio wave conditions. The information processing system according to claim 2.

4. The map is a map that visualizes the distribution of radio wave intensity using contour lines. The information processing system according to claim 3.

5. The map is a map that displays the distribution of radio wave intensity using regions colored with varying densities according to each level of radio wave intensity. The information processing system according to claim 4.

6. The map is a map in which the path of the mobile device is superimposed on a display of the distribution of radio wave intensity. The information processing system according to claim 3.

7. The creation unit plans the path of the mobile device based on information about the arrangement of performers or equipment in the environment. The information processing system according to claim 1.

8. The aforementioned creation unit, The route of the mobile device is planned based on the acceptable level for the radio wave intensity in the radio wave conditions, which is set for the aforementioned map. The information processing system according to claim 2.

9. The aforementioned creation unit, The path of the mobile device is planned based on the tolerance level set according to the user operation based on the map displayed on the display unit. The information processing system according to claim 8.

10. The manufacturing unit is Based on the radio wave conditions and the operation plan, the system predicts the changes in the radio wave conditions for the mobile device and outputs information indicating the predicted changes in the radio wave conditions to the user. The information processing system according to claim 1.

11. The device further comprises a determination unit that determines whether or not there is distortion in the video data transmitted from the mobile device, The aforementioned creation unit, The position of the mobile device at the time the video data, which was determined to have the aforementioned disturbance, was transmitted is obtained, and information indicating the obtained position is displayed on the map. The information processing system according to claim 2.

12. An acquisition unit that acquires radio wave conditions in an environment in which a mobile device is operating, which includes a transmission function for transmitting video data and a moving mechanism for rotating and moving the housing, Based on the aforementioned radio wave conditions and the radio wave strength required to transmit the video data, a creation unit plans a route for the mobile device to continue transmitting the video data and creates an operation plan including the planned route for the mobile device. Equipped with, Information processing device.

13. A map generation unit that generates a map visualizing the radio wave conditions, A display unit that displays the aforementioned map, Furthermore, The information processing apparatus according to claim 12.

14. The creation unit plans the path of the mobile device based on information about the arrangement of performers or equipment in the environment. The information processing apparatus according to claim 12.

15. The manufacturing unit is Based on the radio wave conditions and the operation plan, the system predicts the changes in the radio wave conditions for the mobile device and outputs information indicating the predicted changes in the radio wave conditions to the user. The information processing apparatus according to claim 12.

16. Executed by the processor, An acquisition step to acquire radio wave conditions in the environment in which a mobile device, which includes a transmission function for transmitting video data and a movement mechanism for rotating and moving the enclosure, operates, The steps include: planning a route for the mobile device to continue transmitting the video data based on the radio wave conditions and the radio wave strength required to transmit the video data, and creating an operation plan that includes the planned route for the mobile device; Having, Information processing methods.

17. The processor executes the following: A map generation step that generates a map visualizing the aforementioned radio wave conditions, A display step of displaying the aforementioned map, It further possesses, The information processing method according to claim 16.

18. In the step of creating the operation plan, the route of the mobile device is planned based on information about the arrangement of performers or equipment in the environment. The information processing method according to claim 16.

19. The processor executes: The system further includes the step of predicting the changes in the radio wave conditions for the mobile device based on the radio wave conditions and the operation plan, and outputting information indicating the predicted changes in the radio wave conditions to the user. The information processing method according to claim 16.

Images