Information processing apparatus, method of controlling the same, and storage medium

Abstract

To perform photographing by controlling the driving of a moving device in accordance with the change of a moving object when photographing the moving object by the moving device provided with an imaging apparatus.SOLUTION: The moving apparatus 100 includes an image capturing apparatus 130, a moving mechanism unit 117 for movement, a communication unit 118 that receives operation instruction information for a moving object 150 to be operated, and a control unit 111. Controller 111 acquires an imaging scenario list in which a condition related to imaging of moving object 150 is described for each of a plurality of cuts, stores the imaging scenario list in imaging scenario list storage 116, assigns a priority to each of the plurality of cuts described in the imaging scenario list, selects a cut to be imaged from among the plurality of cuts based on the received operation instruction information and the priority, and controls imaging device 130 and moving mechanism 117 according to the condition related to imaging described for the selected cut to image moving object 150.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus, a control method thereof, a program, and an information processing system. [Background technology]

[0002] VLOGs (Videologs), which involve filming lifestyles and everyday events, editing the videos, and posting them publicly on video streaming sites or social media, are becoming increasingly popular. One category of VLOG is called "Drive VLOGs," which are primarily shot while driving in a car, and these are generally shot using drone cameras.

[0003] As a technology that can be used for shooting a driving VLOG, for example, Patent Document 1 discloses a technology that detects the position of a vehicle to be shot and controls an unmanned aerial vehicle based on the detected vehicle position. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-56903 Summary of the Invention [Problem to be solved by the invention]

[0005] When shooting a driving VLOG, it is desirable to shoot a variety of shots by changing the position and direction of the camera during shooting in order to improve the appearance of the images (videos) after editing. In response to such demands, the technology described in Patent Document 1 above does not require the user to operate the drone camera while driving a car. However, it is not possible to change the drone's flight conditions to shoot in response to changes in the moving subject, which makes it difficult to obtain a variety of videos.

[0006] An object of the present invention is to provide an information processing apparatus that, when photographing a moving subject with a moving device equipped with an imaging device, controls the driving of the moving device in accordance with changes in the moving subject to perform photographing. [Means for solving the problem]

[0007] The information processing device of the present invention is an information processing device that controls a moving device equipped with an imaging means and a driving means for movement, and is characterized by comprising: a receiving means that receives, via communication, steering instruction information for a moving subject that requires steering; an acquiring means that acquires a shooting scenario list in which conditions for shooting the moving subject are described for each of a plurality of cuts; an assigning means that assigns a priority to each of the plurality of cuts described in the shooting scenario list; a selecting means that selects a cut to be shot from the plurality of cuts based on the steering instruction information and the priority; and a control means that controls the imaging means and the driving means in accordance with the conditions of the cut selected by the selecting means. [Effects of the Invention]

[0008] According to the present invention, when a moving subject is photographed using a moving device equipped with an imaging device, the driving of the moving device can be controlled in accordance with changes in the moving subject to perform the photographing. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a schematic configuration of an imaging system according to an embodiment. [Figure 2] 5 is a flowchart showing a control flow according to the first embodiment, which is executed by a control unit of a moving device main body that constitutes the photographing system. [Figure 3] FIG. 2 is a diagram showing an example of a shooting scenario list used in the first embodiment. [Figure 4] FIG. 10 is a schematic diagram showing the shooting screen for the shot names "Side" and "Window" in the shooting scenario list. [Figure 5] 10 is a flowchart showing a control flow according to a second embodiment, which is executed by a control unit of a moving device main body that constitutes the photographing system. [Figure 6] FIG. 10 is a diagram showing an example of a second shooting scenario list used in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, an information processing system according to the present invention is an imaging system that captures an image of a subject that moves by maneuvering (hereinafter referred to as a "moving subject") using a mobile device (hereinafter simply referred to as a "mobile device") that has an imaging function.

[0011] This photography system basically changes the position and attitude of the mobile device in response to control instructions for the moving subject, allowing the imaging device equipped in the mobile device to capture video of the moving subject at the desired angle of view or viewing angle.

[0012] 1 is a block diagram showing a schematic configuration of an image capturing system according to an embodiment of the present invention, which includes a mobile device 100 and a moving subject 150. The mobile device 100 includes a mobile device body 110 and an image capturing device .

[0013] First, we will explain the mobile device main body 110 that constitutes the mobile device 100. The mobile device main body 110 has a control unit 111, a ROM 112, a RAM 113, a position and orientation detection unit 114, an image processing unit 115, a shooting scenario list storage unit 116, a movement mechanism unit 117, and a communication unit 118.

[0014] The control unit 111 is an information processing device (microcomputer) that has a CPU and performs overall control of the mobile device main body 110 by reading out control programs for each block that constitutes the mobile device main body 110 from the ROM 112 and expanding them in the RAM 113.

[0015] The ROM 112 is a non-volatile memory that can be electrically erased and stored, and stores parameters and the like necessary for the operation of each block in addition to programs for controlling the operation of each block provided in the mobile device main body 110. The RAM 113 is a rewritable volatile memory, and is used for expanding programs executed by the control unit 111 and the like, and for temporarily storing data generated by the operation of each block provided in the mobile device main body 110.

[0016] The position and orientation detection unit 114 is a sensor that detects various information necessary for controlling the position and orientation of the mobile device main body 110. The position and orientation detection unit 114 includes a GPS sensor that detects the position, a gyro sensor that detects angular velocity, and an acceleration sensor that detects changes in velocity. The position and orientation detection unit 114 also includes a magnetic sensor that detects the direction, an atmospheric pressure sensor that detects the altitude, and a distance measurement sensor that detects the distance to the subject to be photographed (in this embodiment, this refers to the moving subject 150) and surrounding objects using, for example, ultrasound.

[0017] The image processing unit 115 performs various image processing operations on the video image acquired from the imaging device 130 via the communication unit 118 to control the position and attitude of the mobile device main body 110. Specifically, the image processing unit 115 detects and tracks the position of the subject being photographed relative to the position of the mobile device main body 110 in three dimensions, that is, in space.

[0018] The shooting scenario list storage unit 116 (hereinafter referred to as "scenario storage unit 116") stores a shooting scenario list acquired from an external information processing device (not shown) via the communication unit 118. The external information processing device is, for example, a smartphone or a PC communicably connected to the mobile device main body 110. The shooting scenario list will be described in detail later.

[0019] When the mobile device main body 110 is a drone that flies and moves through the air, the mobile mechanism unit 117 is composed of a propeller, a motor that rotates the propeller, a power source that drives the motor, etc., and generates buoyancy and propulsion. Note that the mobile device main body 110 is not limited to one that flies through the air, and may be one that moves on land by rotating wheels or one that moves underwater by rotating a screw.

[0020] The communication unit 118 communicates with the image capture device 130 and the moving subject 150 using a communication method defined by a predetermined standard, such as wireless LAN.

[0021] The control unit 111 controls the position and orientation of the mobile device main body 110 in space relative to the moving subject 150, and drives the movement mechanism unit 117 so that the subject to be photographed falls within the shooting range of the imaging device 130. At this time, the tracking result of the moving subject 150 by the image processing unit 115, the position information and orientation information of the mobile device main body 110 by the position and orientation detection unit 114, and the steering instruction information and position information of the moving subject 150 transmitted from the moving subject 150 are used. The steering instruction information and position information will be described in detail later.

[0022] Next, a description will be given of the imaging device 130 that constitutes the mobile device 100. The imaging device 130 has an imaging control unit 131, a ROM 132, a RAM 133, an optical system 134, an imaging unit 135, an A / D conversion unit 136, an image processing unit 137, a video recording unit 138, a display unit 139, and an imaging communication unit 140.

[0023] The imaging control unit 131 is, for example, a CPU, and performs overall control of the imaging device 130 by reading out a control program for each block constituting the imaging device 130 from a ROM 132 and developing the program in a RAM 133 .

[0024] The ROM 132 is a non-volatile memory that can be electrically erased and stored, and stores parameters and the like necessary for the operation of each block in addition to programs for controlling the operation of each block provided in the imaging device 130. The RAM 133 is a rewritable volatile memory, and is used for expanding programs executed by the imaging control unit 131 and the like, and for temporarily storing data generated by the operation of each block provided in the imaging device 130.

[0025] The optical system 134 has a lens group including a zoom lens and a focus lens, and an aperture mechanism, and forms an optical image of incident light on the imaging surface of an imaging element that constitutes the imaging unit 135. The imaging unit 135 has an imaging element such as a CCD sensor or a CMOS sensor, and the optical image formed on the imaging surface of the imaging element by the optical system 134 is converted into an analog image signal by photoelectric conversion and output to the A / D conversion unit 136. The A / D conversion unit 136 converts the analog image signal input from the imaging unit 135 into a digital image signal and outputs it to the RAM 133, and the RAM 133 temporarily stores the transmitted digital image signal.

[0026] The image processing unit 137 performs various image processing such as demosaicing, noise reduction, white balance correction, and gamma processing for displaying and storing (saving) the digital image data temporarily stored in the RAM 133. The image processing unit 137 stores video data (video data) generated by performing predetermined image processing (development processing) in the video recording unit 138. The image processing unit 137 generates video data that the image processing unit 115 of the mobile device main body 110 uses to track the moving subject 150, and transmits the generated video data to the mobile device main body 110 via the imaging communication unit 140.

[0027] The video recording unit 138 has a storage medium such as a media card for storing various data including captured video data.

[0028] The display unit 139 is configured with a display device such as a liquid crystal monitor, and displays images stored in the RAM 133 and images stored in the video recording unit 138 .

[0029] The imaging communication unit 140 communicates with the mobile device main body 110 using a communication method defined by a predetermined standard, such as wireless LAN. The imaging control unit 131 acquires various setting conditions of the imaging device 130 from the mobile device main body 110 via the imaging communication unit 140, and performs various settings of the imaging device 130 based on the acquired setting conditions. Note that, since the imaging device 130 is mounted on the mobile device main body 110, they may be configured to be able to communicate with each other via a wired connection using a USB cable or the like, or via connection between connectors.

[0030] The photography system may be configured so that the video captured by the imaging device 130 is transmitted to an external terminal (not shown) having a monitor via the imaging communication unit 140 and displayed on the monitor of the external terminal. This allows the user of the photography system to check the video captured by the imaging device 130 in real time. Here, the user of the photography system refers to the passengers (driver and passengers) of the moving subject 150, and to those involved in video shooting with the photography system who are not in the moving subject 150.

[0031] Next, the configuration of moving subject 150 will be described. Moving subject 150 is something that moves according to control, such as a car, a motorcycle, a boat, an airplane, or a train. Moving subject 150 is not limited to something that moves by being directly controlled by a human on board, but may also be something that moves by automatic control, which automatically controls itself while recognizing the surrounding situation even if there is a driver, or something that travels unmanned by automatic driving along a predetermined route. It is assumed that a known control method is used for the automatic control, and therefore a description thereof will be omitted here.

[0032] The moving subject 150 has a steering control unit 151 , a ROM 152 , a RAM 153 , a position detection unit 154 , a steering mechanism unit 155 , an operation mechanism unit 156 , and a steering communication unit 157 .

[0033] Steering control unit 151 is, for example, a CPU, and performs overall control of moving subject 150 by reading out a control program for each block of moving subject 150 from ROM 152 and expanding it in RAM 153. Steering control unit 151 transmits steering instruction information and position information of moving subject 150 to mobile device main body 110 via steering communication unit 157.

[0034] ROM 152 is a non-volatile memory that can be electrically erased and stored, and stores parameters and the like necessary for the operation of each block in addition to programs for controlling the operation of each block provided in moving subject 150. RAM 153 is a rewritable volatile memory, and is used for expanding programs executed by steering control unit 151 and the like, and for temporarily storing data generated by the operation of each block provided in moving subject 150.

[0035] Position detection unit 154 is a sensor that detects the spatial position of moving subject 150, and includes, for example, a GPS sensor, a barometric pressure sensor, etc. Position detection unit 154 can detect the spatial position of moving subject 150 by acquiring ground position information (planar position information) of moving subject 150 using the GPS sensor and acquiring height information using the barometric pressure sensor. Note that the altitude of moving subject 150 can also be detected using a GPS sensor.

[0036] Steering mechanism unit 155 is operated when steering (driving) moving subject 150, and for example, when moving subject 150 is an automobile, steering mechanism unit 155 may include a steering wheel, an accelerator pedal, a brake pedal, a turn signal lever, a wiper lever, a light switch, etc. Specific examples of steering mechanism unit 155 for vehicles other than automobiles will not be described here. Note that steering mechanism unit 155 is operated by a driver aboard moving subject 150, or by automatic steering by steering control unit 151.

[0037] When the steering mechanism unit 155 is operated, the steering control unit 151 generates steering instruction information according to the operation and outputs the generated steering instruction information to the operation mechanism unit 156. Examples of the steering instruction information include accelerator information, brake information, window opening / closing information, steering wheel operation information, and the like.

[0038] The operating mechanism unit 156 operates a predetermined mechanism in accordance with the steering instruction information. For example, if the moving subject 150 is an automobile, the steering angle is transmitted to the actuator as steering instruction information, thereby changing the direction of the front wheels. Also, steering instruction information corresponding to the degree of depression of the accelerator pedal is transmitted to the actuator, which adjusts the rotation speed of the engine (or motor). Furthermore, headlights are turned on / off, blinking / off of blinker lights, and brake lights are turned on / off in accordance with the steering instruction information corresponding to the operation of the light switch, the operation of the turn signal lever, and the degree of depression of the brake pedal.

[0039] The steering communication unit 157 communicates with the mobile device main body 110 using a communication method defined by a predetermined standard, such as wireless LAN. The steering instruction information generated by the steering control unit 151 is transmitted to the steering communication unit 157 together with position information detected by the position detection unit 154, and is further transmitted from the steering communication unit 157 to the control unit 111 via the communication unit 118 of the mobile device main body 110. When tracking the moving subject 150 by image processing, the control unit 111 controls the driving of the movement mechanism unit 117 so that the moving subject 150 is within the shooting range of the imaging device 130, using the position information of the mobile device main body 110 and the steering instruction information and position information acquired from the moving subject 150.

[0040] Next, the control flow in the imaging system will be described. Fig. 2 is a flowchart showing the flow of control according to the first embodiment, which is executed by the control unit 111 of the mobile device main body 110 in a series of controls executed in the imaging system. Each process (step) indicated by an S number in this flowchart is realized by the control unit 111 of the mobile device main body 110 executing a predetermined program and controlling the operation of each block of the mobile device main body 110. Note that here, a case will be described in which the moving subject 150 is an automobile and the mobile device main body 110 is a drone.

[0041] In S201, the control unit 111 acquires a shooting scenario list from an external information processing device (not shown) communicably connected to the mobile device main body 110, and stores it in the scenario storage unit .

[0042] Here, the shooting scenario list will be explained. The shooting scenario list is a list in which main subjects and the conditions for photographing the main subjects with the image capture device 130 are described (in other words, prescribed or defined).

[0043] Fig. 3(a) is a diagram showing an example of a shooting scenario list when the moving subject 150 is an automobile and the mobile device 100 is a drone. The shooting scenario list 300 in Fig. 3(a) lists shooting start conditions, shooting end conditions, and shooting conditions as shooting conditions for each shooting cut (hereinafter referred to as "cut"). The shooting conditions specify what to shoot and how, and in this embodiment, list the main subject, the relative position of the imaging device 130 (mobile device 100) with respect to the main subject, and camera work.

[0044] Note that the start of shooting refers to the start of recording as video (image) data, and the end of shooting refers to the end of recording as video (image) data. In this embodiment, the subject to be shot is the moving subject 150, and the main subject refers to an object that is desired to be included in the shooting angle of view, such as the entire moving subject 150, a part such as the front, or a passenger of the moving subject 150. The relative position is a three-dimensional relative position in space. For example, in addition to a horizontal relative position such as "3 m to the right of the position of the subject to be shot," a vertical relative position such as "20 m above the position of the subject to be shot" is also described. The camerawork describes how the mobile device 100 will be moved relative to the moving subject 150 to shoot (record video). In the shooting scenario list 300, the horizontal relative position is described to the left of the slash ( / ), and the vertical relative position is described to the right of the slash ( / ). Note that the condition that the vertical relative positions of the subject to be shot and the mobile device 100 are the same indicates that their altitudes are the same.

[0045] As an example, the cut name "Turning" in the shooting scenario list 300 will be described. In the cut name "Turning," the control unit 111 of the mobile device 100 sets the entire automobile as the main subject. When the accelerator pedal of the automobile is depressed to a certain level or less, that is, based on steering instruction information indicating that the accelerator pedal depression amount has fallen to a certain level or less, shooting (which involves saving video (moving image) data) begins so that the entire automobile fits within the shooting angle of view. Then, the control unit 111 of the mobile device 100 shoots while rotating the mobile device 100 in a circle with a radius of 10 m centered on the automobile at an altitude of 20 m from the automobile, and ends shooting of this cut when shooting from 360° (all directions) is completed. Note that the shooting end condition may be determined by the mobile device 100, such as "360° shooting completed" for the cut name "Turning," or may be based on steering instruction information from the moving subject 150, such as "Close window" for the cut name "Window."

[0046] The content of the shots listed in the shooting scenario list is not limited to those shown in the shooting scenario list 300. For example, another example of a shot is one in which, when the accelerator pedal is being depressed, the mobile device 100 does not follow the car, but captures the car's acceleration in a dynamic manner. Another example is a shot in which, when the brake is depressed without turning the steering wheel, the mobile device 100 is moved diagonally behind the car to capture the brake lights. Shooting conditions are also not limited to those shown in the shooting scenario list 300, and may include, for example, the zoom setting of the optical system 134 of the image capture device 130. As a specific example, the shot titled "Window" specifies that the mobile device 100 should be shot closer to the moving subject 150 than the shot titled "Side," thereby enabling close-up shots of people inside the car. Alternatively, the telephoto (zoom) function of the image capture device 130 may be used to obtain video with an equivalent shooting range without changing the distance between the moving subject 150 and the mobile device 100.

[0047] Returning to the explanation of the flowchart in FIG. 2, in S202, the control unit 111 assigns a priority to each cut in the shooting scenario list acquired in S201 and stores the priority in the scenario storage unit 116. The criteria for assigning a priority to each cut are not particularly limited. As one example, a priority may be assigned to each cut in the shooting scenario list based on the desires of the user of the shooting system. As another example, a higher priority may be assigned to a cut that the user expects to have a lower frequency of occurrence of operation instruction information that matches the shooting start conditions in the shooting scenario list. Assigning such a priority based on the user's desires and expectations is performed, for example, by the control unit 111 receiving an instruction (input) of the priority assigned to each cut by the user via an external information processing device (not shown) communicably connected to the mobile device main body 110.

[0048] FIG. 3(b) shows a shooting scenario list 310 in which priorities have been assigned to the shooting scenario list 300 in FIG. 3(a). The shooting scenario list 310 has a "priority" column. In this embodiment, the smaller the number in the priority column, the higher the priority. Therefore, priority "1" is the highest priority.

[0049] In this embodiment, a priority is assigned to each cut in the shooting scenario list in S202, but this is not limiting, and a shooting scenario list to which a priority has already been assigned in S201 may be acquired. In the above-described mode in which a priority is assigned after acquiring a shooting scenario list to which no priority has been assigned, there is an advantage that when changing the priority for shooting using the same shooting scenario list, only the priority needs to be changed. For example, if the priority used for traveling from point A to point B is changed to a different priority for traveling from point B to point C, only the priority can be changed without acquiring the shooting scenario list again. The shooting scenario list 300 may also include the number of times each cut has been shot, and it is desirable that the number of times each cut has been shot can be changed as needed, just like the priority.

[0050] When the processing of S202 ends, the operation of the moving subject 150 begins, and in response, in S203 the control unit 111 begins drive control of the moving device 100. For example, when a driver starts the engine of a car (moving subject 150), operation instruction information indicating that the engine should be started and the position information of the car are transmitted from the car to the drone (moving device main body 110). When the control unit of the drone receives the operation instruction information indicating that the car's engine has started and the position information of the car, it controls the drive of the movement mechanism unit based on its own position information to move the drone to a default position. The default position of the drone is not particularly limited. For example, if the default position is set to the rear of the car, the control unit of the drone moves the drone to the rear of the car. The start of operation of the movement mechanism unit 117 of the moving device 100 is not limited to this, and may be manually initiated by the user at any timing when or before the moving subject 150 is started.

[0051] When the movement of moving device 100 to the default position is completed, control unit 111 starts a live view operation by imaging device 130, and further starts a tracking operation of moving subject 150. The resolution (number of pixels) of the video acquired by live view may be smaller than that of normal shooting, to the extent that moving subject 150 can be tracked.

[0052] In S204, the control unit 111 receives steering instruction information and position information from the moving subject 150. Specifically, the steering control unit of the automobile controls acceleration and deceleration in response to depression of the accelerator pedal and brake pedal, and controls driving in response to the steering angle. At this time, the steering control unit of the automobile transmits the steering instruction information and position information of the automobile to the control unit of the drone in real time. The control unit of the drone uses the received steering instruction information, position information, etc. to drive and control the drone to follow the movement of the automobile so that the automobile fits within the shooting range, as described above.

[0053] In S205, the control unit 111 determines whether or not there is any shooting start condition for each cut listed in the shooting scenario list stored in the scenario storage unit 116 that matches the operation instruction information acquired in S204. If the control unit 111 determines that there is any shooting start condition that matches the operation instruction information (YES in S205), it executes the processing of S206, and if it determines that there is no match (NO in S205), it executes the processing of S204.

[0054] In S206, the control unit 111 changes the position and attitude of the mobile device 100 in order to shoot (record video) the cuts described in the shooting scenario list whose shooting start conditions match the operation instruction information. The control unit 111 also instructs the shooting control unit 131 of the imaging device 130 to start shooting, and the shooting control unit 131 starts shooting (recording video data). Note that if the resolution was lowered when acquiring the live view video, the resolution is returned to the specified resolution before shooting.

[0055] In S207, control unit 111 acquires steering instruction information and position information from moving subject 150. Note that the steering instruction information acquired by control unit 111 in S207 is different from the steering instruction information acquired in S204.

[0056] In S208, the control unit 111 determines whether to change the cut to be shot. Specifically, if the priority of a cut for which the operation instruction information acquired in S207 matches the shooting start condition of the shooting scenario list stored in the scenario storage unit 116 is higher than the priority of the cut being shot in S206, it is determined that the cut to be shot will be changed. If the control unit 111 determines that the cut to be shot will be changed (YES in S208), it executes the process of S209, and if it determines that the cut to be shot will not be changed (NO in S208), it executes the process of S211. Note that if the determination in S208 is NO, the cut being shot in S206 will continue to be shot without being changed.

[0057] In S209, the control unit 111 changes the position and attitude of the movable device 100 so that shooting can be performed as described in the changed cut according to the determination in S208.

[0058] In S210, the control unit 111 instructs the imaging control unit 131 of the imaging device 130 to start shooting the changed cut, thereby starting shooting of the changed cut. For example, in S206, it is assumed that a cut with the cut name "side" in the shooting scenario list 300 is being shot. FIG. 4(a) is a schematic diagram showing a shooting screen for the cut with the cut name "side." FIG. 4(a) simply shows a video (image) of a moving subject 150, an automobile 400, being shot from a position a predetermined distance (e.g., 10 m) to the right of the automobile. It is assumed that an operation to open a window is performed in the automobile during shooting of this "side" cut, and the drone acquires control instruction information from the automobile to "open the window." The drone's control unit then compares the priority of the cut name "window," for which the control instruction information "open the window" matches the shooting start condition, with the priority of the cut name "side" being shot. As shown in FIG. 3(b), the cut name "window" has a higher priority than the cut name "side view," so in S208 the control unit 111 determines to change the cut to be shot from the cut name "side view" to the cut name "window." Then, in S209 to S210, the drone's control unit moves the drone to a position a predetermined distance (e.g., 3 m) from the right side of the automobile based on the shooting conditions for the cut name "window," and uses the imaging device 130 to capture a close-up of the person inside the automobile. FIG. 4(b) is a schematic diagram showing the shooting screen for the cut name "window," and simply shows a video (image) of a close-up shot of a person 410 seen through the window of automobile 400.

[0059] In S211, the control unit 111 determines whether the shooting end condition for the cut being shot has been satisfied. The shooting end condition for the cut being shot is determined to have been satisfied when the operation instruction information acquired from the moving subject 150 matches the shooting end condition for the cut being shot. For example, if a window is closed while shooting a cut named "Window" in the shooting scenario list 310, the shooting end condition is determined to have been satisfied based on the operation instruction information indicating that the window has been closed. The shooting end condition is also determined to have been satisfied when a predetermined shooting end condition is satisfied regardless of the operation instruction information, such as "360° shooting completed" for a cut named "Turning" in the shooting scenario list 310. If the control unit 111 determines that the shooting end condition has been satisfied (YES in S211), it executes the process of S212. If the control unit 111 determines that the shooting end condition has not been satisfied (NO in S211), it executes the process of S207.

[0060] In S212, the control unit 111 instructs the imaging control unit 131 of the imaging device 130 to end shooting of the cut that began shooting in S206 or S210. Upon receiving the instruction to end shooting, the imaging control unit 131 performs control to end shooting. As a result, the shooting data (video data) of the cut that began shooting in S206 or S210 is saved in the video recording unit 138.

[0061] Note that if the cut to be shot has been changed in S208, the video data of the cut shot before the change may or may not be saved. When shooting of a predetermined cut by the imaging device 130 is completed, the control unit 111 may control the movement mechanism unit 117 to return the moving device main body 110 to a default position, or may control the moving mechanism unit 117 to maintain the position at the time of shooting completion. After shooting of the cut whose shooting began in S206 or S210 is completed, the imaging control unit 131 resumes live view.

[0062] In S213, the control unit 111 performs a process to update the priority of the shot. Specifically, the priority is updated by lowering the priority of the shot. As a result, the priorities of other shots are increased relative to the priority of the shot, making it easier to shoot the other shots. For example, if the shooting of a shot named "Window" in the shooting scenario list 310 is completed in S212, the priority of the shot named "Window" is lowered by one from "1" to "2." The priority is not limited to being lowered by one, but may be lowered by two, or after a shot with the same shot name has been shot a predetermined number of times, the priority of that shot name may become the lowest of the priorities of other shot names. When there are shots with the same priority, the shooting order may be, for example, from the top of the shooting scenario list 310. Note that if the shooting count is defined in the shooting scenario list 310, the shooting count is decremented by one when one shooting of a specific shot is completed. Shooting of a shot whose shooting count reaches zero (0) is no longer performed.

[0063] In S214, the control unit 111 determines whether or not the designated number of shots has been taken for all of the cuts listed in the shooting scenario list 310. For example, as described above, the shooting scenario list 310 does not list the number of shots for each cut. Therefore, if each of the "side," "turning," and "window" shots has been shot at least once, the determination in S214 will be "YES." On the other hand, if the number of shots for each cut is set to multiple times (e.g., three times), the cut will appear as the same cut in the shooting scenario list, but the background will be different each time, resulting in a wide variety of footage. If the control unit 111 determines that the designated number of shots has been taken for all of the cuts (YES in S214), it ends this process. However, if it determines that the designated number of shots has not been taken for all of the cuts (NO in S214), it executes the process of S204.

[0064] In this way, in the control flow according to the first embodiment, the shots to be shot are changed appropriately according to the operation instruction information and the priority of each shot listed in the shooting scenario list, which allows the user of the shooting system to shoot shots with a wide variety of shooting positions and directions without having to worry about the imaging device.

[0065] Next, a control flow according to a second embodiment will be described. In the second embodiment, control in a photography system when photography is performed using a first photography scenario list and a second photography scenario list, which have different contents, will be described. Note that, like the control flow according to the first embodiment, the control flow according to the second embodiment is also performed using the photography system described with reference to FIG. 1.

[0066] The first shooting scenario list is intended for shooting shots according to a specific purpose. For example, when shooting a promotional video, etc., a shooting scenario list containing many shots of moving subjects in close-up is obtained. Also, when filming driving a car on a trip or holiday, a shooting scenario list containing many shots of the car's foreground and long-distance shots with the surrounding scenery in the background is obtained. On the other hand, the second shooting scenario list is not intended to be dependent on a specific purpose.

[0067] 5 is a flowchart showing the flow of control according to the second embodiment, which is executed by the control unit 111 of the mobile device main body 110 in a series of controls executed in the imaging system. Each process (step) indicated by an S number in this flowchart is realized by the control unit 111 of the mobile device main body 110 executing a predetermined program and controlling the operation of each block in the mobile device main body 110. As with the explanation of the control according to the first embodiment described above, here too, the case will be explained where the moving subject 150 is an automobile and the mobile device main body 110 is a drone.

[0068] In S501, the control unit 111 acquires a first shooting scenario list and a second shooting scenario list from an external terminal (not shown) and stores them in the scenario storage unit 116. Here, the shooting scenario list 300 shown in FIG. 3(a) is also the first shooting scenario list, and will be referred to as the "first shooting scenario list 300a" ​​in the following explanation. An example of the second shooting scenario list is shown in FIG. 6(a). The second shooting scenario list 600 contains cuts with names different from those in the first shooting scenario list 300a (departure, door, curve 1, curve 2). The shooting start conditions, shooting end conditions, and shooting conditions for each cut in the second shooting scenario list 600 are as shown in FIG. 6(a), and therefore will not be described here.

[0069] In S502, the control unit 111 assigns a priority to each cut in the first shooting scenario list 300a and the second shooting scenario list 600 acquired in S501. In S502, the priority assigned to each cut in the first shooting scenario list 300a is set relatively higher than the priority assigned to each cut in the second shooting scenario list 600. This allows priority to be given to shooting cuts in a shooting scenario list that suits a specific purpose.

[0070] The first shooting scenario list 300a to which priorities have been assigned is the same as the shooting scenario list 310 in FIG. 3(b), and will be referred to as the "first shooting scenario list 310a" in the following explanation. An example of the second shooting scenario list 600 to which priorities have been assigned is shown in FIG. 6(b). In the second shooting scenario list 610 in FIG. 6(b), a value indicating a lower priority (a larger numerical value) than the priority set for each cut in the first shooting scenario list 310a is assigned. Note that the method for assigning priorities in S502 may be the same as the method for assigning priorities in S202, and therefore will not be described here.

[0071] Steps S503 to S507 are equivalent to steps S203 to S207 in the flowchart of FIG. 2, and therefore a description thereof will be omitted.

[0072] In S508, the control unit 111 determines whether to change the cut to be shot. In the first embodiment, this determination was made to determine whether to change between cuts listed in one shooting scenario list 310. In contrast, in the second embodiment, the determination is made to determine whether to change between all cuts listed in the first shooting scenario list 310a and the second shooting scenario list 610. In other words, the control unit 111 obtains the priority of a cut (hereinafter referred to as the "next candidate cut") for which the operation instruction information obtained in S507 matches the shooting start conditions of all cuts listed in the first shooting scenario list 310a and the second shooting scenario list 610. Next, the control unit 111 determines whether the priority of the next candidate cut is higher than the priority of the cut whose shooting began in S506, and if it is determined that the priority is higher, the control unit 111 changes the cut to be shot.

[0073] Here, examples of the judgment made in S508 will be described. First, as a first example, consider a case where shooting of a specific cut listed in the first shooting scenario list 310a has started immediately before in S506. As described above, in S502, the priority assigned to each cut in the first shooting scenario list 310a is set relatively higher than the priority assigned to each cut in the second shooting scenario list 610. On the other hand, in the subsequent S513, similar to S213, the priority of cuts whose shooting has been completed is lowered. Therefore, in the first example, if the next candidate cut is a cut listed in the second shooting scenario list 610, and the priority of the cut being shot is lower than that of the next candidate cut, a cut change is made in S508. Similarly, in the first example, if the next candidate cut is another cut listed in the first shooting scenario list 310a, and the priority of the cut being shot is lower than that of the next candidate cut, a cut change is made in S508.

[0074] As a second example, consider the case where shooting of a specific cut listed in the second shooting scenario list 610 has started immediately before in S506. In the second example, if the next candidate cut is another cut listed in the second shooting scenario list 610, a cut change is made in S508 if the priority of the cut being shot is lower than that of the next candidate cut. Similarly, in the second example, if the next candidate cut is a cut listed in the first shooting scenario list 310a, a cut change is made in S508 if the priority of the cut being shot is lower than that of the next candidate cut.

[0075] In S509, the control unit 111 changes the position and attitude of the mobile device 100 so that the next candidate shot determined in S508 can be photographed.

[0076] Steps S510 to S513 are equivalent to steps S210 to S213 in the flowchart of FIG. 2, and therefore a description thereof will be omitted.

[0077] In S514, the control unit 111 determines whether or not shooting has been completed the designated number of times for all cuts listed in the first shooting scenario list 310a, regardless of whether or not all cuts listed in the second shooting scenario list 610 have been shot. The description of the designated number of times of shooting is the same as that in S214. If the control unit 111 determines that shooting the designated number of times for all cuts in the first shooting scenario list 310a has been completed (YES in S514), it ends this processing. On the other hand, if the control unit 111 determines that shooting the designated number of times has not been completed (NO in S514), it executes the processing of S504.

[0078] In the above explanation, a configuration was described in which priority is set to prioritize the shooting of cuts listed in the first shooting scenario list 310a. In this case, for cuts listed in the first shooting scenario list 310a and for which a specified number of shots have been taken, certain conditions may be added to the priority update in S513 so that shooting is given higher priority. Specifically, the priority is updated in S513 so that the priority of the cut is higher than that of any cut listed in the second shooting scenario list 610 until the specified number of shots have been taken. For example, if the specified number of shots is two, the judgment in S508 is not made until at least two shots have been taken.

[0079] Through this process, in the early stages of shooting, shots listed in the first shooting scenario list 310a that correspond to a specific purpose are shot first, and as shooting progresses, shots listed in the second shooting scenario list 610 are additionally shot. As a result, it becomes possible to obtain footage with a wide variety of shooting positions and directions.

[0080] In the control flow according to the second embodiment, multiple (at least two) shooting scenario lists with different shooting purposes are used, and the shots to be shot are changed appropriately according to the priority of each shot listed in each shooting scenario list. This makes it possible to shoot with a wide variety of shooting positions and directions while giving priority to shooting shots that correspond to the shooting purpose without being conscious of the imaging device.

[0081] While the present invention has been described in detail above based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0082] For example, in S508 in the second embodiment, it was determined whether or not to change the cuts to be shot between the cuts listed in the first shooting scenario list 310a and the cuts listed in the second shooting scenario list 610. However, without being limited to this, whether or not to change the cuts to be shot in S508 may be determined by detecting cuts that match the operation instruction information acquired in S507 from all cuts listed in the first shooting scenario list 310a and the second shooting scenario list 610 and comparing the priorities.

[0083] In the above embodiment, the control unit 111 included in the mobile device main body 110 selected a shooting scenario and instructed the start / end of video recording in accordance with the steering instruction information. This configuration is not limited to the above. For example, a configuration may be adopted in which a server (not shown) controls the mobile device main body 110, the imaging device 130, and the moving subject 150, and the server selects a shooting scenario and instructs the start / end of video recording in accordance with the steering instruction information. In this configuration, the shooting scenario can be stored in the server. For the same reason, a configuration may be adopted in which the steering control unit 151 performs drive control and imaging control of the mobile device 100 by the control unit 111, that is, the steering control unit 151 functions as the above-mentioned server. Furthermore, a configuration in which the mobile device 100 captures images by including the control unit 111 and the imaging control unit 131 has been described. This configuration is not limited to the above. The mobile device 100 may also be configured to include a single control unit that performs drive control of the mobile device main body 110 and imaging control of the imaging device 130.

[0084] Furthermore, in the second embodiment, the process is described for when a cut listed in the first shooting scenario list 310a is initially selected and shooting is started, and then control instruction information corresponding to the cut listed in the second shooting scenario list 610 is received. On the other hand, if control instruction information that matches the shooting start conditions of the cut listed in the second shooting scenario list 610 is first acquired, shooting of that cut may be started. Suppose that control instruction information that matches the shooting start conditions of the cut listed in the first shooting scenario list 310a and that also lists the number of shots is acquired. In this case, the cut to be shot is changed, and then, as explained above, the process of S508 is skipped until the specified number of shots has been shot.

[0085] Furthermore, from the time the moving subject 150 starts moving until the time when the control instruction information corresponding to each cut in the first shooting scenario list 310a is received, shooting may not be performed even if the control instruction information corresponding to each cut in the second shooting scenario list 610 is received. This allows the cuts in the first shooting scenario list 310a to be shot with priority.

[0086] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0087] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An information processing device that controls a moving device equipped with an imaging means and a driving means for movement, characterized in that it comprises: a receiving means that receives, via communication, steering instruction information for a moving subject that requires steering; an acquiring means that acquires a shooting scenario list in which conditions for shooting the moving subject are described for each of a plurality of cuts; an assigning means that assigns a priority to each of the plurality of cuts described in the shooting scenario list; a selecting means that selects a cut to be shot from the plurality of cuts based on the steering instruction information and the priority; and a control means that controls the imaging means and the driving means according to the conditions of the cut selected by the selecting means. (Configuration 2) The information processing device described in Configuration 1 is characterized in that, when the selection means acquires the operation instruction information that matches the conditions of another cut while shooting a specified cut among the multiple cuts, it selects the cut with the higher priority between the specified cut and the other cut. (Configuration 3) The information processing device according to configuration 2, further comprising an update means for lowering the priority of a cut selected by the selection means when shooting of the cut is completed. (Configuration 4) The information processing device described in Configuration 2 is characterized in that the shooting scenario list includes a first shooting scenario list and a second shooting scenario list in which cuts with different conditions are listed, and the assigning means assigns a lower priority to the cuts listed in the second shooting scenario list than the priority to the cuts listed in the first shooting scenario list. (Configuration 5) An information processing device as described in Configuration 4, further comprising an update means for lowering the priority of a cut selected by the selection means when shooting of the cut is completed, wherein the update means does not lower the priority of a cut that is listed in the first shooting scenario list and for which a number of shots has been specified below the priority of a cut listed in the second shooting scenario list until shooting of the number of shots has been completed. (Configuration 6) The information processing device described in Configuration 4 is characterized in that, when the specified cut is a cut listed in the first shooting scenario list and the number of shots is specified, and the other cut is a cut listed in the second shooting scenario list, the selection means selects the specified cut without comparing the priority of the specified cut and the other cut until the number of shots has been completed. (Configuration 7) The information processing device described in any one of configurations 1 to 6, characterized in that the conditions related to the shooting include shooting start conditions, shooting end conditions, and shooting conditions, and the shooting conditions include at least a main subject, the relative position of the moving device with respect to the main subject, and camera work, and the control means controls the imaging means and the driving means to shoot a cut among the multiple cuts whose operation instruction information matches the shooting start conditions. (Configuration 8) The information processing device described in Configuration 7 is characterized in that the control means terminates filming of the cut being filmed when the operation instruction information received by the receiving means for the cut being filmed matches the filming termination condition, or when an operation that was previously set as an operation of the moving device is completed. (Configuration 9) An information processing device described in any one of configurations 1 to 8, comprising an image processing means for detecting the moving subject from the image obtained by the imaging means and tracking the moving subject in the image, and a detection means for detecting the position and attitude of the moving device, wherein the receiving means further receives position information of the moving subject from the moving subject, and the control means controls the driving of the driving means based on the information of the position and attitude of the moving device detected by the detection means, the steering instruction information and the position information, and the tracking result of the moving subject by the image processing means. (Configuration 10) The information processing device according to any one of configurations 1 to 9, characterized in that the information processing device is mounted on the moving device or the moving subject. (Configuration 11) The information processing device according to any one of configurations 1 to 9, wherein the information processing device is a server connected to the mobile device and the moving subject so as to be able to communicate with each other. (Configuration 12) The information processing device according to any one of configurations 1 to 11, wherein the steering instruction information includes at least one of accelerator information, brake information, window opening / closing information, and steering wheel operation information. (Configuration 13) The information processing device described in Configuration 12, characterized in that when the receiving means receives information that the window has been opened as the steering instruction information, the control means controls at least one of the imaging means or the driving means to take a close-up photograph of the moving subject. (Configuration 14) The information processing device described in configuration 12 or 13, characterized in that when the receiving means receives information that the accelerator has been depressed as the steering instruction information, the control means controls the imaging means and the driving means so that the imaging means captures the moving subject without causing the driving means to follow the movement of the moving subject. (Configuration 15) The information processing device described in any one of configurations 12 to 14, characterized in that when the receiving means receives information that the accelerator depression amount is below a certain level as the steering instruction information, the control means controls the imaging means and the driving means so that the moving device rotates around the moving subject and takes an image. (Configuration 16) An information processing device described in any one of configurations 12 to 15, characterized in that when the receiving means receives information that the brakes have been applied without turning the steering wheel as the steering instruction information, the control means controls the imaging means and the driving means to photograph the moving subject from diagonally behind. (Configuration 17) A mobile device comprising an imaging means and a driving means for movement, characterized in that the mobile device comprises: a receiving means for receiving, via communication, steering instruction information for a moving subject that involves steering; an acquiring means for acquiring a shooting scenario list in which conditions for shooting the moving subject are described for each of a plurality of cuts; an assigning means for assigning a priority to each of the plurality of cuts described in the shooting scenario list; a selecting means for selecting a cut to be shot from the plurality of cuts based on the steering instruction information and the priority; and a control means for controlling the imaging means and the driving means in accordance with the conditions described for the cut selected by the selecting means. (Configuration 18) The moving device described in Configuration 17 is characterized in that, when the selection means acquires the operation instruction information that matches the conditions of another cut while shooting a specified cut among the multiple cuts, it selects the cut with the higher priority between the specified cut and the other cut. (Configuration 19) An information processing system having a moving subject that requires manipulation, and a mobile device that is equipped with an imaging means for photographing the moving subject and a driving means for moving in accordance with the movement of the moving subject, wherein the moving subject is equipped with a transmitting means for transmitting manipulation instruction information for the moving subject to the mobile device, and the mobile device is equipped with a receiving means for receiving the manipulation instruction information via communication, an acquiring means for acquiring a shooting scenario list in which conditions for photographing the moving subject are described for each of a plurality of cuts, an assigning means for assigning a priority to each of the plurality of cuts described in the shooting scenario list, a selecting means for selecting a cut to be photographed from the plurality of cuts based on the manipulation instruction information and the priority, and a control means for controlling the imaging means and the driving means in accordance with the conditions described for the cut selected by the selecting means. (Method 1) A control method for an information processing device that controls a moving device equipped with an imaging means and a driving means for movement, comprising the steps of: acquiring a shooting scenario list in which conditions for shooting a moving subject that moves by operation are described for each of a plurality of cuts; assigning a priority to each of the plurality of cuts described in the shooting scenario list; acquiring driving instruction information from the moving subject; selecting a cut from the plurality of cuts in which the conditions and the driving instruction information match; controlling the imaging means and the driving means according to the conditions of the selected cut to shoot the moving subject; and, when the driving instruction information is acquired that matches the conditions of another cut different from the cut being shot, changing the shot to be shot between the cut being shot and the other cut with the higher priority. (Program 1) A program for executing each step in the control method for an information processing device according to Method 1. [Explanation of symbols]

[0088] 100 Mobile Device 110 Mobile device body 111 Control Unit 114 Position and Orientation Detection Unit 115 Image processing section 116 Shooting scenario list storage section 117 Moving mechanism section 118 Communications Department 130 Imaging device 150 Moving subject 151 Steering control unit 157 Flight and Communication Department 300,310 Shooting scenario list 300a, 310a First Filming Scenario List 600,610 Second Filming Scenario List

Claims

1. An information processing device for controlling a moving device having an imaging means and a driving means for moving the device, a receiving means for receiving, via communication, steering instruction information for a moving subject that requires steering; an acquisition means for acquiring a shooting scenario list in which conditions relating to shooting of the moving subject are described for each of a plurality of shots; an assigning means for assigning a priority to each of the plurality of cuts listed in the shooting scenario list; a selection means for selecting a shot to be photographed from the plurality of shots based on the operation instruction information and the priority; an information processing apparatus comprising: a control means for controlling the imaging means and the driving means in accordance with the conditions of the cut selected by the selection means;

2. The information processing device described in claim 1, characterized in that when the selection means acquires the operation instruction information that matches the conditions of another cut while shooting a specified cut among the plurality of cuts, it selects the cut with the higher priority between the specified cut and the other cut.

3. 3. The information processing apparatus according to claim 2, further comprising an update unit that lowers the priority of a cut selected by said selection unit when shooting of the cut is completed.

4. the shooting scenario list includes a first shooting scenario list and a second shooting scenario list in which cuts having different conditions are described; 3. The information processing device according to claim 2, wherein the assigning means assigns a lower priority to the cuts listed in the second shooting scenario list than the priority to the cuts listed in the first shooting scenario list.

5. an update means for lowering the priority of a cut selected by the selection means when shooting of the cut is completed; The information processing device according to claim 4, characterized in that the update means does not lower the priority of a cut that is listed in the first shooting scenario list and for which a number of shots has been specified below the priority of a cut that is listed in the second shooting scenario list until the shooting of the number of shots has been completed.

6. The information processing device described in claim 4, characterized in that when the specified cut is a cut listed in the first shooting scenario list and the number of shots is specified, and the other cut is a cut listed in the second shooting scenario list, the selection means selects the specified cut without comparing the priority of the specified cut and the other cut until the number of shots has been completed.

7. The conditions related to the photography include a photography start condition, a photography end condition, and a photography time condition, the photographing conditions include at least a main subject, a relative position of the mobile device with respect to the main subject, and camera work; The information processing device according to any one of claims 1 to 6, characterized in that the control means controls the imaging means and the driving means so as to shoot a cut among the plurality of cuts for which the operation instruction information matches the shooting start condition.

8. The information processing device described in claim 7, characterized in that the control means ends the filming of the cut being filmed when the operation instruction information received by the receiving means matches the filming termination condition for the cut being filmed, or when an operation that was previously set as an operation of the mobile device is completed.

9. an image processing means for detecting the moving subject from the image obtained by the imaging means and tracking the moving subject in the image; a detection means for detecting the position and attitude of the moving device; the receiving means further receives position information of the moving subject from the moving subject; 3. The information processing device according to claim 1, wherein the control means controls the driving of the driving means based on information on the position and attitude of the moving device detected by the detection means, the steering instruction information and the position information, and the tracking result of the moving subject by the image processing means.

10. 3. The information processing apparatus according to claim 1, wherein the information processing apparatus is mounted on the moving device or the moving subject.

11. 3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a server connected to the mobile device and the moving subject so as to be able to communicate with each other.

12. 3. The information processing device according to claim 1, wherein the operation instruction information includes at least one of accelerator information, brake information, window opening / closing information, and steering wheel operation information.

13. 13. The information processing device according to claim 12, wherein the control means controls at least one of the imaging means or the driving means to take a close-up photograph of the moving subject when the receiving means receives information that the window is open as the steering instruction information.

14. 13. The information processing device according to claim 12, wherein when the receiving means receives information that the accelerator has been depressed as the steering instruction information, the control means controls the imaging means and the driving means so that the imaging means captures an image of the moving subject without causing the driving means to follow the movement of the moving subject.

15. The information processing device according to claim 12, characterized in that when the receiving means receives information that the accelerator depression amount is below a certain level as the steering instruction information, the control means controls the imaging means and the driving means so that the mobile device rotates around the moving subject and takes an image.

16. The information processing device according to claim 12, characterized in that the control means controls the imaging means and the driving means to photograph the moving subject from diagonally behind when the receiving means receives information that the brakes have been applied without turning the steering wheel as the steering instruction information.

17. A moving device comprising an imaging means and a driving means for moving, a receiving means for receiving, via communication, operation instruction information for a moving subject that requires operation; an acquisition means for acquiring a shooting scenario list in which conditions relating to shooting of the moving subject are described for each of a plurality of shots; an assigning means for assigning a priority to each of the plurality of cuts listed in the shooting scenario list; a selection means for selecting a shot to be photographed from the plurality of shots based on the operation instruction information and the priority; a control means for controlling the imaging means and the driving means in accordance with the conditions described for the shot selected by the selection means;

18. The moving device described in claim 17, characterized in that when the selection means acquires the operation instruction information that matches the conditions of another cut while shooting a specified cut among the plurality of cuts, it selects the cut with the higher priority between the specified cut and the other cut.

19. A moving subject that requires maneuvering, an information processing system having an imaging means for imaging the moving subject and a moving device including a driving means for moving in accordance with the movement of the moving subject, The moving subject is a transmitting means for transmitting operation instruction information for the moving subject to the moving device; The moving device is a receiving means for receiving the steering instruction information through communication; an acquisition means for acquiring a shooting scenario list in which conditions relating to shooting of the moving subject are described for each of a plurality of shots; an assigning means for assigning a priority to each of the plurality of cuts listed in the shooting scenario list; a selection means for selecting a shot to be photographed from the plurality of shots based on the operation instruction information and the priority; an information processing system comprising: a control means for controlling the imaging means and the driving means in accordance with the conditions described for the shot selected by the selection means;

20. A control method for an information processing device that controls a moving device having an imaging means and a driving means for movement, comprising: obtaining a shooting scenario list in which conditions for shooting a moving subject that moves by operation are described for each of a plurality of shots; a step of assigning a priority to each of the plurality of cuts listed in the shooting scenario list; receiving steering instruction information from the moving subject; selecting a cut that matches the condition and the operation instruction information from the plurality of cuts; a step of controlling the imaging means and the driving means in accordance with the conditions of the selected shot to photograph the moving subject; A control method for an information processing device characterized by comprising a step of changing the cut to be shot to the cut being shot or the other cut with the higher priority when the operation instruction information is acquired that meets the conditions of another cut different from the cut being shot.

21. A program for executing each step of the method for controlling an information processing device according to claim 20.

Images