Aerial video provision service system and aerial control method for the aerial video provision service system

Abstract

The service provides tourists visiting tourist spots who can simply take a picture of a flight request board with their data terminal, and then view video files of aerial footage captured by automated flight on the data terminal they operate. [Solution] When a tourist operates one of the first to fourth data terminals, and the camera captures an image of a flight request instruction board placed at a tourist spot, the connection unit connects to the aerial photography platform 1A provided by the server device 1. The server device 1 sends a flight start signal to the unmanned aircraft (drones) D1 to D4 to take aerial photographs of the tourist spot. While flying along the stored aerial photography flight route, the cameras CAM1 to CAM4 capture aerial video data, which is then sent to the server device 1. The server device 1 then uses AI editing to edit the received aerial video data and sends it back to one of the first to fourth data terminals operated by the tourist.

Description

Technical Field

[0001] The present invention relates to an aerial video providing service system that receives an aerial photography request from an application installed on a data terminal, supports the departure and arrival of a drone, and provides a video service by aerial photography using the drone, and an aerial photography control method for the aerial video providing service system.

Background Art

[0002] In recent years, operating a drone equipped with a camera and imaging a video from above to provide impressive images that cannot be viewed from the ground has been carried out in various scenes including TV programs.

[0003] On the other hand, the operation of a drone requires certain training, and it is difficult for those with little experience to fly a drone as intended. To ensure safe flight, a qualified person who has passed the examination in flight training is required for the operation of the drone, and flight in restricted flight areas is generally prohibited. In addition, in order to fly a drone in a specific area, it is necessary to apply for a flight plan to the Ministry of Land, Infrastructure, Transport and Tourism and obtain permission. In addition, Patent Document 1 below discloses an aerial video providing system that can provide video data obtained by aerial photography using a drone with a simple operation.

[0004] Patent Document 1 discloses that, in order to provide an aerial video provision system, information terminal device, aerial video provision method, and aerial video provision program that can provide aerial video data captured using an unmanned aerial vehicle with simple operation, the communication unit 101 of the information terminal device 100 receives video data captured by the camera unit 203 of the unmanned aircraft 200 from the unmanned aircraft 100 and transmits the received video data to the management server 300. The communication unit 301 of the management server 300 stores the video data received from the information terminal device 100 in the video data storage unit 320, and the communication unit 301 transmits a URL indicating the storage location of the video data in the video data storage unit 320 to the information terminal device 100. The two-dimensional code generation unit 105 of the information terminal device 100 generates a two-dimensional code from the URL received from the management server 300, and the input / output unit 103 displays the two-dimensional code.

[0005] Furthermore, Patent Document 2 discloses "an information processing device that enables users to easily perform effective photography according to the subject and location. The device includes a flight route generation unit that presents a template of flight route information indicating the flight route of an aircraft, and, based on user operation, associates the flight route information of the selected template with the flight range of the aircraft and generates flight route information for the aircraft."

[0006] Furthermore, Non-Patent Document 1 below has been published, which shows the configuration of a typical unmanned aerial vehicle equipped with a camera function. [Prior art documents] [Patent Documents]

[0007] [Patent Document 1] Japanese Patent Publication No. 2023-6929 [Patent Document 2] International Publication No. 2015 / 163012 [Non-patent literature]

[0008] [Non-Patent Document 1] DJI Store, Let's Fly! First Flying Camera Experience Event @ Osaka / Nagoya, [online], January 17, 2020, [Searched December 22, 2023], Internet<URL:https: / / store.dji.com / jp / guides / lets-fly-mavicmini / > [Overview of the Initiative] [Problems that the invention aims to solve]

[0009] However, the system described in Patent Document 1 requires operators to take off and land the unmanned aerial vehicle. Therefore, in order to adopt this system as an aerial photography service in tourist areas, it would be necessary to secure operators at all times during tourist hours. In addition to system maintenance, the management and operating costs would need to be covered, and there was a risk that the service fee paid by the user would exceed 10,000 yen per flight.

[0010] Furthermore, since the flight routes for drones are determined by limitations on flight time based on battery capacity, they are usually limited to one route per aerial photography service. In other words, it has been pointed out that if the aerial photography route is limited to just one during the holiday season, it becomes impossible to provide attractive aerial video services to tourists, even though the level of interest shown by tourists changes depending on the season, such as cherry blossoms, autumn leaves, summer festivals, autumn festivals, and fresh greenery.

[0011] The present invention was made to solve the above problems, and the object of the present invention is to provide an aerial video provision service system and an aerial video control method for the aerial video provision service system that can freely deploy a paid aerial video provision service system in which tourists visiting tourist spots can perform a simple operation of taking an image of a flight request instruction board with a data terminal, and the raw aerial video data of a professional photographer taking aerial shots of scenic spots that are normally inaccessible to tourists on the day of their visit, from angles envisioned by the photographer, is delivered from a server device to a data terminal. [Means for solving the problem]

[0012] The aerial video provision service system of the present invention, which achieves the above objective, has the following configuration.

[0013] The first invention is an aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the unmanned aircraft is equipped with flight control means that controls the flight state so as to receive aerial photography flight instructions from the server device, start flying from a return point, fly around on an aerial photography flight route selected by the data terminal, and land at the return point, and video transmission means that transmits video data captured by the first camera to the server device. The second invention is an aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the data terminal comprises a second camera for imaging a flight request instruction board adjacent to the return position, connection means for connecting to a service screen provided by the server device by analyzing the image of the flight request instruction board captured by the second camera, route selection means for selecting a desired flight route from a list of flight routes displayed on the service screen, payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected, and receiving means for receiving aerial video data of tourist spots that has been AI edited from the aerial video data transmitted from the unmanned aircraft to the server device. The third invention is an aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, wherein the server device comprises editing means for receiving the aerial video data received from the unmanned aircraft and performing AI editing, and transmission means for transmitting the AI-edited aerial video data of tourist spots to the data terminal. The fourth invention is an aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the unmanned aircraft includes flight control means that, upon receiving aerial photography flight instructions from the server device, starts flying from a return point, performs a circular flight along an aerial photography flight route selected by the data terminal, and controls the flight state to land at the return point, and video transmission means that transmits video data captured by the first camera to the server device, and the data terminal includes a second camera that images a flight request instruction board adjacent to the return point, and the flight request instruction board imaged by the second camera The system comprises: connection means for connecting to a service screen provided by the server device by analyzing the image; route selection means for selecting a desired flight route from a list of flight routes displayed on the service screen; payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected; and receiving means for receiving aerial photography video data of tourist spots that has been AI-edited from the aerial photography video data transmitted from the unmanned aircraft to the server device. The server device further comprises: editing means for receiving the aerial photography video data received from the unmanned aircraft and AI-editing it; and transmission means for transmitting the AI-edited aerial photography video data of tourist spots to the data terminal. [Effects of the Invention]

[0014] According to the present invention, a paid aerial photography service can be freely developed that can distribute from a server device to a data terminal impressive aerial photography video data full of a sense of speed and seasonal feeling, in which a professional cameraman takes an aerial photograph of a scenic spot that cannot usually be entered on the day of the tourist spot from an assumed angle.

Brief Description of the Drawings

[0015] The drawings show specific embodiments of the present invention and include not only essential configurations of the invention but also optional and preferred embodiments. [Figure 1] A block diagram for explaining the configuration of an aerial photography video providing service system showing this embodiment. [Figure 2] A block diagram for explaining the configuration of drones arranged at the first to fourth tourist spots shown in FIG. 1. [Figure 3] A block diagram for explaining the configuration of the server device shown in FIG. 1. [Figure 4] (a) is a block diagram for explaining the configuration of the first to fourth data terminals connected to the server device shown in FIG. 1, and (b) is a diagram showing the configuration of a program developed in the RAM shown in (a). [Figure 5] A diagram showing the relationship between the flight route and flight altitude when the first to fourth drones shown in FIG. 1 take an aerial photograph of a tourist spot. [Figure 6] A conceptual diagram for explaining an operation in which a tourist operating the first data terminal shown in FIG. 1 reads an aerial photography request board by his own operation. <OPTIONAL>A flowchart showing an example of an aerial photography flight processing procedure of a drone in an aerial photography video providing service system showing this embodiment. [Figure 8] A flowchart showing an example of an aerial photography flight processing procedure of a drone in an aerial photography video providing service system showing this embodiment. [Figure 9] A flowchart showing an example of an aerial photography flight processing procedure of a drone in an aerial photography video providing service system showing this embodiment. [Figure 10]A flowchart showing an example of the data processing procedures of the first to fourth data terminals in the aerial video providing service system according to this embodiment. [Figure 11] A flowchart showing an example of the data processing procedures of the first to fourth data terminals in the aerial video providing service system according to this embodiment. [Figure 12] A flowchart showing an example of the data processing procedures of the server device in the aerial video providing service system according to this embodiment. [Figure 13] A flowchart showing an example of the data processing procedures of the server device in the aerial video providing service system according to this embodiment.

Best Mode for Carrying Out the Invention

[0016] Next, the best mode for carrying out the present invention will be described with reference to the drawings.

[0017] <Explanation of System Configuration> 〔First Embodiment〕 FIG. 1 is a block diagram for explaining the configuration of an aerial video providing service system according to this embodiment. In this embodiment, via a predetermined communication medium, any one of unmanned aircraft (drones) D1 to D4 equipped with cameras for aerial photography of tourist spots, the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N operated by tourists, and a server device 1 for instructing the unmanned aircraft to perform aerial photography flight are used as an example of an aerial video providing service system that can communicate with each other. However, the number of standby aircraft of any one of the drones D1 to D4 arranged at the tourist spot may be composed of a plurality. The first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N have a function of performing two-way wireless communication via antennas AT1 to AT4 and a network 21 according to a predetermined wireless communication protocol.

[0018] Furthermore, since the size of each of the D1 to D4 drones will depend on the lift required depending on the weight of the mounted camera, multiple variations are expected.

[0019] Furthermore, in order to accurately follow the flight path without being affected by wind speed, multiple variations in the number of lift-generating blades are assumed.

[0020] Furthermore, server device 1 will monitor the position, altitude, and flight speed of any of the drones D1 to D4 in flight and perform flight route feedback control to prevent them from deviating from the flight route.

[0021] Furthermore, while aerial footage captured by drones D1 through D4 typically uses the 2.4GHz and 5GHz Wi-Fi bands, 4K video requires high-speed data transfer due to its large data volume. The 5GHz band enables high-speed data transfer and has less interference, resulting in more stable communication. Furthermore, this system complies with the drone information infrastructure system proposed by the Ministry of Land, Infrastructure, Transport and Tourism, and has cleared all requirements such as aircraft registration and remote control application, and is authorized to remotely control the flight of drones D1 to D4 in accordance with instructions from server device 1. Here, the remote control system is configured to also allow the drones to fly along a stored aerial photography route (with multiple aerial photography points registered) based on flight signals transmitted from server device 1 to one of the drones D1 to D4 at the tourist site, prior to fully automated flight.

[0022] In Figure 1, 1 is a server device that communicates with the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, which are operated by tourists staying at various tourist spots connected via the network 21 through the aerial photography platform 1A, and provides aerial video services. Here, the network 21 includes wireless and wired interfaces, and by communicating with any of the drones D1 to D4 and the server device 1 via an access point (not shown), the network 21 can instruct any of the drones D1 to D4 to take off, perform aerial photography, and land. The drones will then safely and professionally perform aerial photography along a set aerial photography route close to the tourist spot, capturing dynamic and dynamic shots from above. The captured video data will then be further edited by AI on the server device 1, providing a service that transmits highly impressive video files to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, which are operated by the tourists. These files will allow tourists to feel the air, temperature, and humidity of the day of their visit, as if they were piloting the drone themselves and viewing the tourist spot from above.

[0023] Here, the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N include cases where services are provided to different tourist destinations, cases where the first data terminals 3-1 to 3-N and the second data terminals 4-1 to 4-N provide services as tourists staying in the same tourist destination, and cases where the third data terminals 5-1 to 5-N and the fourth data terminals 2-1 to 2-N provide services as tourists staying in the same tourist destination, and the combination of data terminals is set arbitrarily.

[0024] Furthermore, 21 is a network that mediates bidirectional data communication between the server device 1 and the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N using a predetermined protocol.

[0025] Here, the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N are all equipped with an imaging unit (first camera) and have a two-dimensional code reading application already installed.

[0026] Specifically, camera CAM1, which functions as the first camera and is associated with the first data terminals 3-1 to 3-N; camera CAM2, which functions as the second camera and is associated with the second data terminals 4-1 to 4-N; camera CAM3, which functions as the third camera and is associated with the third data terminals 5-1 to 5-N; and camera CAM4, which functions as the fourth camera and is associated with the fourth data terminals 2-1 to 2-N, have images printed on the aerial photography request boards (flight request instruction boards) BD1 to BD4, which are located next to the drone landing and takeoff areas of the first to fourth tourist spots SP1 to SP4 (described later), that contain a two-dimensional code image of a URL that identifies the aerial photography platform 1A provided by server device 1.

[0027] As a result, when the aerial photography request boards (flight request instruction boards) BD1~BD4, which are located next to the drone landing and takeoff area of ​​the tourist destination, are read by the application being launched, the camera CAM1, which is associated with the first data terminals 3-1~3-N functioning as the first camera, the camera CAM2, which is associated with the second data terminals 4-1~4-N functioning as the second camera, the camera CAM3, which is associated with the third data terminals 5-1~5-N functioning as the third camera, and the camera CAM4, which is associated with the fourth data terminals 2-1~2-N functioning as the fourth camera, are read by the application being launched, they are connected to the aerial photography platform 1A, and the menu screen is displayed as the initial screen on the touch panel displays 311 of the first data terminals 3-1~3-N, the second data terminals 4-1~4-N, the third data terminals 5-1~5-N, and the fourth data terminals 2-1~2-N.

[0028] Here, tourists operating the first data terminal 3-1~3-N, the second data terminal 4-1~4-N, the third data terminal 5-1~5-N, and the fourth data terminal 2-1~2-N can select aerial photography routes set for each tourist spot or instruct one of the drones D1~D4 to start flying by operating the menu screen. The flight program is registered so that one of the drones D1~D4 that has started flying will take off from the marker section of the flight route selected by the tourist (which is both the takeoff point and the landing point), complete a certain amount of flight time, and then return to the marker section (section H (home position section)) and land.

[0029] Furthermore, at the first to fourth tourist spots SP1 to SP4, aerial photography request boards (flight request instruction boards) BD1 to BD4 are placed close to the take-off and landing points (which also serve as return points) for one of the drones D1 to D4. The aerial photography request boards BD1 to BD4 are equipped with wireless antennas and are configured to communicate with server device 1 in accordance with wireless communication protocols.

[0030] Furthermore, the aerial photography request boards (flight request instruction boards) BD1 to BD4 shall have identification images, converted into two-dimensional codes (QR1 to QR4), attached in advance.

[0031] Therefore, each of the first data terminals 3-1 to 3-N is equipped with a camera CAM1, and when a tourist activates the QR code reading application and captures the above-mentioned QR codes (QR1 to QR4) by operating it themselves, they can automatically connect to the aerial photography platform 1A provided by the server device 1, which is the communication destination (URL).

[0032] Similarly, each of the second data terminals 4-1 to 4-N is equipped with a camera CAM2. When a tourist activates a QR code reading application and captures the QR codes (QR1 to QR4) themselves, they can automatically connect to the aerial photography platform 1A provided by the server device 1, which is the communication destination (URL).

[0033] Similarly, each of the third data terminals 5-1 to 5-N is equipped with a camera CAM3. When a tourist activates a QR code reading application and captures the above-mentioned QR codes (QR1 to QR4) using their own operation, they can automatically connect to the aerial photography platform 1A provided by the server device 1, which is the communication destination (URL).

[0034] Similarly, each of the fourth data terminals 2-1 to 2-N is equipped with a camera CAM4. When a tourist activates a QR code reading application and captures the QR code, they can automatically connect to the aerial photography platform 1A provided by the server device 1, which is the communication destination (URL).

[0035] Figure 2 is a block diagram illustrating one of the configurations of drones D1 to D4, which are placed at the first tourist spot SP1, the second tourist spot SP2, the third tourist spot SP3, and the fourth tourist spot SP4 shown in Figure 1.

[0036] In Figure 2, D1 to D4 are unmanned aircraft (drones) equipped with a communication unit DR1, a camera unit DR2, a GPS unit DR3, a flight control unit DR4, a main unit control unit DR5 that comprehensively controls these, an image memory unit DR6, a battery unit DR7, a reception unit DR8, and an unmanned aircraft control data storage unit DR9. When the communication unit DR1 receives flight instructions from the server device 1 via the network 21, it reads the flight route information stored in advance in the flight control unit DR4, thereby controlling the start and stop of the rotating fan of the drone body. The main unit control unit DR5 controls the start of shooting by the camera unit DR2, which can adjust the imaging direction 360 degrees, and the transmission of aerial images to the server device 1.

[0037] Furthermore, the flight control unit DR4 has a function to acquire position information received by the GPS unit DR3 and determine whether or not the aircraft is flying along a pre-stored flight route.

[0038] Furthermore, the reception unit DR8 executes a process to receive one of the flight patterns stored in the unmanned aerial vehicle control data storage unit DR9 from the server device 1.

[0039] The imaging memory unit DR6 temporarily stores the imaging data captured by the camera unit DR2 from the air, and, while synchronized with the communication unit DR1, transmits the imaging data, which consists of a predetermined number of frames per second, to the server device 1 according to a 4G or 5G protocol.

[0040] The DR7 battery unit primarily supplies power to the DC motor that drives the rotor (rotating blades) (not shown), and also supplies power to other components as needed.

[0041] Power consumption varies depending on the number of rotors, but it is proportional to the rotor operating time, and the flight time of the drone itself is generally less than one hour.

[0042] The AT is an antenna that is configured to transmit aerial video data (aerial video data) to the server device 1 via an access point (not shown) using a wireless protocol, and to receive flight control information (takeoff instructions, route flight instructions, shooting angle control instructions, return instructions, landing instructions) from the server device 1.

[0043] However, the flight control instructions based on the registered aerial photography flight route may be configured to be stored in advance as a control program.

[0044] Furthermore, the flight control unit DR4 normally flies in a trajectory that circles the stored imaging flight route. However, through communication with the server device 1, if the server device 1 determines that the flight-permissible wind speed value at the first to fourth tourist spots SP1 to SP4 exceeds a threshold, it notifies the data terminal of a first alert indicating the cancellation of the aerial photography flight. In response, when the main control unit DR5 receives the first alert from the server device 1, it displays the reason for the flight cancellation in the aerial photography request on the first data terminals 3-1 to 3-N.

[0045] Furthermore, if the server device 1 compares the aerial photography flight route selected by the tourist with the sun's movement path over the tourist spot and determines that it will fly through a backlit area, it will send a second alert to the first data terminals 3-1~3-N, the second data terminals 4-1~4-N, the third data terminals 5-1~5-N, and the fourth data terminals 2-1~2-N, informing them that the orbital position of the flight route will be corrected. In response, the main control unit DR5 controls the rotor drive by the flight control unit DR4 to correct the flight conditions set for the aerial photography flight route selected by the tourist.

[0046] This allows the DR2 camera unit to capture the clearest possible video even when it is directly exposed to backlight during aerial photography.

[0047] Furthermore, if the server device 1 compares the aerial photography flight route selected by the tourist with the sun's movement routes for the first to fourth tourist spots SP1 to SP4 and determines that it will fly in a backlit area, and if the server device 1 proposes a change in the flight route to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, and the tourist approves the proposed change in the flight route, the main control unit DR5 controls the rotor drive by the flight control unit DR4 to change the aerial photography flight route selected by the tourist.

[0048] Figure 3 is a block diagram illustrating the configuration of the server device 1 shown in Figure 1. In Figure 3, 11 is the communication unit, which controls the communication process connecting to the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, which are connected to the network 21 as a communication medium.

[0049] 13 is the CPU, which starts the operating system (OS) stored in external memory 18 connected to the internal bus 12, and starts various applications installed via APIs. It also executes the processing of various programs deployed on RAM 16.

[0050] 14A is an aerial photography editing program database, which stores image editing applications and procedures generated by the AI ​​support unit 19 for aerial video data captured by cameras CAM1 to CAM4 when flying along aerial photography flight routes set adjacent to tourist spots transmitted from drones D1 to D4 via the network 21.

[0051] 14B is an aerial video database that temporarily stores aerial video data captured by cameras CAM1 to CAM4 when flying along an aerial flight route set adjacent to a tourist spot transmitted via network 21 from one of drones D1 to D4.

[0052] Specifically, when any of the drones D1 to D4 takes aerial photos along a flight route selected by the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, the system learns the received aerial video data and stores it in the aerial video database 14B, which is an external memory 18.

[0053] 16 is expandable RAM, which stores the basic program of the aerial photography platform 1A installed in external memory 18.

[0054] Here, the RAM16 is configured with the AI ​​editing unit 16-1, the transmission unit 16-2, the first alert unit 16-3, the second alert unit 16-4, and the proposal unit 16-5. The CPU 13 executes these functions as appropriate according to the flowchart described later, thereby realizing various aerial video editing processes.

[0055] Specifically, the AI ​​editing unit 16-1 receives the aerial video data received from one of the drones D1 to D4 and performs AI editing.

[0056] In this embodiment, the AI ​​editing features the following first to fifth effects, and performs versatile AI image editing processing by combining multiple effects.

[0057] The first effect here is the slow-motion effect, which, for example, emphasizes beautiful scenery or movement by showing a specific scene in slow motion.

[0058] The second effect is the time-lapse effect, which can be used to represent the passage of time, such as the sunset or the growth of plants.

[0059] The third effect is the miniature effect, which makes aerial footage appear like a miniature, creating a sense of spaciousness.

[0060] The fourth effect is the background music addition effect, which enhances the visual beauty of the video by adding music or narration.

[0061] The fifth effect is the filter effect, which changes the atmosphere of a video by adjusting the hue and contrast.

[0062] Furthermore, the transmission unit 16-2 performs the process of sending the AI-edited aerial video data of tourist spots, which has been edited by the AI ​​editing unit 16-1, to the requesting data terminal.

[0063] The first alert unit 16-3, when it determines that the flight-permitted wind speed value among the weather conditions set for any of the drones D1 to D4 exceeds a threshold by comparing it with the wind speed forecast value along the flight route obtained from the weather site, executes a process to alert the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N to cancel the aerial photography flight.

[0064] Furthermore, the second alert unit 16-4 compares the flight path of the unmanned aircraft with the sun's movement path over the tourist spot and, if it determines that the aircraft is flying in a backlit area, it executes a process to alert the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N that the orbital position of the flight path will be corrected.

[0065] The proposal unit 16-5 compares the flight path of any of the drones D1 to D4 with the sun's movement path at tourist spots SP1 to SP4, and if it determines that the drone will be flying in a backlit area, it executes a process to propose a change to the flight path to the data terminal.

[0066] 17 is a touch panel display that shows the program's startup status through various non-illustrated UI screens.

[0067] Figure 4 is a block diagram illustrating the configuration of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, which are connected to the server device 1 shown in Figure 1.

[0068] The first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5-N are envisioned to be devices such as tablet devices, PC devices, and smartphones.

[0069] In Figure 4(a), 301 is the CPU, which executes various applications by loading the OS and control programs stored in ROM 302 into RAM 303 and executing them. 304 is the communication unit, which controls communication for connecting to the server device 1 connected to network 21. 311 is a touch panel display, which is configured to allow users to freely select tabs and icons on the displayed screen.

[0070] Camera 305 is a second camera capable of capturing still images and videos, and the captured images and videos are recorded in RAM303.

[0071] In the RAM 303 shown in Figure 4(b), the login unit 303-1 performs a process to authenticate the ID and password of the user performing the terminal operation.

[0072] 303-3 is a UI control unit that executes browser function processing and controls the display on the touch panel displays 311 of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, which are provided by the aerial photography platform 1A shown in Figure 1.

[0073] Furthermore, the UI control unit 303-3 receives the aerial video file edited by the server device 1, saves it to a non-volatile memory (not shown) or a non-volatile memory area, and the video can be played by launching a video application downloaded by the download unit 303-2 from the application site.

[0074] 303-4 is a connection section that analyzes a two-dimensional image (e.g., a QR code® image) attached to the flight request instruction board BD1 captured by the second camera 305, and performs a process to connect to the service screen provided by the aerial photography platform 1A of the server device 1.

[0075] 303-5 is the route selection unit, which executes the process of selecting the desired flight route from the list of flight routes displayed on the service screen.

[0076] Furthermore, the flight route is configured so that the server device 1 can add the optimal aerial flight route based on multiple flight conditions such as season, weather conditions, and the position of the sun, by AI analysis of the aerial video data it learns.

[0077] 303-6 is the receiving unit, which receives AI-edited aerial video data of tourist spots from the server device 1, which is transmitted from one of the drones D1 to D4.

[0078] Unit 303-7 is the payment unit, which processes the payment (including electronic payment and point payment) for the aerial photography service fee presented when the desired flight route is selected by the route selection unit 303-5.

[0079] Furthermore, the receiving unit 303-6 is also configured to receive video files associated with aerial video data of tourist spots received from the server device 1 via the SNS screens installed on the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N.

[0080] Figure 5 shows the relationship between the flight routes and altitudes when drones D1 to D4, shown in Figure 1, take aerial photographs of the first to fourth tourist spots SP1 to SP4.

[0081] In this example, the first to fourth tourist spots, SP1 to SP4, are schematically described using, for example, Itsukushima Shrine on Miyajima Island in Hiroshima Prefecture.

[0082] In this instance, after landing on Miyajima, tourists operating one of the following data terminals—for example, the first data terminal 3-1~3-N, the second data terminal 4-1~4-N, the third data terminal 5-1~5-N, or the fourth data terminal 2-1~2-N—which is used to operate one of the drones D1~D4, will activate a QR code reading application attached to the aerial photography request board (flight request instruction board) BD1 (including cases where it is attached inside a waterproof transparent case). When they scan the QR code QR1, they will automatically connect to the aerial photography platform 1A provided by the server device 1, which will be the communication destination (URL).

[0083] Here, the server device 1 transmits a screen for selecting one of the multiple aerial photography flight routes registered in the drone D1's unmanned aerial vehicle control data storage unit DR9 to the touch panel display 311 of one of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, or the fourth data terminals 2-1 to 2-N.

[0084] The unmanned aerial vehicle control data storage unit DR9 stores flight data indicating the flight path of one of the drones D1 to D4, along with a flight pattern that identifies the flight data, imaging conditions, and weather conditions, all associated with each other.

[0085] This allows tourists to select one aerial flight route from a library of aerial photography images showcasing the attractions of Miyajima.

[0086] Next, the server device 1 sends an instruction (flight permission instruction) to the main control unit DR5 of one of the drones D1 to D4 to select a flight route and prepare for takeoff, so that one of the drones D1 to D4 can fly the selected aerial photography flight route.

[0087] The selected aerial photography flight route, according to the flight management program of the main control unit DR5, involves ascending to an altitude of 25m to capture a video of the Great Torii gate from above, then flying across from the left while keeping the Great Torii gate in view, and finally descending to an altitude of approximately 3m above sea level. [omitted] Next, one of the drones D1 to D4 will ascend to an altitude of 20m to take aerial photographs of the lanterns of Itsukushima Shrine on Miyajima Island by circling above them. It will then fly along the set aerial photography flight route, at the set flight speed, capturing the lanterns and the main torii gate located around the shrine, and finally hover above the takeoff point, descending sequentially to return to base.

[0088] Figure 6 is a conceptual diagram illustrating how a tourist operating one of the data terminals 3-1 to 3-N shown in Figure 1 reads the aerial photography request board BD1 through their own operation.

[0089] Specifically, this corresponds to the state in which the two-dimensional code QR1 is scanned while the two-dimensional code reading application attached to the (flight request instruction board) BD1 (including when it is attached inside a waterproof transparent case) is running.

[0090] Furthermore, the main control unit DR5 can also be controlled to start a normal aerial photography flight only after commemorative aerial photography of the visitor themselves has been completed, for which a spot fee is paid as an optional aerial photography service. Additionally, by paying a spot fee for optional aerial photography, it's possible to control the system so that the visitor is captured in a commemorative aerial photograph and any messages they make are recorded via microphone before the regular aerial photography flight begins.

[0091] [Aerial photography flight processing for drones D1-D4] Figures 7 to 9 are flowcharts illustrating an example of the aerial photography flight processing procedure for drones D1 to D4 in the aerial photography video provision service system shown in this embodiment. (1) to (19) indicate each step, and each step is realized by the main control unit DR5 executing a control program stored in it.

[0092] First, the main control unit DR5 determines whether it has received an aerial photography flight instruction from the server device 1 (1), and if it determines that it has received the instruction, the main control unit DR5 performs a pre-flight check (2).

[0093] Here, the pre-flight check includes a battery level check, which involves determining whether flight is possible based on the power consumption during the flight time, which is determined by the desired aerial photography flight route selected from the first data terminal 3-1 to 3-N operated by the tourist, and the remaining battery level.

[0094] Here, the main control unit DR5 shall notify the server device 1 that the pre-flight check is complete once it has completed the pre-flight checklist that has been created in advance.

[0095] Next, it is determined whether the server device 1 is receiving local weather data collected based on GPS information assigned to one of the drones D1 to D4 that is in flight (3).

[0096] Here, the main control unit DR5 analyzes the weather conditions received from the server device 1 to determine whether aerial photography flight is possible safely (4). The main control unit DR5 determines whether the wind speed data among the weather data received from the server device 1 exceeds the wind speed value specified in the flight restrictions.

[0097] If the main control unit DR5 determines that the aircraft is unable to fly, it notifies the server device 1 of the inability to fly (19) and terminates this process.

[0098] On the other hand, in step (4), if the main control unit DR5 determines that flight is possible, it determines whether each rotor is started (for example, if there are 4 rotors, it determines whether all 4 rotors are rotating by detecting with a sensor not shown) (5). If the main control unit DR5 determines that the rotors are not started, it notifies the server device 1 that flight is impossible (19) and terminates this process.

[0099] Meanwhile, in step (5), if the main control unit DR5 determines that each rotor is OK to start, it sets the aerial photography route selected by the tourist in the flight control unit DR4 (6).

[0100] Next, the main control unit DR5 activates (ON) the first camera (7) and gradually increases the altitude of one of the drones D1 to D4 to determine whether it has reached a predetermined altitude (flight start altitude) (8). If the main control unit DR5 determines that it has reached a predetermined altitude (flight start altitude), it proceeds to step (9).

[0101] Next, the flight control unit DR4 reads the aerial photography flight route (9) and starts the aerial photography flight by independently controlling the rotation speed of the multiple rotors (10).

[0102] Furthermore, several route points that must be passed through are pre-set along the aerial photography flight path.

[0103] Therefore, the flight control unit DR4 executes a process to read the route point N, which indicates the number of route points (11).

[0104] Next, the flight control unit DR4 compares the current GPS information to determine whether the first route point has been passed (12). If the flight control unit DR4 determines that the first route point has been passed, it performs a process to subtract "1" from route point N (13), and the flight control unit DR4 determines whether route point N is "0" (14).

[0105] At this point, if the flight control unit DR4 determines that route point N is not "0", it returns to step (13) and continues the aerial photography flight of one of the drones D1 to D4.

[0106] On the other hand, in step (14), if the flight control unit DR4 determines that route point N is "0", it determines that it has performed an aerial photography flight along a pre-set flight route and determines whether the current position information (GPS) is above the flight start point (home position) of any of the drones D1 to D4 (15). If the flight control unit DR4 determines that the drones D1 to D4 are not above their home positions, it returns to step (12).

[0107] On the other hand, in step (15), if the flight control unit DR4 determines that any of the drones D1 to D4 is above the home position, the flight control unit DR4 gradually reduces the rotation speed of the rotor (the blades fixed to a rotating shaft composed of servo motors) in order to lower the altitude of any of the drones D1 to D4 (16).

[0108] Then, once the flight control unit DR4 confirms that any of the drones D1 to D4 has landed at their home position (17), it stops all rotors, notifies the server device 1 that the drones have returned (18), and terminates this process.

[0109] This allows tourists to scan a QR code image with a data terminal they operate, receive a flight start instruction from server device 1, and automatically transmit aerial video data to server device 1 while flying along the desired flight route.

[0110] [Examples of data processing for data terminals 1 to 4] Figures 10 and 11 are flowcharts illustrating an example of the data processing procedure for the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N in the aerial video provision service system illustrating this embodiment. (21) to (35) indicate each step, and each step is realized by the CPU 301 executing a control program stored in an external memory (not shown).

[0111] First, the CPU 301 starts the QR code reading application installed on the first to fourth data terminals operated by the tourists (21). In this state, the CPU 301 enables the camera function installed on the first data terminal 3-1 to 3-N, the second data terminal 4-1 to 4-N, the third data terminal 5-1 to 5-N, and the fourth data terminal 2-1 to 2-N. Then, after the CPU 301 has finished reading the QR code printed on the flight request instruction board BD1 located near the drone D1 (22), the CPU 301 waits for the URL to connect to the aerial photography platform 1A of the server device 1, which instructs the drones D1 to D4 to start flying, to be displayed on the screens of the first data terminal 3-1 to 3-N, the second data terminal 4-1 to 4-N, the third data terminal 5-1 to 5-N, and the fourth data terminal 2-1 to 2-N (23).

[0112] Then, when a tourist taps the URL that connects to the aerial photography platform 1A of the server device 1, which is displayed on the screens of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N (24), the CPU 301 waits to receive a flight route selection screen for setting the aerial photography flight course presented by the server device 1 (25).

[0113] Next, the CPU 301 waits for an instruction (tap) to select the desired aerial photography flight route from the list of flight routes displayed on the screen (26). Next, the CPU 301 receives a payment screen from the server device 1 for the tourist to pay for the aerial photography service displayed on the screen (27).

[0114] Next, CPU 301 checks the payment screen displayed on the screen and confirms that the payment OK button indicating completion of payment has been tapped (28). Then, drones D1-D4 begin aerial photography flight based on the selected desired aerial photography flight route. At this point, the captured video data is transferred from drones D1-D4 to server device 1. The aerial video data received by server device 1 is then AI edited by AI editing unit 16-1.

[0115] Next, the CPU 301 receives the aerial video data transferred from the server device 1 (29) and saves it to its internal memory (30).

[0116] Here, the CPU 301 confirms that the tourist has launched the SNS application installed on the data terminal and has transitioned to a screen where they have selected friends etc. on the SNS operation screen (31), and then selects the aerial video data file registered in the internal memory (32).

[0117] Here, tourists choose whether to make their registered aerial video data publicly available and share it, or to send it to registered users.

[0118] The CPU 301 then determines whether the user has selected to publish and share the aerial video data registered by the tourist, or to send it to the registered user (33).

[0119] If the CPU 301 determines that the user has selected to publish and share the registered aerial video data, it confirms that the user will publish the registered aerial video data in the public file section of the SNS operation screen (34), and then terminates the process.

[0120] On the other hand, in step (33), if the CPU 301 determines that the user has selected an operation to send to a registered user, and determines that the tourist has selected a user displayed on the SNS screen, the aerial video data file to be sent is finalized.

[0121] Next, when the tourist taps the button to send on the SNS screen, the CPU 301 sends the attached aerial video data file via the network 21 (35) and terminates this process.

[0122] [Example of aerial video data processing on server device 1] Figures 12 and 13 are flowcharts illustrating an example of the data processing procedure for the server device 1 in the aerial video provision service system shown in this embodiment. (41) to (55) indicate the respective steps, and each step is realized by the CPU 13 executing a stored control program.

[0123] First, the CPU 13 of server device 1 determines whether there are any tourists logged into the aerial photography platform 1A from the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N (41). If the CPU 13 determines that there are tourists logged in, it extracts the tourist spot ID (specified in the URL) that identifies the tourist spot to be acquired when logging in (42). Next, the CPU 13 reads the aerial photography flight list from the external memory 18 (43) and presents the aerial photography list screen to the requesting data terminal (44).

[0124] Next, when the CPU 13 determines that a desired aerial photography flight course has been selected from the list of aerial photography flight courses displayed on the screen of the data terminal operated by the tourist (45), the CPU 13 determines that the drone D1 parked at the first to fourth tourist spots SP1 to SP4, identified by the tourist spot ID, will be the target of the flight (46).

[0125] Next, the CPU 13 sends an instruction to the drone D1 specifying the aerial photography flight course determined in step (45) (47).

[0126] Next, when the CPU 13 receives a flight start notification indicating that the drone D1 has completed its initial setup (48), the CPU 13 receives aerial video data transmitted from the drone D1 and stores it in the aerial video database 14B (49).

[0127] Next, the CPU 13 determines from the GPS information of the drone D1 whether it is passing through the route points set for the aerial photography flight course (50).

[0128] Next, the CPU 13 works in conjunction with the AI ​​support unit 19 to perform AI editing on the aerial video data stored in the aerial video database 14B (51).

[0129] AI editing here includes trimming and cutting, which automatically removes unnecessary parts and leaves only the important parts.

[0130] Similarly, AI editing includes processes such as color correction and tone matching to adjust and maintain consistency in the video's color tones.

[0131] Similarly, AI editing includes audio editing processes such as noise reduction (wind noise, etc.), extraction of natural sounds (train whistles), and addition of effects.

[0132] Similarly, this includes processes such as slow-motion and fast-forward editing, which involve editing specific scenes in slow motion or fast-forward.

[0133] Similarly, the additional editing of special effects includes a process that automatically adds effects and animations.

[0134] Similarly, the text and title insertion and editing features include automatically inserting text and titles and unifying their styles.

[0135] Similarly, crossfade editing includes the process of automatically applying a crossfade effect to make scene transitions smoother.

[0136] Next, CPU 13 determines whether there are any image quality abnormalities in the AI-edited aerial video data, that is, it determines that the video check is OK (52).

[0137] If the CPU 13 determines that there is no abnormality in the image quality of the aerial video data, it transfers the aerial video data to one of the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, or the fourth data terminals 2-1 to 2-N operated by the requesting tourist (53).

[0138] Next, the CPU 13 determines whether the transfer has ended based on whether it has detected the EOF (end of frame) of the aerial video data that was started to be transferred (54).

[0139] Next, the CPU 13 determines whether it has received an acknowledgment from any of the destination data terminals 3-1~3-N, 4-1~4-N, 5-1~5-N, or 2-1~2-N (55). If it determines that it has not received an acknowledgment from any of the destination data terminals 3-1~3-N, 4-1~4-N, 5-1~5-N, or 2-1~2-N, it continues transferring the aerial video data. If it determines that it has received an acknowledgment from any of the destination data terminals 3-1~3-N, 4-1~4-N, 5-1~5-N, or 2-1~2-N, it terminates the transfer of the aerial video data and ends this process.

[0140] [Effects of the First Embodiment] According to this embodiment, tourists visiting a tourist spot can simply take an image of a flight request instruction board with their data terminal, and live aerial video data, captured by a professional photographer from angles intended for a scenic spot that is normally inaccessible to tourists, can be delivered from the server device to the data terminal.

[0141] In this way, there is no need for local staff to be constantly on standby to give instructions for initiating drone flights, significantly reducing labor costs for the drone service system and allowing tourists to receive aerial video services at a low cost. Furthermore, a paid aerial photography service can be freely deployed, delivering impressive aerial video data—full of speed and capturing the seasonal atmosphere—from a server device to data terminals. This service captures stunning views of tourist spots that are normally inaccessible, from angles envisioned by professional photographers.

[0142] [Second Embodiment] In the above embodiment, the case of performing aerial photography flight with one drone was described, but it is also possible to configure the system so that even more interesting aerial video can be transmitted to the server device 1 by simultaneously flying the same aerial photography flight route in both forward and reverse directions with any combination of multiple drones D1 to D4.

[0143] [Effects of the second embodiment] According to this embodiment, even tourists who are not satisfied with aerial photography by a single drone can enjoy more acrobatic aerial videos by using multiple drones, and this service can be freely developed to achieve that.

[0144] [Third Embodiment] In the above embodiment, we described a case where an aerial video file edited by the server device 1 is sent to a data terminal operated by a tourist. However, by configuring the server device 1 to link with an SNS registered on the data terminal operated by the tourist via API, the aerial video file obtained from the server device 1 may be sent simultaneously to multiple friends who have been registered as friends, allowing the group to share the aerial video file.

[0145] [Effects of the third embodiment] According to this embodiment, when sharing travel memories as aerial video data with a group, and using it as further communication material, the operational burden on the user operating the data terminal from which the data was distributed is reduced, allowing them to concentrate on responding within the group.

[0146] [Fourth Embodiment] In the above embodiment, we described a case where an aerial video file edited by the server device 1 is sent to a data terminal operated by a tourist. However, the system may also be configured to automatically upload the video to a video channel to which the tourist is registered.

[0147] [Effects of the fourth embodiment] According to this embodiment, by publishing aerial videos on a video site managed by tourists, it is expected that the number of followers will increase, and sometimes, a viral phenomenon will occur, leading to an increase in views and opportunities to earn advertising revenue.

[0148] [Fifth Embodiment] In the above embodiment, we described a case where aerial video files edited by the server device 1 are automatically uploaded to a video channel to which the tourist is registered, using a data terminal operated by the tourist. However, it is also possible to configure the system so that the tourist can make hometown tax donations to tourist destinations by automatically registering the aerial video on a channel that publishes aerial videos and automatically publishing the aerial video on a ranking site where points and rankings are awarded based on the number of views.

[0149] [Effects of the Fifth Embodiment] According to this embodiment, opportunities for tourists to use various network systems that utilize points they have earned will increase, and synergistic effects can be expected for both tourist destinations and tourists.

[0150] [Sixth Embodiment] In the above embodiment, we described a case where the drone flight is initiated in conjunction with the tourist taking an image of a flight request instruction board adjacent to the return location using a data terminal operated by the tourist. However, the system may be configured to allow setting the aerial photography start time, and to allow instructing the start of the flight with a predetermined time lag.

[0151] [Effects of the 6th Embodiment] According to this embodiment, for example, if a lake is a tourist spot, by configuring the system to allow tourists riding on lakeside boats (rowboats, pedal boats) to also be included in the aerial photography, it becomes possible for tourists to appear as the main subject in the aerial video, enabling the development of a service that distributes the video as a souvenir of the trip.

[0152] [Seventh Embodiment] In the above embodiment, an example was described in which one of the drones D1 to D4 automatically flies based on a stored aerial photography flight route. However, the Ministry of Land, Infrastructure, Transport and Tourism's system for registering and managing one of the drones D1 to D4 and the pilot does not currently approve of autonomous flight. Therefore, as an aerial video provision service system in which any of the drones D1 to D4 equipped with a first camera CAM1 for aerial photography of tourist spots can communicate via a predetermined communication medium, the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N operated by tourists, and a server device 1 that instructs any of the drones D1 to D4 to perform aerial photography flights, the server device 1 shown in Figure 1 is configured to communicate with the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, and the third data terminals 5-1 to 5- N, by having a configuration that functions as a flight route monitoring means that receives an aerial photography flight request transmitted from any of the fourth data terminals 2-1 to 2-N and transmits flight control information to any of the drones D1 to D4 in real time, allowing the drone to fly along the aerial photography flight route stored in one of the drones D1 to D4, it is also possible to configure the system as one in which, while any of the drones D1 to D4 is performing an aerial photography flight, the flight commander on the server device 1 side monitors the flight status and remotely controls any of the drones D1 to D4 to continue flying, abort the flight, or return automatically.

[0153] [Effects of the 7th Embodiment] According to this embodiment, even before the system in which drones D1 to D4 perform fully automated flight along an aerial photography flight route is approved by the Ministry of Land, Infrastructure, Transport and Tourism, as shown in the first to sixth embodiments, it is possible to achieve the effects shown in the first to sixth embodiments by having the server device 1 remotely control the drones D1 to D4 without having local staff with licenses to operate the drones D1 to D4 permanently stationed on site.

[0154] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by a process in which one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.

[0155] (1) An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the unmanned aircraft is equipped with flight control means that controls the flight state so as to receive aerial photography flight instructions from the server device, start flying from a return position, fly around on an aerial photography flight route selected by the data terminal, and land at the return position, and video transmission means that transmits video data captured by the first camera to the server device.

[0156] (2) An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the data terminal comprises a second camera for imaging a flight request instruction board adjacent to the return position, connection means for connecting to a service screen provided by the server device by analyzing the image of the flight request instruction board captured by the second camera, route selection means for selecting a desired flight route from a list of flight routes displayed on the service screen, payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected, and receiving means for receiving aerial video data of tourist spots that has been AI edited from the aerial video data transmitted from the unmanned aircraft to the server device.

[0157] (3) An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the server device comprises editing means for receiving the aerial video data received from the unmanned aircraft and performing AI editing, and transmission means for transmitting the AI-edited aerial video data of tourist spots to the data terminal.

[0158] (4) An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the unmanned aircraft includes flight control means that, upon receiving aerial photography flight instructions from the server device, starts flying from a return point, performs a circular flight along an aerial photography flight route selected by the data terminal, and controls the flight state to land at the return point, and video transmission means that transmits video data captured by the first camera to the server device, and the data terminal includes a second camera that images a flight request instruction board adjacent to the return point, and a video transmission means that images the flight request instruction board captured by the second camera The system comprises: connection means for connecting to a service screen provided by the server device by analyzing an image; route selection means for selecting a desired flight route from a list of flight routes displayed on the service screen; payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected; and receiving means for receiving aerial photography video data of tourist spots that has been AI-edited from the aerial photography video data transmitted from the unmanned aircraft to the server device. The server device further comprises: editing means for receiving the aerial photography video data received from the unmanned aircraft and AI-editing it; and transmission means for transmitting the AI-edited aerial photography video data of tourist spots to the data terminal.

[0159] (5) The flight request instruction board is characterized in that it has two-dimensional code image data including tourist spot identification information printed on it in advance.

[0160] (6) The server device is characterized by having storage means for learning the aerial video data of tourist spots received when the unmanned aircraft takes aerial photographs along the flight route selected by the data terminal and storing it in external memory.

[0161] (7) The unmanned aircraft is characterized by comprising: a receiving means for receiving flight data indicating the flight path of the unmanned aircraft from the server device, a flight pattern for identifying the flight data, imaging conditions, and weather conditions; and an unmanned aircraft control data storage means for storing the flight data received by the receiving means, the flight pattern for identifying the flight data, the imaging conditions, and the weather conditions in association with aerial photography flight route identification information.

[0162] (8) The receiving means is characterized by receiving a video file associated with the aerial video data of the tourist spot received from the server device via the SNS screen installed on the data terminal.

[0163] (9) The server device is characterized in that, when it determines that the weather conditions set for the unmanned aircraft, by comparing the flight-permissible wind speed value with the wind speed forecast value along the aerial photography flight route obtained from a weather site, exceeds a threshold, it alerts the data terminal to cancel the aerial photography flight.

[0164] (10) The server device is characterized in that, when it determines that the unmanned aircraft is flying in a backlit area by comparing the aerial photography flight route and the sun's movement route over the tourist spot, it provides a second alert means to the data terminal that the orbital position of the flight route will be corrected.

[0165] (11) The server device is characterized in that, when it determines that the unmanned aircraft will fly in an area with backlighting after comparing the flight path of the unmanned aircraft with the path of the sun moving over the tourist spot, it provides a suggestion means to the data terminal to suggest a change in the flight path.

[0166] (12) An aerial photography control method for an aerial video provision service system, which enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, comprising: a flight control step in which the unmanned aircraft receives an aerial photography flight instruction from the server device, starts flying from a return position, performs a circling flight along an aerial photography flight route selected by the data terminal, and controls the flight state to land at the return position; and a transfer step in which the unmanned aircraft transfers video data captured by the first camera to the server device.

[0167] (13) An aerial photography control method for an aerial photography video provision service system, which enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform an aerial photography flight, wherein the data terminal is equipped with a second camera for imaging a flight request instruction board adjacent to the return position, and comprises a connection step of connecting to a service screen provided by the server device by analyzing the image of the flight request instruction board captured by the second camera, a route selection step of selecting a desired flight route from a list of flight routes displayed on the service screen, a settlement step of settling the aerial photography service fee presented by the server device when the desired flight route is selected, and a reception step of receiving aerial photography video data of tourist spots that has been AI edited from the aerial photography video data transmitted from the unmanned aircraft to the server device.

[0168] (14) An aerial photography control method for an aerial photography video provision service system, wherein an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights are able to communicate via a predetermined communication medium, wherein the server device comprises an editing step of receiving the aerial photography video data received from the unmanned aircraft and performing AI editing, and a transmission step of transmitting the AI-edited aerial photography video data of tourist spots to the data terminal.

[0169] (15) An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights via a predetermined communication medium, wherein the server device includes flight route monitoring means that receives an aerial photography flight request transmitted from the data terminal and performs control to transmit flight control information for flying the aerial photography flight route stored in the unmanned aircraft in real time. [Industrial applicability]

[0170] While the above embodiments mainly described cases where the drone flies during the daytime, the present invention can also be applied to nighttime flights, making it possible to construct a system that provides services such as aerial photography of fireworks displays in various locations during the summer, or aerial photography of night views by controlling the flight of a drone from the deck of a cruise ship over night view spots nationwide. Furthermore, when the first data terminals 3-1 to 3-N, the second data terminals 4-1 to 4-N, the third data terminals 5-1 to 5-N, and the fourth data terminals 2-1 to 2-N, operated by tourists, receive AI-edited aerial video data from server device 1, it is also possible to incorporate a service that issues NFTs (digital certificates) in cooperation with an NFT server system (not shown) to ensure the uniqueness of the AI-edited aerial video data. Furthermore, if the rights holder of AI-edited aerial video data registered on the NFT marketplace is, for example, an influencer, the system may be configured to allow resellers of the NFT marketplace to access a service that links to the records of the original owner. [Explanation of Symbols]

[0171] 1 Server device 2-1~2-N Fourth data terminal 3-1~3-N First data terminal 4-1~4-N Second data terminal 5-1~5-N Third data terminal D1-D4 Drones

Claims

1. An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The aforementioned unmanned aircraft A flight control means that receives an aerial photography flight instruction from the server device, starts the flight from the return position, performs a circular flight along the aerial photography flight route selected by the data terminal, and controls the flight state to land at the return position. A video transmission means that transmits video data captured by the first camera from the air to the server device, A service system for providing aerial video footage, characterized by having the following features.

2. An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The aforementioned data terminal is A second camera captures images of the flight request instruction board adjacent to the return position, By analyzing the image of the flight request instruction board captured by the second camera, a connection means is established to connect to the service screen provided by the server device, A route selection means for selecting a desired flight route from a list of flight routes displayed on the aforementioned service screen, A payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected, An aerial video provision service system characterized by comprising: a receiving means for receiving aerial video data of tourist spots that has been AI-edited from the aerial video data transmitted from the unmanned aircraft to the server device; and the receiving means for receiving the aerial video data from the server device.

3. An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The server device is An editing means for receiving aerial video data received from the aforementioned unmanned aircraft and performing AI editing, An aerial video provision service system characterized by comprising: a transmission means for transmitting aerial video data of tourist spots edited by AI using the aforementioned editing means to the data terminal.

4. An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The aforementioned unmanned aircraft A flight control means that receives an aerial photography flight instruction from the server device, starts the flight from the return position, performs a circular flight along the aerial photography flight route selected by the data terminal, and controls the flight state to land at the return position. A video transmission means that transmits video data captured by the first camera from the air to the server device, Equipped with, The aforementioned data terminal is A second camera that images the flight request instruction board adjacent to the aforementioned return position, By analyzing the image of the flight request instruction board captured by the second camera, a connection means is established to connect to the service screen provided by the server device, A route selection means for selecting a desired flight route from a list of flight routes displayed on the aforementioned service screen, A payment means for settling the aerial photography service fee presented by the server device when the desired flight route is selected, The system includes a receiving means for receiving aerial video data of tourist spots that has been AI-edited from the aerial video data transmitted from the unmanned aircraft to the server device, The server device is An editing means that receives the aerial video data received from the aforementioned unmanned aircraft and performs AI editing, An aerial video provision service system characterized by comprising: a transmission means for transmitting aerial video data of tourist spots edited by AI using the aforementioned editing means to the data terminal.

5. The aerial video provision service system according to claim 4, characterized in that the flight request instruction board has two-dimensional code image data including tourist spot identification information pre-printed on it.

6. The server device is The aerial video provision service system according to claim 4, further comprising storage means for learning and storing in external memory the aerial video data of tourist spots received when the unmanned aircraft takes aerial photographs along the flight route selected by the data terminal.

7. The aforementioned unmanned aircraft The server device receives flight data indicating the flight path of the unmanned aircraft, a flight pattern for identifying the flight data, imaging conditions, and weather conditions, and a receiving means for receiving these conditions. An unmanned aircraft control data storage means stores the flight data received by the reception means, the flight pattern that identifies the flight data, the imaging conditions, and the weather conditions in association with aerial photography flight route identification information. The aerial video provision service system according to claim 4, characterized by comprising the above.

8. The aerial video provision service system according to claim 4, characterized in that the receiving means receives a video file associated with the aerial video data of the tourist spot received from the server device via an SNS screen installed on the data terminal.

9. The server device is The aerial video provision service system according to claim 4, further comprising a first alert means that alerts the data terminal to cancel the aerial photography flight when it is determined that the weather conditions set for the unmanned aircraft, by comparing the flight-permissible wind speed value with the wind speed forecast value along the aerial photography flight route obtained from a weather site, exceed a threshold.

10. The server device is The aerial video provision service system according to claim 4, further comprising a second alert means that alerts the data terminal that the orbital position of the flight route will be corrected when it is determined that the unmanned aircraft is flying in a backlit area by comparing the aerial photography flight route flown by the unmanned aircraft with the path of the sun's movement over the tourist spot.

11. The server device is The aerial video provision service system according to claim 4, characterized in that, when it is determined that the unmanned aircraft will fly in an area of ​​backlighting after comparing the flight path of the aircraft with the path of the sun moving over the tourist spot, the system includes a suggestion means to suggest a change in the flight path to the data terminal.

12. An aerial photography control method for an aerial video provision service system, which enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The aforementioned unmanned aircraft A flight control step involves receiving an aerial photography flight instruction from the server device, starting the flight from the return position, performing a circular flight along the aerial photography flight route selected by the data terminal, and controlling the flight state to land at the return position. A transfer step of transferring video data captured by the first camera from the air to the server device, An aerial photography control method for an aerial video provision service system, characterized by comprising the following features.

13. An aerial photography control method for an aerial video provision service system, which enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The aforementioned data terminal is It is equipped with a second camera that images the flight request instruction board adjacent to the return position, The connection step involves analyzing the image of the flight request instruction board captured by the second camera to connect to the service screen provided by the server device, A route selection step in which the desired flight route is selected from the list of flight routes displayed on the aforementioned service screen, A settlement step in which the aerial photography service fee presented by the server device is settled when the desired flight route is selected, A receiving step of receiving aerial video data of tourist spots that has been AI-edited from the aerial video data transmitted from the unmanned aircraft to the server device, An aerial photography control method for an aerial video provision service system, characterized by comprising the following features.

14. An aerial photography control method for an aerial video provision service system, which enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The server device is The editing step involves receiving aerial video data received from the aforementioned unmanned aircraft and performing AI editing, A transmission step involves sending the AI-edited aerial video data of the tourist spot, which has been edited in the aforementioned editing step, to the data terminal. A service system for providing aerial video footage, characterized by having the following features.

15. An aerial video provision service system that enables communication between an unmanned aircraft equipped with a first camera for aerial photography of tourist spots, a data terminal operated by a tourist, and a server device that instructs the unmanned aircraft to perform aerial photography flights, via a predetermined communication medium, The server device is An aerial video provision service system characterized by comprising a flight route monitoring means that receives an aerial photography flight request transmitted from the data terminal and performs control to transmit flight control information to the unmanned aircraft in real time, which is used to fly the aerial photography flight route stored in the unmanned aircraft.

Images