Information processing system, information processing method, and program

Abstract

To enable flight quality evaluation of a flying object.SOLUTION: There is provided an information processing system comprising: a flight log acquisition unit for acquiring a flight log of a flying object; a storage unit for storing evaluation information for evaluating flight quality of the flying object on the basis of log values in the flight log; and an evaluation unit for evaluating flight quality of the flying object based on the acquired flight log and the evaluation information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 proposes a mechanism for determining whether a flight route can be flown safely. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-105591 Summary of the Invention [Problem to be solved by the invention]

[0004] Even if the flight route is safe, driving may not be safe.

[0005] The present invention has been made in consideration of this background, and aims to provide a technology that can evaluate the flight quality of an aircraft. [Means for solving the problem]

[0006] The main invention of the present invention for solving the above problem is an information processing system comprising a flight log acquisition unit that acquires a flight log of an aircraft, a memory unit that stores evaluation information for evaluating the flight quality of the aircraft based on log values ​​contained in the flight log, and an evaluation unit that evaluates the flight quality of the aircraft based on the acquired flight log and evaluation information.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, the flight quality of an aircraft can be evaluated. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an outline of an information processing system according to an embodiment of the present invention. [Figure 2] 2 is a diagram illustrating an example of a hardware configuration of the information processing terminal 10. FIG. [Figure 3] A block diagram showing an example of the functional configuration of the unmanned aerial vehicle 20 according to this embodiment. [Figure 4] A diagram showing an example of the functional configuration of a flight controller 23 provided in an unmanned aerial vehicle 21. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a management server 30. [Figure 6] FIG. 2 is a diagram illustrating an example of the software configuration of a management server 30. [Figure 7] FIG. 10 is a diagram illustrating the operation of the management server 2. DETAILED DESCRIPTION OF THE INVENTION

[0010] <System Overview> 1 is a diagram showing an outline of an information processing system according to this embodiment. As shown in the figure, the information processing system includes an information processing terminal 10, an administrator terminal 11, an unmanned aerial vehicle 20, and a management server 30.

[0011] The information processing terminal 10 is implemented, for example, by a small tablet-shaped computer. In other embodiments, the information processing terminal 10 may be realized by a portable information processing terminal such as a smartphone or game console, or by a stationary information processing terminal such as a personal computer. The information processing terminal 10 may also be realized by multiple pieces of hardware, with functions distributed among them. A user U using the information processing terminal 10 can perform operations on the touch panel of the information processing terminal 10 to control the flight of the unmanned aerial vehicle 20. The user U can also operate a control device (transmitter) independent of or linked to the information processing terminal 10 to control the unmanned aerial vehicle 20.

[0012] The management server 30 evaluates the flight quality of the unmanned aerial vehicle. The management server 30 may be a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

[0013] <Information processing terminal 10>

[0014] 2 is a diagram showing an example of the hardware configuration of the information processing terminal 10. The information processing terminal 10 includes a control unit 11 and a touch panel 12, which is an example of a display unit.

[0015] The processor 11a is an arithmetic unit that controls the operation of the control unit 11, controls the transmission and reception of data between each element, and performs processes necessary for executing programs, etc. In this embodiment, the processor 11a is, for example, a CPU (Central Processing Unit), and performs various processes by executing programs stored in the storage 11c (described later) and expanded in the memory 11b.

[0016] The memory 11b includes a main storage device that is configured with a volatile storage device such as a DRAM (Dynamic Random Access Memory), and an auxiliary storage device that is configured with a nonvolatile storage device such as a flash memory, an HDD (Hard Disc Drive), etc. This memory 11b is used as a working area for the processor 11a, and also stores a BIOS (Basic Input / Output System) that is executed when the control unit 11 starts up, various setting information, etc.

[0017] The storage 11c stores programs, information used for various processes, etc. For example, when a user operates an aircraft for capturing images of an area including a building S1, etc., via the information processing terminal 10, the storage 11c may store a program for controlling the flight of the aircraft.

[0018] The transmitter / receiver 11d connects the controller 11 to a network such as the Internet, and may include a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

[0019] The input / output unit 11e is an interface to which an input / output device is connected, and in this embodiment, the touch panel 12 is connected.

[0020] The bus 11f transmits, for example, address signals, data signals, and various control signals between the connected processor 11a, memory 11b, storage 11c, transmission / reception unit 11d, and input / output unit 11e.

[0021] The touch panel 12 is an example of a display unit and includes a display surface on which acquired videos and images are displayed. In this embodiment, the display surface accepts information input by touching the display surface, and is implemented using various technologies such as a resistive film system or a capacitive system.

[0022] For example, an image captured by the unmanned aerial vehicle 20 may be displayed on the display surface of the touch panel 12. Information regarding the flight restriction zone of the unmanned aerial vehicle 20 may be displayed on the display surface superimposed on the image captured by the unmanned aerial vehicle 20. Buttons, objects, etc. for controlling the flight of the unmanned aerial vehicle 20 and the imaging device may also be displayed on the display surface. A user may input information via the touch panel 12 to the images, buttons, etc. displayed on the display surface.

[0023] Note that, although the present embodiment cites the touch panel 12 as an example of a display unit, the present technology is not limited to such an example. For example, the display unit may be realized by a display device such as another display, a monitor, or a smartphone. Furthermore, an input device for acquiring input information may be realized by a method other than the touch panel 12. For example, instead of the touch panel 12, the input device may be realized by various input devices such as a mouse, a keyboard, a voice recognition device, or an eye gaze recognition device. Furthermore, the information processing terminal 10 may be realized independently of at least one of a display device such as the touch panel 12 and an input device. In this case, for example, the information processing terminal 10 may be realized by one or more servers such as a cloud server, and may be provided to be able to communicate with the touch panel 12.

[0024] <Unmanned Aerial Vehicle 20>

[0025] Fig. 3 is a block diagram showing an example of the functional configuration of the unmanned aerial vehicle 20 according to this embodiment. As shown in Fig. 3, the unmanned aerial vehicle 20 according to one embodiment includes a main body 21, a transceiver 22, a flight controller 23, a battery 24, an ESC 25, a motor 26, a propeller 27, and a camera 28. The unmanned aerial vehicle 20 is an example of an aerial vehicle. The type of the aerial vehicle is not particularly limited, and may be, for example, a multi-rotor drone as shown in Fig. 3.

[0026] The flight controller 23 may have one or more processors 23A, such as programmable processors (e.g., central processing units (CPUs)).

[0027] Flight controller 23 has and has access to memory 23B, which stores logic, code, and / or program instructions that the flight controller can execute to perform one or more steps.

[0028] The memory 23B may include a separable medium such as an SD card or random access memory (RAM) or an external storage device. Data acquired from the sensors 23C may be directly transmitted to and stored in the memory 23B. For example, still image and video data captured by the camera 28 is recorded in the built-in memory or an external memory.

[0029] The flight controller 23 includes a control module configured to control the state of the air vehicle. For example, the control module controls the propulsion mechanism (motor 26, etc.) of the air vehicle via an ESC (Electric Speed ​​Controller) 25 to adjust the spatial position, speed, and / or acceleration of the air vehicle, which has six degrees of freedom (translational motion x, y, and z, and rotational motion θx, θy, and θz). The control module can control one or more of the camera 28, sensors 23C, etc.

[0030] The flight controller 23 can communicate with a transceiver 22 configured to transmit and / or receive data from one or more external devices (e.g., a terminal such as the information processing terminal 10, a display device, or other remote control). For example, the transceiver 22 can utilize one or more of a local area network (LAN), a wide area network (WAN), infrared, radio, WiFi, a point-to-point (P2P) network, a telecommunications network, cloud communications, etc.

[0031] The transceiver unit 22 can transmit and / or receive one or more of the following: data acquired by the camera 28 or sensors 23C, processing results generated by the flight controller 23, predetermined control data, user commands from the information processing terminal 10, a transceiver (prop) or a remote controller, etc.

[0032] The sensors 23C according to this embodiment may include an inertial sensor (acceleration sensor, gyro sensor), a GPS sensor, a proximity sensor (e.g., lidar), or a vision / image sensor (e.g., camera).

[0033] The battery 24 may be a known battery such as a lithium polymer battery. The power that drives the unmanned aerial vehicle 20 is not limited to the electric power supplied from the battery 24, but may be powered by an internal combustion engine, for example.

[0034] Camera 28 is an example of an imaging device. The type of camera 28 is not particularly limited, and may be, for example, a normal digital camera, a spherical camera, an infrared camera, a thermography image sensor, or the like. Camera 28 may be connected to main body 21 by a gimbal (not shown) or the like so as to be independently displaceable.

[0035] <Unmanned Aerial Vehicle 20> 4 is a diagram showing an example of the functional configuration of the flight controller 23 provided in the unmanned aerial vehicle 21. The processor 23A includes a flight control unit 231, a flight log recording unit 232, a flight log providing unit 233, and a flight log storage unit 234.

[0036] The flight control unit 231 controls the flight of the unmanned aerial vehicle 20 in response to instructions from the information processing terminal 10. Note that the control of the unmanned aerial vehicle 20 by the flight control unit 231 can be the control of a general drone, and detailed explanation will be omitted here.

[0037] The flight log memory unit 234 stores a log (flight log) showing details of the flight content of the unmanned aerial vehicle 20. The flight log includes the time (date and time), an aircraft ID that identifies the unmanned aerial vehicle 20, position, altitude, speed, information that identifies the device, operation content, reception strength from GPS satellites, communication strength with the information processing terminal 10, etc. The operation content may include stick operations and button presses on the control device (transmitter).

[0038] The flight log recording unit 232 creates a flight log and registers it in the flight log storage unit 234. The flight log recording unit 232 can, for example, acquire position information and altitude information of the unmanned aerial vehicle 20 measured by a positioning means and an altitude measurement means (not shown) provided in the unmanned aerial vehicle 20, and include this information in the flight log. Note that the flight log recording process may be a general process implemented in the unmanned aerial vehicle 20 by, for example, a drone manufacturer.

[0039] The flight log providing unit 233 provides the flight log to an external device. For example, the flight log providing unit 233 can read out the flight log stored in the flight log storage unit 234 in response to a request and provide it to the sender of the request.

[0040] <Administration Server 30> FIG. 5 is a diagram illustrating an example of the hardware configuration of the management server 30. Note that the illustrated configuration is an example, and other configurations may also be used. The management server 30 includes a CPU 201, a memory 202, a storage device 203, a communication interface 204, an input device 205, and an output device 206. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, a solid-state drive, or a flash memory. The communication interface 204 is an interface for connecting to a communication network, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, or a USB (Universal Serial Bus) connector or an RS232C connector for serial communication. The input device 205 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, or the like for inputting data. The output device 206 is, for example, a display, a printer, a speaker, or the like for outputting data. Each functional unit of the management server 30 is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the management server 30 can be realized as part of the storage area provided by the memory 202 and the storage device 203.

[0041] <Administration Server 30> 6 is a diagram showing an example of the software configuration of the management server 30. The management server 2 includes a flight log acquisition unit 311, an evaluation unit 312, a notification unit 313, a flight log storage unit 331, an evaluation information storage unit 332, and an evaluation result storage unit 333.

[0042] The flight log acquisition unit 311 acquires the flight log of the unmanned aerial vehicle 20. The flight log acquisition unit 311 may, for example, transmit a request to the unmanned aerial vehicle 20 to acquire the flight log, or may transmit a request to the information processing terminal 10, and the information processing terminal 10 receiving the request transmits a request to the unmanned aerial vehicle 20 to acquire the flight log, and then return the acquired flight log to the management server 30. The flight log acquisition unit 311 can register the acquired flight log in the flight log storage unit 331.

[0043] The flight log storage unit 331 stores the flight log. The flight log storage unit 331 can store the flight log in association with the user U and the unmanned aerial vehicle 20.

[0044] The evaluation information storage unit 332 stores information (evaluation information) for evaluating the flight quality of the unmanned aerial vehicle 20 based on the flight log. The evaluation information can set conditions for values ​​(log values) such as measurement values ​​included in the flight log, and logic for adding or subtracting from the evaluation value when the conditions are met. For example, the evaluation information can include lowering the evaluation value when flight is started with the remaining battery power below a predetermined value (low battery), lowering the evaluation value when flight continues with the remaining battery power below a predetermined value (low battery), lowering the evaluation value when both the left and right sticks of the control device (transmitter) are operated simultaneously, lowering the evaluation value when the unmanned aerial vehicle 20 is moved with the camera zoom magnification remaining greater than a predetermined value, lowering the evaluation value when the flight speed of the unmanned aerial vehicle 20 is greater than a predetermined value for a predetermined period of time, lowering the evaluation value when flight is started with the reception strength from GPS satellites less than a predetermined value, and lowering the evaluation value when flight continues with the reception strength from GPS satellites less than a predetermined value. The following may be set: lowering the evaluation value if the flight started with the communication strength between the information processing terminal 10, the control device (transmitter) or the management server 30 being less than a predetermined value, lowering the evaluation value if the flight continued with the communication strength between the information processing terminal 10, the control device (transmitter) or the management server 30 being less than a predetermined value, lowering the evaluation value if the flight started with the wind speed being equal to or greater than a predetermined value, lowering the evaluation value if the flight continued with the wind speed being equal to or greater than a predetermined value, lowering the evaluation value if the home point is not set in an open location (a location where the area occupied by buildings or other structures within a predetermined distance around the home point is equal to or less than a predetermined value), etc. Furthermore, the evaluation information may be set to increase the evaluation value if the flight did not involve sharp turns or sudden starts, for example, if the ratio of the time during which the flight speed or attitude rotation speed was less than a predetermined value to the total flight time was equal to or greater than a predetermined value.

[0045] The evaluation information may be a machine learning learning model. The learning model can be created by machine learning using each log value included in the flight log as input data and the evaluation value as training data. The log values ​​of the flight log to be learned may be all log values ​​or only some of the log values. In this case, the system may include an evaluation value input unit that accepts input of an evaluation value for the flight log from a user, and a learning processing unit that performs machine learning using the log values ​​included in the flight log and the accepted evaluation values ​​as training data. The learning model can be created for each evaluation item (e.g., safe piloting, calm piloting, etc.). When the learning processing unit accepts an evaluation value for the flight log from a user after a flight, it may perform additional learning to update the evaluation information (learning model).

[0046] The evaluation unit 312 evaluates the flight quality of the unmanned aerial vehicle 20 based on the flight log. The evaluation unit 312 can evaluate the flight quality based on the evaluation information. The evaluation unit 312 can calculate the evaluation value, for example, by setting an initial value of the evaluation value, determining whether the log value included in the flight log satisfies the conditions included in the evaluation information, and increasing or decreasing the evaluation value based on logic corresponding to the satisfied conditions. The evaluation unit 312 can register the calculated evaluation value in the evaluation result storage unit 333 in association with the date (or date and time), an aircraft ID that identifies the unmanned aerial vehicle 20, and a user ID that identifies the user who piloted the vehicle.

[0047] The evaluation unit 312 can compile past flight logs for each pilot user U and evaluate the control quality for each user U. The evaluation unit 312 can, for example, compile evaluation values ​​for each user from the evaluation result storage unit 333 and evaluate the compile value (for example, an average value or a median value) or a value corresponding to the compile value as the flight quality (operation quality) of the user U.

[0048] The evaluation unit 312 can compile past flight logs for each unmanned aerial vehicle 20 and evaluate the flight quality of each unmanned aerial vehicle 20. The evaluation unit 312 can, for example, compile evaluation values ​​for each unmanned aerial vehicle 20 from the evaluation result storage unit 333 and evaluate the compile value (for example, the average value or the median value) or a value corresponding to the compile value as the flight quality of the unmanned aerial vehicle 20.

[0049] The notification unit 313 notifies the evaluation result by the evaluation unit 312. For example, the notification unit 313 can notify the user U, who is the owner (operator) of the unmanned aerial vehicle 20, of the flight quality of the unmanned aerial vehicle 20. For example, the notification unit 313 can notify the user U of the operation quality of the user U.

[0050] <Operation> FIG. 7 is a diagram illustrating the operation of the management server 2.

[0051] The management server 2 acquires the flight log of the unmanned aerial vehicle 20 (S401), evaluates the flight quality of the unmanned aerial vehicle 20 corresponding to the flight log based on the evaluation information and the flight log (S402), and notifies the user of the evaluation result (S403). The management server 2 evaluates the control quality for each pilot (user U) based on the history of the evaluation results (S404), and notifies the user of the control quality (S405).

[0052] As described above, the information processing system of this embodiment can evaluate flight quality based on the flight log of the unmanned aerial vehicle 20. In addition, the control quality of each pilot (user U) can be evaluated according to the flight quality evaluation history.

[0053] Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and equivalents thereof are also included in the present invention.

[0054] For example, the processing by each of the functional units of the management server 2 described above may be performed by any of the functional units. Also, a different functional unit that performs part of the processing by each of the functional units described above may be added. Also, the functional units of the management server 2 may be distributed across multiple computers.

[0055] Furthermore, the information stored in each storage unit of the management server may be stored in any of the storage units. That is, the information stored in the above-mentioned multiple storage units may be stored in one storage unit, or part of the information stored in one of the above-mentioned storage units may be stored in another storage unit.

[0056] <Disclosures> The present disclosure also includes the following configurations. [Item 1] a flight log acquisition unit that acquires a flight log of the aircraft; a storage unit that stores evaluation information for evaluating the flight quality of the aircraft based on the log values ​​included in the flight log; an evaluation unit that evaluates the flight quality of the aircraft based on the acquired flight log and the evaluation information; An information processing system comprising: [Item 2] Item 1, an information processing system according to item 1, The memory unit stores a learning model that learns one or more of the log values ​​included in the flight log and the flight quality, The evaluation unit evaluates the flight quality by providing the log value included in the acquired flight log to the learning model; An information processing system characterized by: [Item 3] Item 1, an information processing system according to item 1, The storage unit stores ranges and evaluation values ​​for each type of one or more of the log values ​​included in the flight log, The evaluation unit aggregates the evaluation values ​​corresponding to the ranges that include the log values ​​included in the acquired flight log, and evaluates the flight quality according to the aggregated values; An information processing system characterized by: [Item 4] acquiring a flight log by the aircraft; a step of evaluating the flight quality of the aircraft based on evaluation information for evaluating the flight quality of the aircraft based on log values ​​included in the flight log and the acquired flight log; An information processing method characterized by being executed by a computer. [Item 5] acquiring a flight log by the aircraft; a step of evaluating the flight quality of the aircraft based on evaluation information for evaluating the flight quality of the aircraft based on log values ​​included in the flight log and the acquired flight log; A program that causes a computer to execute the following. [Explanation of symbols]

[0057] 1. User terminal 2 Management Server

Claims

1. a flight log acquisition unit that acquires a flight log of the aircraft; a storage unit that stores evaluation information for evaluating the flight quality of the aircraft based on the log values ​​included in the flight log; an evaluation unit that evaluates the flight quality of the aircraft based on the acquired flight log and the evaluation information; An information processing system comprising:

2. 2. The information processing system according to claim 1, The memory unit stores a learning model that learns one or more of the log values ​​included in the flight log and the flight quality, The evaluation unit evaluates the flight quality by providing the log value included in the acquired flight log to the learning model; An information processing system characterized by:

3. 2. The information processing system according to claim 1, The storage unit stores ranges and evaluation values ​​for each type of one or more of the log values ​​included in the flight log, The evaluation unit aggregates the evaluation values ​​corresponding to the ranges that include the log values ​​included in the acquired flight log, and evaluates the flight quality according to the aggregated values; An information processing system characterized by:

4. acquiring a flight log by the aircraft; a step of evaluating the flight quality of the aircraft based on evaluation information for evaluating the flight quality of the aircraft based on log values ​​included in the flight log and the acquired flight log; An information processing method characterized by being executed by a computer.

5. acquiring a flight log by the aircraft; a step of evaluating the flight quality of the aircraft based on evaluation information for evaluating the flight quality of the aircraft based on log values ​​included in the flight log and the acquired flight log; A program that causes a computer to execute the following.

Images