Information processing device, information processing method, program, and information processing system

The information processing device facilitates the creation of autonomous mobile object routes by acquiring, connecting, and smoothing state parameters, enabling precise and complex flight paths for drones and other mobile objects.

JP7589687B2Active Publication Date: 2024-11-26SONY GROUP CORP
4 Cites 0 Cited by

Patent Information

Application Number
JP2021536625
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-07-26
Filing Date
2020-05-22
Publication Date
2024-11-26
Estimated Expiration
2040-05-22

AI Technical Summary

Technical Problem

There is a need for a technology that can easily create movement routes for mobile objects capable of autonomous movement.

Method used

An information processing device that includes an acquisition unit to gather route information comprising a route with multiple positions and state parameters, a connection unit to link routes, and a smoothing unit to smooth differences in state parameters between connected paths, allowing for the creation of autonomous mobile object routes.

Benefits of technology

Enables the easy creation of routes for autonomous mobile objects by smoothing state parameter differences, facilitating precise and complex flight paths for drones and other mobile objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007589687000010
    Figure 0007589687000010
  • Figure 0007589687000011
    Figure 0007589687000011
  • Figure 0007589687000012
    Figure 0007589687000012
Patent Text Reader

Abstract

An information processing device according to one embodiment of the present technology is provided with an acquisition unit, a connection unit, and a smoothing unit. The acquisition unit acquires path information that includes a path, which contains a plurality of positions, and a state parameter, which pertains to the movement state of a moving body when moving along the path and is associated with each position in the path. The connection unit connects a first path included in first path information that has been acquired and a second path included in second path information that has been acquired. The smoothing unit smooths a difference between a first state parameter associated with a first smoothing point on the first path and a second state parameter associated with a second smoothing point on the second path.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present technology relates to an information processing device, an information processing method, a program, and an information processing system that can be applied to control of autonomous movement of a moving object. [Background technology]

[0002] In the flight processing system described in Patent Document 1, a user searches for flight data of a drone. The flight data includes a flight path, a flight speed, an image collection direction and an image collection speed of an image collection device mounted on the drone, and the like. A preview image of the flight path of the searched flight data is presented to the user. By checking the preview image, the user can intuitively grasp the information of the searched flight data, and can easily select the desired flight data. In addition, in the flight processing system described in Patent Document 1, the drone is controlled based on selected flight data, thereby making it possible to easily reproduce the flight data (Patent Document 1,

[0036] to

[0045] ,

[0066] to

[0068] Figures 2, 5, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6294487 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for technology that enables easy creation of travel routes for autonomously moving bodies like this.

[0005] In view of the above circumstances, an object of the present technology is to provide an information processing device, an information processing method, a program, and an information processing system that enable a route for a mobile body capable of autonomous movement to be easily created. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to an embodiment of the present technology includes an acquisition unit, a connection unit, and a smoothing unit. The acquisition unit acquires route information including a route including a plurality of positions and state parameters related to a moving state of a moving object when moving along the route, the state parameters being associated with each position of the route. The connection unit connects a first route included in the acquired first route information and a second route included in the acquired second route information. The smoothing unit smooths a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path.

[0007] In this information processing device, route information is acquired including a route including a plurality of positions and state parameters related to the moving state of the moving object when moving along the route associated with each position of the route. A first route included in the acquired first route information is connected to a second route included in the acquired second route information. A difference between a first state parameter associated with a first smooth point on the first route and a second state parameter associated with a second smooth point on the second route is smoothed. This makes it possible to easily create a route for a moving object capable of autonomous movement.

[0008] The smoothing unit may set the first smoothing point and the second smoothing point based on a connection point where the first path and the second path are connected.

[0009] The smoothing unit may set the connection point to at least one of the first smoothing point and the second smoothing point.

[0010] The information processing device may further include a generation unit that generates route information that associates a route in which the first route and the second route are connected to each other with a state parameter including a result of the smoothing.

[0011] The state parameters relating to the moving state of the moving body may include a speed of the moving body and an attitude of the moving body.

[0012] The acquisition unit may acquire performance information related to a performance of the moving object. In this case, the smoothing unit may smooth a difference between the first state parameter and the second state parameter based on the acquired performance information.

[0013] The performance information may include at least one of a maximum speed of the moving body, a maximum acceleration of the moving body, a maximum deceleration of the moving body, and a maximum angular velocity of the moving body.

[0014] The information processing device may further include a smoothing determination unit that determines whether or not to smooth the difference between the first state parameter and the second state parameter.

[0015] The connection unit may connect an end point of the first path and a start point of the second path. In this case, the smoothing determination unit may determine whether to smooth the difference between the first state parameter and the second state parameter based on a difference between the state parameter associated with the end point of the first path and the state parameter associated with the start point of the second path.

[0016] The acquisition unit may acquire performance information related to a movement performance of the moving object. In this case, the determination unit may determine whether or not to smooth the difference between the first state parameter and the second state parameter based on the acquired performance information.

[0017] The information processing device may further include a connection determination unit that determines the ease of connection to other routes for each position on the route included in the acquired route information.

[0018] The connection determination unit may determine the ease of connection to the other route based on the state parameter included in the acquired route information.

[0019] The information processing device may further include a GUI generating unit that generates a GUI (Graphical User Interface) for inputting an instruction related to a connection of the route included in the route information.

[0020] The instructions regarding the connection of the routes may include an instruction to cut out a portion of the route included in the route information, an instruction to duplicate the route or a portion of the route, an instruction to connect the first route and the second route, an instruction to set the first smoothing point and the second smoothing point, and an instruction to perform smoothing.

[0021] The information processing device may further include a connection determination unit that determines the ease of connection to other routes for each position of the route included in the acquired route information. In this case, the GUI generation unit may generate the GUI including the route in which the determination result by the connection determination unit is displayed in an identifiable manner.

[0022] The information processing device may further include an end point smoothing unit that performs end point smoothing on at least one of a start point or an end point of the route included in the acquired route information for connection with other routes.

[0023] The end point smoothing section may smooth a difference between the state parameter at an end point, which is either the start point or the end point, and the state parameter at a position that is set with the end point as a reference.

[0024] An information processing method according to one embodiment of the present technology is an information processing method executed by a computer system, and includes acquiring route information including a route including a plurality of positions and state parameters related to the moving state of a moving body when moving along the route, the state parameters being associated with each position of the route. The first route included in the acquired first route information and the second route included in the acquired second route information are connected. A difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path is smoothed.

[0025] A program according to one embodiment of the present technology causes a computer system to execute the following steps. A step of acquiring route information including a route including a plurality of positions and state parameters related to the moving state of a moving object when moving along the route, the state parameters being associated with each position on the route. A step of connecting the first route included in the acquired first route information and the second route included in the acquired second route information. Smoothing a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path.

[0026] An information processing system according to an embodiment of the present technology includes an information processing device, a generation unit, and a mobile object. The information processing device includes an acquisition unit, a connection unit, and a smoothing unit. The acquisition unit acquires route information including a route including a plurality of positions and state parameters related to a moving state of a moving object when moving along the route, the state parameters being associated with each position of the route. The connection unit connects a first route included in the acquired first route information and a second route included in the acquired second route information. The smoothing unit smooths a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path. The generating unit generates route information in which a route in which the first route and the second route are connected to each other are associated with a state parameter including a result of the smoothing. The moving object is capable of moving based on the route information generated by the generation unit. [Brief description of the drawings]

[0027] [Figure 1] 1 is a schematic diagram showing an example of the configuration of a route editing system according to a first embodiment; [Diagram 2] 2 is a block diagram showing an example of a functional configuration of a route editing system. FIG. [Diagram 3] FIG. 2 is a schematic diagram showing the configuration of a route information DB. [Figure 4] FIG. 2 is a schematic diagram showing the configuration of an aircraft performance DB. [Diagram 5] 13 is a flowchart showing an example of connecting and smoothing route information. [Figure 6] FIG. 13 is a schematic diagram showing an example of a GUI for editing a route. [Figure 7] 11A and 11B are diagrams showing examples of inputting instructions to cut and copy a part of a route. [Figure 8] FIG. 13 is a diagram showing an example of display of a duplicated partial route. [Figure 9] FIG. 13 is a diagram showing an example of displaying two partial routes to be connected. [Figure 10] FIG. [Figure 11] 11 is a schematic diagram showing an example of input when setting a smoothing region. FIG. [Figure 12] FIG. 13 is a schematic diagram showing a newly generated route. [Figure 13] FIG. 11 is a schematic diagram of a route editing GUI according to a second embodiment. [Figure 14] FIG. 2 is a block diagram showing an example of a hardware configuration of a server device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0029] <First embodiment> [Route editing system] 1 is a schematic diagram showing a configuration example of a route editing system 100 according to a first embodiment of the present technology. The route editing system 100 corresponds to an embodiment of an information processing system related to the present technology.

[0030] The route editing system 100 includes a drone 10, a user terminal 20, and a server device 30. The drone 10, the user terminal 20, and the server device 30 are connected via a network 5 so as to be able to communicate with each other.

[0031] The network 5 is constructed, for example, by the Internet, a wide area communication network, etc. Alternatively, any WAN (Wide Area Network) or LAN (Local Area Network) may be used, and the protocol for constructing the network 5 is not limited.

[0032] The drone 10 is a moving body having an autonomous movement control unit (not shown) and a drive system including a propeller. The autonomous movement control unit performs various controls related to the autonomous movement (autonomous flight) of the drone 10. For example, the autonomous movement control unit executes self-position estimation, surrounding situation analysis, action planning using a cost map, etc., drive system control, etc. In this embodiment, the drone 10 corresponds to a moving body.

[0033] The user terminal 20 includes various devices that can be used by the user 1. For example, a PC (Personal Computer) or a smartphone is used as the user terminal 20. The user 1 can use the route editing system 100 via the user terminal 20.

[0034] The server device 30 can provide application services related to the route editing system 100. For example, in this embodiment, the server device 30 can edit route information of the drone 10 based on an instruction from the user 1 and generate new route information. The route information includes a route including a plurality of positions and a state parameter related to a moving state of the drone 10 when moving along the route associated with each position of the route, and will be described in detail later. The server device 30 functions as an embodiment of an information processing device according to the present technology.

[0035] The server device 30 has a database 25 and is capable of storing various information related to the route editing system 100. The server device 30 is also capable of reading out various information from the database 25 and outputting it to the user terminal 20 or the like.

[0036] In this embodiment, the autonomous flight of the drone 10 is performed based on the route information generated by the server device 30. The configuration, method, etc. for realizing the autonomous flight of the drone 10 are not limited, and any technology may be used.

[0037] In this embodiment, a so-called cloud service is provided by the network 5, the database 25, and the server device 30. Therefore, it can be said that the user terminal 20 is connected to a cloud network. There is no limitation on the method for connecting the user terminal 20 and the server device 30 so that they can communicate with each other. For example, the two may be connected to each other by short-range wireless communication such as Bluetooth (registered trademark) without constructing a cloud network. 1, one user 1 is shown, but there is no limit to the number of users 1 who can use the route editing system 100. For example, the user 1 can obtain and edit route information generated by another user.

[0038] FIG. 2 is a block diagram showing an example of the functional configuration of the route editing system 100. As shown in FIG.

[0039] The drone 10 has a power unit 11, a group of sensors 12, an aircraft control unit 13, an obstacle detection unit 14, a moving object information calculation unit 15, a route information recording unit 16, a behavior planning unit 17, a cost map generation unit 18, and a communication control unit 19.

[0040] The power unit 11 includes various devices related to a drive system for moving the drone 10. For example, the power unit 11 includes a servo motor capable of specifying torque, a motion controller that resolves and replaces the movement of the drone 10 itself, and a feedback control device using sensors in each motor. Furthermore, for example, the power unit 11 includes a motor having four to six propellers facing upward on the body, and a motion controller that resolves and converts the movement of the drone 10 itself into the amount of rotation of each motor.

[0041] The sensor group 12 includes various sensors for detecting external and internal information of the drone 10 and the self-position of the drone 10. Specifically, for example, the sensor group 12 includes a GPS (Global Positioning System) for detecting the self-position, a magnetic sensor for measuring the attitude of the drone 10, an inertial measurement unit (IMU), and the like. For example, the sensor group 12 includes a laser distance measuring sensor for detecting obstacles, a contact sensor, an ultrasonic sensor, a radar, a LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging), a barometer for measuring air pressure, and the like.

[0042] The aircraft control unit 13 controls the operation of the drone 10 based on the action plan supplied from the action planning unit 17. For example, the power unit 11 operates based on a control signal, causing the drone 10 to move.

[0043] The obstacle detection unit 14 detects an obstacle that impedes the movement of the drone 10 based on the data or signals from the sensor group 12. For example, this corresponds to a building or the like that blocks the route included in the route information of the drone 10.

[0044] The mobile object information calculation unit 15 calculates various pieces of information related to the drone 10 as mobile object information based on data or signals from the sensor group 12. For example, state parameters related to the moving state of the drone 10 are calculated as information included in the mobile object information. The state parameters related to the moving state of the drone 10 are parameters that indicate how the drone 10 moves along the route. In this embodiment, the state parameters related to the moving state include the speed of the drone 10 and the attitude of the drone 10. For example, the state parameters of the drone 10 are associated with each position on the route (position at each predetermined time interval), such as the speed and attitude of the drone 10 when it is at position A on the route, and the speed and attitude when it is at position B on the route. Other moving body information calculated includes the drone 10's own position and acceleration, the presence or absence of an abnormality and its content, and the status of other equipment installed on the drone 10. In this embodiment, the state parameters related to the movement state of the drone 10 correspond to state parameters related to the movement state of a moving body when moving along a route associated with each position on the route.

[0045] The route information recording unit 16 records route information calculated by the moving body information calculation unit 15, the route traveled by the drone 10 and state parameters related to the movement state of the drone 10. In this disclosure, a route includes both the route (trajectory) that the drone 10 is planned to travel or the route (trajectory) that the drone 10 has already traveled. For example, route information is calculated from the position information of the drone 10 at each time from the start of movement to the end of movement. In this case, the route includes position information at each time from the position information of the point where the drone 10 started moving to the position information of the point where the drone 10 ended moving. In other words, the route can be said to be the trajectory of the drone 10 that integrates each piece of position information (waypoint) of the drone 10 that moved. In this embodiment, each piece of position information included in the route is associated with a state parameter related to the movement state of the drone 10. For example, the coordinates where the drone 10 is located at a certain time are associated with the speed and attitude of the drone 10 at those coordinates. This information is recorded as route information. The route also includes the flight pattern of the drone 10. That is, the route also includes trajectories defined as patterns, such as a turn or a figure of eight. For example, for a flight pattern such as a turn or a figure of eight, the speed, attitude, and the like of the drone 10 when performing the turn or the figure of eight are associated as state parameters related to the movement state of the drone 10, and are recorded as route information. In some cases, the state parameters associated with a flight pattern may be defaulted, i.e., how to move through a given flight pattern may be set by default. In this embodiment, the route traveled by the drone 10 corresponds to a route that includes multiple positions.

[0046] The behavior planning unit 17 plans a behavior plan for the drone 10 based on information supplied from the cost map generating unit 18 and the communication control unit 19. For example, the behavior planning unit 17 plans departure, stopping, traveling direction (e.g., forward, backward, left turn, right turn, change of direction, etc.), moving speed, etc. The behavior plan also includes route information. That is, the behavior plan includes autonomous flight of the drone 10 such as avoidance of obstacles, and flight of the drone 10 according to a route including multiple positions included in the route information and state parameters related to the moving state of the drone 10.

[0047] The communication control unit 19 communicates with a communication control unit 31 that enables communication with a server device 30. The method for connecting the communication control units 19 (31) to each other so that they can communicate with each other is not limited. For example, any network such as a WAN or LAN may be used. The communication control unit 19 (31) can transmit and receive various information (data) by controlling a module for establishing communication and communication devices such as a router.

[0048] The user terminal 20 includes a UI unit 21, a PC processing unit 22, and a communication control unit . The UI unit 21 includes any UI device, such as an image display device such as a display, an audio output device such as a speaker, an operation device such as a keyboard, a switch, a pointing device, a remote controller, etc. Of course, it also includes a device having the functions of both an image display device and an operation device, such as a touch panel. In addition, various GUIs displayed on a display, a touch panel, or the like can also be considered as elements included in the UI unit 21.

[0049] The PC processing unit 22 can execute various processes based on instructions input by the user 1, control signals from the server device 30, and the like. For example, various processes are executed, including displaying route information, displaying a GUI for inputting instructions regarding route connections, and the like.

[0050] The communication control unit 23 communicates with a communication control unit 31 that enables communication with the server device 30. The method for connecting the communication control units 23 (31) to each other so that they can communicate with each other is not limited. For example, any network such as a WAN or LAN may be used. The communication control unit 23 (31) can transmit and receive various information (data) by controlling a module for establishing communication and communication devices such as a router.

[0051] The server device 30 has hardware necessary for configuring a computer, such as a CPU, a ROM, a RAM, and a HDD (see FIG. 14). The CPU loads a program according to the present technology, which is pre-recorded in the ROM or the like, into the RAM and executes the program, thereby realizing each of the functional blocks exemplified in FIG. 2 and executing the information processing method according to the present technology. For example, the server device 30 can be realized by any computer such as a PC. Of course, hardware such as an FPGA or an ASIC may be used. Also, dedicated hardware such as an IC (integrated circuit) may be used to realize each block shown in FIG. The program is installed in the server device 30 via, for example, various recording media. Alternatively, the program may be installed via the Internet or the like.

[0052] The server device 30 includes a communication control unit 31 and a route control unit 32. In this embodiment, the route control unit corresponds to a GUI generation unit.

[0053] The communication control unit 31 controls communication with the drone 10 and the user terminal 20. For example, the communication control unit 31 receives a connection instruction for route information input via the user terminal 20 and supplies it to the route control unit 32. In addition, the route information generated by the route control unit 32 is transmitted to the drone 10.

[0054] The route control unit 32 has an instruction determination unit 33, a GUI output 34, a route editing unit 35, a route analysis unit 36, a route information generation unit 37, and a management unit 38. The aircraft performance DB 39 and the route information DB 40 are constructed in the database 25 shown in FIG. The blocks included in the route control unit 32 work together to display the route editing GUI, generate edited route information, and so on.

[0055] The instruction determination unit 33 determines instruction information related to various instructions input by the user 1. For example, an instruction (instruction information) to acquire route information input by the user 1 via the route editing GUI is output to the management unit 38. Also, for example, an instruction to connect routes is output to the route editing unit 35.

[0056] The GUI output unit 34 generates and outputs a route editing GUI. For example, various information included in the route editing GUI is updated in response to an instruction from the user 1, etc. The GUI output unit 34 can appropriately generate and output an image of the updated information. For example, in this embodiment, the GUI output unit 34 outputs the route included in the route information, information related to route editing, and route determination results, etc. Hereinafter, the output of an image or GUI containing predetermined information may be expressed as the display of an image or GUI containing predetermined information.

[0057] The route editing unit 35 is capable of editing the route based on an instruction regarding route connection determined by the instruction determination unit 33. In this embodiment, the instruction regarding route connection includes an instruction to cut out a part of a route included in the route information, an instruction to duplicate a route or a part of a route, an instruction to connect a first route and a second route, an instruction to set a first smooth point and a second smooth point, an instruction to set a smoothing area, and an instruction to perform smoothing. That is, based on the instructions determined by the instruction determination unit 33, the route editing unit 35 cuts out a portion of the route included in the acquired route information, copies a route or a portion of a route, connects acquired routes together, sets a first smooth point and a second smooth point, sets a smoothing area, and performs smoothing.

[0058] For ease of understanding, in the following description, of two routes that are the subject of a connection instruction, the route whose end point is connected to the other route is referred to as the first route, and the route whose start point is connected is referred to as the second route. For example, suppose an input is made to connect two routes. A start point (end point where the movement begins) and an end point (end point where the movement ends) are set for each of the two routes. Typically, the end point of one route is connected to the start point of the other route, and this position becomes the position of the connection point. In other words, the route whose end point is the connection point becomes the "first route," and the route whose start point is the connection point becomes the "second route." Of course, the present technology is not limited to the case where the "first route" and the "second route" are defined in this manner, and can be applied. Also, route information including a first route and state parameters associated with each position on the first route is defined as first route information, and route information including a second route and state parameters associated with each position on the second route is defined as second route information.

[0059] The route editing unit 35 can connect the first route included in the acquired first route information and the second route included in the second route information. In this embodiment, the end point of the first route and the start point of the second route are connected. Therefore, the end point of the first route and the start point of the second route become the connection point of the two routes. The route editing unit 35 can also perform smoothing on the connected first route and second route. Specifically, the difference between a first state parameter associated with a first smooth point on the first route and a second state parameter associated with a second smooth point on the second route is smoothed. In this embodiment, the route editing unit 35 functions as a connection unit and a smoothing unit.

[0060] The route analysis unit 36 ​​performs a determination regarding the connection of routes. In this embodiment, it is determined whether or not to smooth the difference between a first state parameter associated with a first smooth point and a second state parameter associated with a second smooth point. For example, the end point of the first path and the start point of the second path are connected, and based on the difference between the state parameter associated with the end point of the first path and the state parameter associated with the start point of the second path, it is determined whether or not to smooth the difference between the first state parameter and the second state parameter. Of course, the present invention is not limited to this. The route analysis unit 36 ​​also determines the ease of connection with other routes for each position on the route included in the acquired route information. The determination result determined by the route analysis unit 36 ​​is displayed in the route editing GUI via the GUI output unit 34. In this embodiment, the path analysis unit 36 ​​functions as a smoothing determination unit and a connection determination unit.

[0061] The route information generating unit 37 generates new route information in response to route connection, route copying, route cutting, etc. For example, when routes are connected, state parameters related to the moving state of the moving object are associated with the connecting route in which the first route and the second route are connected. The state parameters associated with the connecting route are generated based on the state parameters associated with each position of the first route and the state parameters associated with each position of the second route. For example, when smoothing is performed, a state parameter including the result of the smoothing is associated. That is, in this embodiment, route information is generated in which a route in which the first route and the second route are connected to each other is associated with a state parameter including the result of the smoothing. When smoothing is not performed, for example, the state parameters associated with each position of the first path and the state parameters associated with each position of the second path are directly associated with each position other than the connection points, and for example, the state parameters associated with the end point of the first path or the state parameters associated with the start point of the second path are associated with the position of the connection points. For copying a route, the state parameters are also copied to generate the route information. When a route is cut, state parameters related to the moving state of the moving object associated with each position of the cut route are used as they are. The new route information generated by the route information generating unit 37 is displayed in the route editing GUI via the GUI output unit 34. In this embodiment, the route information generating unit 37 functions as a generating unit.

[0062] The management unit 38 manages an aircraft performance DB 39 and a route information DB 40. In this embodiment, the management unit 38 adds and saves route information to be stored in the route information DB 40. For example, the management unit 38 saves route information acquired in response to an instruction from the user 1, etc., in the route information DB 40. The management unit 38 also saves new route information generated by the route information generation unit 37 in the route information DB 40. The management unit 38 also adds and saves performance information related to the aircraft performance of the drone 10 stored in the aircraft performance DB 39. For example, the management unit 38 acquires performance information from the drone 10 used by the user 1. Note that the method of acquiring the performance information of the drone 10 is not limited. For example, the performance information of the drone 10 may be acquired from the manufacturer that manufactured the drone 10. In this embodiment, the route editing unit 35, the management unit 38, etc. implement an acquisition unit.

[0063] 3 is a schematic diagram showing the configuration of the route information DB 40. The route information DB 40 is a DB commonly used throughout the route editing system 100. Note that the present technology is also applicable to the case where the route information DB 40 is constructed for each user 1.

[0064] The route information DB 40 stores vehicle information, travel dates, and time-series data for each route. The aircraft information is an ID capable of identifying the drone 10 that has traveled the route. For example, a number capable of identifying the drone 10 that has traveled the route is assigned. The movement date is the date on which the drone moved along the route. As shown in Figure 3, time series data is saved for each date when drone 1 moved along route A. The time series data includes the position and speed of drone 10 moving along route A at each time. For example, the time series data for aircraft 1 that traveled route A on February 3rd is stored as "time 0.000, position [x, y, z] = [100, 200, 300], speed [vx, vy, vz] = [0, 0, 0] (m / s)" and "time 0.100, position [x, y, z] = [101, 201, 300], speed [vx, vy, vz] = [0.1, 0.2, 0] (m / s)." Similarly, the time series data for February 4th is stored. For example, time series data for aircraft 1 traveling route B on February 3rd may include information such as "time 0.000, position [x, y, z] = [200, 200, 300], speed [vx, vy, vz] = [0, 0, 0] (m / s)." As the time, information on absolute time may be stored, or information on relative time based on a predetermined timing may be stored. For example, information on relative time from the timing when the drone 10 starts moving may be stored. As the position (coordinates), absolute coordinates (world coordinates) may be stored, or relative coordinates based on a predetermined position (predetermined coordinate system) may be stored. For example, relative coordinates based on the point where the drone 10 starts moving as the origin may be stored. The information related to the route information is not limited to the above. For example, information such as weather and wind on the day of travel may be included in the route information. In addition, in the case of a drone with a photographing function, the route information may include location information for photographing and camera direction information.

[0065] FIG. 4 is a schematic diagram showing the configuration of the aircraft performance DB 39.

[0066] The aircraft performance DB39 stores performance information regarding the performance of each drone. The performance information is information indicating performance related to the movement and the like of the drone 10. In this embodiment, the maximum speed of the drone 10, the maximum acceleration of the drone 10, the maximum deceleration of the drone 10, and the maximum angular velocity of the drone 10 are stored. There may also be a configuration in which at least one of these parameters is stored.

[0067] As shown in FIG. 5, performance information for aircraft 1 such as "maximum speed [x, y, z] = [20, 20, 5] (m / s), maximum acceleration [x, y, z] = [5, 5, 2] (m / s^2), maximum deceleration [x, y, z] = [5, 5, 2] (m / s^2), maximum angular velocity [x, y, z] = [3, 3, 1] (rad / s)" is stored in aircraft performance DB 39. In addition, performance information for aircraft 2 such as "maximum speed [x, y, z] = [30, 30, 8] (m / s), maximum acceleration [x, y, z] = [7, 7, 4] (m / s^2), maximum deceleration [x, y, z] = [5, 5, 2] (m / s^2), maximum angular velocity [x, y, z] = [3, 3, 1] (rad / s)" is stored in aircraft performance DB39.

[0068] The type of performance information stored in the aircraft performance DB 39 is not limited. For example, the maximum flight time and maximum communication distance of the drone 10 may be stored. Also, for example, if the drone has a shooting function, the shutter speed, shooting angle of view, etc. may be stored as the performance information.

[0069] [Route editing system operation] Fig. 5 is a flowchart showing an example of connection and smoothing of route information. Figs. 6 to 12 are schematic diagrams showing an example of a route editing GUI up to the generation of new route information. The flowchart in Fig. 5 will be described below with reference to the route editing GUI in Figs. 6 to 12.

[0070] The user 1 uses the route editing system 100 to set the route along which the drone 10 will move and state parameters such as the speed and attitude of the drone 10 when moving along the route. For example, the user 1 launches an application program related to the route editing system 100 via the user terminal 20.

[0071] A route editing GUI (Graphical User Interface) for inputting instructions regarding route connections included in the route information is generated by the GUI output unit 34, and output to the user terminal 20 (step 101). The transmitted route editing GUI is displayed on a display or the like of the user terminal 20.

[0072] The user 1 specifies route information desired by the user 1. For example, route information stored in the route information DB 40 is displayed in a list. For example, the route information may be displayed in a list together with information related to the route information. Information related to the route information may include any information such as the creator of the route information, the time of creation, and the model of the drone that moved based on the route information. Of course, the route included in the route information and the status parameters relating to the moving status of the moving object may be displayed in an identifiable manner. The user 1 specifies route information including a route that is to be connected to another route, or a route that is to be copied, cut, or the like. The management unit 38 acquires the specified route information from the route information DB. The acquired route information is displayed in the route editing GUI via the GUI output unit 34. The GUI for selecting route information can also be considered as a GUI included in the route editing GUI.

[0073] As shown in FIG. 6, the route editing GUI 50 has a route display section 51 and a display selection section 52. The route display portion 51 displays routes included in the route information designated by the user 1. In the example shown in Fig. 6, the display of route A43 is selected. In this embodiment, a start point 54 of the path A43, which is a point where the drone 10 starts moving, an end point 55, which is a point where the drone 10 ends moving, and a trajectory along which the moving body moves are displayed. For example, the start point 54 corresponds to the position of the drone 10 at time 0. In this embodiment, axes of a Cartesian coordinate system indicating x, y and z axis directions are displayed on the route display unit 51. Each route is displayed on the route display unit 51 based on the position information (x, y and z coordinate values) of the route included in the route information.

[0074] The display selection unit 52 is a GUI for selecting a route (route information) to be displayed in the route display unit 51. In the example shown in FIG. 6, a route B44 is specified in addition to the route A43, and of the routes A43 and B44, the display of the route A43 is selected. It is possible to add and display a new route by selecting the add button 53 in the display selection section 52. In other words, it is possible to additionally specify new route information and display the route included in the route information. Note that the number of routes selectable by the display selection unit 52 is not limited, and any number of routes may be displayed on the route display unit 51. In this case, each route may be displayed so as to be distinguishable by changing the color, width, etc. of each route.

[0075] FIG. 7 is a diagram showing an example of inputting instructions to cut and copy a part of a route. For example, two points on the route A43 are selected by the user 1 as cut points 56 and 57. The route portion A45 between the cut points 56 and 57 is displayed so as to be identifiable. For example, the route portion A45 is displayed thicker than the other portions of the route, or in a color different from the other portions of the route. Notification information 58 is displayed, allowing the user 1 to select whether or not to execute duplication of the cut partial path A45. The partial path A45 is duplicated when the user 1 selects execution of duplication via the notification information 58. Without being limited to this, the partial path A45 may be duplicated by inputting a specific instruction such as a hotkey. In this embodiment, an instruction by the user 1 to execute duplication of the partial route A45 corresponds to an instruction to duplicate a route or a part of a route.

[0076] FIG. 8 is a diagram showing an example of how the duplicated partial route 45 is displayed. As shown in Fig. 8, when the partial path A45 is copied, the partial path A45 is displayed on the path display unit 51. Furthermore, new path information including the partial path A45 and state parameters is generated by the path information generating unit 37 shown in Fig. 2. As the state parameters, the state parameters at each position of the original path A are used as they are. The start point 59 and the end point 60 of the partial path A45 are determined, for example, by comparing the times associated with the positions of the start point 59 and the end point 60, and the earlier one is set as the start point 59.

[0077] FIG. 9 is a diagram showing an example of displaying two partial routes to be connected. 9, it is assumed that a part of the specified route B44 has been cut and copied. The route display unit 51 displays both the duplicated partial route A45 and the duplicated partial route B46. As shown in FIG. 9, the route editing unit 35 may be able to move and rotate partial routes in response to an instruction from the user 1. For example, as shown in the schematic diagram of partial path B46 in Fig. 9, the path may be rotated about the z-axis as the rotation axis. Route information including the rotated partial path B46 is generated as new route information by the route information generating unit 37. For example, based on the position displayed on the route display unit 51, position information (coordinates) indicating the route of the partial path B46 after the rotation is set. The axis of rotation around which the route can be rotated is not limited and may be set arbitrarily. For example, the route may be rotated around the x-axis or y-axis. In this case, the attitude of the drone 10 may not be changed, and only the route (position coordinates) may be changed to generate route information.

[0078] It is assumed that an instruction to connect is input to the partial route A45 and partial route B46 shown in Fig. 9. That is, the partial route A45 and partial route B46 shown in Fig. 9 are displayed as two routes to be connected (step 102). Of course, the two routes to be connected are not limited to routes on which cut, copy, etc. are performed. When the user 1 selects two route information items that he / she wishes to connect, the two routes included in the route information items are displayed as the two routes to be connected.

[0079] FIG. 10 is a schematic diagram showing a connection path. As shown in FIG. 10, in response to an instruction to connect partial routes A45 and B46, partial routes A45 and B46 are connected (step 103). For example, the user 1 causes the end point of partial path B46 to overlap the position of the start point of partial path A45. The position where the end point of partial path B46 and the start point of partial path A45 are overlapped becomes a connection point 61. The start point of partial path B46 is also set as the start point of a connection path 47 that connects partial paths A45 and B46 to each other. The end point of partial path A45 is set as the end point of the connection path 47.

[0080] The route analysis unit 36 ​​determines whether or not smoothing is required for the connection route 47 (step 104). Typically, the necessity of smoothing is determined based on whether or not the drone 10 can fly through the connection point 61. If the drone 10 can fly the connection path 47, it is determined that smoothing is not necessary. If the drone 10 cannot fly the connection path, it is determined that smoothing is necessary. Of course, this is not limited to this, and any judgment criterion may be adopted, such as whether or not smooth flight is possible, whether or not highly safe flight is possible, etc.

[0081] In this embodiment, the starting point of partial path B46 and the end point of partial path A45 are connected, and based on the difference between state parameter B associated with the starting point of partial path B46 and state parameter A associated with the starting point of partial path A45, it is determined whether or not to smooth the difference between the first state parameter and the second state parameter. The information on the connection point includes state parameters associated with the start points or end points of the two routes that are the connection point, and the route directions of the two routes at the connection point. For example, the information on the connection point includes information on state parameters associated with the end point of the partial route A45 and state parameters associated with the end point of the partial route B46. The information on the connection point also includes position (coordinate) information on the end points of the connected partial route A45 and partial route B46. In this embodiment, a difference between a state parameter B of partial path B46 at the end point of partial path B46 and a state parameter A of partial path A45 at the start point of partial path A45 is referenced as information related to connection point 61. Alternatively, a difference between the route direction of partial path B at the end point of partial path B46 and the route direction of partial path A45 at the start point of partial path A45 may be referenced.

[0082] In this embodiment, as shown in FIG. 10, when it is determined that smoothing of the connection path 47 is necessary (YES in step 104), notification information 64 is displayed to the user 1 to the effect that flight is not possible.

[0083] FIG. 11 is a schematic diagram showing an example of input when setting a smoothing region. If it is determined that smoothing of the connection path 47 is necessary (YES in step 104), two positions on the connection path 47 are selected as a smoothing start point 65 and a smoothing end point 66 in response to an instruction from the user 1 (step 105).

[0084] The route editing unit 35 smoothes the route within the smoothing region 67 (step 106). Specifically, the difference between the state parameter associated with the smoothing start point 65 (state parameter B) and the state parameter associated with the smoothing end point 66 (state parameter A) is smoothed. In this embodiment, the method of setting the smoothing region 67 is not limited. For example, the smoothing region 67 may be set without an instruction from the user 1 to select the smoothing start point 65 and the smoothing end point 66. For example, the smoothing start point 65 and the smoothing end point 66 may be set based on the connection point 61 at which the partial path B46 and the partial path A45 are connected. In this case, the route editing unit 35 smoothes the difference between the state parameter associated with the smoothing start point 65 on the partial path B46 in the set smoothing region 67 and the state parameter associated with the smoothing end point 66 of the partial path A45 in the smoothing region 67. In this embodiment, the smoothing start point 65 corresponds to a first smoothing point on the first path. The smoothing end point 66 corresponds to a second smoothing point on the second path. The connection point 61 corresponds to a connection point where the first path and the second path are connected.

[0085] [Smoothing calculations] An example of the smoothing in step 206 will now be described with reference to FIG. When the smoothing start point 65 and the smoothing end point 66 are selected by the user 1, the route editing unit 35 acquires the positions (coordinates) indicating the smoothing start point 65 and the smoothing end point 66, and the speed (state parameter) associated with those positions. The management unit 38 also acquires performance information of the drone 10 moving along the connection path 47. In this embodiment, the maximum acceleration and maximum deceleration of the drone 10 are acquired.

[0086] The velocity of the drone 10 at the smoothing starting point 65 is expressed as the following equation (1).

[0087]

number

[0088] Here, vx1 indicates the speed of the drone 10 on the x-axis, vy1 indicates the speed on the y-axis, and vz1 indicates the speed on the z-axis. In the following, for parameters written as [A, B, C], A corresponds to the x-axis component, B corresponds to the y-axis component, and C corresponds to the z-axis component.

[0089] The velocity of the drone 10 at the smoothing end point 66 is expressed as the following equation (2).

[0090]

number

[0091] The maximum acceleration of the drone 10 moving along the connection path 47 is expressed as the following equation (3).

[0092]

number

[0093] The maximum deceleration of the drone 10 moving along the connection path 47 is expressed as the following equation (4).

[0094]

number

[0095] Here, the difference in speed between the smoothing start point 65 and the smoothing end point 66 is given by the following equation (5).

[0096]

number

[0097] In each of the x, y and z axes, if the speed difference is positive, the speed difference is divided by the maximum acceleration. If the speed difference is negative, the speed difference is divided by the maximum deceleration. This obtains the time required for the speed of each of the x, y and z axes of the drone 10 at the smoothing start point 65 to reach the speed of each of the x, y and z axes of the drone 10 at the smoothing end point 66 while the drone 10 moves between the smoothing start point 65 and the smoothing end point 66. Here, the time required for the speed of each of the x, y and z axes at the smoothing start point 65 to reach the speed of each of the x, y and z axes at the smoothing end point 66 is given by the following formula (6).

[0098]

number

[0099] Therefore, the time for each axis component for which the maximum value is calculated in each of the x, y and z axis directions indicates the time it takes for the drone 10 to move from the smoothing start point 65 to the smoothing end point 66. By determining the time difference, the velocity at the time between the smoothing start point 65 and the smoothing end point 66 is determined.

[0100] Here, the coordinates of the drone 10 moving along the path between the smoothing start point 65 and the smoothing end point 66 at a certain time (t) are given by the following equation (7).

[0101]

number

[0102] Furthermore, the speed of the drone 10 at a certain time moving between the smoothing start point 65 and the smoothing end point 66 is given by the following equation (8).

[0103]

number

[0104] The distance of the drone 10 after a unit time is given by multiplying the speed at a certain time by the unit time in the following formula (9). In other words, the coordinates of the drone 10 at time t can be found by adding the coordinates of the drone 10 at time (t-1) to the speed x unit time.

[0105]

number

[0106] By using the above formula to find the coordinates between a certain time and the next time, a route that complements the smoothed coordinates at a certain time and the coordinates at the next time is calculated. FIG. 12 is a schematic diagram showing a newly generated route. As a result, route information is generated in which the route in which the partial route A45 and the partial route B46 are connected to each other, as shown in FIG. 12, is associated with state parameters including the results of smoothing.

[0107] The calculation method for performing the smoothing is not limited. For example, in the above-mentioned smoothing calculation method, the maximum acceleration or maximum deceleration is used to smooth out the time difference to the shortest. In addition, it is possible to smoothly change the acceleration of the drone 10 itself. In this case, the movement time of the drone 10 will be extended, or the distance of the route (flight distance of the drone 10) will be longer. Besides, whether or not to perform smoothing may be determined based on the difference in the route directions of the connected partial route A45 and partial route B46. For example, assume that the route direction of partial route A45 is in the x-axis direction ([1, 0, 0]). If the route direction of partial route B46 is in the same x-axis direction ([1, 0, 0]), the route analysis unit 36 ​​may determine that smoothing at the connection point 61 is not necessary. Conversely, for example, when the route direction of partial route B46 is significantly different from the route direction of partial route A45, such as [-1, 0, 0.5], the route analysis unit 36 ​​may determine that smoothing is necessary at the connection point 61. In other words, smoothing may be performed on a route that has an angle of a predetermined threshold or more from the reference direction, using the route direction at the connection point of one of the connected routes as a reference direction. In the above, the same smoothing calculation method is used for all directions in the x, y, and z directions. However, this is not limited to this, and different smoothing calculation methods may be executed for each axis (direction). Furthermore, these smoothing methods may be presented to the user 1 so that they can be selected.

[0108] 11, when the user 1 selects a smoothing start point 65 and a smoothing end point 66, the route editing unit 35 presents the user 1 with notification information 68 indicating whether or not to perform smoothing. When the user 1 selects the notification information 68 or inputs a specific instruction such as a hotkey, the route information generating unit 37 generates route information in which the route 48 in which the partial route A 45 and the partial route B 46 are connected to each other are associated with state parameters including the results of the smoothing.

[0109] As shown in Fig. 12, the route 48 included in the new route information generated by the route information generating unit 37 is displayed on the route display unit 51 (step 107). If the generated route 48 is a route desired by the user 1 (YES in step 108), the route information including the route 48 is transmitted to the drone 10 by the user 1. As a result, the drone 1 performs autonomous flight according to the route information desired by the user 1. On the other hand, if the generated route 48 is a route not desired by the user 1, the process returns to the process (step 105) of selecting the smoothing start point 65 and the smoothing end point 66 shown in Fig. 11 (NO in step 108).

[0110] In the present embodiment, the method of smoothing is not limited. For example, smoothing may be performed at the connection point 61. For example, the route editing unit 35 smoothes the difference between a state parameter associated with the end point of the partial route B46 and a state parameter associated with the start point of the partial route A45. This smoothing corresponds to the case where the end point of partial path B46 is set as the smoothing start point 65 and the start point of partial path A45 is set as the smoothing end point 66. In this smoothing, there is a possibility that a sudden change occurs in the state parameters such as the speed when moving through the connection point 61. In response to this, a smoothing start point 65 is set at a position different from the connection point 61 on the partial path B46. Also, a smoothing end point 66 is set at a position different from the connection point 61 on the partial path A45. In other words, a smoothing region 67 is set as a range for the specified smoothing. This makes it possible to suppress abrupt changes in state parameters such as speed, and to smoothly realize movement from partial path B46 to partial path A45. If the smoothing start point 65 and the smoothing end point 66 are set at positions different from the connection point 61, the smoothing may result in a connection path 47 that does not pass through the connection point 61 being generated. On the other hand, when the connection point 61 is set to at least one of the smoothing start point 65 and the smoothing end point 66, it is possible to generate a connection path 47 that passes through the connection point 61. Based on this viewpoint, the smoothing start point 65 and the smoothing end point 66 may be set.

[0111] As described above, in the route editing system 100 according to the present embodiment, route information including a route including a plurality of positions and state parameters related to the movement state of the drone 10 when moving along the route associated with each position of the route is acquired. The first route (partial route B46) included in the acquired first route information and the second route (partial route A45) included in the acquired second route information are connected. The difference between the first state parameter associated with the first smooth point on the first route and the second state parameter associated with the second smooth point on the second route is smoothed. This makes it possible to easily create a route for a moving body capable of autonomous movement.

[0112] In drones, instead of the user operating them using sticks or other devices on a remote controller, the user can specify a flight path that includes timestamps, position, speed, etc., allowing for precise drone flight. This flight path specification makes it possible to fly the same flight path multiple times, freeing the user from having to operate the drone. This has the advantage of allowing the user to concentrate on other tasks, such as filming. In addition, this flight route contains more detailed information than a route with designated intermediate points called waypoints, and it is not a simple, monotonous flight, but rather allows for detailed and complex flying that can be described as a professional acrobatics. Flight routes can be created by actually flying the drone and saving the flight data. If you want to use the flight path created in this way to fly a drone on a different route from the original, you will need to edit the flight path. However, simply cutting and pasting a route may result in creating a route on which the drone cannot fly. For example, when connecting the end points of a route, if the speed of the drone at one end point is 10m / s and the speed of the drone at the other end point is 30m / s, such acceleration is not realistically possible at the connection point, and what happens at that point depends on how the drone handles errors.

[0113] Therefore, with this technology, when connecting two routes, the route information around the connection point is smoothed to make it possible for the drone to actually fly. This makes it possible to combine various flight routes and connect them one after another, making it possible to reuse detailed flight routes.

[0114] <Second embodiment> A route editing system 200 according to a second embodiment of the present technology will be described. In the following description, the description of the same configuration and operation as in the route editing system 100 described in the above embodiment will be omitted or simplified.

[0115] In the first embodiment, the route analysis unit 36 ​​determines whether smoothing is required for a connection route connecting a first route and a second route. In the second embodiment, the ease of connection with other routes is determined for each position of a route included in the route information acquired by the user 1.

[0116] FIG. 13 is a schematic diagram of a route editing GUI 50 according to the second embodiment of the present technology. 13, a route 70 included in the route information acquired by the user 1 is displayed on the route display unit 51. The route editing GUI 50 also has the route display unit 51 and a judgment display unit 71. The determination display unit 71 displays the determination result determined by the route analysis unit 36. In this embodiment, the ease of connection of the route 70 is classified into three types: "difficult (route 72)", "slightly difficult (route 73)", and "easy (route 74)".

[0117] The route analysis unit 36 ​​determines the ease of connection with other routes for each position of the route 70 included in the route information acquired by the user 1. In this embodiment, the route analysis unit 36 ​​determines the ease of connection with other routes based on state parameters included in the acquired route information. Typically, in a location where the speed of the drone 10 is fast, the ease of connection is determined to be "difficult." In a location where the speed of the drone 10 is slow, the ease of connection is determined to be "easy." Of course, the method of determining the ease of connection is not limited. For example, if there are many positions where the drone 10 is moving at a high speed, it may be determined that connection is easy based on the high speed. Also, for example, the distribution of the speed of the drone 10 in the xy axis (horizontal) direction and the z axis (vertical) direction may be analyzed to determine the average speed and the deviation at each position. If the deviation is equal to or greater than a threshold, the ease of connection may be determined to be "difficult." Conversely, if the deviation is equal to or less than a threshold, the ease of connection may be determined to be "easy." In addition, the determination may be made not only based on speed, but also on the attitude of the drone, etc.

[0118] The route display unit 51 also displays the ease of connection of each position on the route 70 so that the user 1 can distinguish between them. In this embodiment, each position on the route 70 corresponding to "difficult", "slightly difficult", and "easy" is displayed in a different color. Note that the distinguishable display method is not limited, and any method may be adopted, such as the thickness of each position on the route 70, a method of adding other images such as an arrow or a frame, or a highlight display.

[0119] <Other embodiments> The present technology is not limited to the above-described embodiment, and various other embodiments can be realized.

[0120] In the above-described first embodiment, the route and the axes of the Cartesian coordinate system are displayed on the route display unit 51. However, the present invention is not limited to this, and any display such as environmental information showing the environment around the route may be output to the route display unit 51. For example, map information and obstacles around the route may be displayed on the route display unit 51. The server device 30 may also have an environmental information DB for storing environmental information for this purpose. The environmental information DB may also be managed by the management unit 38. If the server device 30 has an environmental information DB, the route analysis unit 36 ​​can determine that flying is impossible due to an obstacle when moving or editing a route. In addition, the route editing unit 35 can also present route candidates that avoid obstacles when smoothing a connection route. In addition, if the route analysis unit 36 ​​has set the position coordinates of the subject to be photographed as environmental information, it may determine whether there are any obstacles between the position where the drone 10 takes the photograph and the position coordinates of the subject to be photographed that may interfere with the photographing. For example, suppose that user 1 flies the drone 10 along a route to photograph an artist at a concert venue A. Suppose that user 1 also wants to photograph an artist at another concert venue B along a route that is almost the same as the route used at concert venue A. However, concert venue B has a lower ceiling than concert venue A, and flying along the same route would result in the drone hitting the ceiling. In this case, user 1 performs route editing by cutting a portion of the route used at concert venue A, lowering the height of the route, and connecting it to another returning route. At this time, the change in speed between the end points of the route may be impossible, so user 1 uses the route editing system 100 to smooth the route.

[0121] In the first embodiment described above, the route information is generated before the drone 10 starts flying. This is not limited to the above, and a new route may be selected during the flight of the drone 10. In this case, the drone 10 is realized to fly by smoothing the gap between the route on which the drone 10 is currently flying and the newly selected route. In the above first embodiment, the smoothing start point 65 and the smoothing end point 66 are selected, and the smoothing region is set. However, the present invention is not limited to this, and it is also possible to set the smoothing region 67 without selecting the smoothing start point 65 and the smoothing end point 66 of the user 1. In this case, the smoothing region is set using a predetermined width including the connection point 61, for example.

[0122] In the above first and second embodiments, smoothing is performed on each position of the smoothed region 67 or the path 70. However, the present invention is not limited to this, and end point smoothing may be performed on at least one of the start point or end point of the path for connection with another path. For example, the server device 30 may include an end point smoothing unit that performs end point smoothing. The end point smoothing unit performs smoothing on at least one of the start point or the end point. For example, the end point smoothing unit may smooth a difference between a state parameter at an end point, which is either the start point or the end point, and a state parameter at a position set based on the end point. Also, the route editing unit 35 may perform end point smoothing. By smoothing the end points in advance, it becomes easier to connect paths together, and it is also possible to connect paths together without performing smoothing. The endpoint smoothing performed on the endpoints includes connecting a connection path to the endpoints. The connection path is a path that can be easily connected to other paths or to each other. For example, the connection path may be a straight line path, or a path that flies on a circular path with a constant radius. Or, the connection path may be a path in which the state parameter changes slowly, such as the speed of the drone 10 being constant.

[0123] In the above first and second embodiments, the difference between the state parameters of the two routes included in the route information is smoothed based on information about the connection point 61 at which the partial route A45 and the partial route B46 are connected. Without being limited to this, the difference between the state parameters of the start point and the end point of the connection route 47 may be smoothed. That is, the start point may be selected as the smoothing start point 65, and the end point may be selected as the smoothing end point 66.

[0124] In the first and second embodiments described above, the smoothing calculation method is performed based on the speed difference. However, the smoothing calculation may be performed based on the attitude of the drone 10, the angular velocity of the aircraft performance, and the like. The smoothing method is also not limited. For example, smoothing may include generating route information for flying straight around an end point at a constant speed. For example, smoothing may include creating a route for flying on a circle with a constant radius. In other words, smoothing can be said to make the difference (change) in the state parameters included in the route information constant. Smoothing can also be said to be a process for making it easier to connect a route to other routes. Furthermore, by having multiple smoothing candidate methods as described above, user 1 may be able to select a smoothing candidate. When smoothing is performed, there is a possibility that the connection point 61 may deviate from the path 48. In this case, smoothing may be performed so that the path always passes through the connection point 61. For example, the connection point 61 may be set to either the smoothing start point 65 or the smoothing end point 66. In this way, the path 48 is generated so that it always passes through the connection point 61. Alternatively, the path 48 may be generated so that it does not pass through the connection point 61. Furthermore, by performing smoothing, the distance of the route 48 (the flight distance of the drone 10) may become longer than the connection route 47. In this case, smoothing may be performed so that the route 48 does not exceed a predetermined distance, such as the maximum flight time of the drone 10.

[0125] In the first and second embodiments described above, the two routes included in the two pieces of route information are connected and smoothed. Without being limited to this, smoothing may be performed when two flight patterns of the drone 10 are connected. For example, when the drone 10 turns around a predetermined position and then moves in a figure-of-eight shape, a smoothed route may be generated so that the drone 10 can fly from the "turn" to the "figure-of-eight". In other words, smoothing also includes editing the route so that the drone 10 can fly when the routes of flight patterns are connected to each other or a predetermined route is connected to a flight pattern. The drone 10 may have a moving mechanism capable of moving not only in the air but also on the ground, on water, or underwater. In other words, the present technology can be applied to vehicles that can move in various spaces, such as cars, ships, and submarines, in addition to the drone 10.

[0126] FIG. 14 is a block diagram showing an example of the hardware configuration of the server device 30. As shown in FIG.

[0127] The server device 30 includes a CPU 201, a ROM (Read Only Memory) 202, a RAM 203, an input / output interface 205, and a bus 204 that interconnects these components. A display unit 206, an input unit 207, a storage unit 208, a communication unit 209, a drive unit 210, and the like are connected to the input / output interface 205.

[0128] The display unit 206 is, for example, a display device using liquid crystal, EL (Electro-Luminescence), etc. The input unit 207 is, for example, a keyboard, a pointing device, a touch panel, or other operating device. When the input unit 207 includes a touch panel, the touch panel can be integrated with the display unit 206.

[0129] The storage unit 208 is a non-volatile storage device, such as a HDD, a flash memory, or other solid-state memory. The drive unit 210 is a device capable of driving a removable recording medium 211, such as an optical recording medium, a magnetic recording tape, or the like.

[0130] The communication unit 209 is a modem, a router, or other communication device that can be connected to a LAN, a WAN, or the like and is used to communicate with other devices. The communication unit 209 may communicate using either a wired or wireless method. The communication unit 209 is often used separately from the server device 30. In this embodiment, the communication unit 209 enables communication with other devices via a network.

[0131] Information processing by the server device 30 having the above-mentioned hardware configuration is realized by cooperation between software stored in the storage unit 208 or the ROM 202, etc., and the hardware resources of the server device 30. Specifically, the information processing method according to the present technology is realized by loading a program constituting the software stored in the ROM 202, etc., into the RAM 203 and executing it.

[0132] The program is installed in the server device 30 via, for example, the recording medium 211. Alternatively, the program may be installed in the server device 30 via a global network or the like. Alternatively, any computer-readable non-transitory storage medium may be used.

[0133] An information processing device, information processing method, program, and information processing system related to the present technology may be executed by linking a computer installed in a communication terminal with another computer capable of communicating via a network, etc., thereby constructing an information processing device related to the present technology.

[0134] That is, the information processing device, information processing method, program, and information processing system according to the present technology can be executed not only in a computer system composed of a single computer, but also in a computer system in which multiple computers operate in conjunction with each other. In this disclosure, a system means a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing are both systems.

[0135] The execution of the information processing device, information processing method, program, and information processing system according to the present technology by a computer system includes both cases where, for example, editing of a route, determination of smoothing, generation of route information, etc. are executed by a single computer, and cases where each process is executed by a different computer. Furthermore, the execution of each process by a specific computer includes causing another computer to execute a part or all of the process and acquiring the result.

[0136] In other words, the information processing device, information processing method, program, and information processing system according to the present technology can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by multiple devices via a network.

[0137] The configurations of the GUI generating unit, the route editing unit, the route analyzing unit, the route information generating unit, and the like, and the control flow of the communication system, which have been described with reference to the drawings, are merely one embodiment, and can be modified as desired without departing from the spirit of the present technology. In other words, any other configuration, algorithm, and the like for implementing the present technology may be adopted.

[0138] The effects described in this disclosure are merely examples and are not limiting, and other effects may be present. The description of multiple effects above does not necessarily mean that these effects are exhibited simultaneously. It means that at least one of the effects described above can be obtained depending on the conditions, etc., and it is of course possible that effects not described in this disclosure will be exhibited.

[0139] It is also possible to combine at least two of the characteristic features of each embodiment described above. In other words, the various characteristic features described in each embodiment may be arbitrarily combined without distinction between the embodiments.

[0140] The present technology can also be configured as follows. (1) an acquisition unit that acquires route information including a route including a plurality of positions and state parameters related to a moving state of a moving object when moving along the route, the state parameters being associated with each of the positions of the route; a connection unit that connects a first route included in the acquired first route information and a second route included in the acquired second route information; a smoothing unit that smoothes a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path; An information processing device comprising: (2) An information processing device according to (1), The smoothing unit sets the first smoothing point and the second smoothing point based on a connection point where the first path and the second path are connected. Information processing device. (3) An information processing device according to (2), The smoothing unit sets the connection point to at least one of the first smoothing point and the second smoothing point. Information processing device. (4) The information processing device according to any one of (1) to (3), further comprising: a generating unit that generates route information in which the route in which the first route and the second route are connected to each other are associated with a state parameter including a result of the smoothing. Information processing device. (5) An information processing device according to any one of (1) to (4), The state parameters related to the moving state of the moving body include the speed of the moving body and the attitude of the moving body. Information processing device. (6) An information processing device according to (1) or (5), The acquisition unit acquires performance information related to a performance of the moving object, The smoothing unit smoothes a difference between the first state parameter and the second state parameter based on the acquired performance information. Information processing device. (7) An information processing device according to (6), The performance information includes at least one of a maximum speed of the moving body, a maximum acceleration of the moving body, a maximum deceleration of the moving body, and a maximum angular velocity of the moving body. Information processing device. (8) The information processing device according to any one of (1) to (7), further comprising: A smoothing determination unit is provided for determining whether or not to smooth the difference between the first state parameter and the second state parameter. Information processing device. (9) An information processing device according to (8), the connection portion connects an end point of the first path and a start point of the second path; The smoothing determination unit determines whether or not to smooth the difference between the first state parameter and the second state parameter based on a difference between the state parameter associated with an end point of the first path and the state parameter associated with a start point of the second path. Information processing device. (10) An information processing device according to (8) or (9), The acquisition unit acquires performance information related to the movement performance of the moving object, The smoothing determination unit determines whether or not to smooth the difference between the first state parameter and the second state parameter based on the acquired performance information. Information processing device. (11) The information processing device according to any one of (1) to (10), further comprising: A connection determination unit is provided for determining the ease of connection with other routes for each position of the route included in the acquired route information. Information processing device. (12) The information processing device according to (11), The connection determination unit determines the ease of connection to the other route based on the state parameter included in the acquired route information. Information processing device. (13) The information processing device according to any one of (1) to (12), further comprising: A GUI generating unit generates a GUI (Graphical User Interface) for inputting instructions regarding the connection of the route included in the route information. Information processing device. (14) An information processing device according to (13), The instructions regarding the connection of the routes include an instruction to cut out a part of the route included in the route information, an instruction to duplicate the route or a part of the route, an instruction to connect the first route and the second route, an instruction to set the first smoothing point and the second smoothing point, and an instruction to perform smoothing. Information processing device. (15) The information processing device according to (13) or (14), further comprising: a connection determination unit that determines the ease of connection to other routes for each position of the route included in the acquired route information; The GUI generation unit generates the GUI including the path in which the determination result by the connection determination unit is displayed in an identifiable manner. Information processing device. (16) The information processing device according to any one of (1) to (15), further comprising: An end point smoothing unit that performs end point smoothing for at least one of the start point and the end point of the route included in the acquired route information for connection with another route. Information processing device. (17) An information processing device according to (16), The end point smoothing unit smoothes a difference between the state parameter at an end point, which is either the start point or the end point, and the state parameter at a position that is set based on the end point. Information processing device. (18) acquiring route information including a route including a plurality of positions and a state parameter related to a moving state of a moving object when moving along the route, the state parameter being associated with each position of the route; connecting a first route included in the acquired first route information and a second route included in the acquired second route information; smoothing a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path; The information processing method is executed by a computer system. (19) acquiring route information including a route including a plurality of positions and a state parameter related to a moving state of a moving object when moving along the route, the state parameter being associated with each position of the route; A step of connecting a first route included in the acquired first route information and a second route included in the acquired second route information; smoothing a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path; A program that causes a computer system to execute the above. (20) An acquisition unit that acquires route information including a route including a plurality of positions and a state parameter related to a moving state of a moving object when moving along the route, the state parameter being associated with each position of the route; a connection unit that connects a first route included in the acquired first route information and a second route included in the acquired second route information; a smoothing unit that smoothes a difference between a first state parameter associated with a first smooth point on the first path and a second state parameter associated with a second smooth point on the second path; a generating unit that generates route information in which a route in which the first route and the second route are connected to each other are associated with a state parameter including a result of the smoothing; An information processing device having a moving object that can move based on the route information generated by the generation unit; An information processing system comprising: [Explanation of symbols]

[0141] 10. Drone 30...Server equipment 34...GUI output section 35…Route Editorial Department 36…Route Analysis Department 37...Route information generation unit 38…Management Department 43...Route A 44…Route B 45...Partial path A 46...Partial path B 47…Connection route 50…Route editing GUI 61…Connection point 65…Smoothing start point 66...Smoothing end point 100...Route editing system

Claims

1. An acquisition unit that acquires route information including a route consisting of a plurality of positions including at least a start point where a moving body starts moving and an end point where the moving body ends moving, and state parameters including a speed of the moving body and an attitude of the moving body when moving along the route associated with each of the positions of the route; a connection unit that moves or rotates at least one of a first route included in the acquired first route information and a second route included in the acquired second route information so that coordinates indicating an end point of the first route coincide with coordinates indicating a start point of the second route, thereby connecting the first route and the second route; a smoothing unit that sets a predetermined range including a connection point connecting the first path and the second path, sets a first smooth point on the first path that is an end point of the predetermined range, sets a second smooth point on the second path that is the other end point of the predetermined range, and smooths a difference between a first state parameter associated with the first smooth point and a second state parameter associated with the second smooth point by gradually changing at least one of the speed of the moving body or the attitude of the moving body within the predetermined range; a generating unit that generates route information in which a route in which the first route and the second route are connected to each other are associated with a state parameter including a result of the smoothing; An information processing device comprising:

2. 2. The information processing device according to claim 1, The smoothing unit sets the connection point to at least one of the first smoothing point and the second smoothing point. Information processing device.

3. 2. The information processing device according to claim 1, The acquisition unit acquires performance information related to a performance of the moving object, The smoothing unit smoothes the difference between the first state parameter and the second state parameter by gradually changing at least one of the speed of the moving body or the attitude of the moving body within the predetermined range based on the acquired performance information. Information processing device.

4. 4. The information processing device according to claim 3, The performance information includes at least one of a maximum speed of the moving body, a maximum acceleration of the moving body, a maximum deceleration of the moving body, and a maximum angular velocity of the moving body. Information processing device.

5. The information processing device according to claim 1 , further comprising: A smoothing determination unit is provided for determining whether or not to smooth the difference between the first state parameter and the second state parameter. Information processing device.

6. 6. The information processing device according to claim 5, The smoothing determination unit determines whether or not to smooth the difference between the first state parameter and the second state parameter based on a difference between the state parameter associated with an end point of the first path and the state parameter associated with a start point of the second path. Information processing device.

7. 6. The information processing device according to claim 5, The acquisition unit acquires performance information related to the movement performance of the moving object, The smoothing determination unit determines whether or not to smooth the difference between the first state parameter and the second state parameter based on the acquired performance information. Information processing device.

8. The information processing device according to claim 1 , further comprising: A connection determination unit is provided that determines the ease of connection to other routes based on the state parameters of each position of the route included in the acquired route information. Information processing device.

9. The information processing device according to claim 1 , further comprising: A GUI generating unit generates a GUI (Graphical User Interface) for inputting an instruction regarding the connection of the route included in the route information. Information processing device.

10. The information processing device according to claim 9, The instructions regarding the connection of the routes include an instruction to cut out a part of the route included in the route information, an instruction to duplicate the route or a part of the route, an instruction to connect the first route and the second route, an instruction to set the first smoothing point and the second smoothing point, and an instruction to perform smoothing. Information processing device.

11. The information processing device according to claim 9, further comprising: a connection determination unit that determines the ease of connection to other routes based on the state parameters of each position of the route included in the acquired route information; The GUI generation unit generates the GUI including the path in which a result of the determination by the connection determination unit is displayed in an identifiable manner. Information processing device.

12. The information processing device according to claim 1 , further comprising: An end point smoothing unit that performs end point smoothing for at least one of the start point and the end point of the route included in the acquired route information for connection with another route. Information processing device.

13. The information processing device according to claim 12, The end point smoothing unit smoothes a difference between the state parameter at an end point, which is either the start point or the end point, and the state parameter at a position that is set based on the end point. Information processing device.

14. Acquire route information including a route consisting of a plurality of positions including at least a starting point where a moving body starts moving and an ending point where the moving body ends moving, and state parameters including a speed of the moving body and an attitude of the moving body when moving along the route associated with each of the positions of the route; moving or rotating at least one of a first route included in the acquired first route information and a second route included in the acquired second route information, so that coordinates indicating an end point of the first route and coordinates indicating a start point of the second route coincide with each other, thereby connecting the first route and the second route; a predetermined range including a connection point connecting the first path and the second path is set, a first smooth point which is an end point of the predetermined range is set on the first path, a second smooth point which is the other end point of the predetermined range is set on the second path, and a difference between a first state parameter associated with the first smooth point and a second state parameter associated with the second smooth point is smoothed by gradually changing at least one of the speed of the moving body or the attitude of the moving body within the predetermined range; generating route information in which the first route and the second route are connected to each other and a state parameter including the result of the smoothing are associated with each other; The information processing method is executed by a computer system.

15. A step of acquiring route information including a route consisting of a plurality of positions including at least a starting point where a moving body starts moving and an ending point where the moving body ends moving, and state parameters including a speed of the moving body and an attitude of the moving body when moving along the route associated with each of the positions of the route; a step of moving or rotating at least one of a first route included in the acquired first route information and a second route included in the acquired second route information so that a coordinate indicating an end point of the first route coincides with a coordinate indicating a start point of the second route, thereby connecting the first route and the second route; setting a predetermined range including a connection point connecting the first path and the second path, setting a first smooth point on the first path that is an end point of the predetermined range, setting a second smooth point on the second path that is the other end point of the predetermined range, and smoothing a difference between a first state parameter associated with the first smooth point and a second state parameter associated with the second smooth point by gradually changing at least one of the speed or the attitude of the moving body within the predetermined range; generating route information in which the first route and the second route are connected to each other and a state parameter including a result of the smoothing are associated with each other; A program that causes a computer system to execute the above.

16. An acquisition unit that acquires route information including a route consisting of a plurality of positions including at least a start point where a moving body starts moving and an end point where the moving body ends moving, and state parameters including a speed of the moving body and an attitude of the moving body when moving along the route associated with each of the positions of the route; a connection unit that moves or rotates at least one of a first route included in the acquired first route information and a second route included in the acquired second route information so that coordinates indicating an end point of the first route coincide with coordinates indicating a start point of the second route, thereby connecting the first route and the second route; a smoothing unit that sets a predetermined range including a connection point connecting the first path and the second path, sets a first smooth point on the first path that is an end point of the predetermined range, sets a second smooth point on the second path that is the other end point of the predetermined range, and smooths a difference between a first state parameter associated with the first smooth point and a second state parameter associated with the second smooth point by gradually changing at least one of the speed of the moving body or the attitude of the moving body within the predetermined range; a generating unit that generates route information in which a route in which the first route and the second route are connected to each other are associated with a state parameter including a result of the smoothing; An information processing device having a moving object that can move based on the route information generated by the generation unit; An information processing system comprising:

Citation Information

Patent Citations

  • Cover device for scooter type car

    JP1987094487A

  • Method of generating traveling path of unmanned vehicle

    JP2010073080A

  • Movable apparatus

    JP2010225139A

  • Autonomous nap-of-the-earth (ANOE) flight path planning for manned and unmanned rotorcraft

    US20160210863A1