Unmanned aerial vehicle, information processing method, and program recording medium

By integrating sensors and processors in unmanned aircraft, real-time judgment and control of the relationship between sound source quality and position is solved, and the problem of unmanned aircraft's difficulty in ensuring sound source safety when improving the sound quality is improved, and safety is achieved Efficient sound source proximity and radio reception.

CN112912309BActive Publication Date: 2024-11-01PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980067977.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-02-19
Filing Date
2019-11-08
Publication Date
2024-11-01
Estimated Expiration
2039-11-08

AI Technical Summary

Technical Problem

Existing unmanned aircraft are difficult to ensure the safety of the sound source while improving the sound quality, and cannot effectively control the distance from the sound source to optimize the sound.

Method used

By equiping sensors and processors in the unmanned aircraft, the sound data generated by the microphone is used to determine the quality of the target sound, and the positional relationship of the sound source is obtained by combining the image sensor and the ranging sensor to control the between the unmanned aircraft and the sound source. distance to achieve safe and high-quality sound source proximity and radio reception.

Benefits of technology

While ensuring the safety of the sound source, the audio quality of the unmanned flying body is improved, and the direction and protrusion of the microphone are dynamically adjusted, the noise sound pressure level is optimized, and the sound source signal-to-noise ratio is enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112912309B_ABST
    Figure CN112912309B_ABST
Patent Text Reader

Abstract

The unmanned aerial vehicle (100) has a sensor including at least a microphone (105) for generating sound data, and a processor (101). The processor (101) uses the sound data generated by the microphone (105) to determine the quality of a target sound, and uses the data generated by the sensor to obtain a positional relationship between the unmanned aerial vehicle (100) and a sound source (400) of the target sound. Based on the quality and positional relationship of the target sound, the movement of the unmanned aerial vehicle (100) is controlled by controlling the distance between the unmanned aerial vehicle (100) and the sound source (400) of the target sound.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an unmanned aerial vehicle, an information processing method, and a program. Background Art

[0002] Patent Document 1 discloses an unmanned aerial vehicle that performs a process of removing background noise from sound data collected by a background microphone.

[0003] (Prior art literature)

[0004] (Patent Document)

[0005] Patent Document 1: Japanese Patent Application No. 2017-502568

[0006] However, the technology of Patent Document 1 does not take the safety of the sound source into consideration, and therefore, it may be difficult to improve the sound pickup quality while ensuring safety. Summary of the invention

[0007] Therefore, the present disclosure provides an unmanned aerial vehicle, an information processing method, and a program that can improve the quality of sound pickup while ensuring the safety of the sound source.

[0008] The present disclosure relates to an unmanned aerial vehicle, which comprises: a sensor, comprising at least a microphone that generates sound data; and a processor, wherein the processor uses the sound data generated by the microphone to determine the quality of a target sound, and uses the data generated by the sensor to obtain a positional relationship between the unmanned aerial vehicle and a sound source of the target sound, and controls the movement of the unmanned aerial vehicle in a manner that controls the distance between the unmanned aerial vehicle and the sound source of the target sound based on the quality of the target sound and the positional relationship.

[0009] Moreover, their general or specific forms may also be implemented by systems, methods, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, and recording media.

[0010] The unmanned aerial vehicle, information processing method, and program disclosed herein can improve the sound pickup quality while ensuring the safety of the sound source. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a diagram showing the appearance of an unmanned aerial vehicle and a controller according to an embodiment.

[0012] Figure 2 It is a plan view showing the unmanned aerial vehicle according to the embodiment when viewed from above.

[0013] Figure 3 yes Figure 2 A III-III cross-sectional view of the unmanned aerial vehicle is shown.

[0014] Figure 4 It is a block diagram showing the structure of an unmanned aerial vehicle according to an embodiment.

[0015] Figure 5 This is a flowchart showing an operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0016] Figure 6 This is a flowchart showing an example of a process for determining the quality of a target sound of an unmanned aerial vehicle.

[0017] Figure 7 This is a diagram showing an example of a method for calculating a signal-to-noise ratio which is an index of the quality of a target sound.

[0018] Fig. 8A This is a diagram for explaining a first scene of an operation example of sound collection control of an unmanned aerial vehicle according to an embodiment.

[0019] Figure 8B It is a diagram for explaining a second scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0020] Figure 8C It is a diagram for explaining the third scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0021] Fig. 9A It is a diagram for explaining a fourth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0022] Fig. 9B It is a diagram for explaining the fifth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0023] Fig. 9C It is a diagram for explaining the sixth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0024] Fig. 10A It is a diagram for explaining the seventh scene of the operation example of the sound collection control of the unmanned aerial vehicle involved in the embodiment.

[0025] Fig. 10B It is a diagram for explaining the eighth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0026] Fig. 10C It is a diagram for explaining the ninth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0027] Fig.11A It is a diagram for explaining the tenth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0028] Fig. 11B It is a diagram for explaining the eleventh scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0029] Fig. 12A It is a diagram for explaining the twelfth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0030] Fig. 12B It is a diagram for explaining the thirteenth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0031] Fig.13 This is a table showing an example of the relationship between the reference signal-to-noise ratio and the application.

[0032] Fig.14 This is a flowchart showing an operation example of sound collection control of an unmanned aerial vehicle according to a modification.

[0033] Fig.15 This is a flowchart showing another operation example of the sound collection control of the unmanned aerial vehicle according to the modification. DETAILED DESCRIPTION

[0034] (Knowledge that is the basis of this disclosure)

[0035] The unmanned aerial vehicle described in Patent Document 1, as described above, performs processing to remove background noise generated by a propulsion unit such as a rotor blade possessed by the unmanned aerial vehicle from the collected sound data. However, the unmanned aerial vehicle does not take into account the relative positional relationship with the sound source that is the object of collecting sound data. Therefore, it may happen that the sound source is not included in the sound receiving range that can be effectively received by the sound source collection microphone that the unmanned aerial vehicle has for detecting the target sound from the sound source. In this way, when the sound source is not included in the sound receiving range of the sound source collection microphone, the target sound cannot be efficiently received by the sound source collection microphone, and therefore, the collected background noise is relatively large. Accordingly, the noise component of the sound data obtained by the sound source collection microphone is relatively large, and therefore, the signal-to-noise ratio is small. Therefore, even if the obtained sound data is processed to remove the background noise, it is difficult to obtain high-quality sound data.

[0036] Therefore, in order to make the target sound collected from the sound source relatively larger than the background noise, it is possible to consider moving the unmanned aerial vehicle close to the sound source to collect sound data. In the case of moving the unmanned aerial vehicle in the direction close to the sound source to collect sound data at a position close to the sound source, if the unmanned aerial vehicle cannot be controlled, or if a malfunction occurs in the actuator that generates the propulsion force of the unmanned aerial vehicle, the unmanned aerial vehicle may fall toward the sound source. Therefore, for example, it is necessary to implement safety measures such as surrounding the sound source with a protective net to ensure the safety of the sound source. In other words, it is necessary to fully expend the labor or cost for manufacturing and setting up the protective net, otherwise it is difficult to ensure the safety of the sound source.

[0037] In order to solve such a problem, one form of the present disclosure involves an unmanned aerial vehicle, the unmanned aerial vehicle having: a sensor including at least a microphone that generates sound data; and a processor, the processor using the sound data generated by the microphone to determine the quality of a target sound, using the data generated by the sensor to obtain the positional relationship between the unmanned aerial vehicle and the sound source of the target sound, and controlling the movement of the unmanned aerial vehicle in a manner that controls the distance between the unmanned aerial vehicle and the sound source of the target sound according to the quality of the target sound and the positional relationship. Therefore, the distance between the unmanned aerial vehicle and the sound source can be controlled, and the quality of the target sound can be ensured. Therefore, the sound reception quality can be improved while ensuring the safety of the sound source.

[0038] Furthermore, the processor may control the movement of the unmanned aerial vehicle so as to move away from the sound source when the quality of the target sound is higher than a predetermined target quality. Therefore, by moving away from the sound source within a range where the target quality is maintained, the safety of the sound source can be further improved.

[0039] Furthermore, the processor may control the movement of the unmanned aerial vehicle so as to move away from the sound source, and control the movement of the unmanned aerial vehicle so as to move to any position between the current position of the unmanned aerial vehicle and the position where the quality of the target sound reaches the target quality. Therefore, the safety of the sound source can be improved so that the sound reception quality does not fall below the target quality.

[0040] Furthermore, the processor may control the movement of the unmanned aerial vehicle in a manner close to the sound source when the quality of the target sound is lower than a predetermined target quality. Therefore, by approaching within a range that satisfies the target quality, the sound quality of the target sound can be improved while ensuring the safety of the sound source.

[0041] Furthermore, the processor may also obtain distance information indicating a predetermined distance from the sound source, and when controlling the movement of the unmanned aerial vehicle in a manner to approach the sound source, the movement of the unmanned aerial vehicle is controlled in a manner that does not approach the sound source from a position that is the predetermined distance from the sound source, based on the distance information and the positional relationship. Therefore, the unmanned aerial vehicle is moved in a direction approaching the sound source within a range that can ensure the safety of the sound source, so that the sound source and the unmanned aerial vehicle are at least a predetermined distance apart, thereby reliably ensuring the safety of the sound source while improving the sound reception quality.

[0042] Furthermore, it may be that there is also an actuator for changing the orientation of the microphone and at least one of the protrusion amount of the microphone from the unmanned aerial body. After the processor controls the movement of the unmanned aerial body in a manner of approaching the sound source until the position is the specified distance away from the sound source based on the distance information and the positional relationship, when the quality of the target sound is lower than a predetermined target quality, the actuator is controlled to change the orientation of the microphone and at least one of the protrusion amount of the microphone from the unmanned aerial body.

[0043] Therefore, the processor can control the actuator to change the direction of the microphone so that the direction of the microphone with high sensitivity is directed toward the sound source. Accordingly, the direction of the microphone with high sensitivity can be aligned with the direction of the sound source, so that the sound pressure level of the target sound relative to the sound pressure level of the noise can be relatively increased, and the sound reception quality can be improved.

[0044] Furthermore, when the processor controls the actuator to change the protrusion amount of the microphone toward the outside of the unmanned aerial vehicle, the microphone can be protruded toward the outside of the unmanned aerial vehicle and the microphone can be brought closer to the sound source. Accordingly, the microphone is away from the source of noise, that is, the unmanned aerial vehicle, so the sound pressure level of the noise can be reduced. Furthermore, the microphone is close to the sound source, so the sound pressure level of the target sound relative to the sound pressure level of the noise can be relatively increased. Accordingly, the sound reception quality can be effectively improved.

[0045] Furthermore, the processor may calculate a signal-to-noise ratio using the target sound and noise related to the flight of the unmanned aerial vehicle as an indicator for determining the quality. Therefore, the quality of the target sound can be easily determined.

[0046] Furthermore, the processor may further obtain a target signal-to-noise ratio pre-set using noise related to the flight of the unmanned aerial vehicle as the predetermined target quality, and compare the obtained target signal-to-noise ratio with the calculated signal-to-noise ratio to determine the quality of the target sound. Therefore, by pre-calculating the target signal-to-noise ratio, the amount of processing for the sound reception quality can be reduced.

[0047] Furthermore, the processor may control the unmanned aerial vehicle in such a manner that the unmanned aerial vehicle moves in a horizontal direction. Thus, the unmanned aerial vehicle moves in a horizontal direction away from the sound source, thereby ensuring the horizontal distance from the sound source. Therefore, the unmanned aerial vehicle does not move to a position higher than the current position, thereby reducing the impact when the unmanned aerial vehicle falls and ensuring the safety of the sound source.

[0048] Furthermore, the processor may control the unmanned aerial vehicle in such a manner that the unmanned aerial vehicle approaches the ground. Accordingly, the unmanned aerial vehicle moves toward the direction of the sound source by approaching the ground, and thus can approach the sound source while ensuring the distance from the sound source in the horizontal direction. Therefore, the unmanned aerial vehicle is closer to the ground than the current position, and thus the impact when the unmanned aerial vehicle falls can be further reduced, and the safety of the sound source can be ensured.

[0049] Furthermore, the processor may obtain the positional relationship using the sound data. Thus, only a microphone can be mounted to improve the sound quality while ensuring the safety of the sound source. Furthermore, the increase in the total weight of the unmanned aerial vehicle can be suppressed.

[0050] Furthermore, the sensor may further include an image sensor that generates image data, and the processor may obtain the positional relationship using the image data generated by the image sensor. Accordingly, the processor may obtain the positional relationship using the image data, and thus may obtain a positional relationship with high accuracy.

[0051] Furthermore, the sensor may further include a distance measuring sensor that generates distance measuring data, and the processor may obtain the positional relationship using the distance measuring data generated by the distance measuring sensor. Accordingly, the processor may obtain the positional relationship using the distance measuring data, thereby being able to obtain a positional relationship with high accuracy.

[0052] Furthermore, the processor may determine a target distance based on the quality of the target sound, the positional relationship, and a predetermined target quality, and control the movement of the unmanned aerial vehicle in such a way that the distance between the unmanned aerial vehicle and the sound source becomes the target distance. Thus, the unmanned aerial vehicle can move to a position corresponding to the predetermined target quality.

[0053] Furthermore, the positional relationship may be at least any one of the following (i) to (iii), (i) the distance between the unmanned aerial vehicle and the sound source, (ii) the position of the sound source relative to the unmanned aerial vehicle, and (iii) the direction from the unmanned aerial vehicle to the sound source.

[0054] Moreover, their general or specific forms may also be implemented by systems, methods, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, or recording media.

[0055] Hereinafter, an unmanned aerial vehicle according to one embodiment of the present invention will be described in detail with reference to the drawings.

[0056] Moreover, the embodiments described below all illustrate a specific example of the present invention. The numerical values, shapes, materials, constituent elements, configuration positions of constituent elements, connection forms, steps, and the order of steps shown in the following embodiments are examples and do not limit the purpose of the present invention. Furthermore, constituent elements that are not recorded in the implementation scheme that illustrates the highest level concept among the constituent elements of the following embodiments are described as arbitrary constituent elements.

[0057] (Implementation Method)

[0058] Below, using Figures 1 to 12B , explaining the implementation method.

[0059] [1.Structure]

[0060] Figure 1 It is a diagram showing the appearance of an unmanned aerial vehicle and a controller according to an embodiment. Figure 2 It is a plan view showing the unmanned aerial vehicle according to the embodiment when viewed from above.

[0061] like Figure 1 As shown, the unmanned aerial vehicle 100 receives an operation signal corresponding to the user's operation on the controller 200 from the controller 200, and flies according to the received operation signal. In addition, the unmanned aerial vehicle 100 may also take pictures using the camera 107 provided in the unmanned aerial vehicle 100 according to the received operation signal while in flight. The image data taken by the camera 107 may also be sent to the portable terminal 300 described later.

[0062] The controller 200 receives an operation from the user and transmits an operation signal corresponding to the received operation to the unmanned aerial vehicle 100. Furthermore, the controller 200 may hold a portable terminal 300 having a display such as a smartphone.

[0063] The mobile terminal 300 receives image data captured by the camera 107 of the unmanned aerial vehicle 100 from the unmanned aerial vehicle 100 , and displays the received image data in real time, for example.

[0064] According to this, the user can check the image data captured by the camera 107 of the unmanned aerial vehicle 100 in real time through the portable terminal 300, and can change the flight state of at least one of the position and posture of the unmanned aerial vehicle 100 during flight by operating the controller 200. Therefore, the user can freely change the shooting range captured by the camera 107 of the unmanned aerial vehicle 100.

[0065] The unmanned aerial vehicle 100 includes four generators 110 , four ducts 130 , a main body 140 , and four arms 141 .

[0066] The four generators 110 each generate a force that causes the unmanned aerial vehicle 100 to fly. Specifically, the four generators 110 each generate an airflow, thereby generating a force that causes the unmanned aerial vehicle 100 to fly. The four generators 110 each include a rotor 111 that rotates to generate an airflow, and an actuator 112 that rotates the rotor 111. The rotor 111 and the actuator 112 have a rotation axis that is substantially parallel to the vertical direction when the unmanned aerial vehicle 100 is set on a horizontal plane, and generate an airflow that flows from the top to the bottom. Accordingly, the four generators 110 generate a thrust that causes the unmanned aerial vehicle 100 to rise upward, thereby generating a force that causes the unmanned aerial vehicle 100 to fly. The actuator 112 is, for example, an electric motor.

[0067] When viewed from above, four generators 110 are arranged at 90-degree intervals around the main body 140. That is, the four generators 110 are arranged in a ring shape so as to surround the main body 140.

[0068] Furthermore, the figure shows an example in which the rotor blades 111 of the four generators 110 are each composed of one propeller, but the invention is not limited to this, and may be composed of two counter-rotating propellers rotating in opposite directions on the same rotation axis.

[0069] Figure 3 yes Figure 2 The III-III cross-sectional view of the unmanned aerial vehicle is shown. That is, Figure 3 This is a cross-sectional view when one generator 110 and the duct 130 arranged corresponding to the generator 110 are cut along a plane passing through the rotation axis of the rotor 111 .

[0070] The four pipes 130 are respectively provided to correspond to the four generators 110. The four pipes 130 are respectively provided at positions covering the sides of the corresponding generators 110, that is, at positions covering the direction substantially orthogonal to the rotation axis direction of the rotor blades 111 of the generators 110. For example, the four pipes 130 cover the sides of the generators 110 over the length of the rotation axis direction of the corresponding generators 110. That is, the four pipes 130 each have a space 131 in which the generators 110 are arranged, that is, a cylindrical space 131 that penetrates the pipes 130 in the up-down direction. The four pipes 130 each have a shape in which the thickness of the pipes 130 becomes thinner as it approaches the downstream side of the airflow generated by the corresponding generators 110. Specifically, the four pipes 130 each have a shape in which the outer surface of the pipes 130 becomes closer to the inner surface of the cylindrical shape of the pipes 130 as it approaches the downstream side of the airflow generated by the corresponding generators 110. That is, the four pipes 130 have a shape that is sharp on the downstream side of the airflow generated by the corresponding generator 110. In addition, the end of the inner surface of the pipe 130 on the downstream side of the airflow is circular. Specifically, the end is a shape in which the inner diameter of the pipe 130 narrows toward the airflow direction. Accordingly, air can easily enter the pipe 130, and the flight performance can be improved. In addition, the pipe 130 and the unmanned aerial vehicle 100 can be lightweight. In addition, the end can also be a straight line shape corresponding to the direction of the airflow.

[0071] The main body 140 is, for example, a cylindrical box-shaped component, i.e., a housing, and is an electronic device that has a processor, a memory, a battery, various sensors, and the like disposed therein. Furthermore, the shape of the main body 140 is not limited to a cylindrical shape, and may be a box-shaped component of other shapes such as a quadrangular prism. Furthermore, the main body 140 is externally provided with four microphones 105, a gimbal 106, and a camera 107. For example, the four microphones 105 are respectively disposed in areas between four areas connected to the four arms 141 corresponding to the four generators 110 on the side surface of the main body 140. That is, for example, the four microphones 105 are respectively disposed at positions corresponding to directions deviated by 45° from the direction toward each of the four generators 110, centered on the main body 140.

[0072] The four arms 141 are components for connecting the main body 140 and the four pipes 130. One end of the four arms 141 is fixed to the main body 140, and the other end is fixed to a corresponding one of the four pipes 130.

[0073] Figure 4 : is a block diagram showing the structure of an unmanned aerial vehicle according to an embodiment of the present invention. Figure 4This is a block diagram for explaining the functions of the processor 101 realized by the hardware configuration of the unmanned aerial vehicle 100 .

[0074] like Figure 4 As shown, the unmanned aerial vehicle 100 includes a processor 101 , a GPS (Global Positioning System) receiver 102 , an acceleration sensor 103 , a gyro sensor 104 , four microphones 105 , a gimbal 106 , a camera 107 , a distance measuring sensor 108 , a communication IF 109 , and four generators 110 .

[0075] The processor 101 obtains detection results detected by various sensors including the acceleration sensor 103, the gyro sensor 104, the four microphones 105, the image sensor of the camera 107, the distance sensor 108, etc., the reception results of the GPS receiver 102 or the communication IF 109, etc., and executes a predetermined program stored in a memory or storage (not shown) to perform various processes for the obtained detection results or reception results. Accordingly, the processor 101 controls at least one of the four generators 110, the gimbal 106 and the camera 107.

[0076] The GPS receiver 102 receives information indicating the position of the GPS receiver 102 from artificial satellites including GPS satellites. That is, the GPS receiver 102 detects the current position of the unmanned aerial vehicle 100. The GPS receiver 102 sequentially outputs the detected current position of the unmanned aerial vehicle 100 to the processor 101 or a memory not shown in the figure.

[0077] The acceleration sensor 103 is a sensor that detects accelerations applied to the unmanned aerial vehicle 100 in three different directions.

[0078] The gyro sensor 104 is a sensor that detects the angular velocity of rotation about each of three axes having three different directions of the unmanned aerial vehicle 100 as axes.

[0079] The four microphones 105 are microphones with directivity characteristics that can receive higher-quality sound than in an angular range outside the sound collection range within a specified angular range based on a specific direction, i.e., a sound collection range, and are an example of a sensor. The specified angular range is, for example, an angular range below 90°, and is an expanded three-dimensional angular range based on the position of the microphone 105. The four microphones 105 can also be a microphone array having a plurality of microphone elements. The four microphones 105 collect sound to sequentially generate sound data, and sequentially output the sequentially generated sound data to the processor 101 or a memory not shown in the figure. When the sound data is output to the memory, the memory sequentially stores the output sound data. At this time, the memory can also, for example, store the sound data corresponding to the time information showing the current time.

[0080] The gimbal 106 is a device for maintaining the posture of the camera 107 around three axis directions at a constant level. In other words, the gimbal 106 is a device for maintaining the posture of the camera 107 at a desired posture, for example, relative to the earth coordinate system, even if the posture of the unmanned aerial vehicle 100 changes. Here, the desired posture is a posture determined by the shooting direction of the camera 107 included in the operation signal received from the controller 200.

[0081] The camera 107 is a device having an optical system such as a lens and an image sensor, and is an example of a sensor. The camera 107 sequentially generates image data by shooting, and sequentially outputs the sequentially generated image data to the processor 101 or the memory. When the image data is output to the memory, the memory sequentially stores the output image data. At this time, the memory may also store the image data, for example, in correspondence with the time information indicating the current time.

[0082] The distance measuring sensor 108 is a sensor that detects the distance from the distance measuring sensor 108 to the surrounding objects. The distance measuring sensor 108 is, for example, an ultrasonic sensor, a TOF (Time Of Flight) camera, a LIDAR (Light Detection and Ranging), etc. The distance measuring data generated by the distance measuring sensor 108 may also be data corresponding to the distance to the surrounding objects in the direction based on the distance measuring sensor 108. The distance measuring sensor 108 is fixed at a predetermined position of the unmanned aerial vehicle 100. Therefore, the positional relationship between the predetermined position and the reference position of the unmanned aerial vehicle 100 such as the center position of the main body 140 of the unmanned aerial vehicle 100 is a fixed relationship. Therefore, using the detection result of the distance measuring sensor 108, the unmanned aerial vehicle 100 can calculate the positional relationship between the reference position of the unmanned aerial vehicle 100 and the surrounding objects. The distance measuring sensor 108 is an example of a sensor. The distance measuring sensor 108 performs distance measurement to sequentially generate distance measuring data, and sequentially outputs the generated distance measuring data to the processor 101 or the memory. When the distance measurement data is output to the memory, the memory sequentially stores the output distance measurement data. At this time, the memory may also sequentially store the distance measurement data, for example, corresponding to the time information indicating the current time. Moreover, in the unmanned aerial vehicle 100, a plurality of distance measurement sensors 108 may be arranged at different positions of the unmanned aerial vehicle 100. Accordingly, the plurality of distance measurement sensors 108 can detect the distance from the unmanned aerial vehicle 100 to objects located in different directions.

[0083] The communication IF 109 is a communication interface for communicating with the controller 200 or the portable terminal 300. The communication IF 109 includes, for example, a communication interface for receiving a transmission signal sent by the controller 200. In addition, the communication IF 109 may also be a communication interface for wireless communication with the portable terminal 300, that is, the communication IF 109 may also be, for example, a wireless LAN (Local Area Network) interface that complies with the IEEE802.11a, b, g, n, ac, ax standards.

[0084] The four generators 110 have been described above, and thus detailed description is omitted.

[0085] The processor 101 has, as a functional structure, a sound processing unit 101a, a quality determination unit 101b, a sound source determination unit 101c, a position detection unit 101d, a flight control unit 101e, an image control unit 101f, and an obstacle detection unit 101g. Each of the processing units 101a to 101g sequentially performs processing using detection data sequentially detected from various sensors, processing results sequentially performed by other processing units, and the like, and sequentially outputs the obtained processing results to a predetermined output destination.

[0086] The sound processing unit 101a obtains four sound data generated by the four microphones 105, and performs predetermined sound processing on each of the four sound data. The sound processing unit 101a includes a noise processing unit 101aa and a noise level calculation unit 101ab. The noise processing unit 101aa performs sound source separation processing on the obtained sound data, thereby separating noise related to the flight of the unmanned aerial vehicle 100 and the target sound. The noise related to the flight of the unmanned aerial vehicle 100 (hereinafter referred to as "noise") is, for example, noise generated by driving the generator 110 of the unmanned aerial vehicle 100. The noise processing unit 101aa applies a directional filter for obtaining directivity in an arbitrary direction to the sound signals obtained from the plurality of microphone elements of each microphone 105, for example, to extract noise or target sound. In this way, noise and target sound are separated. Next, the noise level calculation unit 101ab calculates the sound pressure level of the noise separated by the noise processing unit 101aa and the sound pressure level of the target sound separated by the noise processing unit 101aa. Accordingly, in the sound collection processing unit 101a, for each of the four sound data generated by the four microphones 105, the noise and the target sound included in the sound data are extracted. In addition, the noise level calculation unit 101ab may also perform a predetermined sound processing for filtering the sound components of a predetermined frequency band, thereby reducing the noise included in the sound data. The sound components of the predetermined frequency band are, for example, the frequency band of the noise generated by the rotation of the rotor 111 of the generator 110.

[0087] The quality judgment unit 101b uses the sound pressure level of the noise obtained by the sound receiving processing unit 101a and the sound pressure level of the target sound to judge whether the quality of the target sound is higher or lower than the predetermined target quality. And, specifically, the quality judgment unit 101b uses the sound pressure level of the noise and the sound pressure level of the target sound to calculate the signal-to-noise ratio of the noise for the target sound as an indicator for judging the quality of the target sound. And, the quality judgment unit 101b obtains a target signal-to-noise ratio calculated using the signal-to-noise ratio calculated using the target sound and the noise as the predetermined target quality, compares the obtained target signal-to-noise ratio with the calculated signal-to-noise ratio, and thus judges the quality of the target sound. Here, the target signal-to-noise ratio may also be a range of signal-to-noise ratios based on a reference signal-to-noise ratio. For example, the target signal-to-noise ratio may also be a range of ±1dB based on the reference signal-to-noise ratio. And, the target signal-to-noise ratio may also be pre-stored by a memory or storage not shown in the figure, or may be stored by an external device. That is, the quality determination unit 101 b may read out and obtain the target signal-to-noise ratio from a memory or storage not shown in the figure, or may obtain the target signal-to-noise ratio from an external device via the communication IF 109 .

[0088] The quality judgment unit 101b judges whether the signal-to-noise ratio is higher or lower than the target signal-to-noise ratio, and judges that the quality is high when the signal-to-noise ratio is higher than the target signal-to-noise ratio, that is, when the signal-to-noise ratio is higher than the upper limit of the range of the target signal-to-noise ratio. The quality judgment unit 101b judges that the quality is low when the signal-to-noise ratio is lower than the target signal-to-noise ratio, that is, when the signal-to-noise ratio is lower than the lower limit of the target signal-to-noise ratio. The quality judgment unit 101b only needs to judge the quality of the target sound for the sound data with the largest sound pressure level of the target sound obtained by the sound collection processing unit 101a among the four sound data obtained from the four microphones 105, and does not need to judge the quality of the target sound for other sound data.

[0089] The sound source determination unit 101c obtains the positional relationship between the unmanned aerial vehicle 100 and the sound source of the target sound (hereinafter referred to as "sound source") using at least one of the sound data output by the four microphones 105, the image data output by the camera 107, and the distance measurement data output by the distance measurement sensor 108. The sound source determination unit 101c outputs the obtained positional relationship to the flight control unit 101e.

[0090] The sound source determination unit 101c, when obtaining the positional relationship using the sound data generated by the four microphones 105, determines at least one of (i) the sound source direction of the sound source, (ii) the position of the sound source, and (iii) the distance from the sound source based on the unmanned aerial vehicle 100 as the positional relationship using the sound data. The sound source direction of the sound source based on the unmanned aerial vehicle 100 is the direction from the unmanned aerial vehicle 100 to the sound source. The position of the sound source based on the unmanned aerial vehicle 100 is the relative position of the sound source with respect to the unmanned aerial vehicle 100. The distance from the sound source based on the unmanned aerial vehicle 100 is the distance from the unmanned aerial vehicle 100 to the sound source. In this way, the sound source determination unit 101c obtains these determination results as the positional relationship between the unmanned aerial vehicle 100 and the sound source.

[0091] For example, the sound source determination unit 101c may compare the four sound data obtained from the four microphones 105, thereby determining the direction in which the sound pressure estimated to be the target sound is large as the sound source direction. Furthermore, the sound source determination unit 101c may compare the multiple data included in each of the sound data obtained from each of the four microphones 105, that is, the multiple data obtained from the multiple microphone elements constituting the microphone 105, thereby determining the direction in which the sound pressure estimated to be the target sound is large as the sound source direction. Furthermore, for example, the sound source determination unit 101c may obtain the size of the target sound emitted from the sound source, and compare the sound pressure of the target sound included in the sound data generated by the four microphones 105 with the obtained size of the target sound, thereby estimating the distance from the sound source. In this case, the size of the target sound emitted from the sound source may also be a size predetermined in order to estimate the distance from the sound source. Furthermore, the sound source determination unit 101c may estimate the relative position of the sound source with respect to the unmanned aerial vehicle 100 by using the determined sound source direction and the distance from the sound source.

[0092] Furthermore, when the positional relationship is obtained using the image data generated by the image sensor of the camera 107, the sound source determination unit 101c determines at least one of (i) the direction of the sound source, (ii) the position of the sound source, and (iii) the distance from the sound source, based on the unmanned aerial vehicle 100 using the image data. In this way, the sound source determination unit 101c obtains these determination results as the positional relationship between the unmanned aerial vehicle 100 and the sound source. For example, the sound source determination unit 101c may recognize the color, shape, type, etc. of a predetermined sound source by image processing of the image data, thereby determining at least one of the position of the sound source, the distance from the sound source, and the direction of the sound source.

[0093] Furthermore, when the sound source determination unit 101c obtains the positional relationship using the distance measurement data generated by the distance measurement sensor 108, the sound source determination unit 101c determines at least one of (i) the sound source direction of the sound source, (ii) the position of the sound source, and (iii) the distance from the sound source, based on the unmanned aerial vehicle 100. In this way, the sound source determination unit 101c obtains these determination results as the positional relationship between the unmanned aerial vehicle 100 and the sound source. For example, the sound source determination unit 101c may also construct a three-dimensional model using the distance measurement data, recognize the three-dimensional shape of the sound source based on the constructed three-dimensional model, and thereby determine at least one of the position of the sound source, the distance from the sound source, and the direction of the sound source.

[0094] Furthermore, the sound source determination unit 101c may also obtain the distance of an object located in the direction of the sound source determined by the distance measurement data when the direction of the sound source is determined by the sound data or the image data, thereby estimating the relative position of the sound source with respect to the unmanned aerial vehicle 100. In this way, the sound source determination unit 101c may also determine the direction of the sound source and the distance from the unmanned aerial vehicle 100 to the sound source using the data generated by each sensor, thereby determining the relative position of the unmanned aerial vehicle 100 and the sound source.

[0095] Furthermore, the sound source determination unit 101 c may obtain the position information of the sound source from the sound source, thereby determining the direction of the sound source with respect to the UAV 100 or the relative position of the sound source with respect to the UAV 100 .

[0096] The sound source may be, for example, a person, a loudspeaker, or a vehicle.

[0097] The position detection unit 101 d obtains the detection result of the GPS receiver 102 and detects the current position of the unmanned aerial vehicle 100 .

[0098] The flight control unit 101e controls the number of revolutions of the actuator 112 of the generator 110 according to the current position of the UAV 100 detected by the position detection unit 101d, the flight speed and flight posture of the UAV 100 obtained from the detection results of the acceleration sensor 103 and the gyro sensor 104, and the operation signal from the controller 200 received by the communication IF 109, thereby controlling the flight state of the UAV 100. In other words, the flight control unit 101e performs a normal control of controlling the flight state of the UAV 100 according to the operation of the controller 200 by the user.

[0099] Furthermore, the flight control unit 101e, unlike normal control, performs sound collection control on the movement of the unmanned aerial vehicle 100 by controlling the distance between the unmanned aerial vehicle 100 and the sound source based on the quality of the target sound determined by the quality judgment unit 101b and the positional relationship between the unmanned aerial vehicle 100 and the sound source determined by the sound source judgment unit 101c.

[0100] The flight control unit 101e controls the movement of the UAV 100 in a direction away from the sound source when, for example, the quality judgment unit 101b judges that the quality of the target sound is lower than a predetermined target quality during the control of the flight state of the sound collection control. Accordingly, the UAV 100 flies in a direction away from the sound source.

[0101] Furthermore, when the flight control unit 101e controls the movement of the UAV 100 so as to move away from the sound source, the flight control unit 101e controls the movement of the UAV 100 so as to move to an arbitrary position between the current position of the UAV 100 detected by the position detection unit 101d and the position where the quality of the target sound becomes the target quality. In this case, the flight control unit 101e may, for example, determine the distance between the sound source and the position where the quality of the target sound becomes the target quality as the target distance, and control the movement of the UAV 100 so that the distance between the UAV 100 and the sound source becomes the target distance.

[0102] The flight control unit 101e calculates the target distance from the sound source to the position at the predetermined target mass using the distance between the current position of the unmanned aerial vehicle 100 and the sound source, the mass of the target sound based on the sound source, and the relationship between the predetermined sound pressure level and the distance from the sound source, and controls the movement of the unmanned aerial vehicle 100 so that the unmanned aerial vehicle 100 is located at the target distance from the sound source. Accordingly, when the unmanned aerial vehicle 100 flies in a direction away from the sound source, for example, when it flies to the position at which the mass of the target sound becomes the target mass, it does not depart to a position farther from the sound source than the position.

[0103] Furthermore, the flight control unit 101e controls the movement of the UAV 100 so as to approach the sound source when, for example, the quality judgment unit 101b judges that the quality of the target sound is higher than a predetermined target quality during the control of the flight state of the sound collection control. Accordingly, the UAV 100 flies in a direction approaching the sound source.

[0104] The flight control unit 101e, when controlling the movement of the unmanned aerial vehicle 100 so as to approach the sound source, controls the movement of the unmanned aerial vehicle 100 so as not to approach the position of the sound source from the position at the predetermined distance from the sound source, based on the distance information indicating that it is prohibited to approach the position of the sound source from the position at the predetermined distance from the sound source, and the positional relationship obtained by the sound source determination unit 101c. Accordingly, when the unmanned aerial vehicle 100 flies in a direction approaching the sound source, for example, the unmanned aerial vehicle 100 approaches the sound source until the position at the predetermined distance from the sound source, and does not approach the sound source from the position at the predetermined distance.

[0105] Moreover, the distance information may be pre-stored in a memory or storage not shown in the figure, or may be stored in an external device. That is, the flight control unit 101e may read and obtain the distance information from a memory or storage not shown in the figure, or may obtain the distance information from an external device via the communication IF109.

[0106] Furthermore, the flight control unit 101e may perform sound collection control when the target sound is collected by the four microphones 105. For example, the flight control unit 101e may stop the normal control and start the sound collection control when the target sound is collected by the four microphones 105, and stop the sound collection control and start the normal control when the collection of the target sound is completed.

[0107] The sound collection control may be performed when the target sound is received by the four microphones 105. That is, the sound collection control may be performed when only the target sound is received, or may be performed when the target sound is received while the camera 107 is capturing an image.

[0108] The image control unit 101f controls the gimbal 106 according to the operation signal received by the communication IF 109, thereby controlling the posture of the camera 107 so that the shooting direction of the camera 107 faces the direction indicated by the operation signal. In addition, the image control unit 101f may perform a predetermined image processing on the image data shot by the camera 107. The image control unit 101f may also transmit the image data obtained from the camera 107 or the image data after the predetermined image processing to the portable terminal 300 via the communication IF 109.

[0109] The obstacle detection unit 101g detects obstacles around the UAV 100 according to the distance from the UAV 100 to the object detected by the distance measuring sensor 108. The obstacle detection unit 101g may also exchange information with the flight control unit 101e to detect obstacles at the destination to which the UAV 100 is to move. When the obstacle detection unit 101g detects an obstacle at the destination to which the UAV 100 is to move, it may also instruct the flight control unit 101e to move the UAV 100 in a manner to avoid the obstacle.

[0110] [2. Work]

[0111] Next, the operation of the unmanned aerial vehicle 100 according to the embodiment will be described.

[0112] Figure 5 This is a flowchart showing an operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Figure 6 This is a flowchart showing an example of a process for determining the quality of a target sound of an unmanned aerial vehicle. Figure 7 This is a diagram showing an example of a method for calculating a signal-to-noise ratio which is an index of the quality of a target sound.

[0113] like Figure 5 As shown, the quality judgment unit 101b of the unmanned aerial vehicle 100 judges the quality of the target sound included in the four sound data generated by the four microphones 105 when the sound collection control is started by the sound collection processing unit 101a (S11). For example, when the operation signal received from the controller 200 includes a signal indicating the start of sound collection, the sound collection processing unit 101a starts sound collection. The quality judgment process of the target sound in step S1 is performed by using Figure 6 as well as Figure 7 Provide detailed explanation.

[0114] like Figure 6 As shown, first, the noise level calculation unit 101ab of the sound collection processing unit 101a calculates the sound pressure level of the noise for each of the four sound data generated by the four microphones 105 (S21). Figure 7The signal before noise processing is shown as sound data. The signal before noise processing is represented, for example, by the time variation of a normalized number. Therefore, the noise level calculation unit 101ab multiplies the amplitude of the signal before noise processing by a sound pressure conversion coefficient corresponding to the performance of the corresponding microphone 105, thereby calculating the time variation of the sound pressure level. The noise level calculation unit 101ab extracts a specified frequency band based on the calculated time variation of the sound pressure level, and calculates the average sound pressure level at a specified time interval (for example, 1 second) based on the time variation of the sound pressure level of the extracted specified frequency band, thereby calculating the sound pressure level of the noise. Moreover, the specified frequency band is a frequency band predetermined in order to extract the target sound.

[0115] The noise level calculation unit 101ab calculates the sound pressure level of the noise using the signal before noise processing obtained from each microphone 105, but is not limited to this, and obtains the sound pressure level calculated using the signal obtained by receiving the noise in advance in a state where the target sound is not generated from the memory. In this case, the sound pressure level calculated using the signal obtained in advance is, for example, the sound pressure level calculated based on the signal obtained by receiving the sound corresponding to the different stages of the rotation speed of the generator 110 of the unmanned aerial vehicle 100, and is the sound pressure level corresponding to each rotation speed. In other words, the noise level calculation unit 101ab can also read the sound pressure level corresponding to the rotation speed of the generator 110 of the unmanned aerial vehicle 100 from the memory to obtain the sound pressure level of the noise.

[0116] Next, the noise processing unit 101aa of the sound processing unit 101a performs a sound source separation process on the acquired sound data as noise processing, thereby separating the noise related to the flight of the unmanned aerial vehicle 100 and the target sound (S22). Figure 7 Shown is the signal after noise processing.

[0117] Next, the noise level calculation unit 101ab calculates the sound pressure level of the separated target sound (S23). The signal after noise processing is represented by the time variation of the normalized number, for example, in the same manner as the signal before noise processing. Therefore, the noise level calculation unit 101ab calculates the time variation of the sound pressure level by multiplying the amplitude of the signal after noise processing by the sound pressure conversion coefficient corresponding to the performance of the corresponding microphone 105. The noise level calculation unit 101ab extracts a specified frequency band based on the time variation of the calculated sound pressure level, and calculates the average sound pressure level of a specified time interval (for example, 1 second) based on the time variation of the sound pressure level of the extracted specified frequency band, thereby calculating the sound pressure level of the target sound. In addition, the noise level calculation unit 101ab may also calculate the specified time interval for calculating the average sound pressure level using the characteristics of the detected target sound. That is, the specified time interval may also be adjusted according to the characteristics of the detected target sound. Here, as for the characteristics, the frequency band of the detected target sound and the length of the period of the detected target sound may be cited as examples. For example, the noise level calculation unit 101ab may determine whether the detected target sound frequency band is within a predetermined frequency band to lengthen the predetermined time interval. Alternatively, the shorter the duration of the detected target sound, the shorter the predetermined time interval may be.

[0118] The quality determination unit 101b calculates a signal-to-noise ratio of the noise to the target sound by subtracting the sound pressure level of the noise from the sound pressure level of the target sound using the sound pressure level of the noise calculated by the noise level calculation unit 101ab and the sound pressure level of the target sound (S24).

[0119] Next, the quality determination unit 101b determines whether the calculated signal-to-noise ratio is the target signal-to-noise ratio (S12). Specifically, the quality determination unit 101b determines whether the calculated signal-to-noise ratio is within the range of signal-to-noise ratios based on the reference signal-to-noise ratio.

[0120] When the quality determination unit 101b determines that the calculated signal-to-noise ratio is not the target signal-to-noise ratio (No in S12), the process proceeds to the next step S13. On the contrary, when the quality determination unit 101b determines that the calculated signal-to-noise ratio is the target signal-to-noise ratio (Yes in S12), the process proceeds to step S17. When the signal-to-noise ratio is the target signal-to-noise ratio, the unmanned aerial vehicle 100 has already received the target sound well, and therefore, the unmanned aerial vehicle 100 is not moved.

[0121] Next, the obstacle detection unit 101g determines whether the UAV 100 can move safely (S13). Specifically, the obstacle detection unit 101g determines whether there are objects around the UAV 100. If it is determined that there are no objects around the UAV 100, it is determined that the UAV 100 can move safely. If it is determined that there are objects around the UAV 100, it is determined that the UAV 100 cannot move safely.

[0122] If the obstacle detection unit 101g determines that the UAV 100 can move safely ("Yes" in S13), the process proceeds to the next step S14. On the contrary, if the obstacle detection unit 101g determines that the UAV 100 cannot move safely ("No" in S13), the process proceeds to step S17.

[0123] The quality judgment unit 101b judges whether the calculated signal-to-noise ratio is higher or lower than the target signal-to-noise ratio (S14). Here, the following example is described, that is, the quality judgment unit 101b uses the range of ±1dB based on the reference signal-to-noise ratio (e.g., -10dB) as the target signal-to-noise ratio to judge whether the calculated signal-to-noise ratio is higher or lower than the target signal-to-noise ratio. Specifically, the quality judgment unit 101b judges whether the calculated signal-to-noise ratio is higher than the upper limit (e.g., -9dB) of the range of the target signal-to-noise ratio, or whether it is lower than the lower limit (e.g., -11dB) of the range of the target signal-to-noise ratio.

[0124] When the quality determination unit 101b determines that the calculated S / N ratio is higher than the target S / N ratio range (High in S14), the flight control unit 101e controls the UAV 100 to move away from the sound source (S15).

[0125] When the quality determination unit 101b determines that the calculated S / N ratio is lower than the target S / N ratio range (low in S14), the flight control unit 101e controls the UAV 100 to move toward the sound source (S16).

[0126] The sound reception processing unit 101a determines whether to stop sound reception (S17). When the sound reception processing unit 101a determines that sound reception is to be stopped ("Yes" in S17), the sound reception control is terminated. When the sound reception processing unit 101a determines that sound reception is not to be stopped ("No" in S17), the quality determination unit 101b performs the determination in step S11 again.

[0127] Fig. 8A This is a diagram for explaining a first scene of an operation example of sound collection control of an unmanned aerial vehicle according to an embodiment. Figure 8BIt is a diagram for explaining a second scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Figure 8C It is a diagram for explaining the third scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 9A It is a diagram for explaining a fourth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 9B It is a diagram for explaining the fifth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 9C It is a diagram for explaining the sixth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 10A It is a diagram for explaining the seventh scene of the operation example of the sound collection control of the unmanned aerial vehicle involved in the embodiment. Fig. 10B It is a diagram for explaining the eighth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 10C It is a diagram for explaining the ninth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment.

[0128] and, FIG. 8A to FIG. 8C , 9A to 9C , FIG. 10A to FIG. 10C 1 is a diagram showing the operation of the unmanned aerial vehicle 100 when the unmanned aerial vehicle 100 is viewed from above. FIG. 8A to FIG. 8C , 9A to 9C , FIG. 10A to FIG. 10C 4 is a diagram showing an example of the operation of the unmanned aerial vehicle 100 receiving the target sound when the sound source 400 is a person and the target sound is the sound of the sound source 400. FIG. 8A to FIG. 8C , 9A to 9C , FIG. 10A to FIG. 10C In the example of , the reference signal-to-noise ratio is recorded as the target signal-to-noise ratio. FIG. 8A to FIG. 8C , 9A to 9C , FIG. 10A to FIG. 10C The dotted line L1 shown in the example is a virtual line showing a position at a predetermined distance d1 from the sound source 400 shown in the distance information. That is, the dotted line L1 is a line showing the boundary of a safety range for ensuring the safety of the sound source.

[0129] exist Fig. 8A In the illustrated scene, the sound pressure level of the noise is calculated to be 75 dB, the sound pressure level of the target sound is calculated to be 70 dB, and the signal-to-noise ratio is calculated to be -5 dB. At this time, the target signal-to-noise ratio is set to -10 dB, and the calculated signal-to-noise ratio is higher than the target signal-to-noise ratio. Therefore, the unmanned aerial vehicle 100, as shown in FIG. Figure 8B It shows movement in the direction away from the sound source 400. Figure 8BIn the illustrated scene, the UAV 100 uses the sound data obtained from the microphone 105 after leaving the sound source 400 to calculate the sound pressure level of the noise as 75 dB and the sound pressure level of the target sound as 70 dB, thereby calculating the signal-to-noise ratio as -10 dB. In this case, the calculated signal-to-noise ratio is within the target signal-to-noise ratio range, so the UAV 100, in the case of Figure 8C As shown, the device does not move while maintaining a distance from the sound source 400.

[0130] exist Fig. 9A In the scene shown, the sound pressure level of the noise is calculated to be 75dB, the sound pressure level of the target sound is calculated to be 65dB, and the signal-to-noise ratio is calculated to be -10dB. At this time, the target signal-to-noise ratio is set to -10dB, and the calculated signal-to-noise ratio is within the target signal-to-noise ratio range. Therefore, the unmanned aerial vehicle 100, in the case of Fig. 9A As shown, the distance from the sound source 400 is maintained without moving. Fig. 9B 1 shows a scene in which the sound source 400 moves toward the UAV 100. In this case, it is assumed that the UAV 100 calculates the sound pressure level of the noise as 75 dB and the sound pressure level of the target sound as 69 dB using the sound data obtained from the microphone 105 after the UAV 100 approaches the sound source 400, thereby calculating the signal-to-noise ratio as -6 dB. The calculated signal-to-noise ratio is higher than the target signal-to-noise ratio, so the UAV 100, as shown in FIG. Fig. 9C , moving away from the sound source 400. Fig. 9C In the illustrated scene, the UAV 100 uses the sound data obtained from the microphone 105 after leaving the sound source 400 to calculate the sound pressure level of the noise as 75 dB and the sound pressure level of the target sound as 65 dB, thereby calculating the signal-to-noise ratio as -10 dB. In this case, the calculated signal-to-noise ratio is within the target signal-to-noise ratio range, so the UAV 100, in the case of Fig. 9C As shown, the device does not move while maintaining a distance from the sound source 400.

[0131] exist Fig. 10A In the illustrated scene, the sound pressure level of the noise is calculated to be 75 dB, the sound pressure level of the target sound is calculated to be 58 dB, and the signal-to-noise ratio is calculated to be -17 dB. At this time, the target signal-to-noise ratio is set to -10 dB, and the calculated signal-to-noise ratio is lower than the target signal-to-noise ratio. Therefore, the unmanned aerial vehicle 100, as shown in FIG. Fig. 10B , moving towards the direction close to the sound source 400. Fig. 10BIn the illustrated scene, the UAV 100 calculates the sound pressure level of the noise as 75 dB and the sound pressure level of the target sound as 61 dB using the sound data obtained from the microphone 105 after approaching the sound source 400, thereby calculating the signal-to-noise ratio as -14 dB. Even in this case, the calculated signal-to-noise ratio is lower than the target signal-to-noise ratio, so the UAV 100, as shown in FIG. Fig. 10C As shown, it also moves closer to the sound source 400. Fig. 10C The scene shown shows that the unmanned aerial vehicle 100 calculates the sound pressure level of the noise as 75 dB and the sound pressure level of the target sound as 63 dB using the sound data obtained from the microphone 105 after approaching the sound source 400, thereby calculating the signal-to-noise ratio as -12 dB. Even in this case, the calculated signal-to-noise ratio is lower than the target signal-to-noise ratio, but it is close to the position of the predetermined distance d1 from the sound source 400, and therefore, it is no longer moving in the direction close to the sound source.

[0132] Furthermore, in the above description, the positional relationship between the UAV 100 and the sound source 400 is described using the distance in the horizontal direction, but it can also be applied to the distance in the three-dimensional space. In this case, the safety range defined by the predetermined distance d1 indicated by the distance information when the UAV 100 is controlled to move in the direction close to the sound source 400 is described using the range defined by the distance in the horizontal direction as an example, but it can also be defined by the distance in the three-dimensional space.

[0133] Fig.11A It is a diagram for explaining the tenth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 11B It is a diagram for explaining the eleventh scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 12A It is a diagram for explaining the twelfth scene of the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig. 12B 13 is a diagram for explaining the operation example of the sound collection control of the unmanned aerial vehicle according to the embodiment. Fig.11A , Fig. 11B , Fig. 12A as well as Fig. 12B This is a diagram showing an example of the positional relationship between the unmanned aerial vehicle and the sound source and the safety range when viewed from the horizontal direction.

[0134] exist Fig.11AIn the illustrated scene, the sound pressure level of the noise is calculated to be 75 dB, the sound pressure level of the target sound is calculated to be 68 dB, and the signal-to-noise ratio is calculated to be -7 dB. At this time, the target signal-to-noise ratio is set to -10 dB, and the calculated signal-to-noise ratio is higher than the target signal-to-noise ratio. Therefore, the flight control unit 101e controls the unmanned aerial vehicle 100 to move away from the sound source 400. In this way, when the flight control unit 101e controls the unmanned aerial vehicle 100 to move away from the sound source, as shown in FIG. Fig. 11B As shown, the UAV 100 may be controlled to move horizontally instead of ascending the UAV 100. In this case, the flight control unit 101e may control the UAV 100 to move closer to the ground.

[0135] According to this, when the unmanned aerial vehicle 100 moves in a direction away from the sound source, it does not perform control to ascend to move away from the sound source, but moves in a horizontal direction away from the sound source, thereby ensuring the distance from the sound source in the horizontal direction. Therefore, it does not move to a position higher than the current position, thereby reducing the impact when the unmanned aerial vehicle 100 falls, and ensuring the safety of the sound source. In addition, in the above, the example of the unmanned aerial vehicle 100 moving in a direction away from the sound source is used for explanation, but the same effect can be obtained even when the unmanned aerial vehicle 100 moves in a direction close to the sound source.

[0136] exist Fig. 12A In the illustrated scene, the sound pressure level of the noise is calculated to be 75 dB, the sound pressure level of the target sound is calculated to be 59 dB, and the signal-to-noise ratio is calculated to be -16 dB. At this time, the target signal-to-noise ratio is set to -10 dB, and the calculated signal-to-noise ratio is lower than the target signal-to-noise ratio. Therefore, the flight control unit 101e controls the unmanned aerial vehicle 100 to move in a direction close to the sound source 400. In this way, the flight control unit 101e may also control the unmanned aerial vehicle 100 to move in a direction close to the sound source, as shown in FIG. Fig. 12B It is shown that the UAV 100 is controlled in such a manner that the UAV 100 approaches the ground.

[0137] According to this, when the unmanned aerial vehicle 100 moves in the direction approaching the sound source, it does not control to move in the horizontal direction to approach the sound source, but moves in the direction approaching the sound source close to the ground, so that it can approach the sound source while ensuring the distance from the sound source in the horizontal direction. Therefore, it is closer to the ground than the current position, thereby reducing the impact when the unmanned aerial vehicle 100 falls, and the safety of the sound source can be ensured. In addition, in the above, the example of the case where the unmanned aerial vehicle 100 moves in the direction approaching the sound source is used for explanation, but even if the unmanned aerial vehicle 100 moves in the direction away from the sound source, the same effect can be obtained.

[0138] [3. Effects, etc.]

[0139] According to the unmanned aerial vehicle 100 involved in this embodiment, the processor 101 determines the quality of the target sound using the sound data generated by the microphone 105. The processor 101 obtains the positional relationship between the unmanned aerial vehicle 100 and the sound source 400 of the target sound using the data generated by the sensor. The processor 101 controls the movement of the unmanned aerial vehicle 100 in a manner of controlling the distance between the unmanned aerial vehicle 100 and the sound source of the target sound based on the quality and positional relationship of the target sound. Therefore, the distance between the unmanned aerial vehicle 100 and the sound source 400 can be controlled, and the quality of the target sound can be ensured. Therefore, the sound can be collected with appropriate sound quality while ensuring the safety of the sound source 400.

[0140] Furthermore, in the UAV 100, the processor 101 controls the movement of the UAV 100 in a manner away from the sound source 400 when the quality of the target sound is higher than a predetermined target quality. Therefore, the UAV 100 is moved away from the sound source 400 while ensuring the quality of the target sound, thereby further improving the safety of the sound source 400.

[0141] Furthermore, in the UAV 100, the processor 101 controls the movement of the UAV 100 so as to move away from the sound source 400, and controls the movement of the UAV 100 so as to move between the current position of the UAV 100 and the position where the quality of the target sound reaches the target quality. Therefore, the UAV 100 can be moved in a direction away from the sound source 400 within a range where the quality of the target sound is ensured.

[0142] Furthermore, in the UAV 100, when the quality of the target sound is lower than a predetermined target quality, the processor 101 controls the movement of the UAV 100 so as to approach the sound source 400. Therefore, when the quality of the target sound is not ensured, the UAV 100 is moved in a direction close to the sound source 400, thereby improving the quality of the target sound.

[0143] Furthermore, in the UAV 100, the processor 101 calculates a signal-to-noise ratio calculated using a target sound and noise related to the flight of the UAV 100 as an indicator for judging quality. Furthermore, the processor 101 obtains a target signal-to-noise ratio calculated in advance using a signal-to-noise ratio calculated using a target sound and noise related to the flight of the UAV as a predetermined target quality. Furthermore, the processor 101 compares the obtained target signal-to-noise ratio with the calculated signal-to-noise ratio to judge the quality of the target sound. Therefore, the quality of the target sound can be easily judged.

[0144] Furthermore, in the unmanned aerial vehicle 100, the sensor also includes an image sensor provided in the camera 107, that is, an image sensor that generates image data. The processor 101 obtains the positional relationship using the image data generated by the image sensor. Accordingly, the processor 101 also obtains the positional relationship using the image data, and thus can obtain a positional relationship with high accuracy.

[0145] Furthermore, in the unmanned aerial vehicle 100, the sensor further includes a distance measuring sensor 108 that generates distance measuring data. The processor 101 obtains the positional relationship using the distance measuring data generated by the distance measuring sensor 108. Accordingly, the processor 101 also obtains the positional relationship using the distance measuring data, and thus can obtain a positional relationship with high accuracy.

[0146] Furthermore, in the UAV 100, the processor 101 determines the target distance based on the quality and positional relationship of the target sound and the predetermined target quality, and controls the movement of the UAV 100 so that the distance between the UAV 100 and the sound source 400 becomes the target distance. In this way, the UAV 100 can move to a position corresponding to the predetermined target quality.

[0147] [4. Modifications]

[0148] [4-1. Modification 1]

[0149] According to the unmanned aerial vehicle 100 involved in the above embodiment, the reference signal-to-noise ratio that serves as the reference of the target signal-to-noise ratio as the target quality is described by taking a value such as -10 dB as an example, but it is not limited to a single value, and multiple values ​​can be set according to the purpose of the sound reception control.

[0150] Fig.13 : is a table showing an example of the relationship between the reference signal-to-noise ratio and the application. Furthermore, when the target signal-to-noise ratio is not a target range of ±1 dB but a threshold, the reference signal-to-noise ratio may be replaced by the target signal-to-noise ratio.

[0151] like Fig.13 As shown, for example, four stages of reference signal-to-noise ratios may be set according to the purpose. R1 to R4 shown here have the relationship of R1<R2<R3<R4. For example, the reference signal-to-noise ratio for the lowest quality is R1, the reference signal-to-noise ratio for general sound collection is R2, the reference signal-to-noise ratio for relaying is R3, and the reference signal-to-noise ratio for high-quality broadcasting is R4. These purposes are selected by the user's operation of the controller 200, and the reference signal-to-noise ratio corresponding to the selected purpose is used for the sound reception control of the unmanned aerial vehicle 100. In addition, the purpose may be fixed according to the application of the controller 200, in which case the reference signal-to-noise ratio corresponding to the application is used for the sound reception control of the unmanned aerial vehicle 100.

[0152] [4-2. Modification 2]

[0153] According to the unmanned aerial vehicle 100 according to the above embodiment, the flight control unit 101e controls the unmanned aerial vehicle 100 to move away from the sound source when it is determined that the signal-to-noise ratio calculated by the quality determination unit 101b is higher than the target signal-to-noise ratio range, but may also control the unmanned aerial vehicle 100 not to move, because the sound can be collected with sufficiently high quality.

[0154] [4-3. Modification 3]

[0155] According to the UAV 100 involved in the above embodiment, even if the calculated signal-to-noise ratio is lower than the target signal-to-noise ratio, the UAV 100 does not move when approaching the position at the predetermined distance d1 from the sound source, but further control may be performed. That is, in the above embodiment, after the movement of the UAV 100 is controlled so as to approach the sound source until the position is at the predetermined distance from the sound source based on the distance information and the positional relationship, the UAV 100 does not move when the quality of the target sound is lower than the predetermined target quality, but the present invention is not limited to this.

[0156] For example, the unmanned aerial vehicle 100 may also have an actuator (not shown) for changing the orientation of the microphone 105, and the processor 101 may control the actuator to change the orientation of the microphone 105. In other words, the direction in which the microphone 105 has high sensitivity may be directed toward the sound source. In this way, the direction in which the microphone 105 has high sensitivity can be aligned with the direction of the sound source, so that the sound pressure level of the target sound can be relatively increased with respect to the sound pressure level of the noise, and the sound reception quality can be improved.

[0157] Furthermore, the UAV 100 may also control the actuator to change the protrusion amount of the microphone 105 toward the outside of the UAV 100, when it has an actuator (not shown) that changes the protrusion amount of the microphone 105 toward the outside of the UAV 100. That is, the microphone 105 may be protruded toward the outside of the UAV 100 and the microphone 105 may be brought closer to the sound source. Thus, the microphone 105 is away from the UAV 100, which is the source of the noise, and thus the sound pressure level of the noise can be reduced. Furthermore, the microphone 105 is brought closer to the sound source, and thus the sound pressure level of the target sound relative to the sound pressure level of the noise can be relatively increased. Thus, the sound reception quality can be effectively improved. Furthermore, the actuator may include an actuator that changes the direction of the microphone 105 and an actuator that changes the protrusion amount of the microphone 105, and the processor 101 may control both actuators to control the change of the direction of the microphone 105 and the protrusion amount. The outward direction of the UAV 100 is, for example, a lateral direction in the horizontal direction of the UAV 100. Furthermore, the UAV 100 may control at least one of changing the orientation of the microphone 105 and the protrusion amount of the microphone outward from the UAV 100 when the quality of the target sound is lower than the target quality after the movement of the UAV 100 is controlled so as to approach the sound source.

[0158] [4-4. Modification 4]

[0159] The unmanned aerial vehicle 100 according to the above embodiment is configured to include four generators 110 . However, the number of generators included in the unmanned aerial vehicle 100 is not limited to four, and may be one to three, or five or more.

[0160] [4-5. Modification 5]

[0161] The unmanned aerial vehicle 100 involved in the above embodiment is a structure in which the main body 140 and the four pipes 130 are connected by four arms 141. However, the present invention is not limited thereto. If the four generators 110 are connected to the main body 140, the structure may be a structure without the four pipes 130 or the four arms 141. In other words, the unmanned aerial vehicle may be a structure in which the main body 140 and the four generators 110 are directly connected, or a structure in which the main body 140 and the four pipes 130 are directly connected. Furthermore, the unmanned aerial vehicle may be a structure without the four pipes 130, that is, a structure without covering the sides of the four generators 110.

[0162] [4-6. Modification 6]

[0163] The unmanned aerial vehicle 100 involved in the above-mentioned embodiment is a structure having four microphones 105, but the number of microphones provided to the unmanned aerial vehicle 100 is not limited to four, and may be one to three, or may be five or more. Moreover, when the number of microphones 105 is small, the posture of the unmanned aerial vehicle 100 may be rotated, thereby obtaining a plurality of sound data at different timings, and comparing the plurality of sound data to estimate the direction of the sound source. The microphone 105 may be arranged to be exposed to the outside of the unmanned aerial vehicle 100, that is, the external space, and may be arranged to the side of the arm 141 in addition to the side of the main body 140. Furthermore, the microphone 105 may be arranged at a position far from the main body 140. For example, the microphone 105 may be arranged at the front end or in the middle of a rod such as an arm, a line such as a metal wire, or a rope such as a string, which is installed on the main body 140 and extends in a direction away from the main body 140, which is different from the arm 141.

[0164] [4-7. Modification 7]

[0165] In the above embodiment, an example is shown in which the direction of the microphone 105 is changed when the signal-to-noise ratio is lower than the target signal-to-noise ratio even when the distance to the sound source 400 is close to the predetermined distance d1. However, the present invention is not limited to this. The embodiment may be performed after the direction in which the microphone 105 has high sensitivity is aligned with the direction of the sound source in advance. Figure 5 Furthermore, in the case of aligning the direction in which the microphone 105 has high sensitivity with the direction of the sound source, if the unmanned aerial vehicle 100 has an actuator for changing the orientation of the microphone 105, the actuator can be controlled to change the orientation of the microphone 105, and if the unmanned aerial vehicle 100 does not have an actuator, the flight posture can be controlled to align the direction in which the microphone 105 has high sensitivity with the direction of the sound source.

[0166] Furthermore, when the flight posture is controlled so that the direction of high sensitivity of the microphone 105 coincides with the direction of the sound source, information indicating in which range the direction of high sensitivity of each of the four microphones 105 is located with respect to the UAV 100 is stored in advance in a memory (not shown) provided in the UAV 100. Therefore, the quality determination unit 101b that determines the amount of change of the posture of the UAV 100 by the flight control unit 101e can determine the amount of change indicating how much the UAV 100 can be rotated to coincide with the direction of high sensitivity, based on the information of the direction of high sensitivity read out from the memory and the posture of the UAV 100 obtained by various sensors such as the acceleration sensor 103 and the gyro sensor 104.

[0167] [4-8. Modification 8]

[0168] The unmanned aerial vehicle 100 involved in the above-described embodiment starts sound collection when the operation signal received from the controller 200 includes a signal indicating the start of sound collection, but the present invention is not limited to this. For example, when the sound data obtained by the sound collection processing unit 101a includes a sound collection instruction indicating the start of sound collection, sound collection may be started, when the image data obtained by the camera 107 is analyzed to recognize the user's gesture for starting sound collection, or when the user's words for starting sound collection are recognized based on the movement of the user's lips. Furthermore, the recognition of the user's gesture and the pronunciation of a specific keyword may be used to adjust the specified distance d1.

[0169] Furthermore, the unmanned aerial vehicle 100 may also perform autonomous flight according to a preset program without being operated by the controller 200 .

[0170] Furthermore, the controller 200 may not include an operation interface of the UAV 100 , but may operate the UAV 100 according to a preset program.

[0171] [4-9. Modification 9]

[0172] The UAV 100 according to the above embodiment uses the signal-to-noise ratio as an evaluation index of the sound reception quality, but the present invention is not limited to this. The reliability coefficient after the sound recognition process and the error rate of the sound recognition may also be used as the quality evaluation index.

[0173] [4-10. Modification 10]

[0174] The unmanned aerial vehicle 100 involved in the above-mentioned embodiment can also control movement by using information about the frequency of the target sound and the flying sound (i.e., noise) of the unmanned aerial vehicle 100. Specifically, the quality judgment unit 101b judges the difference between the frequency of the target sound and the frequency of the flying sound, and the flight control unit 101e controls the movement to approach or leave the sound source according to the difference. Fig.14 The processing of this modification example will be described. Fig.14 This is a flowchart showing an operation example of the sound collection control of the unmanned aerial vehicle according to the tenth modification.

[0175] The quality determination unit 101b determines the frequency of the target sound and the frequency of the flying sound (S31). In step S31, the frequency band of the target sound and the frequency band of the flying sound may be determined.

[0176] Next, the quality determination unit 101b determines whether the difference between the frequency of the target sound and the frequency of the flying sound is less than a threshold value (S32). When determining the frequency band in step S31, the difference in the center frequency of each frequency band may be used as the frequency difference.

[0177] When it is determined that the difference between the frequency of the target sound and the frequency of the flight sound exceeds the threshold value (No in S32), the flight control unit 101e performs flight control in such a way that the unmanned aerial vehicle 100 moves away from the sound source (S33). In this way, if the difference in frequency is sufficiently large, even if the unmanned aerial vehicle 100 moves away from the target, the sound reception quality of the sound after filtering the flight sound, i.e., noise, from the received sound can be sufficiently maintained.

[0178] On the contrary, when it is determined that the difference between the frequency of the target sound and the frequency of the flight sound is less than the threshold value ("Yes" in S32), the flight control unit 101e performs flight control in such a way that the unmanned aerial vehicle 100 approaches the sound source (S34). In this way, if the difference in frequency is small, it is difficult to fully maintain the sound reception quality of the sound after filtering the flight sound, that is, the noise from the received sound, and therefore the unmanned aerial vehicle 100 is brought closer.

[0179] If the flight control of step S33 or step S34 is performed, the sound reception processing unit 101a determines whether to stop the sound reception (S35). If the sound reception processing unit 101a determines that the sound reception is to be stopped ("Yes" of S35), the sound reception control is terminated. If the sound reception processing unit 101a determines that the sound reception is not to be stopped ("No" of S35), the quality judgment unit 101b performs the judgment of step S31 again.

[0180] In this way, by controlling the distance from the sound source based on the difference between the frequency of the target sound and the frequency of the flying sound (ie, noise), the distance between the sound source and the UAV 100 can be controlled according to the sound collection quality (eg, signal-to-noise ratio).

[0181] [4-11. Modification 11]

[0182] The unmanned aerial vehicle 100 according to the modification 10 may also suppress flight control by controlling the flight sound. Specifically, the flight control unit 101e controls the rotation of the propeller according to the difference in frequency between the target sound and the flight sound. Fig.15 , the processing of this variant example is explained. Fig.15 is a flowchart showing another operation example of the sound collection control of the unmanned aerial vehicle involved in the modification example 11. Fig.14 Description of substantially the same process.

[0183] The quality determination unit 101b determines the frequency of the target sound and the frequency of the flying sound (S31).

[0184] Next, the quality determination unit 101b determines whether the difference between the frequency of the target sound and the frequency of the flying sound is equal to or smaller than a threshold value (S32).

[0185] When it is determined that the difference between the frequency of the target sound and the frequency of the flight sound exceeds the threshold value (No in S32), the flight control unit 101e performs flight control so that the unmanned aerial vehicle 100 moves away from the sound source (S33).

[0186] On the contrary, when it is determined that the difference between the frequency of the target sound and the frequency of the flight sound is less than the threshold value ("Yes" in S32), the flight control unit 101e controls the rotation of the propeller in a manner that increases the difference in frequency (S36). For example, the flight control unit 101e changes the number of revolutions of the propeller in a manner that increases the difference in frequency between the flight sound and the frequency of the target sound.

[0187] In this way, by performing flight control so as to increase the difference between the frequency of the target sound and the frequency of the flight sound, it is possible to improve the sound collection quality and suppress the unmanned aerial vehicle 100 from approaching the sound source.

[0188] Furthermore, after performing movement control or flight control based on the difference in frequency between the target sound and the flying sound as in Modifications 11 and 12, movement control may be performed based on the sound collection quality as in the above-described embodiment.

[0189] [4-12. Modification 12]

[0190] The unmanned aerial vehicle 100 involved in the above-mentioned embodiment may also move within the range where the quality of the target sound satisfies the target quality. Specifically, the flight control unit 101e determines the range where the quality of the target sound satisfies the target quality as the movement allowable range, and limits the movement of the unmanned aerial vehicle 100 within the movement allowable range. For example, the flight control unit 101e executes an operation of moving within the movement allowable range among the operation signals received from the controller 200, but does not execute an operation of moving outside the movement allowable range.

[0191] Furthermore, in each of the above-mentioned embodiments, each component may be formed by dedicated hardware or implemented by executing a software program suitable for each component. Alternatively, a program execution unit such as a CPU or a processor may read and execute a software program recorded in a non-temporary recording medium such as a hard disk or a semiconductor memory to implement each component. Here, the software that implements the unmanned aerial vehicle 100, the information processing method, etc. of each of the above-mentioned embodiments is the following program.

[0192] That is to say, the program is used to enable a computer to execute an information processing method, and the information processing method is executed by the processor of an unmanned aerial body equipped with a sensor and a processor, the sensor includes at least a microphone for generating sound data, the sound data generated by the microphone is used to judge the quality of the target sound, the data generated by the sensor is used to obtain the positional relationship between the unmanned aerial body and the sound source of the target sound, and the movement of the unmanned aerial body is controlled in a manner that controls the distance between the unmanned aerial body and the sound source of the target sound based on the quality of the target sound and the positional relationship.

[0193] The unmanned aerial vehicle, information processing method, and program involved in one or more aspects of the present invention have been described above based on the embodiments, but the present invention is not limited to the embodiments. Various modified aspects that can be thought of by a person skilled in the art to implement the present embodiment, or aspects formed by combining constituent elements of different embodiments, may also be included in the scope of one or more aspects of the present invention as long as they do not depart from the scope of the present invention.

[0194] Moreover, the processing performed by the quality judgment unit 101b, the sound source judgment unit 101c, the obstacle detection unit 101g, and the flight control unit 101e, as well as the image recognition processing and the sound recognition processing can also be performed by machine learning. For example, supervised learning that uses supervised data that assigns labels (output information) to input information to learn the relationship between input and output, unsupervised learning that constructs the structure of data only from unlabeled inputs, semi-supervised learning that processes both labeled and unlabeled data, and reinforcement learning that obtains feedback (reward) for actions selected based on the observation results of the state to learn continuous actions that can obtain the most rewards. In addition, for specific methods of machine learning, there are neural networks (including deep learning using multi-layer neural networks), genetic programming, decision trees, Bayesian networks, support vector machines (SVMs), etc. In the present disclosure, any of the specific examples cited above can be used.

[0195] The present disclosure is useful for an unmanned aerial vehicle, an information processing method, a program, and the like that can improve the quality of target sound.

[0196] Explanation of symbols

[0197] 100 Unmanned Aerial Vehicle

[0198] 101 Processor

[0199] 101a Radio Processing Unit

[0200] 101aa Noise Processing Unit

[0201] 101ab Noise Level Calculation Unit

[0202] 101b Quality Judgment Department

[0203] 101c Sound source determination unit

[0204] 101d Position detection unit

[0205] 101e Flight Control Department

[0206] 101f Image Control Department

[0207] 101g Obstacle Detection Unit

[0208] 102 GPS receiver

[0209] 103 Acceleration sensor

[0210] 104 Gyro Sensor

[0211] 105 Microphone

[0212] 106 Gimbal

[0213] 107 Camera

[0214] 108 Distance Sensor

[0215] 109 Communication IF

[0216] 110 Generator

[0217] 111 Rotary Wing

[0218] 112 Actuator

[0219] 130 Pipe

[0220] 131 Space

[0221] 140 Main Body

[0222] 141 Arm

[0223] 200 Controller

[0224] 300 Portable Terminal

[0225] 400 sound sources

Claims

1. An unmanned aerial vehicle, The unmanned aerial vehicle comprises: a sensor including at least a microphone to generate sound data; and processor, the processor, determining the quality of the target sound obtained using the sound data generated by the microphone, Using the data generated by the sensor, the positional relationship between the unmanned aerial vehicle and the sound source of the target sound is obtained. The movement of the unmanned aerial vehicle is controlled by controlling the distance between the unmanned aerial vehicle and the sound source of the target sound according to the quality of the target sound and the positional relationship. obtaining distance information indicating a specified distance from the sound source, When the movement of the unmanned aerial vehicle is controlled so as to approach the sound source, the unmanned aerial vehicle is moved in a manner not to get closer to the sound source than a safe position at the predetermined distance from the sound source based on the distance information and the positional relationship. the processor, Also based on the distance information and the positional relationship, when the unmanned aerial vehicle is moved as the safe position in a manner approaching the sound source until it reaches a first safe position that is the predetermined distance from the sound source, when it is determined through the judgment that the quality of the first target sound obtained by the first sound data generated as the sound data using the microphone of the unmanned aerial vehicle approaching the first safe position is higher than a predetermined target quality, the unmanned aerial vehicle is moved to a second safe position where the microphone generates second sound data capable of obtaining a second target sound equal to the target quality, The height direction position of the first safety position is higher than the height direction position of the sound source, The height direction position of the second safety position is lower than the height direction position of the first safety position and is away from the sound source by the predetermined distance. During the movement to the second safe position, the processor causes the unmanned aerial vehicle to move from the first safe position to the second safe position along a semicircle with the radius of the specified distance centered on the position of the sound source, thereby causing the unmanned aerial vehicle to move in a direction such that the height direction position of the unmanned aerial vehicle approaches the ground and the horizontal direction position of the unmanned aerial vehicle moves away from the sound source.

2. The unmanned aerial vehicle according to claim 1, When it is determined through the determination that the quality of the target sound is lower than the target quality, the processor controls the movement of the unmanned aerial vehicle so as to approach the sound source.

3. The unmanned aerial vehicle according to claim 1, The unmanned aerial vehicle also has an actuator. The actuator changes at least one of the orientation of the microphone and the amount of projection of the microphone outward from the unmanned aerial vehicle. The processor moves the unmanned aerial vehicle in a manner that approaches the sound source until the first safe position based on the distance information and the positional relationship, and then, when the quality of the first target sound is lower than the target quality, controls the actuator to (i) change the direction of the microphone toward the sound source or (ii) change the protrusion amount of the microphone outward from the unmanned aerial vehicle in a manner that the microphone approaches the sound source.

4. The unmanned aerial vehicle according to any one of claims 1 to 3, The processor, in the determination, calculates a signal-to-noise ratio using the target sound and noise related to the flight of the unmanned aerial vehicle as an indicator for determining the quality.

5. The unmanned aerial vehicle according to claim 4, the processor, Further, a target signal-to-noise ratio preset by using noise related to the flight of the unmanned aerial vehicle is obtained as the target quality, The obtained target signal-to-noise ratio is compared with the calculated signal-to-noise ratio to judge the quality of the target sound.

6. The unmanned aerial vehicle according to any one of claims 1 to 3, The sensor also includes an image sensor that generates image data, The processor obtains the positional relationship using the image data generated by the image sensor.

7. The unmanned aerial vehicle according to any one of claims 1 to 3, The sensor also includes a ranging sensor that generates ranging data, The processor obtains the positional relationship by using the distance measurement data generated by the distance measurement sensor.

8. The unmanned aerial vehicle according to any one of claims 1 to 3, The processor determines a target distance based on the quality of the target sound, the positional relationship, and the target quality, and controls the movement of the unmanned aerial vehicle so that the distance between the unmanned aerial vehicle and the sound source becomes the target distance.

9. The unmanned aerial vehicle according to any one of claims 1 to 3, The positional relationship is at least any one of the following (i) to (iii), (i) the distance between the unmanned aerial vehicle and the sound source, (ii) the position of the sound source relative to the unmanned aerial vehicle, and (iii) the direction from the unmanned aerial vehicle to the sound source.

10. An information processing method, executed by a processor of an unmanned aerial vehicle having a sensor and a processor, wherein the sensor includes at least a microphone for generating sound data, In the information processing method, the processor, determining the quality of the target sound obtained using the sound data generated by the microphone, Using the data generated by the sensor, the positional relationship between the unmanned aerial vehicle and the sound source of the target sound is obtained. The movement of the unmanned aerial vehicle is controlled by controlling the distance between the unmanned aerial vehicle and the sound source of the target sound according to the quality of the target sound and the positional relationship. obtaining distance information indicating a specified distance from the sound source, When the movement of the unmanned aerial vehicle is controlled so as to approach the sound source, the unmanned aerial vehicle is moved in a manner not to get closer to the sound source than a safe position at the predetermined distance from the sound source based on the distance information and the positional relationship. the processor, Also based on the distance information and the positional relationship, when the unmanned aerial vehicle is moved as the safe position in a manner approaching the sound source until it reaches a first safe position that is the predetermined distance from the sound source, when it is determined through the judgment that the quality of the first target sound obtained by the first sound data generated as the sound data using the microphone of the unmanned aerial vehicle approaching the first safe position is higher than a predetermined target quality, the unmanned aerial vehicle is moved to a second safe position where the microphone generates second sound data capable of obtaining a second target sound equal to the target quality, The height direction position of the first safety position is higher than the height direction position of the sound source, The height direction position of the second safety position is lower than the height direction position of the first safety position and is away from the sound source by the predetermined distance. During the movement to the second safe position, the processor causes the unmanned aerial vehicle to move from the first safe position to the second safe position along a semicircle with the radius of the specified distance centered on the position of the sound source, thereby causing the unmanned aerial vehicle to move in a direction such that the height direction position of the unmanned aerial vehicle approaches the ground and the horizontal direction position of the unmanned aerial vehicle moves away from the sound source.

11. A program recording medium storing a program for causing a processor to execute an information processing method, The information processing method is executed by the processor of an unmanned aerial vehicle having a sensor and a processor, wherein the sensor at least includes a microphone that generates sound data. In the information processing method, the processor, determining the quality of the target sound obtained using the sound data generated by the microphone, Using the data generated by the sensor, the positional relationship between the unmanned aerial vehicle and the sound source of the target sound is obtained. The movement of the unmanned aerial vehicle is controlled by controlling the distance between the unmanned aerial vehicle and the sound source of the target sound according to the quality of the target sound and the positional relationship. obtaining distance information indicating a specified distance from the sound source, When the movement of the unmanned aerial vehicle is controlled so as to approach the sound source, the unmanned aerial vehicle is moved in a manner not to get closer to the sound source than a safe position at the predetermined distance from the sound source based on the distance information and the positional relationship. the processor, Also based on the distance information and the positional relationship, when the unmanned aerial vehicle is moved as the safe position in a manner approaching the sound source until it reaches a first safe position that is the predetermined distance from the sound source, when it is determined through the judgment that the quality of the first target sound obtained by the first sound data generated as the sound data using the microphone of the unmanned aerial vehicle approaching the first safe position is higher than a predetermined target quality, the unmanned aerial vehicle is moved to a second safe position where the microphone generates second sound data capable of obtaining a second target sound equal to the target quality, The height direction position of the first safety position is higher than the height direction position of the sound source, The height direction position of the second safety position is lower than the height direction position of the first safety position and is away from the sound source by the predetermined distance. During the movement to the second safe position, the processor causes the unmanned aerial vehicle to move from the first safe position to the second safe position along a semicircle with the radius of the specified distance centered on the position of the sound source, thereby causing the unmanned aerial vehicle to move in a direction such that the height direction position of the unmanned aerial vehicle approaches the ground and the horizontal direction position of the unmanned aerial vehicle moves away from the sound source.