Identification device, method, and program
The identification device uses RNN to process time-series observation data, creating a trained model for identifying flying objects, addressing the challenge of increasing object variety and information volume while reducing human workload and costs.
Patent Information
- Application Number
- JP2020108623
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-06-24
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2040-06-24
AI Technical Summary
The increasing variety of flying objects and the growing amount of information to be handled pose challenges in identifying them, especially as the number of skilled workers for this task is expected to decrease.
An identification device and method utilizing a recurrent neural network (RNN) to process time-series observation information, converting it into a suitable format for learning, generating a trained flying object model, and using this model to identify flying objects without human intervention.
Enables easy identification of flying objects, reducing the workload on individuals and minimizing the need for additional information collection, thus lowering costs and equipment requirements.
Smart Images

Figure 0007616758000001 
Figure 0007616758000002 
Figure 0007616758000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an identification device, method, and program, and in particular to an identification device, method, and program that can easily identify flying objects. [Background technology]
[0002] In air traffic control, a method for identifying flying objects is known in which a person identifies the flying object using an identification signal emitted by the flying object or location information of the flying object acquired by a sensor. Another method for identifying flying objects is known in which image information of the flying object retrieved from radar information of the flying object is compared with aircraft characteristics of the flying object acquired by an image capturing device, thereby improving the identification probability of the flying object such as an aircraft.
[0003] Patent Document 1 describes that "the learning data generation method includes an acquisition step of acquiring two pieces of data from among appearance data of an aircraft on an image of a specific route, signal data of radio waves emitted from an aircraft on the route, and noise data indicating noise from an aircraft on the route, an identification step of identifying attributes of an aircraft on the route by inputting one of the two pieces of acquired data into a first identification model for identifying attributes of the aircraft, and a generation step of generating learning data used for learning a second identification model for identifying attributes of the aircraft by associating the other of the two pieces of data with the attributes of the aircraft on the route identified by the identification step." Patent Document 1 does not describe "generating a learned flying object model by performing regression neural network (RNN) learning, and identifying an approximate flying object that approximates a target flying object from the learned flying object model based on time-series observation information of the target flying object and the learned flying object model."
[0004] Patent Document 2 describes that "the position of each aircraft on the airport surface is detected by an airport detection radar, and when any aircraft on the airport surface emits radio waves, a radio wave source region in which the radio wave source is located is determined by direction finders installed at at least two locations, and when only one aircraft is located in this radio wave source region, the identification information of this aircraft is selected from the contents of the radio waves emitted by the aircraft, the aircraft located in the radio wave source region is specified by the airport detection radar, and the aircraft is automatically identified by correlating the position information of the airport detection radar with the identification information of the aircraft identified by the direction finder." Patent Document 2 does not describe that "a learned flying object model is generated by performing regression neural network (RNN) learning, and an approximate flying object that approximates the target flying object is identified from the learned flying object model based on the time-series observation information of the target flying object and the learned flying object model." [Prior art documents] [Patent documents]
[0005] [Patent Document 1] International Publication No. 2019 / 176058 [Patent Document 2] Japanese Patent Application Publication No. 6-342061 Summary of the Invention [Problem to be solved by the invention]
[0006] While a wide variety of flying objects exist and the amount of information handled is increasing, the population of workers who identify flying objects is expected to decrease. In such a situation, there is a problem that it is difficult to provide an identification device for identifying multiple flying objects that can easily identify flying objects without relying on humans or with the assistance of humans.
[0007] An object of the present disclosure is to provide an identification device, a method, and a program that solve the above-mentioned problems. [Means for solving the problem]
[0008] The identification device according to the present disclosure comprises: An acquisition unit that acquires observation information obtained by observing a flight state of a flying object; A storage unit that stores time-series observation information obtained by processing the observation information in a time series manner for each of the plurality of flying objects; A learning unit that uses learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, and performs the learning using a recurrent neural network (RNN) to generate a learned flying object model; a processing unit that processes the time-series observation information of a predetermined flying object based on the learning observation information to generate processed information; and an identification unit that identifies the specified flying object based on the processed information and the learned flying object model.
[0009] The method according to the present disclosure comprises: Obtaining observation information on a flight state of a flying object; accumulating time-series observation information obtained by processing the observation information in a time series manner for each of the plurality of flying objects; Using learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, the learning is performed using a recurrent neural network (RNN) to generate a learned flying object model; generating processed information by processing the time-series observation information of a predetermined flying object based on the learning observation information; Identifying the predetermined flying object based on the processed information and the learned flying object model; Equipped with.
[0010] The program according to the present disclosure is Obtaining observation information on a flight state of a flying object; accumulating time-series observation information obtained by processing the observation information in a time series manner for each of the plurality of flying objects; Using learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, the learning is performed using a recurrent neural network (RNN) to generate a learned flying object model; generating processed information by processing the time-series observation information of a predetermined flying object based on the learning observation information; Identifying the predetermined flying object based on the processed information and the learned flying object model; to be executed by the computer. Effect of the Invention
[0011] According to the present disclosure, it is possible to provide an identification device, method, and program capable of easily identifying flying objects. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a block diagram illustrating an identification device according to an embodiment. [Diagram 2] 10 is a flowchart illustrating an operation of the identification device according to the embodiment. [Diagram 3] 10 is a flowchart illustrating an operation of the identification device according to the embodiment. [Figure 4] 10 is a flowchart illustrating an operation of the identification device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In each drawing, the same or corresponding elements are given the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.
[0014] [Embodiment Mode] The configuration of an identification device according to an embodiment will be described. In the embodiment, the conversion to a data format suitable for a regression neural network is taken as an example for explanation. In addition, in the embodiment, the process from information accumulation to identification using a trained flying object model is divided into three phases: an information collection phase, a learning phase, and a utilization phase. FIG. 1 is a block diagram illustrating an identification device according to an embodiment.
[0015] As shown in FIG. 1, a recognition device 11 according to the embodiment includes an acquisition unit 111, a storage unit 112, a learning unit 113, a processing unit 114, and a recognition unit 115.
[0016] <Information gathering phase> The acquisition unit 111 acquires observation information obtained by observing the flight state of a flying object, which is an object in flight. The observation information is measured, for example, by a sensor that observes the flying object. The acquisition unit 111 may acquire observation information of a simulated flying object that simulates the flying object, instead of the observation information of the flying object.
[0017] The observation information includes at least one of the following: time-series three-dimensional position information of the flying object, the moving direction of the flying object, and the moving speed of the flying object. The observation information may be information obtained by observing the flight state from a predetermined time in the past to the present.
[0018] The storage unit 112 stores time-series observation information obtained by processing observation information in a time series manner for each of a plurality of flying objects. The acquisition unit 111 may acquire the observation information at a predetermined cycle, and the storage unit 112 may store the time-series observation information at a predetermined cycle. The time-series observation information includes observation information from the past to the present. The time-series observation information may also be referred to as current status information.
[0019] That is, the acquisition unit 111 manages time-series observation information regarding a flying object acquired and calculated in time series from observation information of the flying object observed by a sensor (not shown), or time-series observation information of a simulated flying object that simulates a flying object, and periodically accumulates and stores the time-series observation information in the accumulation unit 112.
[0020] The identification device 11 may further include a display unit that displays the time-series observation information. The combination of the acquisition unit and the display unit may be referred to as a current status display unit.
[0021] The accumulation unit 112 may accumulate the time-series observation information when the identification of the flying object is successful. Specifically, when the identification device 11 identifies a flying object managed by the identification device 11 and the identification is successful, the accumulation unit 112 may store the time-series observation information together with information regarding the identification. In addition, when an operator identifies a flying object managed by the operator and the identification is successful, the accumulation unit 112 may store the time-series observation information together with information regarding the identification.
[0022] The storage unit may also be referred to as a data storage unit. The observation information is information measured by a sensor that observes a flying object, and therefore the observation information may also be referred to as sensor information.
[0023] <Learning Phase> The learning unit 113 uses the learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, and performs learning using a recurrent neural network (RNN) to generate a learned flying object model. That is, the learning unit 113 acquires the time-series observation information accumulated from the storage unit 112, processes the acquired time-series observation information into a format suitable for learning, and performs learning using the recurrent neural network to generate a learned flying object model. Processing into a format suitable for learning refers to, for example, standardizing the time-series observation information or converting it into a dummy variable in machine learning.
[0024] The learning unit 113 stores the used learning observation information and the generated learned flying object model. Since the learning observation information is information that has been converted and processed into a format suitable for learning, it is sometimes called data processing information.
[0025] The learning unit 113 saves the learning observation information and the learned flying object model, and then evaluates the learned flying object model generated by learning. If the learned flying object model passes the evaluation, the learning unit 113 outputs the learning observation information at the time of learning to the processing unit 114, and outputs the learned flying object model to the identification unit 115. If the learned flying object model passes the evaluation, for example, the learning error by the regression neural network is equal to or less than the error threshold, and in this case, the learning unit 113 ends the learning.
[0026] The learning unit may also be referred to as an RNN learning unit, the processing unit may also be referred to as a data processing unit, and the identification unit may also be referred to as an identification processing unit.
[0027] <Usage Phase> The processing unit 114 periodically acquires time-series observation information on a predetermined flying object acquired and calculated from the observation information managed by the acquisition unit 111, or time-series observation information of a simulated predetermined flying object that simulates the predetermined flying object. Here, the predetermined flying object is a flying object that is a target to be identified, for example, a flying object newly observed by a sensor.
[0028] The processing unit 114 acquires the learning observation information at the time of learning from the learning unit 113. The processing unit 114 generates processed information by processing the time-series observation information acquired from the acquisition unit 111 based on the learning observation information, and outputs the generated processed information to the identification unit 115. That is, the processing unit 114 generates processed information by processing the time-series observation information of a predetermined flying object based on the learning observation information. The processing unit 114 saves the processed information acquired from the learning unit 113.
[0029] The processed information is the output when the learning observation information (data processed information) and the time-series observation information (information such as the three-dimensional position information, moving direction, and moving speed of the flying object) are input to the processor 114.
[0030] The identification unit 115 performs identification using the processing information acquired from the processing unit 114 and the learned flying object model acquired from the learning unit 113, and outputs the identification result to the acquisition unit 111. That is, the identification unit 115 identifies the predetermined flying object based on the processing information and the learned flying object model.
[0031] In addition, the identification unit 115 stores the learned flying object model acquired from the learning unit 113. The acquisition unit 111 displays the identification result acquired from the identification unit 115, i.e., information on the identified predetermined flying object, on a display unit (not shown).
[0032] The identification device 11 according to the embodiment identifies a specific flying object newly observed by a sensor based on a learned flying object model learned from observation information (time-series observation information) of flying objects from the past to the present. This makes it possible to provide an identification device, method, and program that can easily identify flying objects without relying on the skill of an individual.
[0033] Furthermore, the identification device 11 according to the embodiment can reduce the workload of people compared to when people identify flying objects, and therefore the number of workers can be reduced.
[0034] Furthermore, in the case where the observation information acquired from the sensor is used for learning in the identification device 11, the observation information required for learning can be easily stored in the storage unit 112. Therefore, there is no need to add a new task for collecting observation information.
[0035] In addition, the observation information used during learning can be not only that obtained from sensors, but also simulated observation information that simulates the observation information obtained from sensors. This makes it possible to shorten the time required to collect information required for learning, and reduce the costs of building equipment for new information collection, the costs of maintaining the equipment, and the personnel costs involved.
[0036] The operation of the identification device according to the embodiment will be described. FIG. 2 is a flowchart illustrating the operation of the identification device according to the embodiment. FIG. 2 shows the process flow of the information gathering phase.
[0037] 2, the accumulation unit 112 accumulates current status information (time-series observation information) (step S101). The accumulation unit 112 periodically accumulates time-series observation information on flying objects acquired and calculated from observation information managed by the acquisition unit 111, or time-series observation information on simulated flying objects that simulate flying objects.
[0038] The acquisition unit 111 checks whether or not to perform identification on the flying object managed by the acquisition unit 111 (step S102).
[0039] In step S102, if the flying object has been identified (step S102: Yes), information regarding the identification of the flying object is stored in the storage unit 112 (step S103).
[0040] In step S102, if the flying object has not been identified (step S102: No), an end determination is made (step S104).
[0041] In step S104, if the process is not to end (step S104: No), the process returns to step S101.
[0042] In step S104, if the monitoring is to be ended (step S104: Yes), that is, if the monitoring of the current situation is to be ended, the display of the current situation information is ended.
[0043] FIG. 3 is a flowchart illustrating the operation of the identification device according to the embodiment. FIG. 3 shows the process flow of the learning phase.
[0044] Here, an error threshold value for determining whether learning is completed in learning performed by learning unit 113 is defined as L in advance.
[0045] 3, the learning unit 113 acquires the accumulated time-series observation information from the accumulation unit 112, and converts and processes the information into a format suitable for learning (step S201). The processed information is referred to as learning observation information.
[0046] The learning unit 113 uses the processed learning observation information to perform learning by a recurrent neural network (RNN) (step S202).
[0047] The learning unit 113 checks the evaluation result. That is, the learning unit 113 compares the error e of the learning by the regression neural network with the error threshold L (step S203).
[0048] If the error e≦the error threshold L (step S203: Yes), the learning unit 113 stores the learning observation information in the processing unit 114 (step S204).
[0049] If the error e is not less than the error threshold L (step S203: No), the learning unit 113 returns to step S201.
[0050] After step S204, the learned flying object model generated in step S202 is stored in the identification unit 115 (step S205).
[0051] FIG. 4 is a flowchart illustrating the operation of the identification device according to the embodiment. FIG. 4 shows the process flow of the utilization phase.
[0052] As shown in FIG. 4, the processing unit 114 acquires time-series observation information regarding a flying object acquired and calculated from the observation information managed by the acquisition unit 111, or time-series observation information of a simulated flying object that simulates a flying object, and processes this to generate processed information (step S301).
[0053] The identification unit 115 performs identification of the flying object using the processing information acquired from the processing unit 114 and the learned flying object model acquired from the learning unit 113 (step S302).
[0054] The acquisition unit 111 displays the flying object identification result on the display unit (step S303).
[0055] After step S303, an end determination is made (step S304).
[0056] In step S304, if the process is not to end (step S304: No), the process returns to step S301.
[0057] In step S304, if the monitoring is to be ended (step S304: Yes), that is, if the monitoring of the current situation is to be ended, the display of the current situation is ended.
[0058] Here, the features of the identification device 11 according to the embodiment will be described below. The identification device 11 identifies a target flying object using a regression neural network based on time-series observation information regarding the flying object acquired and calculated from observation information (sensor information) or time-series observation information simulating the flying object. The classification device 11 includes an acquisition unit 111 , a storage unit 112 , a learning unit 113 , a processing unit 114 , and a classification unit 115 . The acquisition unit (current status display unit) 111 displays and manages time-series observation information regarding flying objects acquired and calculated from observation information or time-series observation information simulating flying objects, and also inputs, displays, and manages information on identified flying objects. The storage unit 112 stores the observation information managed by the acquisition unit 111 . The learning unit 113 uses the observation information stored in the storage unit 112 to convert the time-series observation information into learning observation information required for learning, and generates a learned flying object model. The processing unit 114 acquires the observation information managed by the acquisition unit 111, and outputs processed information that is processed based on the learned observation information to the identification unit 115. The identification unit 115 uses the processed information and the learned flying object model to output the flying object identification result to the acquisition unit 111. The learning unit 113 processes the observation information obtained from the storage unit 112, and then learns the identification rules by using a regression neural network, and stores the used learning observation information and the generated learned flying object model.
[0059] In addition, in the embodiment, since learning is performed using only time series information and identification result information, the present invention can be applied not only to flying objects, but also to identifying moving objects on land, on water, or underwater, such as vehicles, ships, and submarines.
[0060] In the above embodiment, the present invention has been described as being configured as hardware, but the present invention is not limited to this. The present invention can also be realized by having a CPU (Central Processing Unit) execute a computer program to process each component.
[0061] In the above embodiment, the program can be stored and supplied to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (specifically, flexible disks, magnetic tapes, and hard disk drives), magneto-optical recording media (specifically, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (specifically, mask ROMs, PROMs (Programmable ROMs), and EPROMs (Erasable PROMs)), flash ROMs, and RAMs (Random Access Memory). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.
[0062] Although the present invention has been described above with reference to the embodiment, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.
[0063] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present invention. [Explanation of symbols]
[0064] 11: Identification device 111: Acquisition Department 112: Storage unit 113: Learning Department 114: Processing department 115: Identification unit e: error L: Error threshold
Claims
1. In the information gathering phase, An acquisition unit that acquires observation information obtained by observing a flight state of a flying object; A storage unit that stores, for each of the plurality of flying objects, time-series observation information obtained by processing, in time series, simulated observation information that simulates the observation information together with information regarding the identification of the flying object; During the learning phase, A learning unit that uses learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, and performs learning using a recurrent neural network (RNN) to generate a learned flying object model; In the utilization phase, A processing unit that generates processed information processed by the same processing as that used when generating the trained flying object model in order to match an information format of a predetermined time series observation information of a predetermined flying object with an information format of the trained observation information; An identification unit that identifies the predetermined flying object based on the processing information and the learned flying object model; An identification device comprising:
2. The observation information includes at least one of time-series three-dimensional position information of the flying object, a moving direction of the flying object, and a moving speed of the flying object; The information regarding the identification of the flying object includes the type of the flying object, the flight number, the route, or information regarding whether the flying object is an aircraft; The identification device according to claim 1 .
3. The acquisition unit acquires the observation information at a predetermined period. The identification device according to claim 1 or 2.
4. The storage unit stores the predetermined time series observation information when the identification of the predetermined flying object is successful, A case where the flying object is successfully identified indicates a case where the observation information of the flying object is one of the learned flying object models. An identification device according to any one of claims 1 to 3.
5. the learning unit terminates the learning when an error in the learning by the regression neural network is equal to or smaller than an error threshold. An identification device according to any one of claims 1 to 4.
6. A display unit that displays the time-series observation information and information about the identified predetermined flying object is further provided. An identification device according to any one of claims 1 to 5.
7. The observation information is information obtained by observing the flight state from a predetermined time in the past to the present. An identification device according to any one of claims 1 to 6.
8. In the information gathering phase, Obtaining observation information on a flight state of a flying object; accumulating, for each of the plurality of flying objects, time-series observation information obtained by processing, in a time series manner, simulated observation information that simulates the observation information together with information regarding the identification of the flying object; In the learning phase, Using learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, a recurrent neural network (RNN) is used to generate a learned flying object model; In the utilization phase, generating processed information that is processed in the same manner as the processing performed when the learned flying object model was generated, so that the information format of the predetermined time series observation information of the predetermined flying object coincides with the information format of the learned observation information; Identifying the predetermined flying object based on the processed information and the learned flying object model; A method for providing the above.
9. In the information gathering phase, Obtaining observation information on a flight state of a flying object; accumulating, for each of the plurality of flying objects, time-series observation information obtained by processing, in a time series manner, simulated observation information that simulates the observation information together with information regarding the identification of the flying object; In the learning phase, Using learning observation information obtained by converting and processing the time-series observation information into a format suitable for learning, a recurrent neural network (RNN) is used to generate a learned flying object model; In the utilization phase, generating processed information that is processed in the same manner as the processing performed when the learned flying object model was generated, so that the information format of the predetermined time series observation information of the predetermined flying object coincides with the information format of the learned observation information; Identifying the predetermined flying object based on the processed information and the learned flying object model; A program that causes a computer to execute the following.
Citation Information
Patent Citations
Sound identifying apparatus
JP1992276523A
Aircraft discrimination method on airport plane and its automatic aircraft discriminating apparatus
JP1994342061A
Sound-source-kind discrimination apparatus
JP2000275096A
Traffic sound identification device, traffic sound decision program for making computer function as traffic sound identification device, recording medium and traffic sound decision method
JP2006154961A
Air traffic control operation support system, method for predicting aircraft position, and computer program
JP2008097454A