Information processing device, information processing method, and program

Abstract

Provided is an information processing device comprising an acquisition unit that acquires a signal of each pulse wave of a radar wave received by an antenna at each time point, and a display control unit that causes a display object having a size corresponding to the pulse width of each pulse wave to be displayed at a position corresponding to the pulse repetition interval of each pulse wave.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Patent Document 1 discloses a technique for plotting a forward pulse interval time between a forward received pulse signal received before a received pulse signal from a radar device or the like, and a backward pulse interval time between a backward received pulse signal received after the received pulse signal.

[0003] Japanese Patent Application Laid-Open No. 2020-24113

[0004] However, the technique described in Patent Document 1 does not consider, for example, a case in which a radar wave transmitting device uses pulse waves in which at least one of the pulse repetition interval and the pulse width is varied.

[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide a technology that can properly grasp pulse waves from a transmitting device even when the transmitting device uses pulse waves in which at least one of the pulse repetition interval and the pulse width is varied.

[0006] In a first aspect of the present disclosure, there is provided an information processing device having an acquisition unit that acquires signals of each pulse wave of a radar wave received by an antenna at each time point, and a display control unit that displays a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

[0007] In addition, a second aspect of the present disclosure provides an information processing method including: acquiring a signal of each pulse wave of a radar wave received by an antenna at each time point; and displaying a display object having a size corresponding to each pulse width of each pulse wave at a position corresponding to a pulse repetition interval of each pulse wave.

[0008] In addition, a third aspect of the present disclosure provides a program for causing a computer to execute a process of acquiring signals of each pulse wave of a radar wave received by an antenna at each time point, and displaying a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

[0009] According to one aspect, even when a transmission source device uses a pulse wave in which at least one of the pulse repetition interval and the pulse width is varied, the pulse wave from the transmission source device can be properly detected.

[0010] FIG. 1 is a diagram showing an example of the configuration of an information processing device according to an embodiment. FIG. 2 is a diagram showing an example of the configuration of an information processing system according to an embodiment. FIG. 3 is a diagram showing an example of the hardware configuration of an information processing device according to an embodiment. FIG. 4 is a flowchart showing an example of processing of an information processing device according to an embodiment. FIG. 5 is a diagram showing an example of a display screen according to an embodiment. FIG. 6 is a diagram showing an example of a display screen according to an embodiment. FIG. 7 is a diagram showing an example of a display screen according to an embodiment.

[0011] The principles of the present disclosure will be described with reference to some exemplary embodiments. It should be understood that these embodiments are set forth for illustrative purposes only, to aid those skilled in the art in understanding and practicing the present disclosure, without implying any limitation on the scope of the disclosure. The disclosure described herein may be implemented in various ways other than those described below.

[0012] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each drawing is merely an example for describing one or more embodiments. Each drawing is not related to only one particular embodiment, but may also be related to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessarily required to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0014] (First Embodiment) <Configuration> The configuration of an information processing device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the information processing device 10 according to an embodiment. The information processing device 10 has an acquisition unit 11 and a display control unit 12. These units may be realized by cooperation between one or more programs installed in the information processing device 10 and hardware such as a processor and memory of the information processing device 10.

[0015] The acquisition unit 11 acquires the signals of the pulse waves of the radar waves received by the antenna at each time point. The display control unit 12 displays display objects of sizes corresponding to the pulse widths of the pulse waves acquired by the acquisition unit 11 at positions corresponding to the pulse repetition intervals of the pulse waves.

[0016] (Embodiment 2) Next, the configuration of an information processing system 1 according to an embodiment will be described with reference to FIG. 2. <System Configuration> FIG. 2 is a diagram showing an example configuration of an information processing system 1 according to an embodiment. In the example of FIG. 2, the information processing system 1 has an information processing device 10, an antenna 20, and source devices 30A to 30C. Hereinafter, when there is no need to distinguish between them, each of the source devices 30A to 30C will also be simply referred to as a "source device 30." The information processing device 10 and the antenna 20 are connected by, for example, a cable or the like. Note that the number of information processing devices 10, antennas 20, and source devices 30 is not limited to the example of FIG. 2.

[0017] The information processing device 10 may be, for example, a server, a cloud server, a personal computer, a tablet terminal, a smartphone, or other device. The information processing device 10 provides, for example, information about a transmission source device 30 present in the vicinity of the antenna 20 to a user (monitor). The antenna 20 receives a pulse wave of a radar wave transmitted from the transmission source device 30, converts the pulse wave into an electrical signal indicating the frequency of the received radio wave and the time point of reception (reception time, reception timing), and outputs the electrical signal to the information processing device 10.

[0018] The transmission source device 30 may be, for example, a ship, an aircraft, a satellite, etc. The transmission source device 30 transmits radar (Radio Detection And Ranging) waves to measure the distance to other objects.

[0019] <Hardware Configuration> Fig. 3 is a diagram showing an example of the hardware configuration of the information processing device 10 according to the embodiment. In the example of Fig. 3, the information processing device 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components may be connected via a bus or the like. The memory 102 stores at least a part of a program 104. The communication interface 103 includes an interface required for communication with other network elements.

[0020] When the program 104 is executed by the processor 101, memory 102, and other components in cooperation with each other, the computer 100 performs at least some of the processing of the embodiments of the present disclosure. The memory 102 may be of any type. As a non-limiting example, the memory 102 may be a non-transitory computer-readable storage medium. The memory 102 may also be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown in the computer 100, several physically different memory modules may be present in the computer 100. The processor 101 may be of any type. The processor 101 may include one or more of a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. The computer 100 may have multiple processors, such as application-specific integrated circuit chips that are time-slaved to a clock that synchronizes the main processor.

[0021] Embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic, or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device.

[0022] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, that execute on a target real or virtual processor or device to perform the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or divided among program modules as desired in various embodiments. The machine-executable instructions of the program modules may be executed in local or distributed devices. In a distributed device, the program modules may be located in both local and remote storage media.

[0023] The program code for executing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus. When the program code is executed by the processor or controller, the functions / acts in the flowcharts and / or implementing block diagrams are performed. The program code may be executed entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine, or entirely on a remote machine or server.

[0024] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0025] <Processing> Next, an example of processing of the information processing device 10 according to the embodiment will be described with reference to Fig. 4 to Fig. 8. Fig. 4 is a flowchart showing an example of processing of the information processing device 10 according to the embodiment. Figs. 5 to 8 are diagrams showing examples of display screens according to the embodiment. Note that the processing of Fig. 4 may be executed, for example, when a specific operation is performed by the user, or at a specific timing such as periodically.

[0026] In step S101, the acquisition unit 11 acquires signals of each pulse wave of the radar wave received at each time point by the antenna 20. Here, the acquisition unit 11 may acquire, from the antenna 20, a signal indicating the frequency (center frequency) and the time point of reception (transmission time point) of the pulse wave of the radar wave transmitted from the transmission source device 30 such as a ship.

[0027] Next, the display control unit 12 displays a display object having a size corresponding to the pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave acquired by the acquisition unit 11 (step S102). Note that the display control unit 12 may also display a display object corresponding to the pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave whose reception frequency is equal to or greater than a threshold. This allows, for example, when a pulse wave from a transmission source device 30 that is relatively far from the antenna 20 happens to be received, the pulse wave to be removed as noise.

[0028] Here, the display control unit 12 may, for example, display a display object having a size (e.g., width) corresponding to each pulse width of each pulse wave on a graph whose vertical axis or horizontal axis corresponds to the pulse repetition interval of each pulse wave. The display object may be a regular polygon or a circle. Furthermore, as shown in FIGS. 5 and 6 , the display control unit 12 may display a display object corresponding to each pulse width of each pulse wave on a two-dimensional graph whose vertical axis and horizontal axis correspond to the pulse repetition interval of each pulse wave.

[0029] In the example of FIG. 5 , the display control unit 12 indicates that pulse waves having pulse widths corresponding to the sizes of square display objects 521 to 523, each having only a filled-in outer frame, are received in pulse repetition interval (PRI) 511. The display control unit 12 also indicates that pulse waves having pulse widths corresponding to the sizes of the respective display objects are received in pulse repetition intervals 512 to 514. Note that the pulse repetition interval is, for example, the length of time from when the beginning of a pulse wave is received by the antenna 20 to when the beginning of the next pulse wave is received by the antenna 20. The example of FIG. 5 indicates that the pulse waves in each of the pulse repetition intervals 511 to 514 appear periodically or randomly, and that the pulse widths are not constant.

[0030] 6, the display control unit 12 indicates that pulse waves having pulse widths corresponding to the sizes of square display objects 621 to 62N, each of which has only a filled outer frame, are received at pulse repetition intervals 611 to 61N. The example of Fig. 6 indicates that the pulse repetition interval is modulated by a sine wave, and the pulse width is constant.

[0031] The display control unit 12 may display a graph showing the reception frequency for each pulse wave at each pulse repetition interval and a graph showing the reception time for each pulse wave at each pulse repetition interval, as shown in Fig. 7, in association with each of two axes in the two-dimensional graphs, the vertical and horizontal axes corresponding to the pulse repetition interval of each pulse wave, shown in Fig. 5 and Fig. 6. This allows, for example, a user (monitoring person) to intuitively grasp the pulse width, reception frequency, and reception time for each pulse repetition interval of each pulse wave.

[0032] 7, a two-dimensional graph 701 with vertical and horizontal axes corresponding to the pulse repetition interval of each pulse wave and a graph 702 (PRI histogram image) showing the reception frequency for each pulse wave at each pulse repetition interval on the horizontal axis are displayed, sharing a vertical axis 711. Furthermore, the two-dimensional graph 701 and a graph (PRI raster image) 703 showing the reception time for each pulse wave at each pulse repetition interval on the vertical axis are displayed, sharing a horizontal axis 712.

[0033] 5 and 6 and the example of the two-dimensional graph 701 in Fig. 7 have been described in which the display control unit 12 displays a display object at a position where the vertical axis value and the horizontal axis value are the value of the pulse repetition interval of each pulse wave on a two-dimensional graph whose vertical axis and horizontal axis correspond to the pulse repetition interval of each pulse wave. Alternatively, as in Fig. 8, the display control unit 12 may display a display object at a position on an arc whose radius is the value of the pulse repetition interval of each pulse wave on a two-dimensional graph whose vertical axis and horizontal axis correspond to the pulse repetition interval of each pulse wave.

[0034] 8, the display control unit 12 indicates that pulse waves having pulse widths corresponding to the sizes of circular display objects 821 to 823, each having only a non-filled outer frame, are received at pulse repetition interval 811. The display control unit 12 also indicates that pulse waves having pulse widths corresponding to the sizes of the respective display objects are received at pulse repetition interval 812. The example of FIG. 8 indicates that the pulse waves at pulse repetition intervals 811 to 812 appear periodically or randomly, and that the pulse widths are not constant.

[0035] (Example of Identifying Transmission Source Device 30) The display control unit 12 may identify the transmission source device 30 of the radar wave based on two-dimensional data (image) in which display objects corresponding to the pulse widths of the pulse waves are set at positions corresponding to the pulse repetition intervals of the pulse waves. This makes it possible to provide the user with, for example, the names of the transmission source devices 30 present around the antenna 20.

[0036] In this case, the display control unit 12 may identify the transmission source device 30 based on a feature vector inferred by machine learning based on the two-dimensional data (actually measured two-dimensional data) shown in FIGS. 5 and 6 , the two-dimensional graph 701 in FIG. 7 , and FIG. 8 . In this case, the display control unit 12 may use, for example, machine learning results using deep learning or the like based on data combining the actually measured two-dimensional data of each transmission source device 30 and ground truth data of the pulse width for each PRI of each transmission source device 30. The display control unit 12 may then infer a feature vector of each pulse width for each PRI based on the actually measured two-dimensional data to be processed. This allows the feature vector to be appropriately inferred, for example, even if the PRI or pulse width fluctuates due to fading such as Doppler or multipath in a real environment. The display control unit 12 may then calculate the similarity between the inferred feature vector and each template vector (a vector of the feature amount of each pulse width for each PRI) pre-registered for each transmission source device 30. The display control unit 12 may use, for example, the cosine similarity of the feature vectors of the two-dimensional data as the similarity. Then, the display control unit 12 may identify, for example, the transmission source device 30 with the highest similarity. The template vector data for each transmission source device 30 may be registered in advance in the information processing device 10 by an operator or the like.

[0037] The display control unit 12 may also identify a transmission source device 30 based on the similarity between the actually measured two-dimensional data and two-dimensional data set by display objects corresponding to the pulse widths of the pulse waves at positions corresponding to the pulse repetition intervals of the pulse waves set for each of the multiple transmission source devices 30. In this case, the display control unit 12 may, for example, calculate the similarity between the actually measured two-dimensional data and each piece of two-dimensional data set for each transmission source device 30. The display control unit 12 may use, for example, a template matching score for each piece of two-dimensional data as the similarity. The display control unit 12 may use, for example, Sum of Absolute Difference (SAD), Sum of Squared Difference (SSD), or Normalized Cross-Correlation (NCC) as a template matching method. The display control unit 12 may then identify, for example, the transmission source device 30 with the highest similarity. The two-dimensional data for each transmission source device 30 may be preset in the information processing device 10 by, for example, an operator. The two-dimensional data for each transmission source device 30 may be, for example, past measured two-dimensional data based on radar waves received by the antenna 20 in the past.

[0038] <Others> In the PRI raster image shown in 703 of Fig. 7, when displaying received data over a relatively long period of time, the number of display pixels on the axis of reception time may be insufficient, causing the plot points for each pulse wave to be displayed connected (blurred) rather than separated. On the other hand, in the present disclosure, display objects of sizes corresponding to the pulse widths of each pulse wave are displayed at positions corresponding to the pulse repetition intervals of the pulse waves. This allows, for example, pulse waves from the transmission source device 30 to be properly grasped.

[0039] <Modifications> The information processing device 10 may be a device contained in a single housing, but the information processing device 10 of the present disclosure is not limited to this. Each unit of the information processing device 10 may be realized, for example, by cloud computing configured with one or more computers. Furthermore, the information processing device 10 and the antenna 20 may be housed in the same housing and configured as an integrated information processing device. Such information processing devices 10 are also included in examples of the "information processing device" of the present disclosure.

[0040] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0041] Some or all of the above embodiments may also be described as, but are not limited to, the following supplementary notes. Note that some or all of the elements (e.g., configurations and functions) described in each supplementary note dependent on supplementary note 1 may also be dependent on independent supplementary notes in other categories in a similar dependency relationship. Some or all of the elements described in any supplementary note may be applied to various hardware, software, and recording means, systems, and methods for recording software. (Supplementary note 1) An information processing device comprising: an acquisition unit that acquires signals of each pulse wave of radar waves received by an antenna at each time point; and a display control unit that displays display objects of sizes corresponding to each pulse width of each pulse wave at positions corresponding to the pulse repetition interval of each pulse wave. (Supplementary note 2) The information processing device described in supplementary note 1, wherein the display control unit displays display objects corresponding to each pulse width of each pulse wave on a two-dimensional graph whose vertical and horizontal axes correspond to the pulse repetition interval of each pulse wave. (Supplementary Note 3) The information processing device according to Supplementary Note 2, wherein the display control unit displays a graph indicating the reception frequency for each pulse repetition interval of the pulse wave and a graph indicating the reception time for each pulse repetition interval of the pulse wave, in association with two axes corresponding to the pulse repetition interval of each of the pulse waves in the two-dimensional graph. (Supplementary Note 4) The information processing device according to Supplementary Note 2 or 3, wherein the display control unit displays the display object at a position on the two-dimensional graph where the vertical axis value and the horizontal axis value are the value of the pulse repetition interval of each pulse wave, or at a position on an arc whose radius is the value of the pulse repetition interval of each pulse wave. (Supplementary Note 5) The information processing device according to Supplementary Note 1 or 2, wherein the display object is a regular polygon or a circle. (Supplementary Note 6) The information processing device according to Supplementary Note 1 or 2, wherein the display control unit displays a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave whose reception frequency is equal to or greater than a threshold among the pulse waves.(Supplementary Note 7) The information processing device according to Supplementary Note 1 or 2, wherein the display control unit identifies a transmitter device of the radar waves based on a similarity between a feature vector inferred by machine learning based on two-dimensional data set by a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave, and a template vector registered for each of a plurality of transmitter devices. (Supplementary Note 8) The information processing device according to Supplementary Note 1 or 2, wherein the display control unit identifies a transmitter device of the radar waves based on a similarity between two-dimensional data set by a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave, and two-dimensional data set by a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave for each of a plurality of transmitter devices. (Supplementary Note 9) An information processing method comprising: acquiring a signal of each pulse wave of radar waves received by an antenna at each time point; and displaying a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave. (Supplementary Note 10) A program that causes a computer to execute a process of acquiring a signal of each pulse wave of a radar wave received by an antenna at each time point, and displaying a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

[0042] This application claims priority based on Japanese Patent Application No. 2024-070645, filed April 24, 2024, the disclosure of which is incorporated herein in its entirety by reference.

[0043] REFERENCE SIGNS LIST 1 Information processing system 10 Information processing device 11 Acquisition unit 12 Display control unit 20 Antenna 30 Transmission source device

Claims

1. An information processing device having: an acquisition unit that acquires the signal of each pulse wave of a radar wave received by an antenna at each point in time; and a display control unit that displays a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

2. The information processing device according to claim 1, wherein the display control unit displays a display object corresponding to each pulse width of each of the pulse waves on a two-dimensional graph whose vertical and horizontal axes correspond to the pulse repetition interval of each of the pulse waves.

3. The information processing device according to claim 2, wherein the display control unit displays a graph showing the reception frequency for each pulse repetition interval of each pulse wave and a graph showing the reception time for each pulse repetition interval of each pulse wave, each graph corresponding to two axes corresponding to the pulse repetition interval of each pulse wave in the two-dimensional graph.

4. The information processing device according to claim 2 or 3, wherein the display control unit displays the display object at a position on the two-dimensional graph where the vertical axis value and the horizontal axis value are the pulse repetition interval value of each pulse wave, or at a position on an arc whose radius is the pulse repetition interval value of each pulse wave.

5. The information processing device according to claim 1 or 2, wherein the display object is a regular polygon or a circle.

6. The information processing device according to claim 1 or 2, wherein the display control unit displays a display object corresponding to each pulse width of each of the pulse waves at a position corresponding to the pulse repetition interval of each of the pulse waves whose reception frequency is equal to or greater than a threshold value.

7. The information processing device according to claim 1 or 2, wherein the display control unit identifies the device transmitting the radar wave based on the similarity between a feature vector inferred by machine learning based on two-dimensional data in which a display object corresponding to each pulse width of each pulse wave is set at a position corresponding to the pulse repetition interval of each pulse wave, and a template vector registered for each of multiple transmission devices.

8. The information processing device according to claim 1 or 2, wherein the display control unit identifies the device that transmits the radar waves based on the similarity between two-dimensional data set by a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave and two-dimensional data set by a display object corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave for each of a plurality of transmission devices.

9. An information processing method comprising: acquiring a signal of each pulse wave of a radar wave received by an antenna at each time point; and displaying a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

10. A program that causes a computer to execute the following process: acquire the signal of each pulse wave of a radar wave received by an antenna at each point in time; and display a display object of a size corresponding to each pulse width of each pulse wave at a position corresponding to the pulse repetition interval of each pulse wave.

Images