Information processing device, information processing method, and program

Abstract

To provide an information processing device capable of efficiently and accurately determining abnormality of a road surface, a railroad, an overhead wire, and so on.SOLUTION: An information processing device includes a detection device communication section for acquiring a detection signal of a physical amount which is varied in accordance with movement of a vehicle 70 while in contact with a road surface R, an imaging device control section for acquiring image information of the vehicle 70 taken by imaging devices 40A, 40B, and a display control section for displaying the image information on a display. The imaging device control section controls the imaging devices on the basis of the detection signal.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses an inspection vehicle 1 which, while driving along a road, photographs the pavement surface with a thermal infrared camera 3 and a visible light camera 4, detects vehicle vibrations according to the condition of the pavement surface with a vibration sensor 5, detects sounds generated by the vehicle's movement with a driving sound detection unit 6, detects the permeability of the pavement with a permeability detection unit 7, collects detection information from sensors that have been placed in advance around the road with an IC tag communication unit 8, and collects the shape of the pavement surface with a pavement surface measurement unit 9. Summary of the Invention [Problem to be solved by the invention]

[0003] An object of the present invention is to provide an information processing device, an information processing method, and a program that can efficiently and accurately determine an abnormality in a target area. [Means for solving the problem]

[0004] The information processing device according to the present invention includes a detection information acquisition unit that acquires detection information relating to a physical quantity that changes when a moving body moves in contact with a target part, a possibility information determination unit that calculates and determines possibility information that indicates the possibility of an abnormality in the target part from a feature amount that indicates a feature of the detection information, an image information acquisition unit that acquires first image information of the target part captured by a first imaging device arranged on the moving body and second image information of the target part captured by a second imaging device arranged on the moving body, and a possibility information determination unit that, when the possibility information satisfies a predetermined condition, calculates and determines second possibility information that indicates the possibility of an abnormality in the target part based on the first image information and the second image information acquired by the image information acquisition unit, satisfies the predetermined condition. Can be writtenand a display control unit that causes a display unit to display functional information, the first image information, and the second image information in association with each other. Effect of the Invention

[0005] According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that can efficiently and accurately determine an abnormality in a target part. [Brief description of the drawings]

[0006] [Figure 1] 1 is a diagram illustrating an example of a system configuration of an anomaly detection system according to an embodiment of the present invention. [Diagram 2] 1 is a diagram showing a vehicle according to an embodiment of the present invention; [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a control device of a vehicle. [Diagram 5] FIG. 2 is a diagram illustrating an example of a functional configuration of the anomaly detection system according to the present embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of a detailed functional configuration of a signal processing unit according to the present embodiment. [Figure 7] 10 is a sequence diagram showing an example of a storage process of a detection signal in the anomaly detection system according to the present embodiment. FIG. [Figure 8] FIG. 4 is a conceptual diagram illustrating an example of a condition information management table according to the embodiment. [Figure 9] 5 is a flowchart showing an example of signal processing for a detection signal in the information processing device according to the embodiment. [Figure 10] FIG. 2A is a diagram showing an example of a spectrogram of a detection signal during normal operation, and FIG. 2B is a diagram showing an example of a spectrogram of a detection signal during the occurrence of an abnormality. [Figure 11] FIG. 4 is a conceptual diagram illustrating an example of a detection signal management table according to the embodiment. [Figure 12]5 is a flowchart showing an example of processing for image information in the information processing device according to the present embodiment. [Figure 13] FIG. 4 is a conceptual diagram showing an example of an image information management table according to the embodiment. [Figure 14] 13 is a flowchart showing an example of a score display process and a model information storage process in the information processing device according to the present embodiment. [Figure 15] FIG. 11 is a diagram showing an example of an output signal selection screen displayed on the information processing device according to the embodiment. [Figure 16] 10 is a flowchart illustrating an example of a display selection process in the information processing device according to the present embodiment. [Figure 17] FIG. 11 is a diagram showing an example of a display selection screen displayed on the information processing device according to the embodiment. [Figure 18] 11 is a diagram showing an example of image information displayed on a display selection screen according to the embodiment; FIG. [Figure 19] FIG. 4 is a conceptual diagram illustrating an example of a model information management table according to the embodiment. [Figure 20] FIG. 11 is a diagram showing an example of a display selection screen displayed on an information processing device according to a first modified example of the present embodiment. [Figure 21] FIG. 11 is a diagram showing an example of image information displayed on a display selection screen according to a first modified example. [Figure 22] FIG. 11 is a diagram showing an example of a display selection screen displayed on an information processing device according to a second modified example of the present embodiment. [Figure 23] FIG. 11 is a diagram showing a railway vehicle according to a third modified example of the embodiment. [Figure 24] FIG. 13 is a conceptual diagram showing an example of a condition information management table according to a third modified example. [Diagram 25] FIG. 13 is a diagram showing an example of a display selection screen displayed on an information processing device according to a third modified example. [Figure 26] FIG. 11 is a diagram showing a railway vehicle according to a fourth modified example of the embodiment. [Figure 27] FIG. 13 is a conceptual diagram showing an example of a condition information management table according to a fourth modified example. [Figure 28] FIG. 13 is a diagram showing an example of a display selection screen displayed on an information processing device according to a fourth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated description will be omitted.

[0008] System Configuration FIG. 1 is a diagram illustrating an example of a system configuration of an anomaly detection system according to an embodiment of the present invention.

[0009] The anomaly detection system 1A according to this embodiment includes a vehicle 70 and an information processing system 5. The information processing system 5 includes a detection device 30, an imaging device 40, and an information processing device 10.

[0010] The vehicle 70 is an example of a moving object that moves while contacting a target portion such as a road surface. The detection device 30 detects a physical quantity that changes as the vehicle 70 moves while contacting the road surface. The imaging device 40 is an example of an imaging unit that captures a moving or still image of a target portion such as a road surface.

[0011] The anomaly detection system 1A may include a plurality of vehicles 70, a plurality of detection devices 30 corresponding to the plurality of vehicles 70, and a plurality of imaging devices 40.

[0012] The information processing device 10 is a diagnostic device that is connected to the vehicle 70 so as to be able to communicate with the vehicle 70 and diagnoses abnormalities in a target portion such as a road surface. The information processing device 10 may be a general-purpose PC (Personal Computer) in which a dedicated software program is installed. The information processing device 10 may be configured by a single computer or may be configured by multiple computers.

[0013] The information processing device 10 and the vehicle 70 may be connected in any form. For example, the information processing device 10 and the vehicle 70 may be connected by a dedicated connection line, a wired network such as a wired LAN (Local Area Network), or a wireless network.

[0014] The detection device 30 is a sensor that detects a physical quantity, such as vibration or sound, generated when tires mounted on the vehicle 70 come into contact with the road surface or the like while the vehicle 70 is moving, and outputs information on the detected physical quantity as a detection signal (sensor data) to the information processing device 10. The detection device 30 is configured with, for example, a microphone, a vibration sensor, an acceleration sensor, an AE sensor, or the like, and detects a change in the physical quantity, such as vibration or sound.

[0015] These detection means are installed near the tire. The installation method is by fixing with screws, fixing with magnets, adhering with adhesive, or by embedding in holes made by drilling or the like. The number of detection devices 30 may be arbitrary. Also, a plurality of detection devices 30 that detect the same physical quantity may be provided, or a plurality of detection devices 30 that detect different physical quantities may be provided.

[0016] Here, between the information processing device 10 and the detection device 30, several types of filters for filtering the output signal from the detection device 30, or a filter selection means for selecting a filter may be provided as necessary.

[0017] 2 is a diagram showing a vehicle according to this embodiment. The vehicle 70 includes a control device 70A, a tire 50, and a detection device 30. The vehicle 70 also includes a first imaging device 40A arranged to capture an image of a road surface R in the traveling direction of the vehicle 70, and a second imaging device 40B arranged to capture an image of the road surface R behind the vehicle 70 from a vertical direction. The tire 50 is an example of a moving member that moves while making contact with a target portion such as the road surface R.

[0018] The detection device 30 may be pre-installed on the vehicle 70 or may be retrofitted to the vehicle 70 .

[0019] ●Hardware configuration Next, the hardware configuration of the information processing device 10 and the vehicle 70 in this embodiment will be described with reference to Figures 3 and 4. Note that the hardware configurations shown in Figures 3 and 4 may have the same configuration in each embodiment, and components may be added or deleted as necessary.

[0020] ○Hardware configuration of information processing device○ FIG. 3 is a diagram showing an example of a hardware configuration of the information processing device according to the present embodiment.

[0021] The information processing device 10 is constructed by a computer and, as shown in FIG. 23, includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HD (Hard Disk) 104, a HDD (Hard Disk Drive) controller 105, a display I / F 106 and a communication I / F 107.

[0022] Among these, the CPU 101 controls the operation of the entire information processing device 10. The ROM 102 stores programs used to drive the CPU 101, such as an IPL (Initial Program Loader). The RAM 103 is used as a work area for the CPU 101. The HD 104 stores various data such as programs. The HDD controller 105 controls reading and writing of various data from and to the HD 104 under the control of the CPU 101. The display I / F 106 is a circuit that displays an image on the display 106a. The display 106a is a type of display unit such as a liquid crystal or organic EL that displays an image of a subject, various icons, and the like. The communication I / F 107 is an interface used for communication with an external device such as the vehicle 70. The communication I / F 107 is, for example, a NIC (Network Interface Card) compatible with TCP (Transmission Control Protocol) / IP (Internet Protocol).

[0023] The information processing device 10 also includes a sensor I / F 108 , an audio input / output I / F 109 , an input I / F 110 , a media I / F 111 , and a DVD-RW (Digital Versatile Disk Rewritable) drive 112 .

[0024] The sensor I / F 108 is an interface that receives a detection signal via a sensor amplifier 302 included in the detection device 30. The sound input / output I / F 109 is a circuit that processes input / output of sound signals between the speaker 109a and the microphone 109b under the control of the CPU 101. The input I / F 110 is an interface for connecting a predetermined input means to the information processing device 10. The keyboard 110a is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The mouse 110b is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. A touch panel or the like may be used as the input means instead of the keyboard 708a and the mouse 708b. The media I / F 111 controls reading or writing (storing) data from a recording medium 111a such as a flash memory. The DVD-RW drive 112 controls reading or writing various data from a DVD-RW 112a as an example of a removable recording medium. It is to be noted that the DVD-RW is not limited to a DVD-RW, and may be a DVD-R or the like. Furthermore, the DVD-RW drive 112 may be a Blu-ray drive that controls reading and writing of various data from and to a Blu-ray disc.

[0025] The information processing device 10 also includes a bus line 113. The bus line 113 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 101.

[0026] Incidentally, recording media such as HDs and CD-ROMs on which the above programs are stored can be provided domestically or internationally as program products.

[0027] 〇Vehicle hardware configuration〇 FIG. 4 is a diagram showing an example of a hardware configuration of the control device for the vehicle according to the present embodiment.

[0028] As shown in FIG. 4, the control device 70A includes a CPU 701, a ROM 702, a RAM 703, a display I / F 704, a communication I / F 705, a drive circuit 706, a sound output I / F 707, an input I / F 708, and a sensor I / F 709.

[0029] Of these, the CPU 701 controls the operation of the entire control device 70A. The ROM 702 stores programs used to drive the CPU 701, such as an IPL. The RAM 703 is used as a work area for the CPU 701. The display I / F 704 is a circuit that displays images on a display 704a. The display 704a is a type of display unit, such as a liquid crystal or organic EL display, that displays an image of a subject, various icons, and the like.

[0030] The communication I / F 705 is an interface used for communication with an external device such as the information processing device 10. The communication I / F 705 is, for example, a NIC compatible with TCP / IP.

[0031] The drive circuit 706 is a circuit that controls the drive of the motor 706a. The motor 706a drives the tire 50.

[0032] The sound output I / F 707 is a circuit that processes the output of sound signals between the speaker 707a and the microphone 707b under the control of the CPU 701. The input I / F 708 is an interface for connecting a predetermined input means to the control device 70A. The keyboard 708a is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The mouse 708b is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. Instead of the keyboard 708a and the mouse 708b, a touch panel or the like may be used as the input means.

[0033] The control device 70A also includes a bus line 710. The bus line 710 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 701.

[0034] Moreover, the detection device 30 includes a sensor 301 and a sensor amplifier 302, and detects a physical quantity, such as vibration or sound, that changes as the vehicle 70 moves while in contact with the road surface R. As described above, the sensor 301 detects a physical quantity, such as vibration or sound, that is generated when the tire 50 of the vehicle 70 comes into contact with the road surface R while the vehicle 70 is moving. The sensor 301 also acquires a detection signal (sensor data) based on information on the detected physical quantity. The sensor 301 is, for example, a microphone, a vibration sensor, an acceleration sensor, an AE sensor, or the like. The sensor amplifier 302 adjusts the detection sensitivity, etc., of the sensor 301, and outputs the detection signal detected by the sensor 301.

[0035] ●Function configuration FIG. 5 is a diagram illustrating an example of the functional configuration of the anomaly detection system according to the present embodiment.

[0036] Functional configuration of information processing device First, a description will be given of the functional configuration of the information processing device 10. The functions realized by the information processing device 10 include a transmission / reception unit 11, a detection device communication unit 12, a reception unit 13, a display control unit 14, a sound control unit 15, a generation unit 16, a signal processing unit 17, a selection unit 18, a determination unit 21, a storage / readout unit 19, an imaging device control unit 41, and a storage unit 1000.

[0037] The transmission / reception unit 11 has a function of transmitting and receiving various data (or information) to and from an external device such as the vehicle 70. The transmission / reception unit 11 receives, for example, processing information (traveling information) related to the current operation of the vehicle 70. The transmission / reception unit 11 is mainly realized by the communication I / F 107 shown in Fig. 3 and a program executed by the CPU 101. The transmission / reception unit 11 is an example of a processing information acquisition unit.

[0038] The detection device communication unit 12 is a function that performs data communication with the detection device 30. The detection device communication unit 12 receives, for example, a detection signal (sensor data) related to a physical quantity detected by the detection device 30. The detection device communication unit 12 is mainly realized by a program executed by the CPU 101 shown in FIG. 3 . The detection device communication unit 12 is an example of a detection information acquisition unit that acquires detection information. In addition, the detection signal received by the detection device communication unit 12 is an example of detection information related to a physical quantity that changes as the vehicle 70 moves while in contact with the road surface R.

[0039] The reception unit 13 has a function of receiving a user input to an input means such as the keyboard 110a shown in Fig. 3. The reception unit 13 receives a selection of an output item in response to an input to an output signal selection screen 200 (see Fig. 15), for example. The reception unit 13 is mainly realized by a program executed by the CPU 101 shown in Fig. 3.

[0040] The display control unit 14 is a function that displays various screens on the display 106a shown in FIG. 3. The display control unit 14, for example, displays an output signal selection screen 200 (see FIG. 15) on the display 106a. Specifically, the display control unit 14, for example, starts and executes a software application that runs on the OS, thereby downloading a WebAPP (WebApplication) that includes at least HTML (HyperText Markup Language) and includes CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), etc. Then, the display control unit 14 displays various image data generated by the WebAPP on the display 106a. The display control unit 14 displays image data generated by HTML5 that includes data in, for example, XML (Extensible Markup Language), JSON (JavaScript Object Notation), or SOAP (Simple Object Access Protocol) format, etc. on the display 106a. The display control unit 14 is mainly realized by the display I / F 106 shown in FIG. 3 and a program executed by the CPU 101, etc.

[0041] The sound control unit 15 has a function of outputting a sound signal from the speaker 109a shown in Fig. 3. The sound control unit 15 sets a detection signal to be output from the speaker 109a, and causes the set detection signal to be output as sound from the speaker 109a. The sound control unit 15 is mainly realized by the sound input / output I / F 109 shown in Fig. 3, a program executed by the CPU 101, and the like.

[0042] The generating unit 16 has a function of generating various image data to be displayed on the display 106a. For example, the generating unit 16 generates image data related to an output signal selection screen 200 (see FIG. 15) to be displayed on the display 106a. For example, the generating unit 16 renders data stored in the storage unit 1000 and generates image data for displaying the rendered data. Rendering refers to WebpageThis is a process of interpreting data described in a description language (HTML, CSS, XML, etc.) and calculating the layout of characters, image data, etc. that are actually displayed on the screen. Furthermore, when processing information is received by the transmitting / receiving unit 11, the generating unit 16 generates a condition ID for identifying condition information including the received processing information. The generating unit 16 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

[0043] The signal processing unit 17 has a function of performing signal processing of the detection signal received by the detection device communication unit 12. A detailed description of the signal processing unit 17 will be given later. The signal processing unit 17 is mainly realized by a program executed by the CPU 101 shown in FIG.

[0044] The selection unit 18 has a function of selecting a detection signal to be output as sound based on a signal output request from a user. The selection unit 18 selects, for example, a detection signal stored in association with condition information corresponding to output item data included in the signal output request accepted by the acceptance unit 13. The selection unit 18 is mainly realized by a program executed by the CPU 101 shown in FIG.

[0045] The determination unit 21 is mainly realized by the processing of the CPU 101 shown in Fig. 3, and has a function of making various determinations. The determination unit 21 calculates, for example, a difference between signal data related to a plurality of detection signals selected by the selection unit 18. The determination unit 21 is an example of an abnormality determination unit.

[0046] The imaging device control unit 41 has a function of communicating control signals and image data with the imaging device 40 including the first imaging device 40A and the second imaging device 40B. The imaging device control unit 41 transmits, for example, an imaging start signal to the imaging device 40. The imaging device control unit 41 is also an example of an image information acquisition unit that acquires image information of the road surface R, and receives, for example, image information of a moving image or a still image of the road surface R captured by the imaging device 40. The imaging device control unit 41 is mainly realized by a program executed by the CPU 101 shown in FIG. 3.

[0047] The memory / read unit 19 has a function of storing various data in the memory unit 1000 or reading various data from the memory unit 1000. The memory / read unit 19 is mainly realized by the programs executed by the CPU 101 shown in Fig. 3. The memory unit 1000 is mainly realized by the ROM 102, HD 104, and recording medium 111a shown in Fig. 3.

[0048] Further, in the memory unit 1000, a condition information management DB 1001, a detection signal management DB 1003, a model information management DB 1005, and an image information management DB 1007 are constructed. Of these, the condition information management DB 1001 is constituted by a condition information management table described later. The detection signal management DB 1003 is constituted by a detection signal management table described later. The model information management DB 1005 is constituted by a model information management table described later. The image information management DB 1007 is constituted by an image information management table described later. The memory / read unit 19 is an example of a memory control unit.

[0049] ○ Functional configuration of the detection device ○ Next, a description will be given of the functional configuration of the detection device 30. The functions realized by the detection device 30 include a device connection unit 31 and a detection signal acquisition unit 32.

[0050] The device connection unit 31 has a function of transmitting the detection signal acquired by the detection signal acquisition unit 32 to the information processing device 10. The device connection unit 31 is mainly realized by the sensor amplifier 302 shown in FIG.

[0051] The detection signal acquisition unit 32 has a function of detecting a physical quantity such as vibration or sound that changes when the vehicle 70 moves while in contact with the road surface R, and acquiring information on the physical quantity as a detection signal. The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG. 4. The detection signal acquisition unit 32 detects vibration or sound generated when the tire 50 of the vehicle 70 and the road surface R come into contact with each other while the vehicle 70 is moving, and acquires information on the detected physical quantity as detection information (sensor data). For example, when a crack or the like occurs in the road surface R, the sound generated when the tire 50 and the road surface R come into contact with each other changes. Therefore, the detection signal acquisition unit 32 detects acoustic data using the sensor 301 such as a microphone, and transmits a detection signal related to the detected acoustic data to the information processing device 10 via the device connection unit 31. The detection signal acquisition unit 32 is mainly realized by the sensor 301 shown in FIG. 4.

[0052] 〇Vehicle functional configuration〇 Next, the functions realized by the control device 70A of the vehicle 70 include a transmitter / receiver 71, a main control unit 72, a drive control unit 73, a drive unit 74, a setting unit 75, a reception unit 76, a display control unit 77 and a sound control unit 78.

[0053] The transmission / reception unit 71 has a function of transmitting and receiving various data (or information) to and from an external device such as the information processing device 10. The transmission / reception unit 71 transmits processing information related to the current operation of the vehicle 70 to the information processing device 10. The transmission / reception unit 71 is mainly realized by the communication I / F 705 shown in FIG. 4, a program executed by the CPU 701, and the like.

[0054] The main control unit 72 generates and outputs control data for controlling the operation of the drive unit 74. The main control unit 72 also outputs processing information related to the operation of the vehicle 70 to the transmission / reception unit 71. The main control unit 72, for example, sequentially transmits information corresponding to the current operation of the vehicle 70 to the information processing device 10 via the transmission / reception unit 71. When the vehicle 70 runs, the main control unit 72 appropriately changes the type of the drive unit 74 to be driven or the driving state (number of rotations, rotation speed, etc.) of the drive unit 74. Every time the main control unit 72 changes the type of operation, it sequentially transmits information corresponding to the changed type of operation to the information processing device 10 via the transmission / reception unit 71. The main control unit 72 is mainly realized by a program executed by the CPU 701 shown in FIG. 4, etc.

[0055] The drive control unit 73 has a function of controlling the drive of the drive unit 74 based on the control data obtained by the main control unit 72. The drive control unit 73 is realized, for example, by a drive circuit 706 shown in Fig. 4. The drive control unit 73 is mainly realized by the drive circuit 706 shown in Fig. 4 and a program executed by the CPU 701, etc.

[0056] The drive unit 74 is a function that is subject to drive control by the drive control unit 73. The drive unit 74 drives the tires 50 under the control of the drive control unit 73. The drive unit 74 is an actuator that is drive-controlled by the drive control unit 73, and is mainly realized by a motor 706a shown in FIG. 4 and the like. The drive unit 74 may be any actuator that is used for driving the vehicle 70 and is subject to control. Furthermore, two or more drive units 74 may be provided.

[0057] The setting unit 75 has a function of setting condition information corresponding to the current operation of the vehicle 70. The setting unit 75 is mainly realized by a program executed by the CPU 701 shown in FIG.

[0058] The reception unit 76 is a function that receives user input to an input means such as the keyboard 708a shown in Fig. 4. The reception unit 76 receives the selection of an output item in response to, for example, an input to the output signal selection screen 200 (see Fig. 15) displayed on the display 704a. The reception unit 76 is mainly realized by the input I / F 708 shown in Fig. 4, a program executed by the CPU 701, and the like.

[0059] The display control unit 77 has a function of displaying various screen information on the display 704a shown in Fig. 4. The display control unit 77 displays, for example, an output signal selection screen 200 (see Fig. 15) on the display 704a. The display control unit 77 is mainly realized by the display I / F 704 shown in Fig. 4 and a program executed by the CPU 701, etc.

[0060] The sound control unit 78 is realized by an instruction from the CPU 701 shown in Fig. 4, and has a function of outputting a sound signal from the speaker 707a. The sound control unit 78 sets a detection signal to be output from the speaker 707a, and causes the set detection signal to be output as sound from the speaker 707a. The sound control unit 78 is mainly realized by the sound output I / F 707 shown in Fig. 4, a program executed by the CPU 701, and the like.

[0061] Fig. 6 is a diagram showing an example of a detailed functional configuration of the signal processing unit according to the present embodiment. The signal processing unit 17 shown in Fig. 6 includes an amplification processing unit 171, an A / D conversion unit 172, a feature extraction unit 173, a D / A conversion unit 174, and a score calculation unit 175.

[0062] The amplification processing unit 171 has a function of amplifying a detection signal received by the detection device communication unit 12. For example, the amplification processing unit 171 amplifies an analog signal received by the detection device communication unit 12 to an arbitrary magnitude. In addition, the amplification processing unit 171 amplifies a digital signal converted by the A / D conversion unit 172 to an arbitrary magnitude.

[0063] The A / D conversion unit 172 has a function of converting the analog signal amplified by the amplification processing unit 171 into a digital signal.

[0064] The feature extraction unit 173 has a function of extracting a feature (feature information) indicating a feature of the detection signal received by the detection device communication unit 12. The feature may be any information indicating a feature of the detection signal. For example, when the detection signal is acoustic data, the feature extraction unit 173 may extract energy, a frequency spectrum, time, or MFCC (Mel Frequency Cepstrum Coefficients), etc., as the feature.

[0065] The D / A conversion unit 174 has a function of converting the digital signal amplified by the amplification processing unit 171 into an analog signal.

[0066] The score calculation unit 175 calculates a score as an example of possibility information indicating the possibility of an abnormality in the road surface R, from the feature amount (e.g., frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173. The score calculation unit 175 is an example of a possibility information determination unit that determines the possibility information indicating the possibility of an abnormality in the road surface R.

[0067] 〇Memory processing of detection signals〇 FIG. 7 is a sequence diagram showing an example of a storage process of a detection signal in the anomaly detection system according to this embodiment.

[0068] In step S11, the transmitting / receiving unit 71 of the control device 70A transmits processing information related to the current operation of the vehicle 70 to the information processing device 10 constituting the information processing system 5. Specifically, the setting unit 75 of the control device 70A sets processing information indicating specific driving details when the vehicle 70 starts driving. As described above, the processing information is information that is determined for each type of operation of the vehicle 70. Then, the transmitting / receiving unit 71 transmits the processing information set by the setting unit 75 to the information processing device 10. As a result, the transmitting / receiving unit 11 of the information processing device 10 receives the processing information transmitted from the control device 70A (an example of a processing information acquisition step).

[0069] In step S12 , the generation unit 16 of the information processing device 10 generates a condition ID for identifying condition information including the processing information received by the transmission / reception unit 11 .

[0070] Then, in step S13, the storage / reading unit 19 stores and manages the condition ID generated by the generation unit 16 and the condition information associated with the processing information received by the transmission / reception unit 11 in the condition information management DB 1001 (an example of a storage control step). At this time, the storage / reading unit 19 also stores and manages the associated ID given to the processing information indicating the associated processing in the condition information management DB 1001. The condition information management DB 1001 stores and manages the processing information indicating the content of the specific driving processing executed by the vehicle 70 in a condition information management table in association with each condition ID.

[0071] In step S14, the detection signal acquisition unit 32 of the detection device 30 constituting the information processing system 5 detects a physical quantity such as vibration or sound generated by the traveling of the vehicle 70. Here, the detection signal acquisition unit 32 detects sound generated by the traveling of the vehicle 70, and acquires a detection signal (acoustic signal) related to the detected sound.

[0072] In step S15, the device connection unit 31 of the detection device 30 transmits the detection signal acquired in step S14 to the information processing device 10. As a result, the detection device communication unit 12 of the information processing device 10 receives the detection signal transmitted from the detection device 30 (an example of a detection information acquisition step).

[0073] In step S16 , the signal processing unit 17 of the information processing device 10 performs signal processing on the detection signal received by the detection device communication unit 12 .

[0074] In step S17, the storage / readout unit 19 of the information processing device 10 stores the signal data processed by the signal processing unit 17 in the detection signal management DB 1003 in association with the processing information transmitted from the control device 70A (an example of a storage control step). The information processing device 10 associates, for each condition ID generated in step S12, the running time data included in the processing information received in step S11, the signal data related to the detection signal received in step S15, the signal data processed by the signal processing unit 17 (frequency data, score data), and the processing information data included in the processing information received in step S11, and stores and manages them in the detection signal management table. The information processing device 10 may store and manage running distance data instead of the running time data.

[0075] That is, the storage / reading unit 19 stores in the detection signal management DB 1003 each of the plurality of feature amounts (frequency data) in association with each of the plurality of pieces of processing information transmitted from the control device 70A.

[0076] Condition information management table Fig. 8 is a conceptual diagram showing an example of a condition information management table according to the present embodiment. In the storage unit 1000 shown in Fig. 5, the condition information management DB 1001 described in step S13 of Fig. 7 is configured by the condition information management table shown in Fig. 8.

[0077] The condition information management table shown in FIG. 8 is for managing processing information related to the operation of the vehicle 70 for each operation performed by the vehicle 70. The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying the condition information including the processing information. The processing information is information defined for each type of operation of the vehicle 70. As shown in FIG. 8, the processing information includes information on the name of the road on which the vehicle 70 runs, the pavement material of the road on which the vehicle 70 runs, and the type of tires 50 of the vehicle 70.

[0078] Items included in the processing information may further include information indicating operation history information of the user with respect to the vehicle 70, the start date and time of travel, travel time (an example of the travel time of the vehicle 70), and the travel speed of the vehicle 70. Furthermore, travel distance (an example of the travel distance of the vehicle 70) may be included, or travel distance may be included instead of travel time. Travel information including travel time or travel distance is an example of travel information.

[0079] The condition information management table further stores and manages related IDs for identifying related operations (processes) among the operations performed by the vehicle 70 in association with each other. The same related ID is assigned to processing information indicating related processes among the processing information included in the condition information management table. In the example of FIG. 8, the same related ID "R001" is assigned to processing information identified by the condition ID "A000001" and the condition ID "A00003". Here, the related processes to which the related ID is assigned are, for example, processes in which the pavement material and tire type are the same but the road name is different.

[0080] Next, the process performed by the signal processing unit 17 on the detection signal, which corresponds to step S16 in FIG. 7, will be described with reference to FIGS.

[0081] FIG. 9 is a flowchart showing an example of signal processing for a detection signal in the information processing device according to this embodiment.

[0082] First, in step S151, if the detection signal is received (acquired) by the detection device communication unit 12, the information processing device 10 transitions the process to step S152. On the other hand, the information processing device 10 repeats the process of step S151 until the detection signal is received (acquired) by the detection device communication unit 12.

[0083] In step S152, the amplification processing unit 171 of the signal processing unit 17 performs amplification processing on the detection signal received (acquired) by the detection device communication unit 12, and amplifies the detection signal to an arbitrary magnitude. In step S153, the A / D conversion unit 172 of the signal processing unit 17 converts the analog signal amplified by the amplification processing unit 171 into a digital signal.

[0084] In step S154, the feature extraction unit 173 of the signal processing unit 17 performs a process of extracting a feature (feature information) indicating a feature of the digital signal converted by the A / D conversion unit 172 (an example of a feature extraction step). Specifically, the feature extraction unit 173 extracts a frequency spectrum included in the digital signal converted by the A / D conversion unit 172.

[0085] In step S155, the score calculation unit 175 of the signal processing unit 17 calculates a score indicating the possibility of an abnormality in the road surface R from the feature amount (for example, frequency spectrum) of the detection signal extracted by the feature amount extraction unit 173.

[0086] Specifically, the score calculation unit 175 calculates a likelihood indicating the likelihood that the feature information of the detection information is normal using model information of the feature information indicating normal data stored in the model information management DB 1005 of the memory unit 1000, and calculates the inverse of the likelihood as a score.

[0087] The score calculation section 175 may calculate the score by ranking it in stages, or may calculate it as two values, 0 and 1. Furthermore, the score calculation section 175 may accumulate the calculated scores.

[0088] In addition, the score calculation unit 175 may calculate the likelihood indicating the likelihood that the feature information of the detection information is abnormal as a score using model information of the feature information indicating abnormal data stored in the model information management DB 1005.

[0089] Here, the frequency components of the detection signal detected while the vehicle 70 is traveling, which corresponds to step S154 in FIG. 9, will be described.

[0090] Fig. 10(a) shows a spectrogram of a detection signal detected when the vehicle 70 runs on a normal road surface R, and Fig. 10(b) shows a spectrogram of a detection signal detected when the vehicle 70 runs on an abnormal road surface R. As shown in Fig. 10(b), when an abnormality occurs on the road surface R, a frequency component appears near 30,000 Hz.

[0091] Then, in the score calculation step shown in step S155 of FIG. 9, for example, when the spectrogram shown in FIG. 10(b) is model information indicating abnormal data, a score is calculated as a likelihood indicating the likelihood that the spectrogram of the detection signal extracted by the feature extraction unit 173 is abnormal, depending on the extent to which the spectrogram contains frequency components around 30,000 Hz.

[0092] Detection signal management table Fig. 11 is a conceptual diagram showing an example of a detection signal management table according to the present embodiment. In the storage unit 1000, the detection signal management DB 1003 described in step S17 of Fig. 7 is configured by the detection signal management table as shown in Fig. 11.

[0093] The detection signal management table shown in FIG. 11 is for managing the detection signal transmitted from the detection device 30 in association with the processing information transmitted from the control device 70A of the vehicle 70. In the detection signal management table, the running time data transmitted from the control device 70A, the detection signal, the frequency data extracted by the feature extraction unit 173, the score data calculated by the score calculation unit 175, and the processing information data for each running time transmitted from the control device 70A are stored and managed in association with each other for each condition ID. The condition ID is identification information for identifying the condition information included in the condition information management table shown in FIG. 8. As a result, the signal data (detection signal) is stored in association with the related data (processed signal data (frequency data, score data), running time data, and processing information data for each running time) for each condition ID. In the detection signal management table, running distance data and processing information data for each running distance may be stored and managed instead of the running time data and processing information data for each running time.

[0094] FIG. 12 is a flowchart showing an example of processing for image information in the information processing device according to this embodiment.

[0095] The information processing device 10 includes an imaging device 40 that captures an image of the road surface R. However, when determining whether there is an abnormality in the road surface R based on the image information, there is a problem in terms of efficiency.

[0096] That is, in order to judge anomalies based on image information, it is necessary to store a huge amount of image information including normal images, and the time required for image processing to judge anomalies is also enormous.

[0097] On the other hand, if the frequency of image capture by the imaging device 40 is reduced in order to improve the efficiency of abnormality determination based on image information, there is a risk that images showing the essential abnormal state may not be obtained, resulting in a decrease in the accuracy of abnormality determination.

[0098] In view of the above problems, an object of the present embodiment is to provide an information processing device 10 that can determine an abnormality in a road surface R efficiently and accurately.

[0099] The imaging device control unit 41 of the information processing device 10 determines whether the score calculated by the score calculation unit 175 is equal to or greater than a threshold value (step S21).

[0100] If the imaging device control unit 41 determines in step S21 that the threshold value is equal to or greater than the threshold value, it transmits an imaging start signal to the imaging device 40 to start imaging (step S22, an example of an imaging control step). That is, the imaging device control unit 41 controls the imaging device 40 based on the score calculated based on the detection signal. On the other hand, if the imaging device control unit 41 determines in step S21 that the threshold value is less than the threshold value, it ends the process.

[0101] In addition, the information processing device 10 may cause the imaging device 40 to start imaging at a timing regardless of the score calculated by the score calculation unit 175, and the imaging device control unit 41 may delay the timing of sending an imaging end signal to the imaging device 40 to end imaging when the score calculated by the score calculation unit 175 is equal to or greater than a threshold value.

[0102] Following step S22, the imaging device control section 41 acquires image data of a moving image or a still image captured by the imaging device 40 from the imaging device 40 (step S23, an example of an image information acquiring step).

[0103] The memory / read unit 19 of the information processing device 10 associates the image data of the moving image or still image acquired by the imaging device control unit 41 with the processing information transmitted from the control device 70A of the vehicle 70 and stores it in the detection signal management DB 1003 (step S24).

[0104] The information processing device 10 stores and manages, in an image information management table, image data of moving images or still images in association with the running time included in the processing information received in step S11 for each condition ID generated in step S12 shown in Fig. 7. The information processing device 10 may store and manage running distance data instead of running time data.

[0105] The score calculation unit 175 of the signal processing unit 17 of the information processing device 10 calculates a second score as an example of second possibility information indicating the possibility of an abnormality in the road surface R from the image data of the video or still image acquired by the imaging device control unit 41 (step S25).

[0106] Specifically, the score calculation unit 175 calculates a likelihood indicating the likelihood that the image data is normal using model information indicating normal data stored in the model information management DB 1005 of the memory unit 1000, and calculates the inverse of the likelihood as the second score.

[0107] The score calculation section 175 may calculate the second score by ranking it in stages, or may calculate it as a binary value of 0 or 1.

[0108] Furthermore, the score calculation section 175 may calculate a likelihood indicating the likelihood that the image data is abnormal as the second score by using model information indicating abnormal data stored in the model information management DB 1005.

[0109] The determination unit 21 of the information processing device 10 determines whether the second score calculated by the score calculation unit 175 is equal to or greater than a threshold value (step S26), and if it is determined that the second score is equal to or greater than the threshold value, determines that the road surface R is abnormal (step S27). That is, the determination unit 21 determines that the road surface R is abnormal based on the score and the second score indicating the possibility of the road surface R being abnormal, which is determined based on the image information.

[0110] When the information processing device 10 determines that the road surface R is abnormal, it outputs a warning by display or sound using the display 106a, the speaker 109a, etc.

[0111] As described above, the information processing device 10 includes the imaging device control unit 41 that acquires image information of the road surface R captured by the imaging device 40, and the imaging device control unit 41 controls the imaging device 40 based on a detection signal.

[0112] This allows the information processing device 10 to determine the timing for acquiring image information of the road surface R based on the detection signal, and therefore allows the image information of the road surface R to be acquired efficiently.

[0113] The imaging device control unit 41 controls the imaging device 40 based on a score indicating the possibility of an abnormality in the road surface R that is determined based on the detection signal.

[0114] This allows the information processing device 10 to efficiently acquire image information of the road surface R when the possibility of an abnormality in the road surface R is high based on the score.

[0115] The information processing device 10 includes a determination unit 21 that determines, based on the score and the image information, an abnormality in the road surface R. Specifically, the determination unit 21 determines an abnormality in the road surface R based on the score and a second score indicating the possibility of an abnormality in the road surface R that is determined based on the image information.

[0116] As a result, the information processing device 10 can determine abnormalities in the road surface R efficiently and accurately.

[0117] FIG. 13 is a conceptual diagram showing an example of an image information management table according to the present embodiment.

[0118] In the storage unit 1000, the image information management DB 1007 described with reference to FIG. 5 is configured with an image information management table as shown in FIG.

[0119] The image information management table shown in FIG. 13 is for managing image data of moving images or still images acquired by the imaging device control section 41.

[0120] In the image information management table, travel time data and video or still image data transmitted from the control device 70A of the vehicle 70 are stored and managed in association with each other for each condition ID. The condition ID is identification information for identifying the condition information included in the condition information management table shown in Fig. 8. In the image information management table, travel distance data may be stored and managed instead of the travel time data.

[0121] Here, the detection signal management table shown in FIG. 11 stores signal data (detection signal) in association with related data (processed signal data (frequency data, score data), running time data, and processing information data for each running time) for each condition ID, and the condition IDs stored and managed by the detection signal management table are the same as the condition IDs stored and managed by the image information management table.

[0122] Therefore, by combining the detection signal management table shown in FIG. 11 and the image information management table shown in FIG. 13, the information processing device 10 stores, for each condition ID, image data of moving images or still images, signal data (detection signals), and related data (processed signal data (frequency data, score data), running time data, and processing information data for each running time) in association with each other.

[0123] ○Signal data display processing and model information storage processing ○ FIG. 14 is a flowchart showing an example of score display processing and model information storage processing in the information processing device according to this embodiment.

[0124] In step S31, the display control unit 14 of the information processing device 10 causes the display 106a to display the output signal selection screen 200. Specifically, the display control unit 14 causes the output signal selection screen 200 to be displayed by the reception unit 13 receiving an input to a predetermined input screen displayed on the display 106a.

[0125] In step S32, the user inputs output items, and the receiving unit 13 receives a signal selection request including the input output item data.

[0126] In step S33, the information processing device 10 executes a process of displaying the score and a process of selecting signal data to be stored as model information, based on the output item data accepted by the accepting unit 13 (an example of a selecting step).

[0127] In step S34, the storage / reading unit 19 stores the selected signal data in the model information management DB 1005 as model information.

[0128] FIG. 15 is a diagram showing an example of an output signal selection screen displayed on the information processing device according to the present embodiment.

[0129] Fig. 15 is a diagram showing an example of an output signal selection screen displayed on an information processing device, corresponding to steps S31 and S32 of the flowchart shown in Fig. 14. The output signal selection screen 200 shown in Fig. 15 is a display screen for allowing a user to select a score to be displayed and signal data to be stored as model information. The output signal selection screen 200 includes an output item selection area 210 for specifying a score to be displayed and a detection signal to be stored as model information, a "VIEW" button 225 for displaying the score, and a "CANCEL" button 203 to be pressed when canceling the process.

[0130] Here, in the output item selection area 210, data of various items included in the processing information can be selected. The output item selection area 210 includes, for example, a road selection area 211 in which a road can be selected, a pavement material selection area 212 in which a pavement material can be selected, and a tire selection area 213 in which a tire 50 can be selected. In the example of FIG. 15, the reception unit 13 receives the following data as output item data: road; "R101", pavement material; "asphalt", and tire; "A". Note that the items corresponding to each selection area included in the output item selection area 210 are not limited to these, and may be added or changed as appropriate according to the items indicated in the processing information.

[0131] Then, by pressing the "VIEW" button 225 shown in FIG. 15, the signal data selected in the output item selection area 210 is displayed.

[0132] In the above-described Figures 14 and 15, an example has been described in which the output signal selection screen 200 is displayed on the information processing device 10 to allow the user to select the detection signal to be output. However, a configuration may also be used in which the output signal selection screen 200 is displayed on the control device 70A of the vehicle 70 to allow the user to select the detection signal to be output.

[0133] 16 is a flowchart showing an example of a display selection process in the information processing device according to this embodiment, which corresponds to step S33 in the flowchart shown in FIG.

[0134] In step S331, the selection unit 18 selects the processing information corresponding to the output item data accepted in step S32 shown in Fig. 14 from the processing information stored in the condition information management table shown in Fig. 8. Specifically, the storage / reading unit 19 reads out the condition information management table from the condition information management DB 1001. Then, the selection unit 18 selects the condition information including the processing information corresponding to the output item data accepted by the acceptance unit 13 from the condition information included in the read out condition information management table. In this case, the selection unit 18 selects, for example, the condition information of the condition ID "A000001" which is the processing information corresponding to the output item data input in the output item selection area 210 shown in Fig. 15.

[0135] In step S332, the selection unit 18 selects signal data and associated data associated with the same condition ID as the condition ID associated with the processing information selected in step S331 from among the data stored in the detection signal management table shown in Fig. 11. Specifically, the storage / reading unit 19 reads out the detection signal management table from the detection signal management DB 1003. Then, the selection unit 18 selects signal data and associated data associated with the condition ID included in the selected condition information from among the data included in the read detection signal management table. In this case, the selection unit 18 selects, for example, signal data and associated data associated with the condition ID "A000001".

[0136] In step S333, the selection unit 18 selects image data associated with the same condition ID as the condition ID associated with the processing information selected in step S331 from among the data stored in the image information management table shown in Fig. 13. Specifically, the storage / reading unit 19 reads out the image information management table from the image information management DB 1007. Then, the selection unit 18 selects image data associated with the condition ID included in the selected condition information from among the data included in the read image information management table. In this case, the selection unit 18 selects, for example, image data associated with the condition ID "A000001".

[0137] In step S334, the display control unit 14 of the information processing device 10 causes the display 106a to display the information display selection screen 250. Then, the display control unit 14 causes the signal data and related data selected in step S332 and the image data selected in step S333 to be displayed on the information display selection screen 250 in association with each other via the condition ID.

[0138] In step S335, the user selects a section on the information display selection screen 250, whereby the reception unit 13 receives the selection of the section (an example of a receiving step).

[0139] In step S336, the selection unit 18 selects the signal data and associated data related to the section selected in step S335 from the signal data and associated data selected in step S332.

[0140] Fig. 17 is a diagram showing an example of an information display selection screen displayed on the information processing device according to the present embodiment, Fig. 18 is a diagram showing an example of image information displayed on the display selection screen according to the present embodiment.

[0141] Fig. 17 is a diagram showing an example of an information display selection screen displayed on the information processing device, corresponding to step S334 and step S335 of the flowchart shown in Fig. 16. The information display selection screen 250 shown in Fig. 17 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

[0142] The user can check the possibility of an abnormality in the road surface R by checking the score displayed on the information display selection screen 250, but in order to actually determine whether there is an abnormality, the user needs to visually check the road surface R, which poses issues with the accuracy of abnormality determination.

[0143] In order to visually check the road surface R, image data of the vehicle 70 is displayed on the information display selection screen 250, but it is difficult to visually check image data indicating an abnormality from a large amount of image data. Therefore, it is conceivable that the information processing device 10 performs image processing on the image data to determine an abnormality, but this requires storing an enormous amount of image information and takes an enormous amount of time to determine an abnormality by image processing, which poses an efficiency issue.

[0144] In view of the above problems, an object of the present embodiment is to provide an information processing device 10 that can determine an abnormality in the road surface R efficiently and accurately.

[0145] On the information display selection screen 250, the driving time data related to the related data selected by the selection unit 18 is displayed in order of driving time so that the user can check it.

[0146] Furthermore, on the information display selection screen 250, a frequency spectrogram as an example of a feature quantity related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time are displayed in a manner that allows the user to confirm multiple consecutively in association with each running time data. Also, image data A is displayed in association with the maximum score in a manner that allows the user to confirm.

[0147] That is, the display control unit 14 displays a plurality of driving times, frequency spectra, operation history information, and scores on the information display selection screen 250 of the display 106a, and also displays each of the plurality of frequency spectra, each of the plurality of operation history information, each of the plurality of scores, and image information in association with each of the plurality of driving times on the information display selection screen 250 (an example of a display step). In the example of Fig. 17, the display control unit 14 displays the plurality of scores connected together as a line graph, and also displays image information in association with a position in the horizontal axis direction of the line graph showing the plurality of scores.

[0148] Furthermore, the display control unit 14 associates the image information with a maximum score among the multiple scores and displays it on the information display selection screen 250. Here, the maximum score is a score equal to or greater than the threshold value described in step S21 of FIG.

[0149] Furthermore, the information display selection screen 250 includes an input area 222 for inputting a driving time section as a specific section, an "OK" button 251 that is pressed when performing the section selection process, and a "CANCEL" button 253 that is pressed when canceling the section selection process.

[0150] As shown in FIG. 17, among the scores for driving times 1001 to 1250, the scores increase after driving time 1230, and the scores around driving time 1250 are the highest.

[0151] Here, on the information display selection screen 250, image data A of the road surface R is displayed in association with the score, and the user can check the image data A of the road surface R that corresponds to the maximum score near the travel time 1250.

[0152] In the example of FIG. 17, the image data of the road surface R contains more cracks than usual, so the user can determine that the high score is due to the cracks.

[0153] That is, by checking the score and the image information associated with the score, it is possible to accurately determine whether or not there is an abnormality in the road surface R.

[0154] Note that the image data may not only be displayed in association with the maximum score, but may also be displayed in association with all of the multiple scores equal to or greater than the threshold value described in step S21 of Fig. 12. In this case, since displaying all image data simultaneously would result in a cluttered screen, it is preferable to display only image data associated with the score selected with a mouse or the like among the image data associated with each of the multiple scores. Also, when there is a large change in score, the image data may be displayed in association with the score before the change, after the change, or before and after the change.

[0155] Furthermore, an example of selecting normal data from data of running times 1001 to 1250 will be shown with reference to Fig. 17. Looking at the scores as an example of score data, it can be seen that the values ​​are low from running times 1001 to 1230. If the system automatically sets "areas with low scores are normal" or "small cycles (e.g. 1001 to 1105) are normal", this section can be selected as normal data.

[0156] However, looking at the frequency data for the section of running times 1001 to 1230, it can be seen that there is noise in the low frequency range. On the other hand, looking at the frequency data for the section of running times 1105 to 1207, it can be seen that there is no noise in the low frequency range, unlike the section of running times 1001 to 1230.

[0157] Therefore, the user can appropriately determine that the data in the section of driving times 1001-1230, which is a part of the driving times 1001-1230, is more suitable as normal data than the data in the section of driving times 1001-1230.

[0158] Furthermore, when looking at the user operation history for the section of driving times 1001 to 1230, it can be seen that driving in special mode, for example, frequent speed changes, are repeated. It can be seen that the above-mentioned low-frequency noise occurs in the section where driving in special mode is performed. From this, it can be determined that the section where driving in special mode is performed is not suitable as a selection of normal data. Therefore, the user can more appropriately determine that driving times 1105 to 1207 where driving in special mode is not performed are suitable as normal data.

[0159] Then, when the user inputs "1105-1207" in the input area 222 and presses the "OK" button 251, the reception unit 13 receives the selection of "running time 1105-1207". This allows the detection signal or frequency spectrum corresponding to "running time 1105-1207", which is a part of running time 1001-1230, to be appropriately set as normal data.

[0160] In addition, since the information "running time 1105-1207" received by the reception unit 13 is displayed in the input area 222, the user can reliably set the detection signal or frequency spectrum corresponding to "running time 1105-1207" as normal data while checking the content displayed in the input area 222.

[0161] In the above description, when "1105-1207" is entered in the input area 222 and the "OK" button 251 is pressed, the reception unit 13 accepts the selection of "Running time 1105-1207". However, for example, the reception unit 13 may accept the selection of "Running time 1105-1207" by selecting the part of "Running time 1105-1207" among the displayed frequency data, score and user operation history with a mouse or the like and pressing the "OK" button 251.

[0162] As described above, the information processing device 10 includes a display control unit 14 that associates a score indicating the possibility of an abnormality in the road surface R, which is determined based on a detection signal, with image information and displays them on the information display selection screen 250 of the display 106a.

[0163] As a result, by checking the image information in association with the score, the user can determine abnormalities in the road surface R with higher accuracy than when checking only the score. Also, the user can determine abnormalities in the road surface R with higher efficiency than when checking only the image information. That is, the user can determine abnormalities in the road surface R efficiently and with higher accuracy by using the information processing device 10 according to this embodiment.

[0164] The display control unit 14 causes a plurality of frequency spectra of the detection signal to be displayed on the information display selection screen 250, and also causes each of the plurality of frequency spectra to be displayed on the information display selection screen 250 in association with each of the plurality of driving times.

[0165] This allows the user to efficiently and accurately determine abnormalities in the road surface R for each of the multiple scores by checking each of the multiple driving times, each of the multiple frequency spectra, and image information in association with each of the multiple scores.

[0166] The display control unit 14 displays a plurality of pieces of operation history information on the information display selection screen 250, and also displays each piece of the plurality of pieces of operation history information on the information display selection screen 250 in association with each of the plurality of driving times.

[0167] This allows the user to efficiently and accurately determine abnormalities in the road surface R for each of the multiple scores by checking the driving times of each of the multiple driving times, the operation history information of each of the multiple operation history information, and the image information in association with each of the multiple scores.

[0168] The information processing device 10 includes a receiving unit 13 that receives input of a part of a plurality of driving times among the plurality of driving times.

[0169] This allows the user to input a part of the multiple driving times after checking the score and image information associated with the score on the display 106a. Therefore, each of the multiple frequency spectra corresponding to each of the part of the multiple driving times can be appropriately set as normal data or abnormal data.

[0170] The information processing device 10 causes the display control unit 14 to display the part of the multiple driving times received by the receiving unit 13 on the information display selection screen 250. This allows the user to check the part of the multiple driving times that he or she has input, and therefore allows the user to reliably set each of the multiple frequency spectra corresponding to each of the part of the multiple driving times as normal data or abnormal data.

[0171] As described above, the information processing device 10 is provided with a display control unit 14 that displays image information on the information display selection screen 250 of the display 106a, and is also provided with an imaging device control unit 41 that acquires image information of the road surface R imaged by the imaging device 40, as described in FIG. 12, and the imaging device control unit 41 controls the imaging device 40 based on the detection signal.

[0172] This allows the information processing device 10 to determine the timing for acquiring image information of the road surface R based on the detection signal, and therefore allows efficient acquisition of image information of the road surface R. Furthermore, the user can accurately determine abnormalities in the road surface R by checking the image information on the information display selection screen 250. That is, the user can efficiently and accurately determine abnormalities in the road surface R using the information processing device 10 according to this embodiment.

[0173] The imaging device control unit 41 controls the imaging device 40 based on a score indicating the possibility of an abnormality in the road surface R that is determined based on the detection signal.

[0174] This allows the information processing device 10 to efficiently acquire image information of the road surface R when the possibility of an abnormality in the road surface R is high based on the score.

[0175] The display control unit 14 displays the score on the information display selection screen 250. This allows the user to check the score and the image information on the information display selection screen 250 and thus accurately determine whether there is an abnormality in the road surface R.

[0176] The display control unit 14 causes the image information to be displayed in association with the score on the information display selection screen 250. This allows the user to check the score and the image information in association with each other on the information display selection screen 250, thereby enabling the user to accurately determine an abnormality in the road surface R.

[0177] Fig. 19 is a conceptual diagram showing an example of a model information management table according to the present embodiment. As described in step S34 of Fig. 14, a model information management DB 1005 including a model information management table as shown in Fig. 19 is created in the storage unit 1000.

[0178] In the model information management table, the storage / readout unit 19 stores and manages a plurality of pieces of running time data, detection signal data, frequency data, and score data in association with each other for each associated ID.

[0179] Then, the storage / readout unit 19 stores and updates the detection signals and frequency data associated with each of the part of the driving times among the plurality of driving times accepted by the acceptance unit 13.

[0180] In the example of Fig. 19, as model information of the related ID "R001", the detection signals, frequency data, and score data corresponding to each of the running time data 1105 to 1207 received by the reception unit 13 described in Fig. 17 are associated with each other and stored and managed. This allows the detection signals, frequency data, and score data corresponding to the running times 1105 to 1207, which are part of the running times 1001 to 1230, to be properly stored as normal data.

[0181] In addition, the model information management table may store and manage a plurality of detection signals, frequency data, and score data in chronological order in association with each other for each associated ID, without storing the running time data. Also, without storing the frequency data and score data in the model information management table, the processing of steps S154 and S155 in FIG. 9 may be performed again based on the detection signals stored in the model information management table, to extract the frequency data and calculate the score data.

[0182] As described above, the information processing device 10 includes a storage / reading unit 19 that stores in the memory unit 1000 each of the frequency spectra associated with each of the plurality of driving times received by the receiving unit 13.

[0183] This makes it possible to appropriately store each of the plurality of frequency spectra corresponding to each of the plurality of driving times as normal data or abnormal data.

[0184] As described in FIG. 9, the information processing device 10 includes a score calculation unit 175 that determines a score based on a plurality of frequency spectra stored in the memory unit 1000 and a frequency spectrum indicating characteristics of the detection signal acquired by the detection device communication unit 12.

[0185] Here, as described with reference to FIG. 19, the multiple frequency spectra stored in the storage unit 1000 are updated, so that the information processing device 10 can determine the score indicating the possibility of an abnormality in the road surface R with high accuracy.

[0186] Fig. 20 is a diagram showing an example of an information display selection screen displayed on an information processing device according to a first modified example of this embodiment. Fig. 21 is a diagram showing an example of image information displayed on the display selection screen according to the first modified example of this embodiment.

[0187] In the information display selection screen 250, similarly to FIG. 17, the frequency spectrogram, the score data, and the user operation history data are displayed in a state in which the user can check them consecutively in association with the driving time data. Also, the image data is displayed in a state in which the user can check them in association with the scores of the maximum values. In the example of FIG. 20, since there are two maximum values ​​of the score, the image data A and B are displayed in association with the scores of the two maximum values. Also, the image data A and B include image data A1 and B1 of the road surface R on the traveling direction side of the vehicle 70 captured by the first imaging device 40A, and image data A2 and B2 of the road surface R behind the vehicle 70 captured from the vertical direction by the second imaging device 40B.

[0188] That is, the display control unit 14 displays multiple scores and image information on the information display selection screen 250 of the display 106a, and also displays each of the multiple image information on the information display selection screen 250 in correspondence with each of the multiple scores.

[0189] 20 shows an example of selecting abnormal data from data of driving times 801 to 900. Looking at the scores as an example of score data, it can be seen that the values ​​are high around driving time 840 and after driving time 865. If the system automatically sets "points with high scores are normal", these two sections may be selected as abnormal data.

[0190] However, looking at the frequency data just before the driving time 840, it can be seen that the data is interrupted for a moment. It can also be seen that the frequency data values ​​are always the same around the driving time 840. In other words, since the score indicating the change in frequency data has increased due to the interruption of the frequency data, it is considered that it is unlikely that an abnormality in the road surface R has occurred.

[0191] On the other hand, looking at the frequency data after driving time 865, it can be seen that there is an abnormal vibration in the low range, and it is highly likely that some abnormality has occurred in the road surface R. From this, the user can appropriately determine that the data from driving times 865 to 900, which is part of driving time counts 801 to 900, is more suitable as abnormal data than the data around driving time 840.

[0192] Furthermore, looking at the user operation history immediately prior to driving time 840, it can be seen that the power was turned OFF and then ON. The high score immediately after this is thought to be due to the influence of the engine warming up. On the other hand, even though there is no sign of any particular operation by the user from driving time 865 onwards, the frequency data shows abnormal vibrations in the low range, making it highly likely that some kind of abnormality has occurred in the road surface R. From this, the user can more appropriately determine that the data from driving times 865 to 900, which is part of driving times 801 to 900, is more suitable as abnormal data than the data around driving time 840.

[0193] Then, by comparing the condition of the road surface R shown in the image data corresponding to the maximum score around driving time 840 with the condition of the road surface R shown in the image data corresponding to the maximum score from driving time 865 onwards, the user can confirm from the image data that the data for driving times 865-900, which is part of driving times 801-900, is suitable as abnormal data.

[0194] That is, by checking the score and the image information associated with the score, it is possible to accurately determine whether or not there is an abnormality in the road surface R.

[0195] Although an example using the travel time has been described with reference to FIG. 20, the same applies when the travel distance is used instead of the travel time.

[0196] As described above, the display control unit 14 displays multiple scores and image information on the information display selection screen 250, and also displays each of the multiple image information on the information display selection screen 250 in correspondence with each of the multiple scores.

[0197] This allows the user to accurately determine abnormalities in the road surface R for each of the multiple scores by checking each of the multiple image information in association with each of the multiple scores.

[0198] The display control unit 14 displays multiple running times on the information display selection screen 250, and also displays each of the multiple scores and each of the multiple image information on the information display selection screen 250 in correspondence with each of the multiple running times.

[0199] This allows the user to accurately determine abnormalities in the road surface R for each of the multiple scores by checking each of the multiple driving times and each of the multiple image information in association with each of the multiple scores.

[0200] FIG. 22 is a diagram showing an example of an information display selection screen displayed on an information processing device according to a second modified example of this embodiment.

[0201] On the information display selection screen 250, the score data is associated with the driving time data and is displayed in a state where the user can check multiple consecutive scores. Also, similar to FIG. 1920, image data A and B are displayed in association with the scores of the two maximum values, and the image data A and B include image data A1 and B1 of the road surface R in the traveling direction of the vehicle 70 captured by the first image capture device 40A, and image data A2 and B2 of the road surface R behind the vehicle 70 captured from the perpendicular direction by the second image capture device 40B.

[0202] FIG. 22 shows an example in which a plurality of abnormal data are selected from among travel times 801 to 900. Looking at the scores as an example of score data, we can see that there are two high scores between driving times 801 and 900. If the system automatically sets "high score areas as normal," these two sections may be selected as abnormal data.

[0203] However, in some cases, by comparing the image data corresponding to the scores of these two locations, it may be possible to determine that they have completely different trends. In this case, if the two different abnormal data are called Abnormal 1 and Abnormal 2, respectively, the user can determine that each is separate abnormal data.

[0204] Although an example using the travel time has been described in FIG. 22, the same applies when the travel distance is used instead of the travel time.

[0205] FIG. 23 is a diagram showing a railway vehicle according to a third modified example of the present embodiment.

[0206] Railway vehicle 70R is a modified example of vehicle 70 shown in FIG. 2, and includes control device 70A, wheels 50w, detection device 30, and imaging device 40 arranged to capture an image of track r.

[0207] The railcar 70R is an example of a moving body that moves while in contact with a track r, which is an example of a target part. The wheels 50w are an example of a moving member that moves while in contact with the track r. The detection device 30 detects a physical quantity that changes as the wheels 50w of the railcar 70R move while in contact with the track r. The imaging device 40 is an example of an imaging unit that captures a moving or still image of the track r.

[0208] FIG. 24 is a conceptual diagram showing an example of a condition information management table according to the third modified example.

[0209] In the storage unit 1000 shown in FIG. 5, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

[0210] The condition information management table shown in FIG. 24 is for managing processing information related to the operation of the railway vehicle 70R for each operation performed by the railway vehicle 70R. In the condition information management table, condition information in which processing information is associated with each condition ID is stored and managed. The condition ID is identification information for identifying the condition information including the processing information. The processing information is information defined for each type of operation of the railway vehicle 70R. As shown in FIG. 24, the processing information includes information on the name of the line on which the railway vehicle 70R runs, the type of material, etc. of the track r on which the railway vehicle 70R runs, and the type of material, etc. of the wheels 50w of the railway vehicle 70R. The type of material, etc. of the track r is an example of the type of the target part, and the type of material, etc. of the wheels 50w is an example of the type of the moving member.

[0211] Items included in the processing information may further include information indicating the user's operation history information for the railcar 70R, the start date and time of travel, the travel time (an example of the travel time of the railcar 70R), and the travel speed of the railcar 70R. Furthermore, the travel distance (an example of the travel distance of the railcar 70R) may be included, or the travel distance may be included instead of the travel time. Travel information including the travel time or the travel distance is an example of travel information.

[0212] The condition information management table further stores and manages related IDs for identifying related operations (processes) among the operations of the railway vehicle 70R in association with each other. The same related ID is assigned to processing information indicating related processes among the processing information included in the condition information management table. In the example of FIG. 24, the same related ID "R001" is assigned to processing information identified by the condition ID "A000001" and the condition ID "A00003". Here, the related processes to which the related ID is assigned are, for example, processes having the same track type and wheel type but different line names.

[0213] FIG. 25 is a diagram showing an example of a display selection screen displayed on an information processing device according to the third modified example.

[0214] Fig. 25 is a diagram showing an example of an information display selection screen displayed on the information processing device, corresponding to step S334 and step S335 of the flowchart shown in Fig. 16. The information display selection screen 250 shown in Fig. 25 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

[0215] On the information display selection screen 250, the driving time data related to the related data selected by the selection unit 18 is displayed in order of driving time so that the user can check it.

[0216] Furthermore, on the information display selection screen 250, a frequency spectrogram as an example of a feature quantity related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time are displayed in a manner that allows the user to confirm multiple items in association with the running time data. Also, image data A of the track r is displayed in association with the maximum score so that the user can confirm the image data.

[0217] That is, the display control unit 14 displays multiple driving times, frequency spectra, operation history information, and scores on the information display selection screen 250 of the display 106a, and also displays each of the multiple frequency spectra, each of the multiple operation history information, each of the multiple scores, and image information in correspondence with each of the multiple driving times on the information display selection screen 250 (an example of a display step).

[0218] Furthermore, the display control unit 14 associates the image information with a maximum score among the multiple scores and displays it on the information display selection screen 250. Here, the maximum score is a score equal to or greater than the threshold value described in step S21 of FIG.

[0219] Furthermore, the information display selection screen 250 includes an input area 222 for inputting a driving time section as a specific section, an "OK" button 251 that is pressed when performing the section selection process, and a "CANCEL" button 253 that is pressed when canceling the section selection process.

[0220] As described above, the information processing device 10 includes a display control unit 14 that associates a score indicating the possibility of an abnormality in the track r, which is determined based on a detection signal, with image information and displays the associated information on the information display selection screen 250 of the display 106a.

[0221] As a result, by checking the image information in association with the score, the user can determine the abnormality of the track r with higher accuracy than when checking only the score. Also, the user can determine the abnormality of the track r with higher efficiency than when checking only the image information. That is, the user can determine the abnormality of the track r efficiently and accurately by using the information processing device 10 according to this embodiment.

[0222] FIG. 26 is a diagram showing a railway vehicle according to a fourth modified example of the present embodiment.

[0223] 26 is a modified example of the railway vehicle 70R shown in FIG. 23, and includes a control device 70A, a pantograph 50P, a detection device 30, and an imaging device 40 arranged to capture an image of the overhead wires W.

[0224] The railway vehicle 70R is an example of a moving body that moves while being in contact with the overhead wire W, which is an example of a target portion. The pantograph 50P is an example of a moving member that moves while being in contact with the overhead wire W. The detection device 30 detects a physical quantity that changes in response to the movement of the pantograph 50P of the railway vehicle 70R while being in contact with the overhead wire W. The imaging device 40 is an example of an imaging unit that captures a moving or still image of the overhead wire W.

[0225] FIG. 27 is a conceptual diagram showing an example of a condition information management table according to the fourth modified example.

[0226] In the storage unit 1000 shown in FIG. 5, the condition information management DB 1001 described in step S13 of FIG. 7 is configured by a condition information management table as shown in FIG.

[0227] The condition information management table shown in FIG. 27 is for managing processing information related to the operation of the railway vehicle 70R for each operation performed by the railway vehicle 70R. The condition information management table stores and manages condition information in which processing information is associated with each condition ID. The condition ID is identification information for identifying the condition information including the processing information. The processing information is information defined for each type of operation of the railway vehicle 70R. As shown in FIG. 24, the processing information includes information on the name of the line on which the railway vehicle 70R runs, the type of material, etc. of the overhead wires W, and the type of material, etc. of the pantograph 50P of the railway vehicle 70R. The type of material, etc. of the overhead wires W is an example of a type of target part, and the type of material, etc. of the pantograph 50P is an example of a type of moving member.

[0228] Items included in the processing information may further include information indicating the user's operation history information for the railcar 70R, the start date and time of travel, the travel time (an example of the travel time of the railcar 70R), and the travel speed of the railcar 70R. Furthermore, the travel distance (an example of the travel distance of the railcar 70R) may be included, or the travel distance may be included instead of the travel time. Travel information including the travel time or the travel distance is an example of travel information.

[0229] The condition information management table further stores and manages related IDs for identifying related operations (processes) among the operations performed by the railway vehicle 70R in association with each other. The same related ID is assigned to processing information indicating related processes among the processing information included in the condition information management table. In the example of FIG. 27, the same related ID "R001" is assigned to processing information identified by the condition ID "A000001" and the condition ID "A00003". Here, the related processes to which the related ID is assigned are, for example, processes having the same overhead line type and pantograph type but different line names.

[0230] FIG. 28 is a diagram showing an example of a display selection screen displayed on an information processing device according to the fourth modified example.

[0231] Fig. 28 is a diagram showing an example of an information display selection screen displayed on the information processing device, corresponding to step S334 and step S335 of the flowchart shown in Fig. 16. The information display selection screen 250 shown in Fig. 28 is a display screen for displaying the score of the detection signal related to the signal data selected by the selection unit 18 and for selecting a specific section of the detection signal.

[0232] On the information display selection screen 250, the driving time data related to the related data selected by the selection unit 18 is displayed in order of driving time so that the user can check it.

[0233] Furthermore, on the information display selection screen 250, a frequency spectrogram as an example of a feature quantity related to the related data selected by the selection unit 18, score data, and user operation history data as an example of processing information data for each running time are displayed in a manner that allows the user to check them consecutively, each associated with running time data. Also, image data A of the overhead wire W is displayed in a manner that allows the user to check them, associated with the maximum score.

[0234] That is, the display control unit 14 displays multiple driving times, frequency spectra, operation history information, and scores on the information display selection screen 250 of the display 106a, and also displays each of the multiple frequency spectra, each of the multiple operation history information, each of the multiple scores, and image information in correspondence with each of the multiple driving times on the information display selection screen 250 (an example of a display step).

[0235] Furthermore, the display control unit 14 associates the image information with a maximum score among the multiple scores and displays it on the information display selection screen 250. Here, the maximum score is a score equal to or greater than the threshold value described in step S21 of FIG.

[0236] Furthermore, the information display selection screen 250 includes an input area 222 for inputting a driving time section as a specific section, an "OK" button 251 that is pressed when performing the section selection process, and a "CANCEL" button 253 that is pressed when canceling the section selection process.

[0237] As described above, the information processing device 10 is equipped with a display control unit 14 that associates a score indicating the possibility of an abnormality in the overhead line W, which is determined based on the detection signal, with image information of the overhead line W and displays the image information on the information display selection screen 250 of the display 106a.

[0238] As a result, by checking the image information in association with the score, the user can determine abnormalities in the overhead line W with higher accuracy than when checking only the score. Also, the user can determine abnormalities in the overhead line W with higher efficiency than when checking only the image information. That is, the user can determine abnormalities in the overhead line W efficiently and accurately using the information processing device 10 according to this embodiment.

[0239] ●Summary● As described above, the information processing device 10 according to one embodiment of the present invention includes a detection device communication unit 12 (an example of a detection information acquisition unit) that acquires detection signals (an example of detection information) of physical quantities that change as moving bodies such as vehicles 70 and railway vehicles 70R move in contact with target parts such as the road surface R, railroad tracks r, and overhead wires W, an imaging device control unit 41 (an example of an image information acquisition unit) that acquires image information of the road surface R, etc., captured by the imaging device 40 (an example of an imaging unit), and a display control unit 14 that displays the image information on the display 106a (an example of a display unit), and the imaging device control unit 41 controls the imaging device 40 based on the detection signals.

[0240] This allows the information processing device 10 to determine the timing for acquiring image information of the road surface R, etc., based on the detection signal, and therefore allows efficient acquisition of image information of the road surface R, etc. Also, the user can accurately determine abnormalities in the road surface R, etc., by checking the image information on the display 106a. That is, the user can efficiently and accurately determine abnormalities in the road surface R, etc., by using the information processing device 10 according to this embodiment.

[0241] The imaging device control unit 41 controls the imaging device 40 based on a score (an example of possibility information) indicating the possibility of an abnormality such as a road surface R determined based on the detection signal.

[0242] This allows the information processing device 10 to efficiently acquire image information of the road surface R or the like when the possibility of an abnormality in the road surface R or the like is high based on the score.

[0243] The display control unit 14 causes the display 106a to display the score. This allows the user to check the score and image information on the display 106a, thereby enabling the user to efficiently and accurately determine abnormalities such as road surface R.

[0244] The display control unit 14 causes the display 106a to display the image information in association with the score. This allows the user to check the score and the image information in association with each other on the display 106a, thereby enabling the user to efficiently and accurately determine abnormalities such as road surface R.

[0245] The information processing device 10 includes a determination unit 21 (an example of an abnormality determination unit) that determines an abnormality in the road surface R, etc., based on the score and image information. Specifically, the determination unit 21 determines an abnormality in the road surface R, etc., based on the score and a second score (an example of second possibility information) indicating the possibility of an abnormality in the road surface R, etc., determined based on the image information.

[0246] This enables the information processing device 10 to determine abnormalities such as road surface R efficiently and accurately.

[0247] ●Additional Information● The functions of each embodiment can be realized by a computer-executable program written in a legacy programming language such as assembler, C, C++, C#, Java (registered trademark), or an object-oriented programming language, and the program for executing the functions of each embodiment can be distributed through telecommunications lines.

[0248] In addition, the programs for executing the functions of each embodiment can also be stored and distributed on device-readable recording media such as ROM, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), flash memory, flexible disk, CD (Compact Disc)-ROM, CD-RW (Re-Writable), DVD-ROM, DVD-RAM, DVD-RW, Blu-ray disc, SD card, and MO (Magneto-Optical disc).

[0249] Furthermore, some or all of the functions of each embodiment can be implemented on a programmable device (PD) such as an FPGA (Field Programmable Gate Array), or can be implemented as an ASIC, and can be distributed on a recording medium as circuit configuration data (bitstream data) to be downloaded to the PD to realize the functions of each embodiment on the PD, or data described in HDL (Hardware Description Language), VHDL (Very High Speed ​​Integrated Circuits Hardware Description Language), Verilog-HDL, or the like for generating the circuit configuration data.

[0250] So far, an information processing device, an information processing method, and a program according to one embodiment of the present invention have been described. However, the present invention is not limited to the above-described embodiment, and can be modified within the scope of what a person skilled in the art can conceive, such as adding, modifying, or deleting other embodiments, and any aspect is within the scope of the present invention as long as it achieves the functions and effects of the present invention. [Explanation of symbols]

[0251] 1A, 1C Anomaly Detection System 5. Information Processing Systems 10. Information processing device 11 Transmitting and receiving unit (an example of a processing information acquiring unit) 12 Detection device communication unit (an example of a detection information acquisition unit) 18 Selection section 19 Memory / readout unit (an example of a memory control unit) 21 Judgment unit (an example of an abnormality judgment unit) 30 Detection Device 40 Imaging device (an example of an imaging unit) 41 Imaging device control unit (an example of an image information acquisition unit) 70 Vehicle (an example of a moving object) 70R Railway vehicle (an example of a moving object) R Road surface (example of target area) r Railway track (example of target area) W Overhead wire (example of target area) 106a Display (an example of a display unit) 173 Feature Extraction Unit 175 Score calculation unit (an example of a possibility information determination unit) 200 Output signal selection screen 250 Information display selection screen 1000 storage section [Prior art documents] [Patent documents]

[0252] [Patent Document 1] Patent No. 5014464

Claims

1. a detection information acquiring unit that acquires detection information related to a physical quantity that changes as a moving object moves in contact with a target portion; a possibility information determination unit that calculates and determines possibility information indicating a possibility of an abnormality in the target part from a feature amount that indicates a feature of the detection information; an image information acquisition unit that acquires first image information of the target portion captured by a first imaging device disposed on the moving body and second image information of the target portion captured by a second imaging device disposed on the moving body; a display control unit that, when the possibility information satisfies a predetermined condition, causes a display unit to display second possibility information indicating a possibility of an abnormality in the target part, the second possibility information being calculated and determined based on the first image information and the second image information acquired by the image information acquisition unit, in association with the possibility information; and An information processing device comprising:

2. The information processing device according to claim 1 , wherein the display control unit causes the display unit to display the possibility information in association with the first image information and the second image information for each travel time or travel distance related to the movement of the moving object.

3. 3. The information processing device according to claim 2, wherein the display control unit causes the display unit to display a plurality of pieces of the possibility information calculated and determined for each of the driving times or the driving distances, and each piece of image information corresponding to each of the plurality of pieces of the possibility information and forming a pair of the first image information and the second image information.

4. 3. The information processing device according to claim 1, wherein the first imaging device is positioned to image the target portion on a side in the direction of travel of the moving body, and the second imaging device is positioned to image the target portion behind the moving body from a vertical direction.

5. The display control unit is The information processing device according to claim 3 , wherein the first image information and the second image information are displayed on the display unit in association with the possibility information that is equal to or greater than a threshold value representing the specified condition, among the calculated plurality of possibility information.

6. The image information acquisition unit The information processing apparatus according to claim 1 , further comprising: a control unit configured to control the first imaging device and the second imaging device based on the possibility information determined based on the detection information.

7. The information processing device further comprises: The information processing apparatus according to claim 1 , further comprising an abnormality determination unit that determines an abnormality in the target portion based on the possibility information, the first image information, and the second image information.

8. The information processing device according to claim 7 , wherein the abnormality determination unit determines an abnormality in the target portion based on the possibility information and the second possibility information.

9. a detection information acquiring step of acquiring detection information related to a physical quantity that changes as a result of a moving object moving in contact with a target portion; a possibility information determination step of calculating and determining possibility information indicating a possibility of an abnormality in the target part from a feature amount indicating a feature of the detection information; an image information acquisition step of acquiring first image information of the target portion captured by a first imaging device arranged on the moving body and second image information of the target portion captured by a second imaging device arranged on the moving body; a display control step of causing a display unit to display, when the possibility information satisfies a predetermined condition, second possibility information indicating a possibility of an abnormality in the target part, which is calculated and determined based on the first image information and the second image information acquired by the image information acquisition step, in association with the possibility information, and the first image information and the second image information; An information processing method comprising the steps of:

10. On the computer, a detection information acquiring step of acquiring detection information related to a physical quantity that changes as a result of a moving object moving in contact with a target portion; a possibility information determination step of calculating and determining possibility information indicating a possibility of an abnormality in the target part from a feature amount indicating a feature of the detection information; an image information acquisition step of acquiring first image information of the target portion captured by a first imaging device arranged on the moving body and second image information of the target portion captured by a second imaging device arranged on the moving body; a display control step of causing a display unit to display, when the possibility information satisfies a predetermined condition, second possibility information indicating a possibility of an abnormality in the target part, which is calculated and determined based on the first image information and the second image information acquired by the image information acquisition step, in association with the possibility information, and the first image information and the second image information; A program for executing an information processing method comprising the steps of:

Images