Information output device, information output method and information output program

Abstract

To enable monitoring of a mobile body to be monitored to be achieved by an easier method.SOLUTION: An information output device receives reception radio wave information showing information about a reception radio wave being a wave received by a radio wave sensor from the radio wave sensor, receives photographic image information being information of an image photographed by a camera from the camera, determines whether the reception radio wave is a target radio wave on the basis of a determination condition for determining whether the reception radio wave is the target radio wave being a target radio wave of an output of the photographic image information, and the reception radio wave information, and outputs output information including target image information being the photographic image information received from the camera associated with the radio wave sensor that receives the target radio wave.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information output device, an information output method, and an information output program. [Background technology]

[0002] Police and security guards are tasked with monitoring moving objects, such as people (suspicious individuals) and vehicles exhibiting suspicious behavior. In recent years, however, it has become more difficult to obtain information about suspicious individuals due to the increasing commonplace appearance of criminals and the weakening of relationships with neighbors. Therefore, there is a need to detect moving objects using images captured by surveillance cameras and monitor their behavior.

[0003] However, it is difficult for a monitor to visually find a moving object to be monitored from the many images captured by many surveillance cameras.

[0004] There are methods for detecting people who meet certain conditions by using images captured by a surveillance camera, etc. For example, in the method described in Patent Document 1, a detection device detects people who are behaving suspiciously based on images input from an imaging device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2022 / 091235 Summary of the Invention [Problem to be solved by the invention]

[0006] However, when detecting a moving object to be monitored by image analysis as in Patent Document 1, the amount of processing required for the image analysis is large.

[0007] In view of the above-mentioned problems, the object of the present disclosure is to provide an information output device, an information output method, and an information output program that enable monitoring of a mobile object to be monitored in an easier manner. [Means for solving the problem]

[0008] In one aspect of the present disclosure, an information output device includes a radio wave information receiving unit that receives, from the radio wave sensor, received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving unit that receives, from the camera, captured image information, which is information about an image captured by the camera; a judgment unit that determines whether the received radio waves are target radio waves, which are radio waves that are the target of outputting the captured image information, based on judgment conditions for determining whether the received radio waves are the target radio waves, which are the target radio waves, and the received radio wave information; and an output unit that outputs output information including target image information, which is the captured image information received from the camera associated with the radio wave sensor that received the target radio waves.

[0009] In another aspect of the present disclosure, an information output method receives received radio wave information from a radio wave sensor indicating information about received radio waves, which are radio waves received by the radio wave sensor, receives captured image information from the camera, which is information about an image captured by a camera, determines whether the received radio waves are target radio waves, which are radio waves that are the target of outputting the captured image information, based on judgment conditions for determining whether the received radio waves are target radio waves, which are radio waves that are the target of outputting the captured image information, and the received radio wave information, and outputs output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio waves.

[0010] In another aspect of the present disclosure, the information output program causes a computer to realize a radio wave information receiving function that receives from the radio wave sensor received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving function that receives from the camera captured image information, which is information about an image captured by the camera; a judgment function that determines whether the received radio waves are target radio waves, which are radio waves that are the target of outputting the captured image information, based on judgment conditions for determining whether the received radio waves are the target radio waves, and the received radio wave information; and an output function that outputs output information including target image information, which is the captured image information received from the camera associated with the radio wave sensor that received the target radio waves. [Effects of the Invention]

[0011] According to the present disclosure, it becomes possible to monitor a moving object to be monitored in an easier manner. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of an information output device according to the present disclosure. [Figure 2] FIG. 10 is a diagram illustrating an example of an operation flow of the information output device of the present disclosure. [Figure 3] FIG. 1 is a diagram illustrating an example of the configuration of a system including an information output device according to the present disclosure. [Figure 4] FIG. 1 is a diagram illustrating a configuration example of an information output device according to the present disclosure. [Figure 5] FIG. 10 is a diagram illustrating an example of the arrangement of a camera and a radio wave sensor. [Figure 6] FIG. 10 is a diagram illustrating an example of a correspondence relationship between a camera and a radio wave sensor. [Figure 7] 10A and 10B are diagrams illustrating examples of images that the information output device of the present disclosure displays on a display unit. [Figure 8] FIG. 10 is a diagram illustrating an example of an operation flow of the information output device of the present disclosure. [Figure 9] FIG. 10 is a diagram illustrating an example of an operation flow of the information output device of the present disclosure. [Figure 10]FIG. 10 is a diagram illustrating an example of an operation flow of the information output device of the present disclosure. [Figure 11] FIG. 10 is a diagram illustrating an example of an operation flow of the information output device of the present disclosure. [Figure 12] FIG. 1 is a diagram illustrating an example of a hardware configuration according to each embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] [First embodiment] A first embodiment of the present disclosure will be described.

[0014] A specific example of the information output device 10 in the first embodiment is an information output device 20 in a second embodiment, which will be described later.

[0015] First, a configuration example of an information output device 10 will be described with reference to Fig. 1. Fig. 1 is a diagram showing a configuration example of an information output device 10. The information output device 10 includes a radio wave information receiving unit 11, an image information receiving unit 12, a determination unit 13, and an output unit 14.

[0016] The radio wave information receiver 11 receives received radio wave information from the radio wave sensor. The received radio wave information indicates information about the received radio wave. The received radio wave is a radio wave received by the radio wave sensor.

[0017] The image information receiving unit 12 receives captured image information from the camera. The captured image information is information about an image captured by the camera.

[0018] The determination unit 13 determines whether the received radio wave is a target radio wave based on the determination conditions and the received radio wave information. The target radio wave is a radio wave that is the target of the output of the captured image information. The determination conditions are conditions for determining whether the received radio wave is a target radio wave.

[0019] The output unit 14 outputs output information. The output information includes target image information. The target image information is captured image information received by the image information receiving unit 12 from a camera associated with the radio wave sensor that received the target radio wave.

[0020] Next, a description will be given of an example of the operation flow of the information output device 10. An example of the operation flow of the information output device 10 is shown in FIG.

[0021] The radio wave information receiving unit 11 receives received radio wave information from a radio wave sensor (step S101).

[0022] The image information receiving unit 12 receives captured image information from the camera (step S102).

[0023] The determination unit 13 determines whether the received radio wave is a target radio wave based on the determination conditions and the received radio wave information (step S103).

[0024] The output unit 14 outputs the output information (step S104). The output information includes the target image information.

[0025] As described above, in the first embodiment of the present disclosure, the information output device 10 includes a radio wave information receiving unit 11, an image information receiving unit 12, a determination unit 13, and an output unit 14. The radio wave information receiving unit 11 receives received radio wave information from a radio wave sensor. The received radio wave information indicates information about the received radio waves. The received radio waves are radio waves received by the radio wave sensor. The image information receiving unit 12 receives captured image information from a camera. The captured image information is information about an image captured by the camera. The determination unit 13 determines whether the received radio waves are target radio waves based on the determination conditions and the received radio wave information. The target radio waves are radio waves that are the target of the output of the captured image information. The determination conditions are conditions for determining whether the received radio waves are target radio waves. The output unit 14 outputs output information. The output information includes target image information. The target image information is captured image information received by the image information receiving unit 12 from a camera associated with the radio wave sensor that received the target radio waves.

[0026] As a result, the information output device 10 determines whether the received radio waves are target radio waves and outputs output information including target image information for the radio waves determined to be target radio waves. As a result, image information of a mobile object that may be the target of monitoring is output, making it possible for a monitor or a device to which the output information is output to easily recognize and monitor the mobile object based on the output image information. Furthermore, because output information including target image information for the radio waves determined to be target radio waves is output, the amount of processing required for monitoring can be reduced compared to when the mobile object is detected by image processing. Therefore, monitoring of the mobile object that is the target of monitoring can be achieved in an easier manner.

[0027] [Second embodiment] Next, an information output device 20 according to a second embodiment of the present disclosure will be described. Note that a specific example of the information output device 10 according to the first embodiment is the information output device 20 according to the second embodiment.

[0028] 3 shows an example of the configuration of a system including an information output device 20 of this embodiment. The information output device 20 is connected to radio wave sensors 50-i (i is an integer between 1 and N inclusive). The information output device 20 is also connected to cameras 60-j (j is an integer between 1 and M inclusive). The information output device 20 is also connected to a display means 70 inclusive. The radio wave sensors 50-i, cameras 60-j, and information output device 20 are included in a monitoring system 80.

[0029] The radio wave sensor 50-i receives radio waves. The radio wave sensor 50-i also transmits received radio wave information to the information output device 20. The received radio wave information is radio wave information about the received radio waves. The received radio waves are radio waves received by the radio wave sensor 50-i. The radio wave information is information about radio waves.

[0030] The radio wave sensor 50-i, for example, attempts to receive radio waves at predetermined time intervals. The radio wave sensor 50-i may be capable of receiving radio waves of a specific frequency, or may be capable of receiving radio waves of two or more frequency bands. The radio wave sensor 50-i may attempt to receive radio waves while changing the receiving frequency band at predetermined time intervals.

[0031] The radio wave information may include, for example, waveform data indicating the signal waveform of the radio waves. The radio wave information may also include, for example, radio wave identification information. Radio wave identification information is information that can identify an individual source that emits radio waves. The radio wave identification information may include, for example, an IMEI (International Mobile Equipment Identity), an IMSI (International Mobile Subscriber Identity), a MAC (Media Access Control) address, etc. If the source is a drone, the radio wave identification information may include a remote ID (identification) that is identification information for the drone.

[0032] The radio wave information may also include information regarding radio waves, such as frequency, modulation method, and received signal level at the radio wave sensor 50-i. For example, the radio wave information may include information such as SS-RSRQ (Reference Signal Received Quality).

[0033] The radio wave information may also include radio wave characteristic information, which is information indicating characteristics of the signal waveform of the radio wave.

[0034] Although devices that emit radio waves are manufactured to meet predetermined communication standards, slight individual differences exist due to variations in analog circuits, etc. Therefore, radio waves have features that can be identified based on the individual differences of the devices that emit them. Radio wave feature information may be, for example, a feature based on modulation error obtained by modulation analysis or a feature based on the time waveform of the radio waves. Furthermore, for example, the radio wave feature information may be, but is not limited to, a feature indicating one or more of the transients (rise and fall) of the received signal, the power spectral density of the preamble portion, the error vector magnitude (EVM), the IQ phase error, the IQ imbalance amount, the frequency offset, and the symbol clock error. Radio wave features may also be extracted by machine learning.

[0035] The received radio wave information may further include information about the time when the radio wave was received by the radio wave sensor 50-i.

[0036] The camera 60-j captures images. The camera 60-j also transmits captured image information to the information output device 20. The captured image information is information about images captured by the camera 60-j. The camera 60-j captures images, for example, at predetermined time intervals. The captured image information may be information about still images or information about moving images (video). The camera 60-j may be, for example, a surveillance camera installed in a city. The camera 60-j may also be a security camera with a lower resolution than a surveillance camera.

[0037] The captured image information may further include information about the time when the image was captured by the camera 60-j.

[0038] The display means 70 is a man-machine interface such as a display serving as an output device. The display means 70 displays an image. In this embodiment, the information output device 20 outputs output information to the display means 70. However, the output destination of the output information is arbitrary. The information output device 20 may output the output information to an output destination other than the display means 70.

[0039] 4 shows an example of the configuration of the information output device 20. The information output device 20 includes a radio wave information receiving section 21, an image information receiving section 22, a determining section 23, and an output section 24.

[0040] The radio wave information receiving unit 21 receives received radio wave information from the radio wave sensors 50-1 to 50-N. Information relating to the position of the radio wave sensor 50-i is stored in advance in a storage means (not shown) inside or outside the information output device 20.

[0041] The image information receiving unit 22 receives captured image information from the cameras 60-1 to 60-M. The captured image information is information about an image captured by the camera 60-j. Information about the position of the camera 60-j is stored in advance in a storage means.

[0042] Camera 60-j is associated with one or more of radio wave sensors 50-1 to 50-N. Information on the correspondence between the cameras and the radio wave sensors is stored, for example, in storage means. Two or more radio wave sensors may be associated with one camera. Also, two or more cameras may be associated with one radio wave sensor.

[0043] A camera is associated with a radio wave sensor in the vicinity of the camera. In a pair of a camera and a radio wave sensor associated with the camera, the camera's shooting area and the radio wave sensor's receiving area at least partially overlap. The shooting area is the area captured by the camera. The receiving area is the area where radio waves are received by the radio wave sensor. In other words, in the correspondence between cameras and radio wave sensors, each camera is associated with a radio wave sensor whose receiving area at least partially overlaps with at least a portion of the camera's shooting area.

[0044] For example, assume that cameras 60-1 to 60-5 and radio wave sensors 50-1 to 50-5 are arranged in a field as shown in Fig. 5. Fig. 5 is a diagram showing an example of the arrangement of the cameras and radio wave sensors. In Fig. 5, open circles indicate radio wave sensors. Black circles indicate cameras. Broken circles indicate the receiving areas of the radio wave sensors. Note that the shape of the receiving areas of the radio wave sensors does not have to be circular. For example, the radio wave sensors may be directional. A sector indicates the capturing area of ​​the cameras.

[0045] When cameras and radio wave sensors are arranged as in the example shown in Fig. 5, the correspondence between the cameras and radio wave sensors is as shown in Fig. 6. Fig. 6 is a diagram showing the correspondence between the cameras and radio wave sensors. In the correspondence table shown in Fig. 6, a unit consisting of a camera and a radio wave sensor shown in one row may hereinafter be referred to as a "set." In the example shown in Fig. 6, there are six sets.

[0046] The judgment unit 23 judges whether the radio waves received by the radio wave sensor 50-i (received radio waves) are target radio waves based on the judgment conditions and the received radio wave information. The target radio waves are radio waves that are the target of the output of captured image information by the output unit 24. The judgment conditions are conditions for determining whether the received radio waves are target radio waves. If the judgment conditions are met, the judgment unit 23 judges that the received radio waves are target radio waves.

[0047] The target radio waves may be, for example, radio waves emitted from a source that moves in accordance with the movement of a mobile object that is the target of monitoring. The mobile object that is the target of monitoring may hereinafter be referred to as a target mobile object. The target mobile object may be a person or may not be a person. For example, the target mobile object may be a vehicle. Furthermore, the source of the radio waves may be a wireless communication terminal, or may be a source of radio waves that are not radio waves transmitted by wireless communication.

[0048] For example, the target moving object may be a person (suspicious person) behaving suspiciously. In this case, the determination unit 23 may determine, as the target radio wave, a radio wave transmitted from a source that is presumed to be carried by the person behaving suspiciously.

[0049] For example, if the target moving body is a person who has been in the same place for a long time or who has repeatedly appeared in the same place, the target radio waves may be radio waves emitted from a source that has been in the same place for a long time or that has repeatedly appeared in the same place.

[0050] For example, the determination unit 23 may determine that a received radio wave is a target radio wave if a radio wave presumed to be from the same source as the received radio wave is received more frequently than a predetermined frequency by the radio wave sensor that received the received radio wave. In this case, the determination condition includes that the reception frequency of the received radio wave at the radio wave sensor that received the received radio wave is higher than a predetermined frequency. Note that the reception frequency is the frequency at which a radio wave presumed to be from the same source as the received radio wave is received by a radio wave sensor. Furthermore, the reception frequency at a radio wave sensor may be the number of times that a radio wave presumed to be from the same source as the received radio wave is received by the radio wave sensor within a predetermined period.

[0051] Furthermore, the determination unit 23 may determine that a received radio wave is a target radio wave when a radio wave that is presumed to be from the same source as the received radio wave is received a predetermined number of times or more consecutively by the radio wave sensor that received the received radio wave. In this case, the determination condition includes whether the number of consecutive receptions of the received radio wave by the radio wave sensor that received the received radio wave is a predetermined number or more. The number of consecutive receptions refers to the number of times that radio waves that are presumed to be from the same source as the received radio wave are received consecutively by one radio wave sensor.

[0052] More specifically, the radio wave information receiving unit 21 stores the received radio wave information received from the radio wave sensor 50-i in the storage means as radio wave information of the radio waves received by the radio wave sensor 50-i. Then, the determining unit 23 determines whether the received radio wave indicated by the received radio wave information received from the radio wave sensor 50-i is a target radio wave, based on the radio wave information of the radio waves received by the radio wave sensor during a predetermined period stored in the storage means. The predetermined period may be, for example, a period from a predetermined time before the time the received radio wave is received to the time the received radio wave is received.

[0053] Furthermore, when calculating the reception frequency and the number of consecutive receptions, the determination unit 23 may include the number of receptions at a single radio wave sensor in the number of receptions at radio wave sensors nearby the single radio wave sensor. In this case, information about the nearby radio wave sensors for each of the radio wave sensors is stored in, for example, storage means.

[0054] If the received radio wave information includes radio wave identification information, the determination unit 23 may determine whether radio waves received by the radio wave sensor at a different time are the same as the received radio wave based on the radio wave identification information. If the received radio wave information includes waveform data, the determination unit 23 may determine whether radio waves received by the radio wave sensor at a different time are the same as the received radio wave based on the waveform data. If the received radio wave information includes radio wave characteristic information, the determination unit 23 may determine whether radio waves received by the radio wave sensor at a different time are the same as the received radio wave based on the radio wave characteristic information. If the received radio wave information includes waveform data, the determination unit 23 may determine whether radio waves received by the radio wave sensor at a different time are the same as the received radio wave based on the radio wave characteristic information extracted from the waveform data.

[0055] When the determining unit 23 extracts radio wave characteristic information from waveform data, an extraction rule indicating which characteristic quantity is to be extracted from the waveform data as radio wave characteristic information is determined in advance.

[0056] Furthermore, the determination unit 23 may use machine learning to extract the radio wave characteristic information. The determination unit 23 extracts the radio wave characteristic information from the waveform data using an extraction model generated by a learning means. The extraction model is a model that extracts the radio wave characteristic information from the waveform data. The extraction model is generated, for example, from waveform data of radio waves output from various transmission sources. The input to the extraction model is waveform data included in the received radio wave information received by the radio wave information receiving unit 21. The output from the extraction model is the radio wave characteristic information extracted from the waveform data.

[0057] Furthermore, for example, the determination unit 23 may determine that a received radio wave transmitted from a specific transmission source is the target radio wave. In this case, radio wave information of the specific transmission source is stored in advance in the storage means as verification radio wave information. The specific transmission source may be designated as an individual transmission source. For example, the specific transmission source may be a transmission source possessed by a specific person. Note that the verification radio wave information may be configurable from a device external to the information output device 20.

[0058] Furthermore, a specific transmission source may be designated as a transmission source having specific characteristics. A transmission source having specific characteristics may be, for example, a specific model or a transmission source for a specific purpose. A specific model may be, for example, a prepaid mobile phone. For example, the determination unit 23 may determine that a received radio wave that matches the radio wave characteristic information of a specific model is the target radio wave. In this case, the radio wave characteristic information of the specific model is stored in advance in the storage means as matching radio wave information.

[0059] Furthermore, the transmission source having a specific characteristic may be, for example, a smartphone using a specific application. For example, if the signal waveform of radio waves when a specific application is being used has a characteristic, the verification radio wave information may include information on the characteristic as radio wave characteristic information.

[0060] The determination unit 23 can determine whether the received radio wave is a radio wave transmitted from a specific transmission source in the following manner.

[0061] If the received radio wave information includes radio wave identification information, the judgment unit 23 may judge whether the received radio wave is a radio wave transmitted from a specific source based on the radio wave identification information (received radio wave identification information) included in the received radio wave information and the radio wave identification information (matching radio wave identification information) included in the matching radio wave information.

[0062] In addition, when the received radio wave information includes waveform data, the judgment unit 23 may judge whether the received radio wave is a radio wave transmitted from a specific source based on the waveform data (received waveform data) included in the received radio wave information and the waveform data (verification waveform data) included in the verification radio wave information.

[0063] In addition, if the received radio wave information includes radio wave characteristic information, the judgment unit 23 may judge whether the received radio wave is a radio wave transmitted from a specific source based on the radio wave characteristic information (received radio wave characteristic information) included in the received radio wave information and the radio wave characteristic information (matching radio wave characteristic information) included in the matching radio wave information.

[0064] In addition, when the received radio wave information includes waveform data, the judgment unit 23 may judge whether the received radio wave is a radio wave transmitted from a specific source based on radio wave characteristic information (received radio wave characteristic information) extracted from the waveform data included in the received radio wave information and radio wave characteristic information (matching radio wave characteristic information) included in the matching radio wave information.

[0065] The judgment condition may include one or more conditions. When the judgment condition includes two or more conditions, the judgment condition may be a logical sum (OR) of the two or more conditions, a logical product (AND), or a combination of a logical sum and a logical product.

[0066] In determining whether the received radio wave is the target radio wave, the determination unit 23 may determine whether the received radio wave is the target radio wave based on the degree of match between the received radio wave and the target radio wave. The degree of match is the degree of possibility that the received radio wave is the target radio wave.

[0067] For example, when the judgment conditions include two or more conditions, the degree of match may be an index that increases as the number of conditions that are satisfied increases.Furthermore, when the judgment conditions include a condition based on reception frequency, the degree of match may be an index that increases as the reception frequency increases.Furthermore, when the judgment conditions include a condition based on the number of consecutive receptions, the degree of match may be an index that increases as the number of consecutive receptions increases.

[0068] The determination unit 23 may also determine that the received radio wave is the target radio wave if the degree of match is equal to or greater than a predetermined first standard, or may determine that the received radio wave is not the target radio wave if the degree of match is lower than the first standard.

[0069] Furthermore, the determination unit 23 may evaluate whether the received radio wave is the target radio wave in two or more predetermined stages based on the degree of match. For example, the determination unit 23 may evaluate the possibility that the received radio wave is the target radio wave in three stages: high, medium, and low, based on the degree of match. Then, the determination unit 23 may determine that the received radio wave is the target radio wave when the evaluation result is high.

[0070] When it is unclear whether the received radio wave is a target radio wave, the determination unit 23 may store radio wave information of the received radio wave (received radio wave information) in a storage means as ambiguous information of the radio wave sensor that received the received radio wave. The ambiguous information is radio wave information of a radio wave that is unclear whether it is a target radio wave. Radio waves that are unclear whether they are a target radio wave may be referred to as gray radio waves hereinafter.

[0071] The determination unit 23 may increase the degree of match of the received radio wave when radio wave information about a radio wave that was received earlier than the received radio wave and is estimated to be the same radio wave as the received radio wave is stored in the storage means as ambiguous information of the radio wave sensor that received the received radio wave. The determination unit 23 may increase the degree of match by, for example, adding a predetermined value to the degree of match calculated without referring to the ambiguous information.

[0072] Gray radio waves are radio waves that are less likely to be the target radio waves than the probability that they are determined to be the target radio waves, but more likely to be determined not to be the target radio waves. For example, if the probability that a received radio wave is the target radio wave is evaluated on a three-point scale of high, medium, and low, gray radio waves may be radio waves that are evaluated as having a "medium" probability.

[0073] For example, the judgment unit 23 judges that the received radio wave is the target radio wave when the degree of match is equal to or greater than a first criterion. Furthermore, the judgment unit 23 may judge that it is unclear whether the received radio wave is the target radio wave when the degree of match is lower than the first criterion and equal to or greater than a predetermined second criterion. In this case, the second criterion is lower than the first criterion. Furthermore, the judgment unit 23 may judge that the received radio wave is not the target radio wave when the degree of match is lower than the second criterion.

[0074] In this way, by reflecting the ambiguity information in the degree of match, it is possible to increase the degree of match when radio waves whose possibility of being the target radio waves was ambiguous (gray radio waves) are received again by the same radio wave sensor. For example, if the target of monitoring is a person (suspicious person) behaving suspiciously, when a source whose possibility of being a source carried by the suspicious person reappears in the same location, the determination unit 23 can increase the possibility that the source is determined to be a source carried by the suspicious person.

[0075] Furthermore, the determination unit 23 may estimate the communication volume of the source of the received radio waves based on the waveform data and radio wave characteristic information included in the received radio wave information, and increase or decrease the degree of match based on the communication volume. For example, it is assumed that people who exist in the same location tend to communicate a lot (for example, watch videos), and people who exist in the same location but communicate less tend to be more suspicious. In such a case, when it is estimated that the communication volume of the source of the received radio waves is less than a predetermined volume, the determination unit 23 may add a predetermined value to the degree of match of the received radio waves.

[0076] The output unit 24 outputs output information when it is determined that the received radio wave is a target radio wave. The output information is information related to the target radio wave. The output information includes target image information. The target image information is captured image information received from a camera associated with the radio wave sensor that received the target radio wave.

[0077] As a result, target radio waves are detected based on radio wave information, and when target radio waves are detected, information on images that may contain a moving object accompanied by a source emitting target radio waves is output. Because target radio waves are detected based on radio wave information, the amount of processing required for monitoring can be reduced compared to when a target moving object is detected by image analysis from many images captured by many cameras. Furthermore, because information on images that may contain the target moving object is output, the amount of data in the output information can be reduced compared to when information on many images captured by many cameras is output. Furthermore, when a monitor monitors a target moving object visually, the monitor can search for the target moving object from images that may contain the target moving object, making monitoring easier compared to when searching for the target moving object from many images captured by many cameras. Furthermore, even when the device to which the output information is output detects the target moving object by image analysis, the monitor can detect the target moving object from images that may contain the target moving object, making detection easier compared to when detecting the target moving object from many images captured by many cameras.

[0078] Furthermore, the target image information includes information on an image captured by a camera associated with the radio wave sensor that received the target radio wave within a predetermined time before or after the time when the received radio wave determined to be the target radio wave was received by the radio wave sensor. The target image information may also include information on an image captured by the camera before the received radio wave was determined to be the target radio wave. For example, the target image information may include information on an image captured by the radio wave sensor that received the received radio wave within a predetermined time before or after the time when the radio wave that is estimated to be from the same source as the received radio wave determined to be the target radio wave was received.

[0079] When the image information receiving unit 22 determines that the received radio waves are target radio waves, it may receive target image information from a camera associated with the radio wave sensor that received the target radio waves. This reduces the amount of data transmitted from the camera to the information output device 20. When the image information receiving unit 22 determines that the received radio waves are target radio waves, it may cause the camera associated with the radio wave sensor that received the target radio waves to capture an image. This reduces the power consumption of the camera.

[0080] The output information may also include information on the installation location of the radio wave sensor that received the target radio wave, and information on the installation location of the camera associated with the radio wave sensor that received the target radio wave.

[0081] The output unit 24 may output the output information to the display means 70. Furthermore, the output unit 24 may output the output information as image information for displaying an image on the display means 70. That is, the output unit 24 may cause the display means 70 to display an image by outputting the output information to the display means 70.

[0082] Next, a description will be given of a specific example of an image that the output unit 24 causes to be displayed on the display means 70. Note that the image that the output unit 24 causes to be displayed on the display means 70 may be referred to as a display image.

[0083] For example, the display image may include an image (photographed image) taken by a camera associated with the radio wave sensor that received the target radio wave. For example, the display image may include a screen item indicating a radio wave sensor at the position of the radio wave sensor on a map for the radio wave sensor that received the target radio wave. Also, for example, the display image may include a screen item indicating a camera at the position of the camera on a map for the camera associated with the radio wave sensor that received the target radio wave. Also, the display image may include a screen item indicating the reception area of ​​the radio wave sensor. Also, the display image may include a screen item indicating the shooting area of ​​the camera.

[0084] The display image may also include two or more pieces of target image information at different times for radio waves that are presumed to be from the same source as the target radio waves. In other words, the display image may include time-series target image information for radio waves that are presumed to be from the same source as the target radio waves.

[0085] FIG. 7 is a diagram showing an example of a display image. In FIG. 7, the open circles indicate the positions of the radio wave sensors that received the target radio waves. The filled circles indicate the positions of the cameras associated with the radio wave sensors that received the target radio waves. The image shown in FIG. 7 includes an image (photographed image) taken by the camera associated with the radio wave sensor that received the target radio waves. The display image may also include information on the time the photographed image was taken. The display image may also include information on the time the target radio waves were received by the radio wave sensor.

[0086] Furthermore, the output unit 24 may output information to an output destination other than the display means 70.

[0087] Next, an example of the operation flow of the information output device 20 of this embodiment will be described. An example of the operation flow of the information output device 20 of this embodiment is shown in Fig. 8 and Fig. 9.

[0088] The image information receiving unit 22 receives captured image information from the cameras 60-1 to 60-M. For example, the image information receiving unit 22 receives captured image information at predetermined time intervals (step S201 in FIG. 8).

[0089] Furthermore, radio wave information receiver 21 receives received radio wave information from radio wave sensors 50-1 to 50-N. For example, radio wave information receiver 21 receives received radio wave information at predetermined time intervals (step S202 in FIG. 9).

[0090] The determination unit 23 determines whether the received radio wave is a target radio wave (step S203). For example, every time the radio wave information receiving unit 21 receives received radio wave information, the determination unit 23 determines whether the received radio wave is a target radio wave.

[0091] If the received radio wave is determined to be the target radio wave (YES in step S204), the output unit 24 outputs output information including the target image information (step S205). The target image information is the captured image information received by the image information receiving unit 22 from the camera associated with the radio wave sensor that received the target radio wave.

[0092] Next, a description will be given of another example of the operation flow of the information output device 20. Fig. 10 shows another example of the operation flow of the information output device 20.

[0093] Radio wave information receiver 21 receives received radio wave information from radio wave sensors 50-1 to 50-N. For example, radio wave information receiver 21 receives received radio wave information at predetermined time intervals (step S301).

[0094] The determination unit 23 determines whether the received radio wave is a target radio wave (step S302). For example, every time the radio wave information receiving unit 21 receives received radio wave information, the determination unit 23 determines whether the received radio wave is a target radio wave.

[0095] When the received radio waves are determined to be target radio waves (YES in step S303), the image information receiving unit 22 receives captured image information (target image information) from the camera associated with the radio wave sensor that received the target radio waves (step S304). In this case, the image information receiving unit 22 may start the camera associated with the radio wave sensor that received the target radio waves, have it capture an image, and then receive the captured image information (target image information). In this case, the camera may stop or enter a standby state after a predetermined time has elapsed since the last image was captured.

[0096] The output unit 24 outputs output information including the target image information (step S305). The target image information is captured image information received by the image information receiving unit 22 from the camera associated with the radio wave sensor that received the target radio wave.

[0097] Furthermore, if the result of step S204 in Fig. 9 is NO, or if the result of step S303 in Fig. 10 is NO, the information output device 20 may perform the operation shown in Fig. 11. Fig. 11 shows an example of another operation flow of the information output device 20.

[0098] When the possibility that the received radio wave is the target radio wave is ambiguous (YES in step S401), the determination unit 23 may store the radio wave information of the received radio wave in the storage means as ambiguous information of the radio wave sensor that received the received radio wave (step S402).The determination unit 23 may then use the ambiguous information to determine whether a radio wave received by the radio wave sensor after the received radio wave is the target radio wave.

[0099] In the above explanation, we have described a case where whether a received radio wave is a target radio wave is determined in real time, but the information output device 20 may also perform equivalent operations based on past received radio wave information and captured image information (accumulated information).

[0100] As described above, in the second embodiment of the present disclosure, the information output device 20 includes a radio wave information receiving unit 21, an image information receiving unit 22, a determination unit 23, and an output unit 24. The radio wave information receiving unit 21 receives received radio wave information from a radio wave sensor. The received radio wave information indicates information about the received radio waves. The received radio waves are radio waves received by the radio wave sensor. The image information receiving unit 22 receives captured image information from a camera. The captured image information is information about an image captured by the camera. The determination unit 23 determines whether the received radio waves are target radio waves based on the determination conditions and the received radio wave information. The target radio waves are radio waves that are the target of the output of the captured image information. The determination conditions are conditions for determining whether the received radio waves are target radio waves. The output unit 24 outputs output information. The output information includes target image information. The target image information is captured image information received by the image information receiving unit 22 from a camera associated with the radio wave sensor that received the target radio waves.

[0101] As a result, the information output device 20 determines whether the received radio waves are target radio waves and outputs output information including target image information for the radio waves determined to be target radio waves. As a result, image information of a possible captured image of a mobile object being monitored is output, allowing a monitor or a device to which the output information is output to easily recognize and monitor the mobile object being monitored based on the output image information. Furthermore, because output information including target image information for radio waves determined to be target radio waves is output, the amount of processing required for monitoring can be reduced compared to when a mobile object is detected by image processing. Therefore, monitoring of the mobile object being monitored can be achieved in an easier manner.

[0102] Furthermore, since output information including target image information for radio waves determined to be target radio waves is output, it is possible to reduce the data amount of the output information.

[0103] [Hardware configuration example] An example of the configuration of hardware resources for realizing the information output device (10, 20) in each embodiment of the present disclosure described above using one information processing device (computer) will be described. Note that the information output device may be physically or functionally realized using at least two information processing devices. The information output device may also be realized as a dedicated device. Also, only some of the functions of the information output device may be realized using an information processing device.

[0104] 12 is a diagram illustrating an example of a hardware configuration of an information processing device that can realize the information output device according to each embodiment of the present disclosure. The information processing device 90 includes a communication interface 91, an input / output interface 92, a computing device 93, a storage device 94, a nonvolatile storage device 95, and a drive device 96.

[0105] 1 can be realized by a communication interface 91 and a computing device 93. Also, the determination unit 13 can be realized by the computing device 93.

[0106] The communication interface 91 is a communication means for the information output device of each embodiment to communicate with an external device via a wired or / and wireless connection. When the information output device is realized using at least two information processing devices, the devices may be connected via the communication interface 91 so as to be able to communicate with each other.

[0107] The input / output interface 92 is a man-machine interface including a keyboard as an example of an input device and a display as an output device.

[0108] The arithmetic device 93 is realized by a general-purpose central processing unit (CPU), a microprocessor, or other arithmetic processing device, and a plurality of electric circuits. The arithmetic device 93 can, for example, read various programs stored in a nonvolatile storage device 95 into the storage device 94 and execute processing in accordance with the read programs.

[0109] The storage device 94 is a memory device such as a RAM (Random Access Memory) that can be accessed by the arithmetic device 93, and stores programs, various data, etc. The storage device 94 may be a volatile memory device.

[0110] The nonvolatile storage device 95 is a nonvolatile storage device such as a ROM (Read Only Memory) or a flash memory, and is capable of storing various programs, data, and the like.

[0111] The drive device 96 is, for example, a device that processes reading and writing of data from and to a recording medium 97, which will be described later.

[0112] The recording medium 97 is any recording medium capable of recording data, such as an optical disk, a magneto-optical disk, or a semiconductor flash memory.

[0113] Each embodiment of the present disclosure may be realized, for example, by configuring an information output device using the information processing device 90 illustrated in FIG. 12 and supplying a program capable of realizing the functions described in each of the above embodiments to this information output device.

[0114] In this case, the embodiment can be realized by having the arithmetic unit 93 execute a program supplied to the information output device. Also, it is possible to configure some, but not all, of the functions of the information output device in the information processing unit 90.

[0115] Furthermore, the information output device may be configured so that the program is recorded on a recording medium 97 and is stored in the nonvolatile storage device 95 as appropriate at the time of shipment or operation of the information output device. In this case, the program may be supplied by installing it in the information output device using an appropriate jig at the manufacturing stage before shipment or at the operation stage. The program may also be supplied by a general procedure such as downloading it from an external source via a communication line such as the Internet.

[0116] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0117] (Appendix 1) a radio wave information receiving unit that receives, from the radio wave sensor, received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving unit that receives captured image information, which is information about an image captured by the camera, from the camera; a determination unit that determines whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information, based on a determination condition for determining whether the received radio wave is the target radio wave; an output unit that outputs output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio wave; An information output device comprising:

[0118] (Appendix 2) The target radio wave is a radio wave transmitted from a source that moves in accordance with the movement of a target mobile object that is a mobile object to be monitored. 2. The information output device according to claim 1.

[0119] (Appendix 3) the determination unit determines whether the received radio wave is the target radio wave based on information about the radio wave received by the radio wave sensor during a predetermined period. 10. The information output device according to claim 1 or 2.

[0120] (Appendix 4) the determination unit determines that the received radio wave is the target radio wave when a radio wave that is estimated to be from the same transmission source as the received radio wave is received by the radio wave sensor that received the received radio wave at a frequency higher than a predetermined frequency; 4. An information output device according to any one of claims 1 to 3.

[0121] (Appendix 5) the determination unit determines that the received radio wave is the target radio wave when a radio wave that is presumed to be from the same transmission source as the received radio wave is received consecutively by the radio wave sensor that received the received radio wave a predetermined number of times or more. 5. An information output device according to any one of claims 1 to 4.

[0122] (Appendix 6) The target radio wave is the received radio wave transmitted from a specific transmission source. 6. An information output device according to any one of Supplementary Note 1 to Supplementary Note 5.

[0123] (Appendix 7) The determination unit determines whether the received radio wave is the target radio wave based on a degree of match, which is a degree of possibility that the received radio wave is the target radio wave. 7. An information output device according to any one of claims 1 to 6.

[0124] (Appendix 8) The determination unit determines that the received radio wave is the target radio wave when the degree of match is equal to or greater than a first criterion. 8. The information output device according to claim 7.

[0125] (Appendix 9) The determination unit determines that it is unclear whether the received radio wave is the target radio wave when the degree of match is lower than the first criterion and equal to or higher than a second criterion that is lower than the first criterion. 9. The information output device according to claim 8.

[0126] (Appendix 10) When it is unclear whether the received radio wave is the target radio wave, the determination unit stores the received radio wave information in a storage unit as ambiguous information of the radio wave sensor that received the received radio wave, The ambiguous information is information about radio waves that are ambiguous as to whether they are the target radio waves. 10. The information output device according to claim 9.

[0127] (Appendix 11) the determination unit increases the degree of match of the received radio wave when information on a radio wave that was received earlier than the received radio wave and is estimated to be a radio wave from the same transmission source as the received radio wave is stored in the storage means as the ambiguous information of the radio wave sensor that received the received radio wave. 11. The information output device according to claim 10.

[0128] (Appendix 12) When the received radio wave is determined to be the target radio wave, the image information receiving unit receives the captured image information from the camera associated with the radio wave sensor that received the target radio wave. 12. An information output device according to any one of claims 1 to 11.

[0129] (Appendix 13) receiving, from the radio wave sensor, received radio wave information indicating information about the received radio wave, which is a radio wave received by the radio wave sensor; receiving captured image information from the camera, the captured image information being information on an image captured by the camera; determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information based on a determination condition for determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information and on the received radio wave information; outputting output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio wave; Information output method.

[0130] (Appendix 14) On the computer, a radio wave information receiving function for receiving, from the radio wave sensor, received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving function for receiving captured image information from the camera, which is information on an image captured by the camera; a determination function for determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information, based on a determination condition for determining whether the received radio wave is the target radio wave; an output function for outputting output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio wave; An information output program that achieves this.

[0131] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 12, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 13 and 14 in the same dependent relationship as Supplementary Notes 2 to 12. Furthermore, not limited to Supplementary Notes 1, 13, and 14, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0132] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate. [Explanation of symbols]

[0133] 10, 20 Information output device 11, 21 Radio wave information receiving unit 12, 22 Image information receiving unit 13, 23 Judgment Department 14, 24 Output section 50-i radio wave sensor 60-j camera 70 Display means 80 Surveillance System 90 Information processing equipment 91 Communication Interface 92 Input / Output Interface 93 Arithmetic unit 94 Storage device 95 Non-volatile storage devices 96 Drive Device 97 Recording Media

Claims

1. a radio wave information receiving unit that receives, from the radio wave sensor, received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving unit that receives captured image information, which is information about an image captured by the camera, from the camera; a determination unit that determines whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information, based on a determination condition for determining whether the received radio wave is the target radio wave; an output unit that outputs output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio wave; An information output device comprising:

2. The target radio wave is a radio wave transmitted from a source that moves in accordance with the movement of a target mobile object that is a mobile object to be monitored. The information output device according to claim 1 .

3. the determination unit determines whether the received radio wave is the target radio wave based on information about the radio wave received by the radio wave sensor during a predetermined period.

3. The information output device according to claim 1.

4. the determination unit determines that the received radio wave is the target radio wave when a radio wave that is estimated to be from the same transmission source as the received radio wave is received by the radio wave sensor that received the received radio wave at a frequency higher than a predetermined frequency; 3. The information output device according to claim 1.

5. the determination unit determines that the received radio wave is the target radio wave when a radio wave that is presumed to be from the same transmission source as the received radio wave is received consecutively by the radio wave sensor that received the received radio wave a predetermined number of times or more.

3. The information output device according to claim 1.

6. The determination unit determines whether the received radio wave is the target radio wave based on a degree of match, which is a degree of possibility that the received radio wave is the target radio wave.

3. The information output device according to claim 1.

7. The determination unit determines that the received radio wave is the target radio wave when the degree of match is equal to or greater than a first criterion. The information output device according to claim 6.

8. The determination unit determines that it is unclear whether the received radio wave is the target radio wave when the degree of match is lower than the first criterion and equal to or higher than a second criterion that is lower than the first criterion. The information output device according to claim 7.

9. receiving, from the radio wave sensor, received radio wave information indicating information about the received radio wave, which is a radio wave received by the radio wave sensor; receiving captured image information from the camera, the captured image information being information on an image captured by the camera; determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information based on a determination condition for determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information and the received radio wave information; outputting output information including target image information, which is the photographed image information received from a camera associated with the radio wave sensor that received the target radio wave; Information output method.

10. On the computer, a radio wave information receiving function for receiving, from the radio wave sensor, received radio wave information indicating information about received radio waves, which are radio waves received by the radio wave sensor; an image information receiving function for receiving captured image information from the camera, which is information on an image captured by the camera; a determination function for determining whether the received radio wave is a target radio wave that is a target radio wave for outputting the captured image information, based on a determination condition for determining whether the received radio wave is the target radio wave; an output function for outputting output information including target image information, which is the captured image information received from a camera associated with the radio wave sensor that received the target radio wave; An information output program that achieves this.

Images