Information output device, information output system, information output method, and information output program

Abstract

To make it possible to improve detection accuracy of an object.SOLUTION: An information output device receives photographic image information as information of an image photographed by a camera from a plurality of cameras; receives reception radio wave information as information about radio waves received by a radio wave sensor from a plurality of radio wave sensors; calculates a matching degree between reception information including the photographic image information received from a set of cameras and the reception radio wave information received from a set of radio wave sensors, and object information including object image information as information of an image of an object and object radio wave information as information about radio waves emitted by a radio communication terminal associated with the object, according to each set concerning the camera and the radio wave sensor associated with the camera thereof; outputs output information as information about a calculation result of the matching degree; and changes a weighting coefficient with respect to each of the photographic image information and the reception radio wave information, according to the set thereof.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information output device, an information output system, an information output method, and an information output program. [Background technology]

[0002] There are methods for detecting specific individuals, such as criminals, using images captured by surveillance cameras, etc. For example, in the method described in Patent Literature 1, a notification is issued when an image captured by a surveillance camera matches a facial image of a specific individual.

[0003] Patent Document 2 also describes a method of collating radio wave information in addition to collating images. Patent Document 2 describes that when a moving object captured in a captured image is a registered moving object, the position of the moving object is set as the radio wave detection range of the radio wave sensor, and the radio wave sensor is caused to detect radio waves. Patent Document 2 also describes collating information related to the detected radio waves with information related to radio waves registered in a database. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2003-187352 A [Patent Document 2] International Publication No. 2022 / 091165 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the methods described in Patent Documents 1 and 2, the accuracy of the degree of match calculated when comparing image and radio wave information may be low. The degree of match indicates the degree of match of the information being compared. For example, there may be a high possibility that a low degree of match is calculated when an object is present. Also, there may be a high possibility that a high degree of match is calculated when an object is not present. As a result, the accuracy of object detection based on the degree of match may be low.

[0006] In view of the above-mentioned problems, an object of the present disclosure is to provide an information output device, an information output system, an information output method, and an information output program that enable improvement in the accuracy of detecting an object. [Means for solving the problem]

[0007] In one aspect of the present disclosure, an information output device includes an image information receiving unit that receives, from a plurality of cameras, captured image information, which is information on an image captured by the camera; a radio wave information receiving unit that receives, from a plurality of the radio wave sensors, received radio wave information, which is information on radio waves received by the radio wave sensors; a calculation unit that calculates, for each pair of a camera and a radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information, which is information on an image of an object, and object information including target radio wave information, which is information on radio waves emitted by a wireless communication terminal associated with the object; and an output unit that outputs output information that is information related to the calculation result of the degree of match, and in calculating the degree of match, the calculation unit changes a weighting coefficient for each of the captured image information and the received radio wave information according to the pair.

[0008] In another aspect of the present disclosure, an information output system includes an image information receiving means for receiving, from a plurality of cameras, captured image information which is information on an image captured by the camera; a radio wave information receiving means for receiving, from a plurality of the radio wave sensors, received radio wave information which is information on radio waves received by the radio wave sensors; a calculation means for calculating, for each pair of a camera and a radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information which is information on an image of an object, and object information including target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; and an output means for outputting output information which is information regarding the calculation result of the degree of match, wherein in calculating the degree of match, the calculation means changes a weighting coefficient for each of the captured image information and the received radio wave information according to the pair.

[0009] In another aspect of the present disclosure, an information output method receives captured image information from a plurality of cameras, which is information on an image captured by a camera, and receives received radio wave information from a plurality of radio wave sensors, which is information on radio waves received by a radio wave sensor, and for each pair of a camera and a radio wave sensor associated with the camera, calculates a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, and target image information which is information on an image of an object, and object information including target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object, outputs output information which is information regarding the calculation result of the degree of match, and in calculating the degree of match, changes a weighting coefficient for each of the captured image information and the received radio wave information according to the pair.

[0010] In another aspect of the present disclosure, the information output program causes a computer to realize an image information receiving function that receives, from a plurality of cameras, captured image information, which is information on an image captured by a camera; a radio wave information receiving function that receives, from a plurality of radio wave sensors, received radio wave information, which is information on radio waves received by a radio wave sensor; a calculation function that calculates, for each pair of a camera and a radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information, which is information on an image of an object, and object information including target radio wave information, which is information on radio waves emitted by a wireless communication terminal associated with the object; and an output function that outputs output information that is information regarding the calculation result of the degree of match, and the calculation function changes a weighting coefficient for each of the captured image information and the received radio wave information according to the pair in calculating the degree of match. Effect of the Invention

[0011] According to the present disclosure, it is possible to improve the accuracy of detecting an object. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating a configuration example of an information output device according to a first embodiment of the present disclosure. [Diagram 2] FIG. 4 is a diagram illustrating an example of an operation flow of the information output device according to the first embodiment of the present disclosure. [Diagram 3] FIG. 11 is a diagram illustrating a configuration example of a system including an information output device according to a second embodiment of the present disclosure. [Figure 4] FIG. 11 is a diagram illustrating a configuration example of an information output device according to a second embodiment of the present disclosure. [Diagram 5] FIG. 1 is a diagram illustrating an example of the arrangement of a camera and a radio wave sensor. [Figure 6] FIG. 2 is a diagram illustrating an example of a correspondence relationship between a camera and a radio wave sensor. [Figure 7] 13 is a diagram showing an example of an image displayed on a display unit by an information output device according to a second embodiment of the present disclosure; FIG. [Figure 8] FIG. 13 is a diagram illustrating another configuration example of the information output device according to the second embodiment of the present disclosure. [Figure 9] FIG. 13 is a diagram illustrating another configuration example of the information output device according to the second embodiment of the present disclosure. [Figure 10] FIG. 11 is a diagram illustrating an example of an operation flow of an information output device according to a second embodiment of the present disclosure. [Figure 11] FIG. 11 is a diagram illustrating an example of an operation flow of an information output device according to a second embodiment of the present disclosure. [Figure 12] FIG. 11 is a diagram illustrating an example of an operation flow of an information output device according to a second embodiment of the present disclosure. [Figure 13] FIG. 2 is a diagram illustrating an example of a hardware configuration according to each embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [First embodiment] A first embodiment of the present disclosure will be described.

[0014] A specific example of the information output device 10 in the first embodiment is an information output device 20 in a second embodiment, which will be described later.

[0015] First, a configuration example of the information output device 10 of this embodiment will be described. Fig. 1 shows a configuration example of the information output device 10 of this embodiment. The information output device 10 includes an image information receiving unit 11, a radio wave information receiving unit 12, a calculation unit 13, and an output unit 14.

[0016] The image information receiving unit 11 receives captured image information from a plurality of cameras. The captured image information is information on images captured by the cameras.

[0017] The radio wave information receiver 12 receives received radio wave information from a plurality of radio wave sensors. The received radio wave information is information on radio waves received by the radio wave sensors.

[0018] The calculation unit 13 calculates the degree of match between the received information and the object information for each pair of a camera and a radio wave sensor associated with the camera. The received information includes captured image information received from the camera of the pair and received radio wave information received from the radio wave sensor of the pair. The object information includes target image information and target radio wave information. The target image information is information on an image of the object. The target radio wave information is information on radio waves emitted by a wireless communication terminal associated with the object.

[0019] In calculating the degree of match, the calculation unit 13 changes the weighting coefficients for the captured image information and the received radio wave information according to the pair.

[0020] The output unit 14 outputs the output information, which is information related to the calculation result of the degree of match.

[0021] Next, an example of the operation flow of the information output device 10 of this embodiment will be described. Fig. 2 shows an example of the operation flow of the information output device 10 of this embodiment.

[0022] The image information receiving unit 11 receives captured image information from a plurality of cameras (step S101).

[0023] The radio wave information receiver 12 receives received radio wave information from a plurality of radio wave sensors (step S102).

[0024] The calculation unit 13 calculates the degree of match between the received information and the object information for each pair of a camera and a radio wave sensor associated with the camera (step S103). In calculating the degree of match, the calculation unit 13 changes the weighting coefficients for the captured image information and the received radio wave information according to the pair.

[0025] The output unit 14 outputs the output information (step S104).

[0026] As described above, in the first embodiment of the present disclosure, the information output device 10 includes the image information receiving unit 11, the radio wave information receiving unit 12, the calculation unit 13, and the output unit 14. The image information receiving unit 11 receives captured image information from a plurality of cameras. The captured image information is information of an image captured by the camera. The radio wave information receiving unit 12 receives received radio wave information from a plurality of radio wave sensors. The received radio wave information is information of radio waves received by the radio wave sensors. The calculation unit 13 calculates the degree of match between the received information and the object information for each pair of a camera and a radio wave sensor associated with the camera. The received information includes the captured image information received from the camera of the pair and the received radio wave information received from the radio wave sensor of the pair. The object information includes the target image information and the target radio wave information. The target image information is information of an image of the object. The target radio wave information is information of radio waves emitted by a wireless communication terminal associated with the object. The calculation unit 13 changes the weight coefficient for each of the captured image information and the received radio wave information according to the pair in calculating the degree of match. The output unit 14 outputs the output information, which is information related to the calculation result of the degree of match.

[0027] In this way, the information output device 10 changes the weighting coefficients for the captured image information and the received radio wave information in calculating the degree of match according to the pair. As a result, for a pair in which the captured image information is the cause of the deterioration of the detection accuracy, the weighting coefficient for the captured image information can be lowered to reduce the influence of the captured image information on the degree of match. Also, for a pair in which the received radio wave information is the cause of the deterioration of the detection accuracy, the weighting coefficient for the received radio wave information can be lowered to reduce the influence of the received radio wave information on the degree of match. As a result, it is possible to reduce the possibility that the degree of match is low when an object is present, or that the degree of match is high when an object is not present. Therefore, it is possible to improve the detection accuracy of the object.

[0028] [Second embodiment] Next, an information output device 20 according to a second embodiment of the present disclosure will be described. Note that a specific example of the information output device 10 according to the first embodiment is the information output device 20 according to the second embodiment.

[0029] 3 shows an example of the configuration of a system including an information output device 20 of this embodiment. The information output device 20 is connected to radio wave sensors 50-i (i is an integer between 1 and N). The information output device 20 is also connected to cameras 60-j (j is an integer between 1 and M). The information output device 20 is also connected to a display means 70. The radio wave sensors 50-i, the cameras 60-j, and the information output device 20 are included in a monitoring system 80.

[0030] The radio wave sensor 50-i receives radio waves. In addition, the radio wave sensor 50-i transmits received radio wave information to the information output device 20. The received radio wave information is radio wave information about radio waves received by the radio wave sensor 50-i. The radio wave information is information related to radio waves.

[0031] The radio wave information may include, for example, waveform data indicating the signal waveform of the radio wave.

[0032] The radio wave information may also include, for example, radio wave identification information. Radio wave identification information is information capable of identifying an individual source that emits radio waves. The radio wave identification information may include, for example, an International Mobile Equipment Identity (IMEI), an International Mobile Subscriber Identity (IMSI), a Media Access Control (MAC) address, and the like. In the case where the source is a drone, the radio wave identification information may include a remote ID (identification), which is identification information of the drone.

[0033] The radio wave information may also include information regarding radio waves, such as frequency, modulation method, and received signal level at the radio wave sensor 50-i. For example, the radio wave information may include information such as SS-RSRQ (Reference Signal Received Quality).

[0034] The radio wave information may also include radio wave characteristic information, which is information that indicates characteristics of the signal waveform of the radio wave.

[0035] Although devices that transmit radio waves are manufactured to meet a predetermined communication standard, minute individual differences exist due to variations in analog circuits, etc. Therefore, radio waves have features that can be identified based on the individual differences of the devices that are the transmission sources. The radio wave characteristic information may be, for example, a feature based on a modulation error obtained by modulation analysis, or a feature based on the time waveform of the radio waves. In addition, for example, the radio wave characteristic information may be a feature indicating one or more of the transient (rising and falling) of the received signal, the power spectrum density of the preamble portion, the error vector magnitude (EVM), the IQ phase error, the IQ imbalance amount, the frequency offset, and the symbol clock error, but is not limited to these.

[0036] The camera 60-j captures images. The camera 60-j also transmits captured image information to the information output device 20. The captured image information is information on images captured by the camera 60-j. The camera 60-j captures images, for example, at predetermined time intervals. The captured image information may be information on still images or information on moving images (video). The camera 60-j may be, for example, a surveillance camera installed in a city. The camera 60-j may also be a security camera with a lower resolution than a surveillance camera.

[0037] The display means 70 is a man-machine interface such as a display serving as an output device. The display means 70 displays an image. In this embodiment, the information output device 20 outputs output information to the display means 70. However, the output destination of the output information is arbitrary. The information output device 20 may output the output information to an output destination other than the display means 70.

[0038] 4 shows an example of the configuration of the information output device 20 of this embodiment. The information output device 20 of this embodiment includes an image information receiving section 21, a radio wave information receiving section 22, a calculation section 23, and an output section 24.

[0039] The image information receiving unit 21 receives captured image information from the cameras 60-1 to 60-M. The captured image information is information on an image captured by the camera 60-j. Information on the position of the camera 60-j is stored in advance in a storage means (not shown) inside or outside the information output device 20.

[0040] The radio wave information receiving unit 22 receives received radio wave information from the radio wave sensors 50-1 to 50-N. The received radio wave information is information on radio waves received by the radio wave sensor 50-i. Information on the position of the radio wave sensor 50-i is stored in advance in a storage means.

[0041] Camera 60-j is associated with one or more of radio wave sensors 50-1 to 50-N. Information on the correspondence between the cameras and the radio wave sensors is stored, for example, in a storage means. Two or more radio wave sensors may be associated with one camera. Also, two or more cameras may be associated with one radio wave sensor.

[0042] A camera is associated with a radio wave sensor in the vicinity of the camera. In a pair of a camera and a radio wave sensor associated with the camera, the shooting area of ​​the camera and the receiving area of ​​the radio wave sensor at least partially overlap. The shooting area is an area photographed by the camera. The receiving area is an area where radio waves are received by the radio wave sensor. In other words, in the correspondence between the cameras and the radio wave sensors, each camera is associated with a radio wave sensor whose receiving area at least partially overlaps with at least a portion of the shooting area of ​​the camera.

[0043] For example, assume that cameras 60-1 to 60-5 and radio wave sensors 50-1 to 50-5 are arranged in a field as shown in Fig. 5. Fig. 5 is a diagram showing an example of the arrangement of the cameras and radio wave sensors. In Fig. 5, the open circles represent radio wave sensors. Furthermore, the black circles represent cameras. Furthermore, the dashed circles represent the receiving areas of the radio wave sensors. Note that the shape of the receiving areas of the radio wave sensors does not have to be circular. For example, the radio wave sensors may be directional. Furthermore, a sector represents the capturing area of ​​the cameras.

[0044] When the cameras and radio wave sensors are arranged as in the example shown in Fig. 5, the correspondence between the cameras and the radio wave sensors is as shown in Fig. 6. Fig. 6 is a diagram showing the correspondence between the cameras and the radio wave sensors. In the table of correspondence shown in Fig. 6, a unit consisting of a camera and a radio wave sensor shown in one row will hereinafter be called a "set." In the example shown in Fig. 6, the number of sets is six.

[0045] The calculation unit 23 calculates the degree of match between the received information and the object information for each pair of a camera and a radio wave sensor associated with the camera. The received information includes captured image information received from the camera of the pair and received radio wave information received from the radio wave sensor of the pair. The degree of match indicates the degree of match between the received information and the object information.

[0046] The target information also includes target image information and target radio wave information. The target image information is information on an image of the target. The target is an object that is the target of detection. The target may be, for example, a person, or may not be a person. For example, if a specific person is the target, the target image information may be a facial image or a full-body image of the person. The target image information may also include one or more image information for one target.

[0047] Furthermore, the target radio wave information is information on radio waves emitted by a wireless communication terminal associated with the target object. For example, if the target object is a person, the wireless communication terminal may be a wireless communication terminal carried by the person. The wireless communication terminal moves in conjunction with the movement of the target object. Hereinafter, the radio waves emitted by the wireless communication terminal associated with the target object may be referred to as target radio waves.

[0048] For example, when the correspondence between the cameras and the radio wave sensors is as shown in FIG. 6, the calculation unit 23 calculates the degree of match for each of the six pairs.

[0049] The calculation unit 23 calculates the degree of match D, for example, using the following formula.

[0050]

number

[0051] In the above formula, WI is a weighting coefficient for the captured image information. DI is the degree of match between the captured image information and the target image information. The degree of match between the captured image information and the target image information is hereinafter referred to as the image match degree. WR is a weighting coefficient for the received radio wave information. DR is the degree of match between the received radio wave information and the target radio wave information. The degree of match between the received radio wave information and the target radio wave information is hereinafter referred to as the radio wave match degree.

[0052] The calculation formula for the degree of match D is not limited to the above formula. The degree of match D is calculated using a weighting factor WI for the captured image information, a weighting factor WR for the received radio wave information, an image match degree DI, and a radio wave match degree DR. The higher the degree of match, the higher the degree of match.

[0053] In calculating the degree of match D, the calculation unit 23 changes the weighting factor WI for the captured image information and the weighting factor WR for the received radio wave information depending on the pair.

[0054] The weighting factor WI for the captured image information and the weighting factor WR for the received radio wave information may be set in advance for each pair. In this case, the correspondence between the pair and the weighting factor is stored in advance in the storage means. Then, the calculation unit 23 changes the weighting factor according to the correspondence.

[0055] In addition, the weighting factor WI for the captured image information and the weighting factor WR for the received radio wave information may be dynamically changed according to a predetermined condition. In this case, the correspondence between the set, the predetermined condition, and the weighting factor is stored in advance in the storage means. The calculation unit 23 changes the weighting factor according to the predetermined condition associated with the set.

[0056] Furthermore, the weighting coefficient WI for the captured image information and the weighting coefficient WR for the received radio wave information may be changed in response to an operational input by an operator.

[0057] For example, the calculation unit 23 may change the weighting coefficient WI for the captured image information according to the reliability of the captured image information from the pair of cameras for which the degree of match D is to be calculated.

[0058] For example, when the camera is installed in a dimly lit place, the reliability of the captured image information is low. For example, when the camera is installed in a dimly lit place, the image matching degree DI is high, but the possibility that the object is not captured, and the image matching degree DI is low, but the possibility that the object is captured increases. Therefore, the calculation unit 23 reduces the weighting coefficient WI for the captured image information from the camera installed in a dimly lit place.

[0059] For example, for a group consisting of cameras installed in a dimly lit place throughout the day, the weighting factor WI for the captured image information may be set low in advance. The calculation unit 23 may change the weighting factor WI for the captured image information according to the brightness information. The brightness information is information about the brightness of the place where the camera is installed. The correspondence between the group and the brightness information may be stored in a storage means.

[0060] In addition, when the reliability changes depending on the time period, the calculation unit 23 may change the weighting factor WI for the captured image information depending on the time period when the image was captured. For example, the calculation unit 23 may lower the weighting factor WI for the captured image information during a dark time period. In this case, the correspondence between the set, the time period, and the weighting factor may be stored in a storage unit. In addition, the calculation unit 23 may change the weighting factor WI for the captured image information depending on the brightness information. In this case, the correspondence between the set, the time period, and the brightness information may be stored in a storage unit. In addition, the brightness information may be dynamically changed based on information such as an illuminance sensor installed at the installation location of the camera.

[0061] The calculation unit 23 may change the weighting factor WI for the captured image information according to the brightness of the image indicated by the captured image information. For example, when the average brightness of the image is lower than a predetermined threshold, the calculation unit 23 may lower the weighting factor WI for the captured image information.

[0062] Also, for a group consisting of cameras with low resolution, the weighting factor WI for the captured image information may be set low in advance. Also, the calculation unit 23 may change the weighting factor WI for the captured image information according to the resolution information indicating the resolution of the camera. In this case, the resolution information of the cameras in each group is stored in the storage means.

[0063] Furthermore, the calculation unit 23 may change the weighting coefficient WR for the received radio wave information according to the reliability of the received radio wave information from the radio wave sensor of the pair for which the degree of match D is to be calculated.

[0064] For example, if the location where the radio wave sensor is installed is a place with a lot of people or a place where the influence of multipath is large, the reliability of the received radio wave information is low. For example, if the location where the received radio wave information is installed is a place where it is difficult to collect radio wave information as described above, the radio wave matching degree DR is high but the target radio wave is not received, and the radio wave matching degree DR is low but the target radio wave is received, which is likely to be the case. Therefore, the calculation unit 23 lowers the weighting coefficient WI for the received radio wave information from the radio wave sensor with low reliability.

[0065] For example, for a group of radio wave sensors that have low reliability of received radio wave information throughout the day, the weighting factor WR for the received radio wave information may be set low in advance. The calculation unit 23 may also change the weighting factor WR for the received radio wave information according to reliability information indicating the reliability of the received radio wave information. In this case, the relationship between the group and the reliability information may be stored in a storage means. The reliability information is set according to the environment of the installation location of the radio wave sensor, such as pedestrian traffic and the influence of multipath.

[0066] Furthermore, when the reliability varies depending on the time period, the calculation unit 23 may change the weighting factor WR for the received radio wave information depending on the time period in which the radio wave is received. For example, the calculation unit 23 may lower the weighting factor WR for the received radio wave information during a time period when there are many people around the radio wave sensor. In this case, the correspondence between the set, the time period, and the weighting factor may be stored in the storage means. Also, the correspondence between the set, the time period, and the reliability information may be stored in the storage means.

[0067] In addition, the calculation unit 23 may change the weighting factor WR for the received radio wave information according to the reception level (gain) of the radio wave indicated by the received radio wave information. For example, when the reception level is lower than a predetermined threshold, the calculation unit 23 may lower the weighting factor WR for the received radio wave information.

[0068] The calculation unit 23 may change the weighting coefficients so that the sum of the weighting coefficient WI for the captured image information and the weighting coefficient WR for the received radio wave information is constant (for example, 1). Also, for example, when the reliability of both the captured image information and the received radio wave information are low, the calculation unit 23 may reduce both the weighting coefficient WI for the captured image information and the weighting coefficient WR for the received radio wave information.

[0069] Any method can be used to calculate the image match degree DI and the radio wave match degree DR. Examples of the method for calculating the image match degree DI and the radio wave match degree DR will be described later.

[0070] As described above, the reliability of the captured image information and the received radio wave information may be low. Therefore, when detecting an object using at least one of the captured image information and the received radio wave information, the detection accuracy of the object may be low. For example, when the reliability of the captured image information is low (for example, when an image is captured in a dark place), the possibility that the image matching degree is low even if an object exists, or the image matching degree is high even if an object does not exist, increases. Therefore, the information output device 20 of this embodiment changes the weighting coefficient WI for the captured image information and the weighting coefficient WR for the received radio wave information according to the combination of the camera and the radio wave sensor.

[0071] The information output device 20 reduces the weighting factor WI for the captured image information for a group with a low reliability of the captured image information. Also, the information output device 20 reduces the weighting factor WR for the received radio wave information for a group with a low reliability of the received radio wave information. This reduces the influence of information with low reliability on the degree of match. Therefore, the detection accuracy of the object can be improved. In other words, it is possible to reduce the possibility that the degree of match becomes low when the object is present, or the possibility that the degree of match becomes high when the object is not present.

[0072] The output unit 24 outputs the output information, which is information related to the calculation result of the degree of match.

[0073] The output information may include, for example, information about a pair for which a degree of match satisfying a predetermined condition has been calculated. For example, the predetermined condition may be that the degree of match is higher than a predetermined value. Furthermore, the predetermined condition may be, for example, that the degree of match is the highest. Furthermore, the predetermined condition may be, for example, that the degree of match is higher than a predetermined value and is the highest. Furthermore, the output information may include at least one of information about the installation position of the camera and information about the installation position of the radio wave sensor for a pair for which a degree of match satisfying a predetermined condition has been calculated. Furthermore, the output information may include information about the degree of match for a pair for which a degree of match satisfying a predetermined condition has been calculated.

[0074] In this embodiment, the output unit 24 outputs the output information to the display means 70. Also, in this embodiment, the output unit 24 outputs the output information as image information for displaying an image on the display means 70. That is, the output unit 24 causes the display means 70 to display the image by outputting the output information to the display means 70.

[0075] Next, a specific example of an image that the output unit 24 causes the display means 70 to display will be described.

[0076] For example, the image may include a screen item indicating the pair with the highest degree of matching among pairs with a degree of matching higher than a predetermined value. For example, the image may include screen items indicating the position of the camera and the position of the radio wave sensor on the map for the pair with the highest degree of matching. The image may also include information on the calculated degree of matching. The image may also include a screen item indicating the receiving area of ​​the radio wave sensor. The image may also include a screen item indicating the shooting area of ​​the camera.

[0077] The image may also show information on two or more calculation results of the degree of match for the same object at different times, i.e., the image may show information on the calculation results of the degree of match for the same object in chronological order.

[0078] FIG. 7 is a diagram showing an example of a display image. In FIG. 7, a white circle indicates the position of a radio wave sensor for the pair for which the highest degree of match was calculated. A black circle indicates the position of a camera for the pair for which the highest degree of match was calculated. The image shown in FIG. 7 includes an image (taken image) taken by the camera of the pair for which the highest degree of match was calculated. The image also includes information on the time when the taken image was taken by the camera of the pair for which the highest degree of match was calculated. The image also includes information on the same object at different times.

[0079] Furthermore, the output unit 24 may output information to an output destination other than the display means 70. For example, the information output by the output unit 24 may include at least one of information on the installation positions of the camera and the installation positions of the radio wave sensor of the pair calculated to have the highest degree of match among the pairs calculated to have a degree of match higher than a predetermined value.

[0080] Next, a method for calculating the image matching degree DI will be described. The image matching degree DI can be calculated by any method. For example, when an image similar to a face image is included in the captured image indicated by the captured image information, the calculation unit 23 calculates a high image matching degree DI.

[0081] Next, a method for calculating the radio wave matching degree DR will be described.

[0082] When the received radio wave information includes radio wave identification information, the calculation unit 23 may calculate the radio wave matching degree DR based on the radio wave identification information (received radio wave identification information) included in the received radio wave information and the radio wave identification information (target radio wave identification information) included in the target radio wave information.

[0083] In addition, when the received radio wave information includes waveform data, the calculation unit 23 may calculate the radio wave matching degree DR based on the waveform data (received waveform data) included in the received radio wave information and the waveform data (target waveform data) included in the target radio wave information.

[0084] In addition, when the received radio wave information includes radio wave characteristic information, the calculation unit 23 may calculate the radio wave matching degree DR based on the radio wave characteristic information (received radio wave characteristic information) included in the received radio wave information and the radio wave characteristic information (target radio wave characteristic information) included in the target radio wave information.

[0085] In addition, when the received radio wave information includes waveform data, the calculation unit 23 may calculate the radio wave matching degree DR based on the radio wave characteristic information (received radio wave characteristic information) extracted from the waveform data included in the received radio wave information and the radio wave characteristic information (target radio wave characteristic information) included in the target radio wave information.

[0086] Next, a method for calculating the radio wave matching degree DR based on the waveform data will be described. The calculation unit 23 may calculate the radio wave matching degree between the received radio wave information and the target radio wave information from, for example, the radio wave characteristic information extracted from the received waveform data and the target radio wave characteristic information. The target radio wave characteristic information is stored in a storage means. The target radio wave characteristic information is the radio wave characteristic information extracted from the target waveform data.

[0087] The calculation unit 23 first extracts radio wave characteristic information from the received waveform data received by the radio wave information receiving unit 22. Extraction rules indicating which feature quantities are to be extracted as radio wave characteristic information from the received waveform data are determined in advance. The calculation unit 23 extracts the radio wave characteristic information from the received waveform data in accordance with the extraction rules.

[0088] Then, the calculation unit 23 calculates the degree of radio wave matching DR from the radio wave characteristic information extracted from the received waveform data and the target radio wave characteristic information. Note that any method can be used to calculate the degree of radio wave matching.

[0089] The calculation unit 23 can also use machine learning to calculate the radio wave matching degree DR. The calculation unit 23 calculates the radio wave matching degree DR by using a calculation model generated by a learning means (not shown). For example, the calculation model may be a model that calculates the radio wave matching degree DR from received waveform data. Also, the calculation model may be a model that calculates the radio wave matching degree DR from received radio wave characteristic information. The calculation model is generated, for example, by signal waveform data or radio wave characteristic information of radio waves output from various transmission sources.

[0090] Furthermore, the calculation unit 23 can utilize machine learning to extract the radio wave characteristic information. The calculation unit 23 extracts the radio wave characteristic information from the received waveform data using an extraction model generated by the learning means. The extraction model is a model that extracts the radio wave characteristic information from the signal waveform data. The extraction model is generated, for example, from signal waveform data of radio waves output from various transmission sources. The input to the extraction model is the received waveform data received by the radio wave information receiving unit 22. Furthermore, the output from the extraction model is the radio wave characteristic information extracted from the received waveform data.

[0091] The information output device may further include an estimation unit 35. An example of the configuration of the information output device 30 including the estimation unit 35 is shown in FIG.

[0092] The estimation unit 35 estimates the position of the object when there is a pair having a degree of match D higher than a predetermined value. Then, the output unit 24 may output the estimation result of the object position by including it in the output information.

[0093] For example, when there is a pair with a degree of match D higher than a predetermined value, the estimation unit 35 may estimate the installation position of the camera or the installation position of the radio wave sensor of the pair with the highest degree of match D as the position of the target object.

[0094] The estimation unit 35 may estimate the position of the object based on the calculation result of the radio wave matching degree DR. For example, the estimation unit 35 estimates the position of the object when there is a pair having a matching degree D higher than a predetermined value (threshold value for matching degree) and there are two or more pieces of received radio wave information having a radio wave matching degree DR higher than a predetermined value (threshold value for radio wave matching degree).

[0095] When the radio wave sensors are installed close to each other, the target radio wave may be received by two or more of the radio wave sensors. In such a case, the number of pieces of received radio wave information having a radio wave match degree DR higher than the predetermined value becomes two or more.

[0096] For example, the estimation unit 35 may estimate, as the position of the target, a location where the receiving areas of the radio wave sensors that are the transmission sources of the received radio wave information overlap for two or more pieces of received radio wave information having a radio wave matching degree DR higher than a predetermined value. The estimation unit 35 may also estimate, as the position of the target, a location where the receiving area of ​​the radio wave sensor that is the transmission source of the received radio wave information overlaps with the shooting area of ​​the pair of cameras with the highest matching degree D.

[0097] The estimation unit 35 may estimate the position of the object based on the position identification information for two or more pieces of received radio wave information whose radio wave matching degree DR is higher than a predetermined value. The position identification information is information that can be used to identify the position of the source of the radio wave.

[0098] The radio wave information receiving unit 22 may receive position identification information for radio waves received by the radio wave sensor 50-i. The position identification information may include, for example, direction information indicating the direction from which the radio waves arrive at the radio wave sensor 50-i. The radio wave sensor 50-i may estimate the direction from which the signal arrives by, for example, an antenna whose directivity can be controlled by beamforming or rotation. The position identification information may also include information used in a radio wave emission position estimation method such as the AOA (Angle of Arrival) method, the POA (Power of Arrival) method, or the TDOA (Time Difference of Arrival) method.

[0099] For example, the estimation unit 35 estimates the position of the wireless communication terminal for two or more pieces of received radio wave information for which a radio wave matching degree DR higher than a predetermined value is calculated, based on the position identification information received from the radio wave sensor that is the source of the received radio wave information.

[0100] Furthermore, the estimation unit 35 may further estimate the moving direction of the object based on the estimation result of the position of the object. The estimation unit 35 may estimate the moving direction of the object based on, for example, two or more estimation results of the position of the object.

[0101] Furthermore, the output unit 24 may output information including the information on the moving direction of the object in the output information. When the information on the moving direction of the object is output, it becomes possible to draw the inspector's attention to the image captured by the camera installed in the moving direction of the object.

[0102] The output unit 24 may also specify a camera installed in the moving direction of the object, and output information including the camera's information in the output information. The output unit 24 may also output information including the image captured by the specified camera in the output information.

[0103] The information output device may further include a control unit 46. An example of the configuration of the information output device 40 including the control unit 46 is shown in FIG.

[0104] When the image match degree DI is higher than a predetermined value, the control unit 46 controls the receiving area of ​​the radio wave sensor of the set having the image match degree DI higher than the predetermined value. The control unit 46 controls the receiving area of ​​the radio wave sensor to be controlled so that it is approximately the same as the shooting area of ​​the camera or narrower than the shooting area. The control unit 46 can control the receiving area of ​​the radio wave sensor by controlling the antenna beam width and beam direction.

[0105] In this case, the calculation unit 23 calculates the degree of radio wave match DR and the degree of match D by using the received radio wave information received by the radio wave information receiving unit 22 after the receiving area has been controlled.

[0106] In this way, the number of radio waves received by the radio wave sensor may be reduced, and the calculation unit 23 may be able to improve the accuracy of the radio wave matching degree DR.

[0107] Next, an example of the operation flow of the information output device 20 of this embodiment will be described. Fig. 10 shows an example of the operation flow of the information output device 20 of this embodiment.

[0108] The image information receiving unit 21 receives captured image information from the cameras 60-1 to 60-M. For example, the image information receiving unit 21 receives the captured image information at predetermined time intervals (step S201).

[0109] Furthermore, the radio wave information receiver 22 receives received radio wave information from the radio wave sensors 50-1 to 50-N. For example, the radio wave information receiver 22 receives received radio wave information at predetermined time intervals (step S202).

[0110] The calculation unit 23 calculates the degree of match between the reception information and the object information for each pair of a camera and a radio wave sensor associated with the camera (step S203). For example, the calculation unit 23 calculates the degree of match at predetermined time intervals.

[0111] The output unit 24 outputs the output information (step S204).

[0112] An example of the operation flow of the information output device 30 (FIG. 8) of this embodiment will be described below. FIG 11 shows an example of the operation flow of the information output device 30 of this embodiment.

[0113] Steps S301 to S303 are similar to steps S201 to S203 in FIG.

[0114] The estimation unit 35 estimates the position of the object (step S304). The estimation unit 35 may further estimate the moving direction of the object.

[0115] The output unit 24 outputs the output information (step S305). The output unit 24 may output the output information including the estimation result of the position of the target object. The output unit 24 may output the output information including the estimation result of the moving direction of the target object.

[0116] Next, an example of the operation flow of the information output device 40 (FIG. 9) of this embodiment will be described. FIG 12 shows an example of the operation flow of the information output device 40 of this embodiment.

[0117] Steps S401 and S402 are similar to steps S201 and S202 in FIG.

[0118] The calculation unit 23 calculates the image coincidence degree DI for each piece of captured image information (step S403).

[0119] When the image match degree DI is higher than the predetermined value, the control unit 46 controls the receiving area of ​​the radio wave sensor of the set in which the image match degree DI is higher than the predetermined value (step S404).

[0120] The radio wave information receiver 22 receives the received radio wave information from the controlled radio wave sensor (step S405).

[0121] The calculation unit 23 calculates the degree of match between the reception information and the object information for each pair of a camera and a radio wave sensor associated with the camera (step S406). At this time, for a pair having an image match degree DI higher than a predetermined value, the calculation unit 23 calculates the radio wave match degree DR and the match degree D using the reception radio wave information received by the radio wave information receiving unit 22 after the receiving area is controlled (i.e., received in step S405).

[0122] The output unit 24 outputs the output information (step S407).

[0123] As described above, in the second embodiment of the present disclosure, the information output device 20 includes the image information receiving unit 21, the radio wave information receiving unit 22, the calculation unit 23, and the output unit 24. The image information receiving unit 21 receives captured image information from a plurality of cameras. The captured image information is information of an image captured by the camera. The radio wave information receiving unit 22 receives received radio wave information from a plurality of radio wave sensors. The received radio wave information is information of radio waves received by the radio wave sensors. The calculation unit 23 calculates a degree of match between the received information and the object information for each pair of a camera and a radio wave sensor associated with the camera. The received information includes captured image information received from the camera of the pair and received radio wave information received from the radio wave sensor of the pair. The object information includes target image information and target radio wave information. The target image information is information of an image of the object. The target radio wave information is information of radio waves emitted by a wireless communication terminal associated with the object. In calculating the degree of match, the calculation unit 23 changes a weighting coefficient for each of the captured image information and the received radio wave information according to the pair. The output unit 24 outputs the output information, which is information related to the calculation result of the degree of match.

[0124] In this way, the information output device 20 changes the weighting coefficients for the captured image information and the received radio wave information in calculating the degree of match according to the pair. As a result, for a pair in which the captured image information is the cause of the deterioration of the detection accuracy, the weighting coefficient for the captured image information can be lowered to reduce the influence of the captured image information on the degree of match. Also, for a pair in which the received radio wave information is the cause of the deterioration of the detection accuracy, the weighting coefficient for the received radio wave information can be lowered to reduce the influence of the received radio wave information on the degree of match. As a result, it is possible to reduce the possibility that the degree of match will be low when an object is present, or the possibility that the degree of match will be high when an object is not present. Therefore, it is possible to improve the detection accuracy of the object.

[0125] Furthermore, the calculation unit 23 calculates an image matching degree and a radio wave matching degree, and calculates a matching degree based on the image matching degree and the radio wave matching degree. The image matching degree indicates the degree of matching between the captured image information and the target image information. The radio wave matching degree indicates the degree of matching between the received radio wave information and the target radio wave information. This makes it possible to calculate the matching degree between the image and the radio wave.

[0126] Furthermore, the calculation unit 23 changes the weighting factor for the captured image information according to the brightness information of the set. The brightness information is information about the brightness of the location where the camera is installed. This makes it possible to reduce the weighting factor for the captured image information when the reliability of the captured image information is low due to the location where the camera is installed being dark.

[0127] Furthermore, the calculation unit 23 changes the weighting coefficient for the captured image information depending on the time of day when the image indicated by the captured image information was captured. This allows the weighting coefficient for the captured image information to be changed depending on the time of day, for example, when the brightness of the location where the camera is installed varies depending on the time of day.

[0128] Furthermore, the calculation unit 23 changes the weighting coefficient for the captured image information according to the brightness of the image indicated by the captured image information. In this way, when the reliability of the captured image information changes according to the brightness of the image, the weighting coefficient for the captured image information can be changed according to the brightness of the screen.

[0129] Furthermore, the calculation unit 23 changes the weighting factor for the captured image information according to the resolution information indicating the resolution of the camera in the set. This makes it possible to reduce the weighting factor for the captured image information when the reliability of the captured image information is low due to a low resolution of the camera.

[0130] Furthermore, the calculation unit 23 changes the weighting coefficient for the received radio wave information according to reliability information indicating the reliability of the received radio wave information. This makes it possible to reduce the influence of the received radio wave information on the match degree for a pair in which the reliability of the received radio wave information is the cause of a decrease in detection accuracy.

[0131] Furthermore, the calculation unit 23 changes the weighting coefficient for the received radio wave information according to the time period in which the radio wave indicated by the received radio wave information was received by the radio wave sensor. This makes it possible to change the weighting coefficient for the received radio wave information when the reliability of the received radio wave information varies depending on the time period.

[0132] Furthermore, the calculation unit 23 changes the weighting coefficient for the received radio wave information according to the reception level of the radio wave indicated by the received radio wave information, thereby making it possible to change the weighting coefficient for the received radio wave information when the reliability of the received radio wave information varies depending on the reception level.

[0133] The output information includes information about the pair whose degree of match is calculated to satisfy a predetermined condition. The condition may be that the degree of match is higher than a predetermined value and is the highest. This makes it possible to output information about the pair that is likely to have a target object nearby.

[0134] The output information includes at least one of the camera installation position information and the radio wave sensor installation position information for the pair for which the degree of match that satisfies the condition has been calculated, thereby making it possible to output the installation position information for the pair that is likely to have a target object nearby.

[0135] The output information also includes information on the degree of match for the pair for which the degree of match that satisfies the condition has been calculated. This makes it possible to output information indicating the degree of possibility for a pair for which the target object is likely to be present nearby. The information output device 30 further includes an estimation unit 35. When there is a pair whose degree of match is higher than a predetermined value, the estimation unit 35 estimates the position of the target object. This makes it possible to provide information that is useful to the person making the check.

[0136] Furthermore, when there is a plurality of pieces of received radio wave information with a degree of radio wave match higher than a predetermined value, the estimation unit 35 estimates the location where the receiving areas of the radio wave sensors that are the transmission sources of the received radio wave information overlap as the position of the target.

[0137] Furthermore, when there are a plurality of pieces of received radio wave information with a radio wave matching degree higher than a predetermined value, the estimation unit 35 may estimate the position of the object based on the position identification information that can be used to identify the position of the source that emits the radio waves. This makes it possible to estimate the position of the object.

[0138] Furthermore, the estimation unit 35 estimates the moving direction of the object based on the position of the object. This allows the inspector to focus on the image captured by the camera installed in the moving direction of the object, making it easier for the inspector to check the object.

[0139] In addition, the output unit 24 identifies a camera installed in the moving direction of the object, and outputs information about the image captured by the camera, including it in the output information. This makes it easier for the inspector to inspect the object.

[0140] [Hardware configuration example] An example of the configuration of hardware resources for implementing the information output device (10, 20, 30, 40) in each embodiment of the present disclosure described above using one information processing device (computer) will be described. Note that the information output device may be physically or functionally implemented using at least two information processing devices. The information output device may also be implemented as a dedicated device. Also, only a part of the functions of the information output device may be implemented using an information processing device.

[0141] 13 is a diagram illustrating an example of a hardware configuration of an information processing device capable of realizing the information output device of each embodiment of the present disclosure. The information processing device 90 includes a communication interface 91, an input / output interface 92, a computing device 93, a storage device 94, a non-volatile storage device 95, and a drive device 96.

[0142] For example, the image information receiving unit 11, the radio wave information receiving unit 12 and the output unit 14 in FIG. 1 can be realized by a communication interface 91 and a calculation device 93, and the calculation unit 13 can be realized by the calculation device 93.

[0143] The communication interface 91 is a communication means for the information output device of each embodiment to communicate with an external device via wired and / or wireless communication. When the information output device is realized using at least two information processing devices, the devices may be connected to each other via the communication interface 91 so as to be able to communicate with each other.

[0144] The input / output interface 92 is a man-machine interface including a keyboard as an example of an input device and a display as an output device.

[0145] The arithmetic device 93 is realized by an arithmetic processing device such as a general-purpose CPU (Central Processing Unit) or a microprocessor, and a plurality of electric circuits. The arithmetic device 93 can, for example, read various programs stored in a non-volatile storage device 95 into the storage device 94 and execute processing according to the read programs.

[0146] The storage device 94 is a memory device such as a RAM (Random Access Memory) that can be referenced by the arithmetic device 93, and stores programs, various data, etc. The storage device 94 may be a volatile memory device.

[0147] The non-volatile storage device 95 is, for example, a non-volatile storage device such as a ROM (Read Only Memory) or a flash memory, and is capable of storing various programs, data, and the like.

[0148] The drive device 96 is, for example, a device that processes reading and writing of data from and to a recording medium 97, which will be described later.

[0149] The recording medium 97 is any recording medium capable of recording data, such as an optical disk, a magneto-optical disk, or a semiconductor flash memory.

[0150] Each embodiment of the present disclosure may be realized, for example, by configuring an information output device using an information processing device 90 illustrated in FIG. 13 and supplying a program capable of realizing the functions described in each of the above embodiments to this information output device.

[0151] In this case, the embodiment can be realized by having the arithmetic device 93 execute the program supplied to the information output device. Also, it is possible to configure some, but not all, of the functions of the information output device in the information processing device 90.

[0152] Furthermore, the information output device may be configured so that the above program is recorded on a recording medium 97 and is appropriately stored in the non-volatile storage device 95 at the shipping stage or operation stage of the information output device. In this case, the method of supplying the above program may be a method of installing the program in the information output device using an appropriate tool at the manufacturing stage before shipping or at the operation stage. The method of supplying the above program may also be a general method such as downloading the program from an external source via a communication line such as the Internet.

[0153] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0154] (Appendix 1) an image information receiving unit that receives captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving unit that receives received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation unit that calculates, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information which is information on an image of an object, and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; an output unit that outputs output information that is information regarding the calculation result of the degree of match; Equipped with the calculation unit changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output device.

[0155] (Appendix 2) The calculation unit calculates an image match degree indicating a degree of match between the photographed image information and the target image information, and a radio wave match degree indicating a degree of match between the received radio wave information and the target radio wave information, and calculates the match degree based on the image match degree and the radio wave match degree. 2. An information output device according to claim 1.

[0156] (Appendix 3) The calculation unit changes a weighting coefficient for the captured image information in accordance with brightness information that is information regarding the brightness of a location where the camera of the set is installed. 3. An information output device according to claim 1 or 2.

[0157] (Appendix 4) the calculation unit changes a weighting coefficient for the captured image information in accordance with a time period during which the image indicated by the captured image information was captured; An information output device according to any one of Supplementary Note 1 to Supplementary Note 3.

[0158] (Appendix 5) The calculation unit changes a weighting coefficient for the captured image information in accordance with brightness of an image indicated by the captured image information. An information output device according to any one of Supplementary Note 1 to Supplementary Note 4.

[0159] (Appendix 6) The calculation unit changes a weighting coefficient for the captured image information in accordance with resolution information indicating a resolution of the camera of the set. An information output device according to any one of Supplementary Note 1 to Supplementary Note 5.

[0160] (Appendix 7) The calculation unit changes a weighting coefficient for the received radio wave information in accordance with reliability information indicating reliability of the received radio wave information. An information output device according to any one of Supplementary Note 1 to Supplementary Note 6.

[0161] (Appendix 8) The calculation unit changes a weighting coefficient for the received radio wave information in accordance with a time period during which the radio wave indicated by the received radio wave information is received by the radio wave sensor. An information output device according to any one of Supplementary Note 1 to Supplementary Note 7.

[0162] (Appendix 9) The calculation unit changes a weighting coefficient for the received radio wave information in accordance with a reception level of the radio wave indicated by the received radio wave information. An information output device according to any one of Supplementary Note 1 to Supplementary Note 8.

[0163] (Appendix 10) the output information includes information about the pair for which the degree of match that satisfies a predetermined condition has been calculated. An information output device according to any one of Supplementary Note 1 to Supplementary Note 9.

[0164] (Appendix 11) The condition is that the degree of match is higher than a predetermined value and that the degree of match is the highest. 11. The information output device according to claim 10.

[0165] (Appendix 12) The output information includes at least one of information on the installation position of the camera and information on the installation position of the radio wave sensor for the pair for which the degree of match that satisfies the condition has been calculated. 12. The information output device according to claim 10 or 11.

[0166] (Appendix 13) the output information includes information on the degree of match for the set for which the degree of match that satisfies the condition has been calculated, 13. An information output device according to any one of claims 10 to 12.

[0167] (Appendix 14) an estimation unit that estimates a position of the object when the matching degree is higher than a predetermined value; 14. The information output device according to any one of claims 1 to 13, further comprising:

[0168] (Appendix 15) When there is a plurality of pieces of received radio wave information whose radio wave matching degree indicating the degree of matching between the received radio wave information and the target radio wave information is higher than a predetermined value, the estimation unit estimates a location where areas in which radio waves are received by the radio wave sensor that is the transmission source of the received radio wave information overlap as the position of the target. 15. The information output device according to claim 14.

[0169] (Appendix 16) The estimation unit estimates the position of the object based on position identification information that is information that can be used to identify the position of a source that emits radio waves when there is a plurality of pieces of received radio wave information in which a radio wave matching degree indicating a degree of matching between the received radio wave information and the target radio wave information is higher than a predetermined value. 15. The information output device according to claim 14.

[0170] (Appendix 17) The estimation unit estimates a moving direction of the object based on a position of the object. 17. An information output device according to any one of claims 14 to 16.

[0171] (Appendix 18) The output unit identifies the camera installed in the moving direction of the object, and outputs information of an image captured by the camera in the output information. 18. The information output device according to claim 17.

[0172] (Appendix 19) an image information receiving means for receiving captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving means for receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation means for calculating, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, and object information including target image information which is information on an image of an object and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; an output means for outputting output information which is information related to the calculation result of the degree of match; Equipped with the calculation means changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output system.

[0173] (Appendix 20) receiving captured image information from a plurality of cameras, the captured image information being information on images captured by the cameras; receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from a plurality of the radio wave sensors; For each pair of the camera and the radio wave sensor associated with the camera, a degree of match is calculated between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, and object information including target image information which is information on an image of an object and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; outputting output information which is information regarding the calculation result of the degree of match; In the calculation of the degree of match, a weighting factor for each of the captured image information and the received radio wave information is changed in accordance with the pair. Information output method.

[0174] (Appendix 21) Calculating an image matching degree indicating a degree of matching between the photographed image information and the target image information, and a radio wave matching degree indicating a degree of matching between the received radio wave information and the target radio wave information, and calculating the matching degree based on the image matching degree and the radio wave matching degree. 21. The information output method according to claim 20.

[0175] (Appendix 22) A weighting coefficient for the captured image information is changed in accordance with brightness information, which is information regarding the brightness of a location where the camera of the set is installed. 22. The information output method according to claim 20 or 21.

[0176] (Appendix 23) A weighting coefficient for the captured image information is changed according to a time period when the image represented by the captured image information was captured. 23. The information output method according to any one of claims 20 to 22.

[0177] (Appendix 24) A weighting coefficient for the captured image information is changed according to the brightness of an image represented by the captured image information. 24. The information output method according to any one of claims 20 to 23.

[0178] (Appendix 25) A weighting coefficient for the captured image information is changed in accordance with resolution information indicating a resolution of the camera of the set. An information output method according to any one of Supplementary Note 20 to Supplementary Note 24.

[0179] (Appendix 26) changing a weighting coefficient for the received radio wave information in accordance with reliability information indicating reliability of the received radio wave information; An information output method according to any one of Supplementary Note 20 to Supplementary Note 25.

[0180] (Appendix 27) A weighting coefficient for the received radio wave information is changed according to a time period during which the radio wave indicated by the received radio wave information is received by the radio wave sensor. An information output method according to any one of Supplementary Note 20 to Supplementary Note 26.

[0181] (Appendix 28) A weighting coefficient for the received radio wave information is changed in accordance with a reception level of the radio wave indicated by the received radio wave information. An information output method according to any one of Supplementary Note 20 to Supplementary Note 27.

[0182] (Appendix 29) the output information includes information about the pair for which the degree of match that satisfies a predetermined condition has been calculated. An information output method according to any one of Supplementary Note 20 to Supplementary Note 28.

[0183] (Appendix 30) The condition is that the degree of match is higher than a predetermined value and that the degree of match is the highest. 29. The information output method according to claim 29.

[0184] (Appendix 31) The output information includes at least one of information on the installation position of the camera and information on the installation position of the radio wave sensor for the pair for which the degree of match that satisfies the condition has been calculated. 31. The information output method according to claim 29 or 30.

[0185] (Appendix 32) the output information includes information on the degree of match for the set for which the degree of match that satisfies the condition has been calculated, An information output method according to any one of Supplementary Note 29 to Supplementary Note 31.

[0186] (Appendix 33) If there is a pair whose degree of match is higher than a predetermined value, the position of the object is estimated. 33. The information output method according to any one of Supplementary Note 20 to Supplementary Note 32.

[0187] (Appendix 34) When there is a plurality of pieces of received radio wave information whose radio wave matching degree indicating the degree of matching between the received radio wave information and the target radio wave information is higher than a predetermined value, a location where areas where radio waves are received by the radio wave sensor that is the transmission source of the received radio wave information overlap is estimated as the position of the target. 34. The information output method according to claim 33.

[0188] (Appendix 35) When there is a plurality of pieces of received radio wave information having a radio wave matching degree, which indicates a degree of matching between the received radio wave information and the target radio wave information, higher than a predetermined value, the position of the target object is estimated based on position identification information, which is information that can be used to identify the position of a source that emits radio waves. 34. The information output method according to claim 33.

[0189] (Appendix 36) Estimating a moving direction of the object based on the position of the object; 36. The information output method according to any one of Supplementary Note 33 to Supplementary Note 35.

[0190] (Appendix 37) identifying the camera installed in the moving direction of the object, and outputting information of an image captured by the camera in the output information; 37. The information output method according to claim 36.

[0191] (Appendix 38) On the computer, an image information receiving function for receiving captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving function for receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation function for calculating, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information which is information on an image of an object, and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; and an output function for outputting output information which is information regarding the calculation result of the degree of match; Realize this, the calculation function changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output program.

[0192] (Appendix 39) The calculation function calculates an image matching degree indicating a degree of matching between the photographed image information and the target image information, and a radio wave matching degree indicating a degree of matching between the received radio wave information and the target radio wave information, and calculates the matching degree based on the image matching degree and the radio wave matching degree. 39. The information output program according to claim 38.

[0193] (Appendix 40) The calculation function changes a weighting coefficient for the captured image information in accordance with brightness information that is information regarding the brightness of a location where the camera of the set is installed. The information output program according to claim 38 or 39.

[0194] (Appendix 41) The calculation function changes a weighting coefficient for the captured image information according to a time period when the image indicated by the captured image information was captured. An information output program according to any one of appendices 38 to 40.

[0195] (Appendix 42) The calculation function changes a weighting coefficient for the captured image information in accordance with the brightness of an image represented by the captured image information. An information output program according to any one of appendix 38 to appendix 41.

[0196] (Appendix 43) The calculation function changes a weighting coefficient for the captured image information in accordance with resolution information indicating a resolution of the camera of the set. An information output program according to any one of appendix 38 to appendix 42.

[0197] (Appendix 44) The calculation function changes a weighting coefficient for the received radio wave information according to reliability information indicating reliability of the received radio wave information. An information output program according to any one of appendix 38 to appendix 43.

[0198] (Appendix 45) The calculation function changes a weighting coefficient for the received radio wave information according to a time period in which the radio wave indicated by the received radio wave information is received by the radio wave sensor. An information output program according to any one of appendix 38 to appendix 44.

[0199] (Appendix 46) The calculation function changes a weighting coefficient for the received radio wave information in accordance with a reception level of the radio wave indicated by the received radio wave information. An information output program according to any one of appendix 38 to appendix 45.

[0200] (Appendix 47) the output information includes information about the pair for which the degree of match that satisfies a predetermined condition has been calculated. An information output program according to any one of appendix 38 to appendix 46.

[0201] (Appendix 48) The condition is that the degree of match is higher than a predetermined value and that the degree of match is the highest. 48. An information output program according to claim 47.

[0202] (Appendix 49) The output information includes at least one of information on the installation position of the camera and information on the installation position of the radio wave sensor for the pair for which the degree of match that satisfies the condition has been calculated. An information output program according to appendix 47 or appendix 48.

[0203] (Appendix 50) the output information includes information on the degree of match for the set for which the degree of match that satisfies the condition has been calculated, An information output program according to any one of appendix 47 to appendix 49.

[0204] (Appendix 51) an estimation function for estimating a position of the object when the match degree is higher than a predetermined value; The information output program according to any one of claims 38 to 50, further comprising:

[0205] (Appendix 52) When there is a plurality of pieces of received radio wave information whose radio wave matching degree indicating the degree of matching between the received radio wave information and the target radio wave information is higher than a predetermined value, the estimation function estimates a location where areas where radio waves are received by the radio wave sensor that is the transmission source of the received radio wave information overlap as the position of the target. 52. The information output program according to claim 51.

[0206] (Appendix 53) The estimation function estimates the position of the object based on position identification information that can be used to identify the position of a source that emits radio waves when there is a plurality of pieces of received radio wave information in which the degree of match between the received radio wave information and the target radio wave information is higher than a predetermined value. 52. The information output program according to claim 51.

[0207] (Appendix 54) The estimation function estimates a moving direction of the object based on a position of the object. An information output program according to any one of claims 51 to 53.

[0208] (Appendix 55) The output function identifies the camera installed in the moving direction of the object, and outputs information on an image captured by the camera in the output information. 55. An information output program according to claim 54.

[0209] Although the present invention has been described above with reference to the embodiment, the present invention is not limited to the above embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0210] 10, 20, 30, 40 Information output device 11, 21 Image information receiving section 12, 22 Radio wave information receiving unit 13, 23 Calculation section 14, 24 Output section 35 Estimation part 46 Control Unit 50-i Radio wave sensor 60-j camera 70 Display means 80 Surveillance Systems 90 Information processing equipment 91 Communication Interface 92 Input / Output Interface 93 Arithmetic unit 94 Storage device 95 Non-volatile storage devices 96 Drive device 97 Recording media

Claims

1. an image information receiving unit that receives captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving unit that receives received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation unit that calculates, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information which is information on an image of an object, and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; an output unit that outputs output information that is information regarding the calculation result of the degree of match; Equipped with the calculation unit changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output device.

2. The calculation unit calculates an image match degree indicating a degree of match between the photographed image information and the target image information, and a radio wave match degree indicating a degree of match between the received radio wave information and the target radio wave information, and calculates the match degree based on the image match degree and the radio wave match degree.

2. The information output device according to claim 1.

3. The calculation unit changes a weighting coefficient for the captured image information in accordance with brightness information that is information regarding the brightness of a location where the camera of the set is installed.

3. The information output device according to claim 1 or 2.

4. The calculation unit changes a weighting coefficient for the captured image information in accordance with resolution information indicating a resolution of the camera of the set.

3. The information output device according to claim 1 or 2.

5. The calculation unit changes a weighting coefficient for the received radio wave information in accordance with reliability information indicating reliability of the received radio wave information.

3. The information output device according to claim 1 or 2.

6. an estimation unit that estimates a position of the object when the matching degree is higher than a predetermined value; The information output device according to claim 1 or 2, further comprising:

7. The estimation unit estimates a moving direction of the object based on a position of the object.

7. The information output device according to claim 6.

8. an image information receiving means for receiving captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving means for receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation means for calculating, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, and object information including target image information which is information on an image of an object and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; an output means for outputting output information which is information related to the calculation result of the degree of match; Equipped with the calculation means changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output system.

9. receiving captured image information from a plurality of cameras, the captured image information being information on images captured by the cameras; receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from a plurality of the radio wave sensors; For each pair of the camera and the radio wave sensor associated with the camera, a degree of match is calculated between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, and object information including target image information which is information on an image of an object and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; outputting output information which is information regarding the calculation result of the degree of match; In the calculation of the degree of match, a weighting factor for each of the captured image information and the received radio wave information is changed in accordance with the pair. Information output method.

10. On the computer, an image information receiving function for receiving captured image information, which is information on images captured by the cameras, from the plurality of cameras; a radio wave information receiving function for receiving received radio wave information, which is information on radio waves received by the radio wave sensors, from the plurality of radio wave sensors; a calculation function for calculating, for each pair of the camera and the radio wave sensor associated with the camera, a degree of match between the captured image information received from the camera of the pair and received information including the received radio wave information received from the radio wave sensor of the pair, target image information which is information on an image of an object, and target radio wave information which is information on radio waves emitted by a wireless communication terminal associated with the object; and an output function for outputting output information which is information regarding the calculation result of the degree of match; Realize this, the calculation function changes a weighting coefficient for each of the captured image information and the received radio wave information in accordance with the pair in calculating the degree of match; Information output program.

Images