Reporting support device, reporting support method, and program

Abstract

One purpose of the present invention is to provide a notification assistance device etc. capable of assisting an operator with ascertainment of a situation when receiving a notification. A notification assistance device according to an aspect of the present disclosure comprises: an acquisition means that acquires a captured image from a notifier terminal, which is a terminal owned by a notifier; an extraction means that extracts characteristic information relating to an object included in the captured image; an identification means that identifies the object on the basis of the extracted characteristic information; and an output means that outputs information relating to the identified object.

Description

[Technical Field]

[0001] The present disclosure relates to a technology for supporting a response to an emergency call. [Background technology]

[0002] When an accident or the like occurs, a person at the scene of the accident will make an emergency call to the police station, fire station, etc. depending on the situation. The operator in the control room who receives the emergency call usually understands the situation from the voice of the caller.

[0003] Patent Document 1 discloses a technology for grasping the situation at the scene when an emergency call is made. Specifically, Patent Document 1 discloses that when an emergency call is received, a video transmission request is sent to the mobile terminal of the caller, and the video captured by the mobile terminal is received. The technology disclosed in Patent Document 1 helps grasp the situation at the scene by having the operator check the video.

[0004] In relation to emergency calls, Patent Document 2 discloses a method for grasping the situation when an emergency transport is performed in response to an emergency call, in which identification information of the patient is acquired at the time of emergency transport and medical information of the patient is acquired based on the identification information. In relation to a technology for acquiring images from a mobile terminal, Patent Document 3 discloses a technology for performing image processing on a captured image depending on whether or not consent has been given to the use of the patient's portrait, and transmitting the image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2021-072642 [Patent Document 2] International Publication No. 2019 / 198358 [Patent Document 3] Japanese Patent Application Laid-Open No. 2005-110004 Summary of the Invention [Problem to be solved by the invention]

[0006] The operator in the control room who receives the call then gives various instructions not only to the caller but also to the police, fire brigade, ambulance, etc. who rush to the scene. For this reason, the operator needs to accurately grasp the situation.

[0007] When the operator can receive the video captured by the caller in the control room, it is easier for the operator to understand the situation at the scene than when only listening to the caller's voice. However, there is a limit to the information that the operator can obtain by viewing the video.

[0008] The present disclosure has been made in consideration of the above-mentioned problems, and one of its objectives is to provide a reporting support device etc. that can assist an operator in understanding a situation when a report is received. [Means for solving the problem]

[0009] A reporting support device according to one aspect of the present disclosure includes an acquisition means for acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter, an extraction means for extracting feature information regarding an object included in the captured image, an identification means for identifying the object based on the extracted feature information, and an output means for outputting information regarding the identified object.

[0010] A reporting support method according to one aspect of the present disclosure acquires a captured image from a reporter terminal, which is a terminal owned by the reporter, extracts feature information about an object contained in the captured image, identifies the object based on the extracted feature information, and outputs information about the identified object.

[0011] A computer-readable storage medium according to one aspect of the present disclosure stores a program that causes a computer to execute the following processes: acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter; extracting feature information about an object contained in the captured image; identifying the object based on the extracted feature information; and outputting information about the identified object. [Effects of the Invention]

[0012] According to the present disclosure, when a report is received, it is possible to assist an operator in understanding the situation. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram schematically illustrating an example of the configuration of a reporting support system including a reporting support device according to a first embodiment of the present disclosure. [Figure 2] 1 is a block diagram illustrating an example of a reporting support device according to a first embodiment of the present disclosure. [Figure 3] 4 is a flowchart illustrating an example of an operation of the reporting support device according to the first embodiment of the present disclosure. [Figure 4] FIG. 10 is a block diagram illustrating an example of a configuration of a reporting support system according to a second embodiment of the present disclosure. [Figure 5] FIG. 10 is a sequence diagram illustrating an example of an operation of the reporting support system according to the second embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram schematically illustrating an example of the configuration of a reporting support system according to a third embodiment of the present disclosure. [Figure 7] FIG. 11 is a diagram illustrating an example of a database according to a third embodiment of the present disclosure. [Figure 8] FIG. 10 is a block diagram illustrating an example of a configuration of a reporting support system according to a third embodiment of the present disclosure. [Figure 9] FIG. 11 is a diagram illustrating an example of an output image according to the third embodiment of the present disclosure. [Figure 10] FIG. 10 is a sequence diagram illustrating an example of an operation of the reporting support system according to the third embodiment of the present disclosure. [Figure 11] FIG. 10 is a diagram schematically illustrating an example of the configuration of a reporting support system according to a fourth embodiment of the present disclosure. [Figure 12] FIG. 10 is a block diagram illustrating an example of the configuration of a reporting support system according to a fourth embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of an output image according to the fourth embodiment of the present disclosure. [Figure 14] FIG. 10 is a sequence diagram illustrating an example of an operation of the reporting support system according to the fourth embodiment of the present disclosure. [Figure 15] FIG. 11 is a block diagram illustrating an example of the configuration of a reporting support system according to a fifth embodiment of the present disclosure. [Figure 16] FIG. 13 is a diagram illustrating an example of a captured image according to a fifth embodiment of the present disclosure. [Figure 17] FIG. 13 is a sequence diagram illustrating an example of an operation of the reporting support system according to the fifth embodiment of the present disclosure. [Figure 18] FIG. 13 is a diagram showing a shooting screen according to a seventh modification of the present disclosure. [Figure 19] 1 is a block diagram showing an example of a hardware configuration of a computer device that realizes a reporting support system according to the first, second, third, fourth, and fifth embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0015] First Embodiment First, the mechanism of reporting will be explained. A caller makes an emergency call by, for example, inputting a predetermined phone number into a mobile phone. This call is connected to a command system in a command room. The command room refers to an organization that issues commands to dispatch those who should rush to the scene (for example, police, fire brigades, and ambulances) depending on the content of the call. An operator in the command room communicates with the caller via the command system. Then, based on the information obtained from the caller, the operator gives instructions to the caller or uses the command system to give instructions to those who should rush to the scene. An example of the reporting support device of the present disclosure is incorporated into a command system used in this way.

[0016] Next, an overview of the reporting support device of the present disclosure will be described.

[0017] Fig. 1 is a diagram schematically illustrating an example of the configuration of a reporting support system 1000 including a reporting support device 100. As shown in Fig. 1, the reporting support system 1000 includes the reporting support device 100 and a reporter terminal 200. The reporting support device 100 is communicably connected to the reporter terminal 200 and an external device 300 via a wireless or wired network. The external device 300 may be included in the reporting support device 100.

[0018] The reporter terminal 200 is a terminal owned by the reporter. The reporter terminal 200 is, for example, a mobile phone, a smartphone, or a tablet terminal, but is not limited to these examples. The reporter terminal 200 may be any terminal that has at least the functions of making a report, taking a photograph, and transmitting the photographed image. For example, when the reporter makes a report using the reporter terminal 200, the report is received by the report support device 100. Then, the operator in the control room who receives the report communicates with the reporter via the report support device 100 and the reporter terminal 200.

[0019] 2 is a block diagram showing an example of a functional configuration of the reporting support device 100 according to the first embodiment. As shown in FIG. 2, the reporting support device 100 includes an acquiring unit 110, an extracting unit 120, an identifying unit 130, and an output unit 140.

[0020] The acquisition unit 110 acquires the captured image from the reporter terminal 200. For example, when a report is made by the reporter terminal 200, the reporter terminal 200 takes a photograph. At this time, the reporting support device 100 may send a signal to the reporter terminal 200 requesting that the reporter take a photograph, thereby activating the camera mounted on the reporter terminal 200. Alternatively, the reporter terminal 200 may start the camera when the reporter terminal 200 accepts input from the reporter. The reporter terminal 200 transmits the captured image generated by capturing the image to the reporting support device 100. The acquisition unit 110 acquires the captured image transmitted from the reporter terminal 200. In this way, the acquisition unit 110 acquires the captured image from the reporter terminal 200 owned by the reporter. The acquisition unit 110 is an example of an acquisition means.

[0021] The extraction unit 120 extracts feature information from the captured image. The feature information is information indicating the features of an object included in the captured image. The feature information is used to identify the object. The use of feature information will be described later. The object may be, for example, a person, or a non-human object such as a sign, billboard, or building. In the present disclosure, such non-human objects are referred to as feature objects. When the object is a person, the feature information may be, for example, feature amounts related to the person's face or feature amounts related to the person's appearance. The person's appearance may include, for example, the person's face, hairstyle, and body shape, or the clothing worn and luggage carried by the person. When the object is a feature object, the feature information may be, for example, feature amounts related to the appearance of the feature object, text information written on the feature object, or a partial image clipped from the captured image that includes the feature object. In this manner, the extraction unit 120 extracts feature information related to the object included in the captured image.

[0022] The identification unit 130 identifies an object based on the feature information. For example, a database containing information in which feature information and information related to objects are previously associated is stored in the external device 300. At this time, the identification unit 130 compares the feature information extracted by the extraction unit 120 with the feature information contained in the database. For example, if the comparison results in a match, the identification unit 130 identifies information associated with the matching feature information, thereby identifying the object. For example, assume that the database contains information in which feature amounts related to a person's face are associated with identification information that identifies the person or personal information such as the person's name. In this case, the identification unit 130 compares the feature amounts related to the person's face extracted by the extraction unit 120 with the feature amounts contained in the database. If the comparison results in a match, the identification unit 130 identifies the identification information or personal information associated with the matching feature amounts.

[0023] For example, assume that the database contains information in which feature amounts related to a person's appearance are associated with attributes indicating gender, age, etc. In this case, the identification unit 130 compares the feature amounts related to the person's appearance extracted by the extraction unit 120 with the feature amounts included in the database. If the comparison results in a match, the identification unit 130 identifies the attribute associated with the matching feature amount.

[0024] The method for identifying an object is not limited to this example. For example, the identification unit 130 may identify the attributes based on a learning model that has previously learned the relationship between the feature amounts related to a person's appearance and the attributes. In this case, the learning model may be stored in the external device 300. Furthermore, for example, if the feature information is text information or a partial image, the identification unit 130 may search for the feature information using a search engine. Then, the identification unit 130 may treat the search results as the result of identifying the object.

[0025] In this way, the identification unit 130 identifies the object based on the extracted feature information. The identification unit 130 is an example of an identification means.

[0026] The output unit 140 outputs information about the object. For example, the output unit 140 outputs information about the object identified by the identification unit 130 to an output device (not shown). Here, the output device is, for example, a display and a speaker. The output device may be a device included in the reporting support device 100, or may be another device communicatively connected to the reporting support device 100. The output unit 140 may output, for example, identification information, personal information, or attributes of the person identified by the identification unit 130. The output unit 140 may also output, for example, a search result by the identification unit 130. However, the output unit 140 may also output information further obtained from information about the object identified by the identification unit 130. For example, it is assumed that the identification information of a person and the person's medical information are associated with each other and stored in a device capable of communicating with the reporting support device 100. Here, the medical information includes the person's health insurance card information, medical information, health checkup results, information about medications taken, etc. The output unit 140 may acquire medical information associated with the identification information identified by the identification unit 130, and output the acquired medical information. Furthermore, for example, the output unit 140 may output information about a feature acquired from a search result by the identification unit 130. For example, if the search result includes position information about the feature, the output unit 140 may output the position information about the feature. In this way, the output unit 140 outputs information about the identified object. The output unit 140 is an example of an output means.

[0027] Next, an example of the operation of the reporting support device 100 will be described with reference to Fig. 3. In this disclosure, each step in a flowchart will be expressed using a number assigned to each step, such as "S1".

[0028] 3 is a flowchart illustrating an example of the operation of the reporting support device 100. The acquisition unit 110 acquires a captured image from a reporter terminal, which is a terminal owned by the reporter (S1). The extraction unit 120 extracts feature information related to an object included in the captured image (S2). The identification unit 130 identifies the object based on the extracted feature information (S3). The output unit 140 outputs information related to the identified object (S4).

[0029] As described above, the reporting support device 100 of the first embodiment acquires a captured image from the reporter terminal 200, which is a terminal owned by the reporter, and extracts feature information about an object included in the captured image. The reporting support device 100 then identifies the object based on the extracted feature information and outputs information about the identified object. For example, assume that an operator in a control room receives a report from a reporter about an accident in which an injured person has occurred. In such a case, if the captured image includes the injured person, the reporting support device 100 can output information about the injured person. For example, the operator can use the output information about the injured person to give further instructions to the reporter or to send commands to an emergency team or the like rushing to the scene. Furthermore, if the captured image includes features such as signs, billboards, and buildings near the reporter, the reporting support device 100 can output information about the features. For example, the operator can use the output information about the features to identify the location of the reporter. As described above, the reporting support device 100 of the first embodiment can assist the operator in understanding the situation when receiving a report.

[0030] <Second embodiment> Next, a reporting support device according to a second embodiment will be described. In the second embodiment, the reporting support device 100 described in the first embodiment will be described in more detail. Note that some of the contents that overlap with those described in the first embodiment will not be described again.

[0031] Fig. 4 is a block diagram showing an example of the configuration of the reporting support system 1000. As shown in Fig. 4, the reporting support system 1000 includes a reporting support device 100 and a reporter terminal 200. The reporting support device 100 and the reporter terminal 200 are connected so as to be able to communicate with each other.

[0032] [Details of the report support device 100] As shown in FIG. 4, the report support device 100 includes an acquisition unit 110, an extraction unit 120, an identification unit 130, an output unit 140, a reception unit 150, and an imaging request unit 160.

[0033] The reception unit 150 receives a report from the reporter terminal 200. When the reception unit 150 receives a report, a call is started between the report support device 100 and the reporter terminal 200, for example, using a telephone line.

[0034] The photographing requesting unit 160 transmits a photographing request to the reporter terminal 200. For example, the photographing requesting unit 160 transmits a message using the telephone number of the reporter terminal 200. At this time, the photographing requesting unit 160 may transmit the message using SMS (Short Message Service). The message includes, for example, a URL (Uniform Resource Locator). For example, when the URL of the message is opened in the reporter terminal 200, data communication between the reporter terminal 200 and the reporting support device 100 is started. The photographing requesting unit 160 may transmit, for example, such a message as a photographing request. The photographing requesting unit 160 may automatically transmit a photographing request when the receiving unit 150 receives a report. Furthermore, the photographing requesting unit 160 may transmit a photographing request when an operation to transmit a photographing request is received from an operator after the report is received.

[0035] The acquisition unit 110 acquires the captured image from the reporter terminal 200 when data communication is started in response to the image capture request. The captured image may be one or more still images or may be a video. If the captured image is a video, the acquisition unit 110 may continue to acquire the video being captured by the reporter terminal 200 in real time.

[0036] The extraction unit 120 extracts feature information from the captured image. At this time, the extraction unit 120 may extract feature information from any of the captured images acquired by the acquisition unit 110.

[0037] The identification unit 130 identifies an object included in the captured image based on the extracted feature information. For example, a database containing information in which feature information and information related to objects are associated is stored in advance in the external device 300. At this time, the identification unit 130 compares the feature information extracted by the extraction unit 120 with the feature information included in the database. If the comparison results in a match, the identification unit 130 identifies the object by identifying information associated with the matching feature information. Furthermore, for example, if the feature information is text information or a partial image, the identification unit 130 may search for the feature information using a search engine. The identification unit 130 may treat the search results as a result of identifying the object.

[0038] Furthermore, the identification unit 130 may identify an object based on a learning model generated in advance. The learning model is a model that learns the relationship between feature information and information about the object. For example, the learning model may be a model that receives feature amounts related to a person's appearance as input and outputs attributes of the person. The learning model may be generated using various machine learning algorithms. Examples of machine learning algorithms include, but are not limited to, SVM (Support Vector Machine), neural networks, and random forests.

[0039] The output unit 140 outputs information about the object identified by the identification unit 130. For example, the output unit 140 outputs the information to an output device communicatively connected to the reporting support device 100. The output device may be, for example, a device that can be visually confirmed by an operator, or may be a device owned by a subject who should rush to the scene.

[0040] [Details of the reporter terminal 200] The reporter terminal 200 includes a reporting unit 210, a request receiving unit 220, an image capturing unit 230, and a data transmitting unit 240.

[0041] The reporting unit 210 makes a report. More specifically, the reporting unit 210 accepts input of an emergency call telephone number from the caller. The reporting unit 210 makes the report to the call destination corresponding to the input telephone number, for example, using a telephone line. When the report is accepted by the report support device 100 at the call destination, the reporting unit 210 starts two-way communication with the call destination. In other words, the reporting unit 210 realizes a call between the caller and an operator at the call destination via the caller terminal 200 and the report support device 100.

[0042] The request receiving unit 220 receives an image capture request from the reporting support device 100. For example, the request receiving unit 220 receives a message using an SMS as described above as an image capture request. Then, the reporter opens a URL included in the message, thereby starting data communication between the reporting support device 100 and the reporter terminal 200. This data communication may be realized by, for example, WebRTC (Web Real Time Communication). That is, the reporter opens a URL included in the message, thereby allowing data communication between the reporting support device 100 and the reporter terminal 200 via a browser.

[0043] The photographing unit 230 takes a photograph and generates a photographed image. That is, the photographing unit 230 has the function of a camera installed in the reporter terminal 200. For example, when the request receiving unit 220 receives a photographing request, the photographing unit 230 activates the camera function. Then, the photographing unit 230 starts photographing. For example, the photographing unit 230 may activate the camera function and start photographing in response to opening a URL included in the message as described above. Note that the timing at which photographing starts is not limited to this example. For example, the photographing unit 230 may start photographing by accepting an operation from the reporter after the camera function has been activated.

[0044] The data transmission unit 240 transmits the captured image to the reporting support device 100. For example, the data transmission unit 240 may transmit the video captured by the imaging unit 230 to the reporting support device 100 in real time. Furthermore, when a still image is captured by the imaging unit 230, the data transmission unit 240 may transmit the still image to the reporting support device 100 each time the image is captured.

[0045] [Example of operation of the reporting support system 1000] Next, an example of the operation of the reporting support system 1000 will be described with reference to FIG.

[0046] 5 is a sequence diagram illustrating an example of the operation of the reporting support system 1000. The reporting unit 210 of the reporter terminal 200 makes a report (S101). The receiving unit 150 of the reporting support device 100 receives a report from the reporter terminal 200 (S102). Next, the imaging requesting unit 160 transmits an imaging request to the reporter terminal 200 (S103). The request receiving unit 220 of the reporter terminal 200 receives the imaging request (S104).

[0047] In response to the request for capturing an image received by the request receiving unit 220, the image capturing unit 230 captures an image (S105). The data transmitting unit 240 transmits the captured image to the communication support device 100 (S106).

[0048] The acquisition unit 110 of the reporting support device 100 acquires a captured image from the reporter terminal 200 (S107). The extraction unit 120 extracts feature information from the acquired captured image (S108). The identification unit 130 identifies an object based on the extracted feature information (S109). The output unit 140 outputs information about the identified object (S110).

[0049] In this way, the reporting support device 100 of the second embodiment acquires a captured image from the reporter terminal 200, which is a terminal owned by the reporter, and extracts feature information about an object included in the captured image. Then, the reporting support device 100 identifies the object based on the extracted feature information and outputs information about the identified object. This allows the reporting support device 100 of the second embodiment to achieve the same effects as the first embodiment. That is, when the reporting support device 100 receives a report, it can support the operator in understanding the situation.

[0050] [Variation 1] In the above embodiment, an example has been described in which the reporter terminal 200 makes a report using a telephone line, and the reporting support device 100 sends a shooting request using SMS to the reporter terminal 200. The operations of the reporter terminal 200 and the reporting support device 100 are not limited to this form.

[0051] For example, the reporter terminal 200 may make a report using data communication instead of a telephone line. The reporting unit 210 makes a report using data communication. The reception unit 150 of the reporting support device 100 receives the report. When the reception unit 150 receives the report, the photography request unit 160 transmits a photography request. At this time, the photography request may be a signal that controls the photography unit 230 of the reporter terminal 200. In this case, when the request receiving unit 220 receives the photography request, the photography unit 230 may automatically start photography.

[0052] The photographing request is not limited to this example, and may be a notification urging the reporter to start photographing. In this case, when the request receiving unit 220 receives the photographing request, a message indicating that photographing should start may be displayed on the reporter terminal 200. Then, the photographing unit 230 may start photographing in response to an operation by the reporter.

[0053] In this way, the reporting support device 100 and the reporter terminal 200 of the first modification do not use a telephone line, so there is no need to use separate lines for reporting and sending and receiving captured images.

[0054] [Variation 2] As an example of how the identification unit 130 identifies an object, the example has been described in which the identification unit 130 compares the feature information extracted by the extraction unit 120 with feature information included in a database. The database stores information in which feature information and information related to objects are associated with each other. Such a database may be generated by an external organization or may be generated by the reporting support system 1000.

[0055] When the reporting support system 1000 generates a database in which facial features of a person are associated with the person's identification information, information including the features may be acquired in advance in the reporter terminal 200. For example, when no incident, accident, or the like has occurred, the photographing unit 230 photographs the face of the reporter. The reporter terminal 200 also accepts input of personal information of the reporter. The data transmitting unit 240 transmits the facial image of the reporter and the input personal information to the reporting support device 100. Then, in the reporting support device 100, for example, a generating unit (not shown) generates a database by associating the facial image or the features extracted from the facial image with the personal information.

[0056] At this time, the reporter terminal 200 may obtain consent to the use of the feature information from the reporter in advance. For example, the photographing unit 230 may output a notification to the reporter terminal 200 to confirm whether or not the reporter has consented to the use of the feature information. Then, when the reporter has input consent, the photographing unit 230 may start photographing. The output notification may be, for example, a sentence such as "Do you agree to the transmission of personal information and information related to your face?" displayed on the display of the reporter terminal 200. In other words, the notification may be a notification to confirm whether or not the reporter may perform facial recognition of people, including the reporter, from images photographed by the reporter terminal 200 in the reporting support system 1000.

[0057] [Variation 3] If consent to the use of feature information has not been obtained in advance, when the request receiving unit 220 receives a photographing request, the reporter terminal 200 may confirm whether or not the reporter will send the photographed image. For example, when the request receiving unit 220 receives a photographing request, the photographing unit 230 outputs a notification to the reporter terminal 200 confirming whether or not the reporter has consented to sending the photographed image. Then, when the reporter has input consent, the photographing unit 230 may start photographing. The output notification may be, for example, a sentence such as "Do you agree to send the photographed image?" displayed on the display of the reporter terminal 200.

[0058] The image capturing request may also include a notification to confirm whether consent has been obtained. That is, the image capturing request unit 160 of the reporting support device 100 may control the reporting device 100 to output the notification to the reporter terminal 200.

[0059] [Variation 4] The reporting support system 1000 may perform different processing depending on whether or not consent has been given to the use of the characteristic information, as explained in the second and third modifications.

[0060] For example, suppose that consent to perform facial recognition of people, including the reporter, from an image captured by the reporter terminal 200 has not been obtained. In this case, when the request receiving unit 220 receives a capture request, the photographing unit 230 may apply processing such as mosaic to the area of ​​the person's face in the captured image. In other words, the photographing unit 230 may generate a captured image that hides the person's face. Then, the data transmitting unit 240 transmits the processed captured image to the reporting support device 100. In this case, the reporting support device 100 may output location information based on features included in the captured image.

[0061] In this way, the reporter terminal 200 may process the area of ​​the captured image for which consent has not been obtained from the reporter regarding the use of the feature information. In this case, the reporting support device 100 may perform processing by the extraction unit 120, the identification unit 130, and the output unit 140 using the area of ​​the captured image excluding the area for which consent has not been obtained regarding the use of the feature information.

[0062] <Third embodiment> Next, a report support system 1001 according to a third embodiment will be described. In the third embodiment, an example in which information about the identified person is further acquired will be described. Note that some of the content overlapping with the content described in the first and second embodiments will not be described.

[0063] Fig. 6 is a diagram schematically illustrating an example of the configuration of a reporting support system 1001. As shown in Fig. 6, the reporting support system 1001 includes a reporting support device 101 and a reporter terminal 200. The reporting support device 101 is connected to the reporter terminal 200, an external device 300, a personal information server, and an on-site terminal 500 so as to be able to communicate with them.

[0064] In this embodiment, an example will be described in which, when an injured person is present, a caller other than the injured person makes a call for emergency assistance, but the content described in this embodiment is not limited to this example. That is, the content described in this embodiment can be applied to various situations in which a caller makes a call.

[0065] The external device 300 is, for example, a device that includes a database for identifying a person. In this case, the database contains information in which at least feature amounts related to a person's face and identification information of the person are associated with each other. FIG. 7 is a diagram showing an example of the database. In the example of FIG. 7, identification information, feature amounts, and personal information are associated with each other. For example, the record in the first line of FIG. 7 indicates that a person with identification information "001" has a feature amount of "X," a name of "Taro Tanaka," and an age of "25." Note that in this example, name and age are listed as personal information, but personal information is not limited to these. Personal information may also include a person's address, telephone number, occupation, etc.

[0066] The identification information may be any information that can uniquely identify a person. For example, the identification information may be information related to the person's official certificate. The official certificate may be, for example, a driver's license or a My Number card. For example, the identification information may be the license number of the driver's license or the personal number (also referred to as "My Number") of the My Number card. Furthermore, without being limited to this example, the identification information may be certification information related to the official certificate. The certification information may be, for example, information indicating the validity of the My Number card, and may be an electronic certificate issued by an external certification authority or the like, or a code generated using the electronic certificate.

[0067] The information server 400 includes information in which identification information and information about a person are associated with each other. For example, the information server 400 may include information in which identification information and medical information are associated with each other. As described above, the medical information may be the person's health insurance card information, medical information such as a medical record, medical checkup results, and information about medications taken. In addition to medical information, the information server 400 may include, for example, information in which identification information and family composition information indicating the person's family composition are associated with each other. The family composition information may be information indicating personal information about the family of the person corresponding to the identification information.

[0068] The on-site terminal 500 is, for example, a terminal owned by a person who should rush to the scene. The on-site terminal 500 may be, for example, a personal computer. The on-site terminal 500 may also be a portable terminal such as a mobile phone, a smartphone, or a tablet terminal. For example, the on-site terminal 500 may be a terminal owned by a member of an ambulance team, or may be a device mounted on an ambulance. The on-site terminal 500 may also be a device provided at a medical institution to which the person is to be transported by ambulance.

[0069] [Details of Reporting Support Device 101] 8 is a block diagram showing an example of the configuration of the reporting support system 1001. As shown in FIG. 8, the reporting support system 1001 includes a reporting support device 101 and a reporter terminal 200.

[0070] The report support device 101 includes an acquisition unit 110 , an extraction unit 120 , an identification unit 130 , an output unit 141 , a reception unit 150 , and an image capture request unit 160 .

[0071] The extraction unit 120 extracts a feature amount relating to the face of a person included in a captured image. The feature amount relating to the face of a person is referred to as a first feature amount.

[0072] The identification unit 130 identifies a person included in the captured image based on the first feature amount. Specifically, the identification unit 130 compares the first feature amount with feature amounts included in the database of the external device 300. If the comparison results in a match, the identification unit 130 identifies identification information associated with the matching feature amount. A method for identifying a person based on feature amounts related to the person's face may use an algorithm used in existing face recognition.

[0073] 7, the identification unit 130 may also identify the name and age of the person. In other words, "identifying a person" may mean identifying the person's identification information or identifying the person's personal information.

[0074] The output unit 141 includes a related information acquisition unit 1401 and an information output unit 1402. The related information acquisition unit 1401 acquires information associated with identification information. Specifically, the related information acquisition unit 1401 acquires information associated with identification information similar to the identification information identified by the identification unit 130 from an information server. For example, if the identified identification information is "001," the related information acquisition unit 1401 acquires medical information associated with the identification information "001." In this way, the related information acquisition unit 1401 can use the identification information identified by the identification unit 130 to acquire information associated with the identification information from a device other than the external device 300.

[0075] The information output unit 1402 outputs information. Specifically, it may output information identified by the identification unit 130, or may output information acquired by the related information acquisition unit 1401. For example, the information output unit 1402 displays the medical information acquired by the related information acquisition unit 1401 on a display connected to the report support device 101. At this time, the information output unit 1402 may also output the information identified by the identification unit 130 or the information acquired by the related information acquisition unit 1401 to the on-site terminal 500. In that case, for example, personal information and medical information of the identified person are displayed on the display of the on-site terminal.

[0076] Furthermore, the information output unit 1402 may output the acquired information by superimposing it on the captured image. Fig. 9 is a diagram showing an example of the output image. In the example of Fig. 9, the personal information and medical information of the injured person are superimposed on the captured image showing the injured person. In this way, the information output unit 1402 may output the output image.

[0077] [Example of operation of the reporting support system 1001] Next, an example of the operation of the reporting support system 1001 will be described with reference to FIG.

[0078] Fig. 10 is a sequence diagram illustrating an example of the operation of the reporting support system 1001. Note that the processes of S201 to S207 are similar to the processes of S101 to S107 in Fig. 5, and therefore description thereof will be omitted.

[0079] The extraction unit 120 extracts feature information (S208). Specifically, the extraction unit 120 extracts a first feature, which is a feature related to the person's face, from the captured image. The identification unit 130 identifies the person based on the feature information (S209). Specifically, the identification unit 130 identifies the person by comparing the first feature with a feature included in the database of the external device 300. Then, the related information acquisition unit 1401 acquires information associated with the identification information of the identified person (S210). For example, the related information acquisition unit 1401 acquires medical information of the identified person. Then, the information output unit 1402 outputs the information acquired by the related information acquisition unit 1401 (S211). For example, the information output unit 1402 outputs the medical information to a display or an on-site terminal 500 connected to the notification support device 101.

[0080] In this way, the reporting support device 101 of the third embodiment extracts the first feature amount related to the face of a person included in a captured image as feature information, identifies the person included in the captured image based on the first feature amount, and outputs information about the identified person. This allows the reporting support device 101 to provide information about the identified person to, for example, an operator. Therefore, the reporting support device 101 can support the operator in understanding the situation.

[0081] Furthermore, the reporting support device 101 of the third embodiment may specify identification information that identifies the specified person, acquire information associated with the identification information, and output the acquired information. Furthermore, the information associated with the identification information may be, for example, medical information of the specified person. For example, assume that there is a target that needs to be transported by ambulance, such as an injured person. In this case, when the target is photographed by the reporter terminal 200, the reporting support device 101 can output the medical information of the target. Therefore, an operator or an ambulance crew can take action according to the medical information of the target.

[0082] [Variation 5] In the above embodiment, the external device 300 is described as having a database containing information in which at least feature amounts and identification information are associated with each other. In this case, the database may contain information in which images including a person's face are associated with the identification information, rather than feature amounts. In this case, the identification unit 130 may identify the person by comparing the first feature amount extracted by the extraction unit 120 with feature amounts extracted from images included in the database.

[0083] <Fourth embodiment> Next, a report support system 1002 according to a fourth embodiment will be described. In the fourth embodiment, a specific example of identifying attributes of a person appearing in a captured image will be described. Note that some of the content overlapping with the content described in the first to third embodiments will not be described.

[0084] Fig. 11 is a diagram schematically illustrating an example of the configuration of a reporting support system 1002. As shown in Fig. 11, the reporting support system 1002 includes a reporting support device 102 and a reporter terminal 201. The reporting support device 102 is communicably connected to the reporter terminal 200, an external device 300, a personal information server, and an on-site terminal 500. The reporter terminal 201 is also communicably connected to a wearable terminal 600.

[0085] In this embodiment, an example will be described in which, when an injured person is present, a caller other than the injured person makes a call for an emergency, but the content described in this embodiment is not limited to this example. That is, the content described in this embodiment can be applied to various situations in which a caller makes a call.

[0086] The wearable device 600 is a device worn by a person. For example, the wearable device 600 may be a wristwatch-type device. A wristwatch-type wearable device 600 is also called, for example, a smart watch. The wearable device 600 measures biological information of the wearer. Examples of biological information include, but are not limited to, blood pressure, heart rate, body temperature, and blood oxygen concentration. The wearable device 600 transmits the measured biological information to the reporter terminal 201.

[0087] [Details of reporter terminal 201] 12 is a block diagram showing an example of the configuration of the reporting support system 1002. As shown in FIG. 12, the reporter terminal 201 includes a reporting unit 210, a request receiving unit 220, an imaging unit 231, a data transmitting unit 240, and a biometric information acquiring unit 250.

[0088] The photographing unit 231 photographs in the same manner as the photographing unit 230. In this case, the photographing unit 231 may have a function of a thermal camera. That is, the photographing unit 231 acquires temperature information based on the strength of the infrared rays using a sensor capable of detecting infrared rays. In this case, if the photographing unit 231 has a function of detecting a person from the photographed image, the photographing unit 231 may acquire temperature information corresponding to the detected person. The photographing unit 231 may generate a photographed image using the infrared rays detected by the sensor. For example, the photographing unit 231 may generate an image colored according to the strength of the infrared rays.

[0089] The biometric information acquiring unit 250 acquires biometric information from the wearable device 600. For example, the wearable device 600 is worn by an injured person. For example, the biometric information acquiring unit 250 transmits a measurement request for biometric information to the wearable device 600. Upon receiving the measurement request, the wearable device 600 measures the biometric information. Then, the wearable device 600 transmits the measured biometric information to the caller terminal 201. The biometric information acquiring unit 250 acquires the biometric information transmitted from the wearable device 600.

[0090] The data transmission unit 240 transmits the captured image generated by the imaging unit 231 to the reporting support device 102. At this time, the data transmission unit 240 may also transmit temperature information acquired by the imaging unit 231, or may also transmit an image captured using infrared rays. The data transmission unit 240 may also transmit biometric information acquired by the biometric information acquisition unit 250. Here, when temperature information corresponding to a person is acquired by the imaging unit 231, the data transmission unit 240 may transmit the temperature information as biometric information.

[0091] [Details of the reporting support device 102] The report support device 102 includes an acquisition unit 111 , an extraction unit 120 , an identification unit 130 , an output unit 141 , a reception unit 150 , and an image capture request unit 160 .

[0092] The acquisition unit 111 acquires captured images in the same manner as the acquisition unit 110. The acquisition unit 111 also acquires biometric information from the reporter terminal 201. When an image captured using infrared rays is also transmitted from the reporter terminal 201, the acquisition unit 111 may also acquire the captured image.

[0093] The extraction unit 120 extracts a feature amount relating to the appearance of a person included in a captured image. The feature amount relating to the appearance of a person is referred to as a second feature amount.

[0094] The identification unit 130 identifies attributes of a person included in the captured image based on the second feature amount. Here, the attributes include, but are not limited to, the person's age, gender, and height. For example, the attributes may include the person's injury status. The injury status includes the location of the person's external injury, whether or not the person is bleeding, and whether or not the person is conscious. The identification unit 130 may identify the person's attributes using a learning model. In this case, a learning model that has learned the relationship between the feature amount related to the person's appearance and the person's attributes is stored in the external device 300. That is, the learning model has learned, for example, the relationship between the feature amount related to the person's appearance and the person's injury status. The learning model is, for example, a model that receives the feature amount related to the person's appearance as input and outputs the person's attributes. The identification unit 130 then inputs the second feature amount extracted by the extraction unit 120 into the learning model. The identification unit 130 identifies the attribute output for the second feature amount as the attribute of the person included in the captured image.

[0095] The information output unit 1402 outputs the attributes and biometric information of the identified person. For example, the information output unit 1402 displays the information indicating the attributes of the identified person and the biometric information on a display connected to the reporting support device 102. At this time, the information output unit 1402 may also output the information indicating the attributes of the identified person and the biometric information to the on-site terminal 500. In this case, for example, the information indicating the attributes of the identified person and the biometric information are displayed on the display of the on-site terminal.

[0096] Furthermore, the information output unit 1402 may output information indicating the attributes of the identified person and biometric information superimposed on the captured image. Fig. 13 is a diagram showing an example of the output image. In the example of Fig. 13, information indicating the attributes of the injured person and biometric information are superimposed on a captured image showing the injured person.

[0097] [Example of operation of the reporting support system 1002] Next, an example of the operation of the reporting support system 1002 will be described with reference to FIG.

[0098] Fig. 14 is a sequence diagram illustrating an example of the operation of the reporting support system 1002. Note that the processes of S301 to S304 are similar to the processes of S101 to S104 in Fig. 5, and therefore description thereof will be omitted.

[0099] The photographing unit 231 photographs in response to the photographing request received by the request receiving unit 220 (S305). At this time, the photographing unit 231 may acquire temperature information based on the strength of infrared rays using a sensor capable of detecting infrared rays, or may generate a photographed image using infrared rays.

[0100] The biometric information acquisition unit 250 transmits a measurement request to the wearable terminal 600 (S306). Then, the biometric information acquisition unit 250 acquires the biometric information from the wearable terminal 600 (S307). The data transmission unit 240 transmits the captured image and the biometric information to the report support device 102 (S308).

[0101] The acquisition unit 111 of the reporting support device 102 acquires a captured image and biometric information (S309). The extraction unit 120 extracts feature information from the captured image (S310). Specifically, the extraction unit 120 extracts a second feature amount, which is a feature amount related to the person's appearance, from the captured image. The identification unit 130 identifies the person's attributes based on the feature information (S311). The information output unit 1402 outputs various information (S312). For example, the information output unit 1402 outputs information indicating the identified attributes and biometric information.

[0102] In this way, the reporting support device 102 of the fourth embodiment extracts the second feature amount related to the appearance of a person included in a captured image as feature information, identifies the attributes of the person included in the captured image based on the second feature amount, and outputs information indicating the identified attributes. This allows the reporting support device 102 to provide, for example, the information indicating the attributes of the identified person to an operator. Therefore, the reporting support device 101 can support the operator in understanding the situation.

[0103] Furthermore, the reporting support device 102 of the fourth embodiment acquires biometric information acquired at the reporter terminal and outputs the biometric information as information about a person included in a captured image. This allows the reporting support device 102 to provide the operator with the biometric information of the person appearing in the captured image.

[0104] [Variation 6] The wearable terminal 600 may transmit the biometric information to the reporting support device 102. That is, the reporting support device 102 may acquire the biometric information from the wearable terminal 600. In this case, the reporter terminal 201 may include, in advance, information on the destination of the data transmission (that is, information for transmitting data to the reporting support device 102) in the measurement request.

[0105] <Fifth embodiment> Next, a reporting support system 1003 according to a fifth embodiment will be described. In the fifth embodiment, a specific example of identifying a feature object appearing in a captured image will be described. Note that some of the content overlapping with the content described in the first to fourth embodiments will not be described.

[0106] The reporting support system 1003 of the fifth embodiment includes a reporting support device 103 instead of the reporting support device 102 shown in FIG.

[0107] [Details of the reporting support device 103] 15 is a block diagram showing an example of the configuration of the reporting support system 1003. As shown in FIG. 15, the reporting support device 103 includes an acquiring unit 111, an extracting unit 120, an identifying unit 130, a receiving unit 150, and an imaging requesting unit 160.

[0108] The extraction unit 120 extracts a feature quantity related to the appearance of a feature object included in the captured image. The feature quantity related to the appearance of the feature object is referred to as a third feature quantity. Here, an example of identifying an object based on the third feature quantity will be described. In the following identification example, the captured image shown in FIG. 13 will be described as having been acquired by the acquisition unit 111 from the reporter terminal 201. FIG. 16 is a diagram showing an example of a captured image. In the example of FIG. 16, a building called Supermarket ABC is included in the captured image.

[0109] [Specific Example 1] In specific example 1, the extraction unit 120 extracts feature quantities related to edges, corners, brightness gradients, etc. of the captured image as third feature quantities. In this case, the external device 300 includes an image database. The image database includes information in which an image including a feature is associated with information about the feature. The information about the feature is, for example, the name and location information of the feature. For example, the image database includes an image of supermarket ABC and information in which information about the name "supermarket ABC" is associated with location information "Kawasaki Ward, Kawasaki City, Kanagawa Prefecture."

[0110] The identification unit 130 performs an image search from the image database using the extracted third feature. Specifically, the identification unit 130 compares the third feature with the feature of the image included in the image database. If the comparison is a match (i.e., if the search is a hit), the identification unit 130 identifies information about the feature associated with the matching feature. For example, the identification unit 130 identifies information about the name "Supermarket ABC" and location information "Kawasaki Ward, Kawasaki City, Kanagawa Prefecture."

[0111] The related information acquisition unit 1403 acquires information about the identified characteristic object. Then, the information output unit 1402 outputs information about the identified characteristic object. For example, the information output unit 1402 displays the name "Supermarket ABC" and the location information "Kawasaki Ward, Kawasaki City, Kanagawa Prefecture" on a display connected to the report support device 103.

[0112] [Specific Example 2] In specific example 2, the extraction unit 120 extracts text information from the captured image as the third feature. In the example of Fig. 16, the captured image includes the text "Supermarket ABC Kawasaki Station Store." The extraction unit 120 extracts, for example, the text information "Supermarket ABC Kawasaki Station Store" as the third feature.

[0113] The identification unit 130 performs a search using the extracted third feature amount. For example, the identification unit 130 searches a search engine for text information such as "Supermarket ABC Kawasaki Ekimae Store." Then, the identification unit 130 identifies the search results.

[0114] The related information acquisition unit 1403 acquires information included in the search results. For example, if the search results include location information, the related information acquisition unit 1403 acquires the location information.

[0115] The information output unit 1402 may output the search results, or may output the information acquired by the related information acquisition unit 1403 .

[0116] [Example of operation of the reporting support system 1003] Next, an example of the operation of the reporting support system 1003 will be described with reference to FIG.

[0117] Fig. 17 is a sequence diagram illustrating an example of the operation of the reporting support system 1003. Note that the processes of S401 to S407 are similar to the processes of S101 to S107 in Fig. 5, and therefore description thereof will be omitted.

[0118] The extraction unit 120 extracts feature information (S408). Specifically, the extraction unit 120 extracts a third feature amount, which is a feature amount related to the appearance of the feature, from the captured image. The identification unit 130 identifies the feature based on the feature information (S409). For example, the identification unit 130 uses the third feature amount to perform an image search from the image database of the external device 300. Then, if the search returns a hit, the identification unit 130 identifies information related to the feature.

[0119] The related information acquisition unit 1403 acquires information about the identified feature (S410), and the information output unit 1402 outputs the acquired information about the feature (S411).

[0120] In this way, the reporting support device 103 of the fifth embodiment extracts a third feature amount related to the appearance of a feature included in a captured image as feature information, identifies the feature included in the captured image based on the third feature amount, and outputs information about the identified feature. This allows the reporting support device 103 to provide information about the identified feature to, for example, an operator. When a report is made, the operator is required to identify the location of the reporter. However, the reporter may not know his or her own location or may panic and be unable to determine his or her location. In response to this, the reporting support device 103 can output information about feature amounts included in the captured image around the reporter, allowing the operator to identify the location using the output information. In other words, the reporting support device 101 can assist the operator in understanding the situation.

[0121] Furthermore, the information about the identified feature may be location information, which allows the operator to more quickly ascertain the location of the caller.

[0122] [Variation 7] In each of the above embodiments, the reporting support device may control the display of shooting auxiliary information on the shooting screen of the reporter terminal. The shooting auxiliary information is information that indicates the object to be photographed. FIG. 18 is a diagram showing an example of the shooting screen. The shooting request unit 160 superimposes the shooting auxiliary information on the shooting screen. In the example of FIG. 18, when there is an injured person, the message "Please take a picture so that the entire injured person is visible" is displayed on the screen of the reporter terminal as the shooting auxiliary information. Furthermore, for example, the shooting request unit 160 may control the display of the message "Please take a picture so that surrounding signs are visible" on the screen of the reporter terminal. This allows the reporter to properly photograph the object to be photographed.

[0123] <Example of hardware configuration of reporting support device> The hardware constituting the reporting support device of the first, second, third, fourth, and fifth embodiments described above will be described. Fig. 19 is a block diagram showing an example of the hardware configuration of a computer device that realizes the reporting support system in each embodiment. The reporting support device and reporting support method described in each embodiment and each modified example are realized in a computer device 90.

[0124] 19, a computer device 90 includes a processor 91, a RAM (Random Access Memory) 92, a ROM (Read Only Memory) 93, a storage device 94, an input / output interface 95, a bus 96, and a drive device 97. The reporting support device may be realized by a plurality of electric circuits.

[0125] The storage device 94 stores a program (computer program) 98. The processor 91 executes the program 98 of the reporting support device using the RAM 92. Specifically, for example, the program 98 includes a program that causes a computer to execute the processes shown in FIGS. 3, 5, 10, 14, and 17. The processor 91 executes the program 98 to realize the functions of the components of the reporting support device. The program 98 may be stored in the ROM 93. Alternatively, the program 98 may be recorded in the storage medium 80 and read out using the drive device 97, or may be transmitted to the computer device 90 from an external device (not shown) via a network (not shown).

[0126] The input / output interface 95 exchanges data with peripheral devices (such as a keyboard, a mouse, and a display device) 99. The input / output interface 95 functions as a means for acquiring or outputting data. The bus 96 connects the components.

[0127] There are various variations in the method for realizing the reporting support device. For example, the reporting support device can be realized as a dedicated device. Furthermore, the reporting support device can be realized based on a combination of multiple devices.

[0128] The scope of each embodiment also includes a processing method for recording a program for realizing each component of the function of each embodiment on a storage medium, reading the program recorded on the storage medium as code, and executing it on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. Furthermore, the storage medium on which the above-mentioned program is recorded and the program itself are also included in each embodiment.

[0129] The storage medium may be, but is not limited to, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc)-ROM, a magnetic tape, a non-volatile memory card, or a ROM. The programs recorded on the storage medium are not limited to standalone programs that execute processes, but also include programs that run on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0130] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0131] The above-described embodiments and modifications can be combined as appropriate.

[0132] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0133] <Additional Notes> [Appendix 1] an acquisition means for acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter; extraction means for extracting feature information relating to an object included in the photographed image; an identification means for identifying the object based on the extracted feature information; and an output means for outputting information about the identified object. Report support device.

[0134] [Appendix 2] the extraction means extracts a first feature amount related to a face of a person included in the photographed image as the feature information; the identification means identifies a person included in the captured image based on the first feature amount; the output means outputs information about the identified person. 2. A reporting support device as described in appendix 1.

[0135] [Appendix 3] The identification means identifies identification information that identifies the identified person. the output means acquires information associated with the identification information and outputs the acquired information. 3. A reporting support device as described in appendix 2.

[0136] [Appendix 4] the information associated with the identification information is medical information of the identified person; 4. A reporting support device as described in appendix 3.

[0137] [Appendix 5] the extraction means extracts a second feature amount relating to the appearance of a person included in the photographed image as the feature information; the identifying means identifies an attribute of the person included in the captured image based on the second feature amount; the output means outputs information indicating the identified attribute. 5. A reporting support device according to any one of appendixes 1 to 4.

[0138] [Appendix 6] the acquiring means acquires the biometric information acquired at the reporter terminal, the output means outputs the biometric information as information about the person included in the photographed image. 6. A reporting support device according to any one of appendixes 1 to 5.

[0139] [Appendix 7] the biological information is information measured by a wearable device capable of communicating with the reporter device, and is at least one of the person's blood pressure, heart rate, body temperature, and blood oxygen concentration; 7. A reporting support device as described in appendix 6.

[0140] [Appendix 8] the extraction means extracts a third feature amount relating to an appearance of a feature object included in the captured image as the feature information; the identifying means identifies position information of the feature based on the third feature amount; The output means outputs the position information. A reporting support device according to any one of appendixes 1 to 7.

[0141] [Appendix 9] The captured image is acquired from the reporter's terminal, which is a terminal owned by the reporter, extracting feature information about an object included in the captured image; Identifying the object based on the extracted feature information; outputting information about the identified object; How to support reporting.

[0142] [Appendix 10] A process of acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter; A process of extracting feature information about an object included in the captured image; A process of identifying the object based on the extracted feature information; and a process of outputting information about the identified object. A computer-readable storage medium. [Explanation of symbols]

[0143] 100, 101, 102, 103 Report support device 110, 111 Acquisition Department 120 Extraction part 130 Specific section 140, 141, 142 Output section 150 Reception 160 Photography Request Section 200, 201 Reporter terminal 210 Reporting Department 220 Request Receiver 230, 231 Photography Department 240 Data Transmission Unit 250 Biometric information acquisition unit 1000, 1001, 1002, 1003 Reporting Support System

Claims

1. an acquisition means for acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter; consent information acquisition means for acquiring information indicating whether or not consent is given to the use of feature information relating to a predetermined object from the reporter terminal; an extraction means for extracting the feature information relating to an object included in the photographed image; an identification means for identifying the object based on the extracted feature information; an output means for outputting information about the identified object, If consent is not obtained for the use of the characteristic information, the extraction means extracts the feature information from an area of ​​the photographed image excluding an area corresponding to the predetermined object for which consent was not obtained; the identifying means identifies the object included in an area excluding an area corresponding to the predetermined object based on the extracted feature information. Report support device.

2. The consent information acquisition means acquires information indicating whether or not consent has been given to the use of the characteristic information relating to the person, If consent is obtained for the use of the characteristic information, the extraction means extracts a first feature amount related to a face of a person included in the photographed image as the feature information; the identifying means identifies a person included in the captured image based on the first feature amount; the output means outputs information about the identified person. The notification support device according to claim 1 .

3. The identification means identifies identification information that identifies the identified person, the output means acquires information associated with the identification information and outputs the acquired information. The notification support device according to claim 2 .

4. the information associated with the identification information is medical information of the identified person; The notification support device according to claim 3 .

5. The consent information acquisition means acquires information indicating whether or not there is consent to the use of the characteristic information about the person, If consent is obtained for the use of the characteristic information, the extraction means extracts a second feature amount relating to the appearance of a person included in the photographed image as the feature information; the identifying means identifies an attribute of the person included in the captured image based on the second feature amount; the output means outputs information indicating the identified attribute. The notification support device according to any one of claims 1 to 4.

6. the acquiring means acquires the biometric information acquired at the reporter terminal, the output means outputs the biometric information as information about the person included in the photographed image. The notification support device according to any one of claims 1 to 5.

7. the biological information is information measured by a wearable device capable of communicating with the reporter device, and is at least one of the person's blood pressure, heart rate, body temperature, and blood oxygen concentration; The notification support device according to claim 6.

8. the extraction means extracts a third feature amount relating to an appearance of a feature object included in the photographed image as the feature information; the specifying means specifies position information of the feature based on the third feature amount; The output means outputs the position information. The notification support device according to any one of claims 1 to 7.

9. The captured image is acquired from the reporter's terminal, which is a terminal owned by the reporter, acquiring information indicating whether or not there is consent to the use of feature information relating to a predetermined object from the reporter terminal; extracting the feature information relating to an object included in the captured image; Identifying the object based on the extracted feature information; outputting information about the identified object; If consent is not obtained for the use of the characteristic information, In the extracting step, the feature information is extracted from an area of ​​the photographed image excluding an area corresponding to the predetermined object for which consent was not obtained; In the step of identifying, the object included in an area excluding an area corresponding to the predetermined object is identified based on the extracted feature information. How to support reporting.

10. A process of acquiring a captured image from a reporter terminal, which is a terminal owned by the reporter; A process of acquiring information indicating whether or not consent has been given to the use of feature information relating to a predetermined object from the reporter terminal; A process of extracting the feature information regarding an object included in the captured image; A process of identifying the object based on the extracted feature information; outputting information about the identified object; on the computer, If consent is not obtained for the use of the characteristic information, In the extraction process, the feature information is extracted from an area of ​​the captured image excluding an area corresponding to the predetermined object for which consent was not obtained; In the identifying process, the object included in an area excluding an area corresponding to the predetermined object is identified based on the extracted feature information. program.

Images